Skip to Main content Skip to Navigation
Conference papers

Designing Coalescing Network-on-Chip for Efficient Memory Accesses of GPGPUs

Abstract : The massive multithreading architecture of General Purpose Graphic Processors Units (GPGPU) makes them ideal for data parallel computing. However, designing efficient GPGPU chips poses many challenges. One major hurdle is the interface to the external DRAM, particularly the buffers in the memory controllers (MCs), which is stressed heavily by the many concurrent memory accesses from the GPGPU. Previous approaches considered scheduling the memory requests in the memory buffers to reduce switching of memory rows. The problem is that the window of requests that can be considered for scheduling is too narrow and the memory controller is very complex, affecting the critical path. In view of the massive multithreading architecture of GPGPUs that can hide memory access latencies, we exploit in this paper the novel idea of rearranging the memory requests in the network-on-chip (NoC), called packet coalescing. To study the feasibility of this idea, we have designed an expanded NoC router that supports packet coalescing and evaluated its performance extensively. Evaluation results show that this NoC-assisted design strategy can improve the row buffer hit rate in the memory controllers. A comprehensive investigation of factors affecting the performance of coalescing is also conducted and reported.
Document type :
Conference papers
Complete list of metadata

Cited literature [18 references]  Display  Hide  Download

https://hal.inria.fr/hal-01403077
Contributor : Hal Ifip <>
Submitted on : Friday, November 25, 2016 - 2:28:52 PM
Last modification on : Thursday, March 5, 2020 - 5:40:19 PM
Long-term archiving on: : Tuesday, March 21, 2017 - 11:17:27 AM

File

978-3-662-44917-2_15_Chapter.p...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Chien-Ting Chen, Yoshi Huang, Yuan-Ying Chang, Chiao-Yun Tu, Chung-Ta King, et al.. Designing Coalescing Network-on-Chip for Efficient Memory Accesses of GPGPUs. 11th IFIP International Conference on Network and Parallel Computing (NPC), Sep 2014, Ilan, Taiwan. pp.169-180, ⟨10.1007/978-3-662-44917-2_15⟩. ⟨hal-01403077⟩

Share

Metrics

Record views

106

Files downloads

285