Dodging Non-Uniform I/O Access in Hierarchical Collective Operations for Multicore Clusters

Abstract : The increasing number of cores led to scalability issues in modern servers that were addressed by using non-uniform memory interconnects such as HyperTransport and QPI. These technologies reintroduced Non-Uniform Memory Access (NUMA) architectures. They are also responsible for Non-Uniform Input/Output Access (NUIOA), as I/O devices may be directly connected to a single processor, thus getting faster access to some cores and memory banks than to the others. In this paper, we propose to adapt MPI collective operations to NUIOA constraints. These operations are now often based on the combination of multiple strategies depending on the underlying cluster topology, with local leader processes being used as intermediate. Our strategy focuses on electing these leaders according to the locality of processes and network interfaces so as to give them privileged network access. We validate our approach on a hierarchical Broadcast operation which brings up to 25% throughput improvement between 64 processes.
Document type :
Conference papers
IEEE. CASS 2011: The 1st Workshop on Communication Architecture for Scalable Systems, held in conjunction with IPDPS 2011, May 2011, Anchorage, United States. 7p, 2011, <10.1109/IPDPS.2011.222>


https://hal.inria.fr/inria-00566246
Contributor : Brice Goglin <>
Submitted on : Wednesday, February 16, 2011 - 3:01:36 PM
Last modification on : Monday, May 6, 2013 - 9:40:04 PM

File

article.pdf
fileSource_public_author

Identifiers

Collections

Citation

Brice Goglin, Stéphanie Moreaud. Dodging Non-Uniform I/O Access in Hierarchical Collective Operations for Multicore Clusters. IEEE. CASS 2011: The 1st Workshop on Communication Architecture for Scalable Systems, held in conjunction with IPDPS 2011, May 2011, Anchorage, United States. 7p, 2011, <10.1109/IPDPS.2011.222>. <inria-00566246>

Export

Share

Metrics

Consultation de
la notice

272

Téléchargement du document

121