Design and Evaluation of Topology-aware Scatter and AllGather Algorithms for Dragonfly Networks

Abstract : High-radix direct network topologies such as Dragonfly have been proposed for petascale and exascale supercomputers because they ensure fast interconnections and reduce the cost of the network compared with traditional network topologies. However, current algorithms for communication do not consider the topology and thus lose numerous opportunities of optimization for performance. In this work, we exploit the strength of the Dragonfly with topology-aware algorithms for AllGather and Scatter operations. We study existing algorithms, then propose derived algorithms, that we evaluate using CODES, an event-driven simulator. As expected, for AllGather, making algorithms topology-aware does improve the performance and reduces the link utilization. However, simulations of various Scatter algorithms show surprising results, and point out the important role played by hardware for the efficiency of the algorithms. In particular, the knowledge of the number and size of input/output buffers in routers can be exploited to accelerate the Scatter operation by a factor up to 2 times.
Liste complète des métadonnées
Contributeur : Nathanaël Cheriere <>
Soumis le : lundi 21 novembre 2016 - 16:43:14
Dernière modification le : vendredi 11 janvier 2019 - 10:20:44
Document(s) archivé(s) le : mardi 21 mars 2017 - 10:11:01


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-01400271, version 1


Nathanaël Cheriere, Matthieu Dorier. Design and Evaluation of Topology-aware Scatter and AllGather Algorithms for Dragonfly Networks. Supercomputing 2016, Nov 2016, Salt Lake City, United States. Supercomputing 2016, 〈〉. 〈hal-01400271〉



Consultations de la notice


Téléchargements de fichiers