Design and Evaluation of Topology-aware Scatter and AllGather Algorithms for Dragonfly Networks

Abstract : High-radix direct network topologies such as Dragonfly have been proposed for petascale and exascale supercomputers because they ensure fast interconnections and reduce the cost of the network compared with traditional network topologies. However, current algorithms for communication do not consider the topology and thus lose numerous opportunities of optimization for performance. In this work, we exploit the strength of the Dragonfly with topology-aware algorithms for AllGather and Scatter operations. We study existing algorithms, then propose derived algorithms, that we evaluate using CODES, an event-driven simulator. As expected, for AllGather, making algorithms topology-aware does improve the performance and reduces the link utilization. However, simulations of various Scatter algorithms show surprising results, and point out the important role played by hardware for the efficiency of the algorithms. In particular, the knowledge of the number and size of input/output buffers in routers can be exploited to accelerate the Scatter operation by a factor up to 2 times.
Liste complète des métadonnées

https://hal.inria.fr/hal-01400271
Contributeur : Nathanaël Cheriere <>
Soumis le : lundi 21 novembre 2016 - 16:43:14
Dernière modification le : mercredi 16 mai 2018 - 11:23:28
Document(s) archivé(s) le : mardi 21 mars 2017 - 10:11:01

Fichier

poster.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01400271, version 1

Citation

Nathanaël Cheriere, Matthieu Dorier. Design and Evaluation of Topology-aware Scatter and AllGather Algorithms for Dragonfly Networks. Supercomputing 2016, Nov 2016, Salt Lake City, United States. Supercomputing 2016, 〈http://sc16.supercomputing.org〉. 〈hal-01400271〉

Partager

Métriques

Consultations de la notice

385

Téléchargements de fichiers

56