High-Performance Message Passing over generic Ethernet Hardware with Open-MX

Brice Goglin 1, 2
2 RUNTIME - Efficient runtime systems for parallel architectures
Inria Bordeaux - Sud-Ouest, UB - Université de Bordeaux, CNRS - Centre National de la Recherche Scientifique : UMR5800
Abstract : In the last decade, cluster computing has become the most popular high-performance computing architecture. Although numerous technological innovations have been proposed to improve the interconnection of nodes, many clusters still rely on commodity Ethernet hardware to implement message passing within parallel applications. We present Open-MX, an open-source message passing stack over generic Ethernet. It offers the same abilities as the specialized Myrinet Express stack, without requiring dedicated support from the networking hardware. Open-MX works transparently in the most popular MPI implementations through its MX interface compatibility. It also enables interoperability between hosts running the specialized MX stack and generic Ethernet hosts. We detail how Open-MX copes with the inherent limitations of the Ethernet hardware to satisfy the requirements of message passing by applying an innovative copy offload model. Combined with a careful tuning of the fabric and of the MX wire protocol, Open-MX achieves better performance than TCP implementations, especially on 10 gigabit/s hardware.
Type de document :
Article dans une revue
Parallel Computing, Elsevier, 2011, 37 (2), pp.85-100. <10.1016/j.parco.2010.11.001>


https://hal.inria.fr/inria-00533058
Contributeur : Brice Goglin <>
Soumis le : vendredi 5 novembre 2010 - 09:35:19
Dernière modification le : jeudi 10 septembre 2015 - 01:06:40
Document(s) archivé(s) le : vendredi 26 octobre 2012 - 15:00:38

Fichier

article.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Brice Goglin. High-Performance Message Passing over generic Ethernet Hardware with Open-MX. Parallel Computing, Elsevier, 2011, 37 (2), pp.85-100. <10.1016/j.parco.2010.11.001>. <inria-00533058>

Exporter

Partager

Métriques

Consultations de
la notice

535

Téléchargements du document

421