Improving Message Passing over Ethernet with I/OAT Copy Offload in Open-MX

Brice Goglin 1, 2
2 RUNTIME - Efficient runtime systems for parallel architectures
Inria Bordeaux - Sud-Ouest, UB - Université de Bordeaux, CNRS - Centre National de la Recherche Scientifique : UMR5800
Abstract : Open-MX is a new message passing layer implemented on top of the generic Ethernet stack of the Linux kernel. Open-MX works on all Ethernet hardware, but it suffers from expensive memory copy requirements on the receiver side due to the hardware's inability to deposit messages directly in the target application buffers. This article presents the implementation of an asynchronous memory copy offload in the Open-MX stack thanks to Intel I/O Acceleration Technology. The overlapping of large message fragment copies with the processing increases the receive throughput by 30% while reducing the CPU usage by up to 40%. It enables Open-MX to reach 10 gigabit/s Ethernet line rate for large messages. Open-MX large intra-node communication also benefits significantly from the I/OAT hardware since the performance of its one-copy-based local communication mechanism is almost doubled by using blocking I/OAT memory copies. By combining all these optimizations, the Open-MX large message performance on top of 10G hardware is now able to bridge the gap with the native Myrinet Express stack.
Type de document :
Communication dans un congrès
IEEE. Cluster 2008, Sep 2008, Tsukuba, Japan. 2008, 〈10.1109/CLUSTR.2008.4663775〉
Liste complète des métadonnées

Littérature citée [15 références]  Voir  Masquer  Télécharger
Contributeur : Brice Goglin <>
Soumis le : mercredi 2 juillet 2008 - 16:30:11
Dernière modification le : jeudi 11 janvier 2018 - 06:22:12
Document(s) archivé(s) le : vendredi 25 novembre 2016 - 23:49:09


Fichiers produits par l'(les) auteur(s)



Brice Goglin. Improving Message Passing over Ethernet with I/OAT Copy Offload in Open-MX. IEEE. Cluster 2008, Sep 2008, Tsukuba, Japan. 2008, 〈10.1109/CLUSTR.2008.4663775〉. 〈inria-00288757〉



Consultations de la notice


Téléchargements de fichiers