NIC-assisted cache-efficient receive stack for message passing over Ethernet

Brice Goglin 1, 2
1 RUNTIME - Efficient runtime systems for parallel architectures
Inria Bordeaux - Sud-Ouest, CNRS - Centre National de la Recherche Scientifique : UMR5800, UB - Université de Bordeaux
Abstract : High-speed networking in clusters usually relies on advanced hardware features in the NICs, such as zero-copy capability. Open-MX is a high-performance message passing stack tailored for regular Ethernet hardware without such capabilities. We present the addition of a multiqueue support in the Open-MX receive stack so that all incoming packets for the same process are handled on the same core. We then introduce the idea of binding the target end process near its dedicated receive queue. This model leads to a more cache-efficient receive stack for Open-MX. It also proves that very simple and stateless hardware features may have a significant impact on message passing performance over Ethernet. The implementation of this model in a firmware reveals that it may not be as efficient as some manually tuned micro-benchmarks. But our multiqueue receive stack generally performs better than the original single queue stack, especially on large communication patterns where multiple processes are involved and manual binding is difficult.
Type de document :
Article dans une revue
Concurrency and Computation: Practice and Experience, Wiley, 2011, Special Issue: Euro-Par 2009, 23 (2), pp.199-210. <10.1002/cpe.1632>


https://hal.inria.fr/inria-00496301
Contributeur : Brice Goglin <>
Soumis le : mercredi 30 juin 2010 - 14:37:22
Dernière modification le : jeudi 10 septembre 2015 - 01:06:38
Document(s) archivé(s) le : mardi 23 octobre 2012 - 09:40:16

Fichier

article.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Brice Goglin. NIC-assisted cache-efficient receive stack for message passing over Ethernet. Concurrency and Computation: Practice and Experience, Wiley, 2011, Special Issue: Euro-Par 2009, 23 (2), pp.199-210. <10.1002/cpe.1632>. <inria-00496301>

Exporter

Partager

Métriques

Consultations de
la notice

323

Téléchargements du document

248