A High-Performance Superpipeline Protocol for InfiniBand

Alexandre Denis 1, 2
1 RUNTIME - Efficient runtime systems for parallel architectures
Inria Bordeaux - Sud-Ouest, UB - Université de Bordeaux, CNRS - Centre National de la Recherche Scientifique : UMR5800
Abstract : InfiniBand high performance networks require that the buffers used for sending or receiving data are registered. Since memory registration is an expensive operation, some communication libraries use caching (rcache) to amortize its cost, and copy data into pre-registered buffers for small messages. In this paper, we present a software protocol for InfiniBand that always uses a memory copy, and amortizes the cost of this copy with a superpipeline to overlap the memory copy and the RDMA. We propose a performance model of our protocol to study its behavior and optimize its parameters. We have implemented our protocol in the NewMadeleine communication library. The results of MPI benchmarks show a significant improvement in cache-unfriendly applications that do not reuse the same memory blocks all over the time, without degradation for cache-friendly applications.
Type de document :
Communication dans un congrès
E. Jeannot AND R. Namyst AND J. Roman. Euro-Par 2011, Aug 2011, Bordeaux, France. Springer, 6853, pp.276-287, 2011, Lecture Notes in Computer Science
Liste complète des métadonnées

Littérature citée [13 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00586015
Contributeur : Alexandre Denis <>
Soumis le : jeudi 14 avril 2011 - 14:08:43
Dernière modification le : mercredi 29 novembre 2017 - 15:10:24
Document(s) archivé(s) le : jeudi 8 novembre 2012 - 16:35:33

Fichier

main.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00586015, version 1

Collections

Citation

Alexandre Denis. A High-Performance Superpipeline Protocol for InfiniBand. E. Jeannot AND R. Namyst AND J. Roman. Euro-Par 2011, Aug 2011, Bordeaux, France. Springer, 6853, pp.276-287, 2011, Lecture Notes in Computer Science. 〈inria-00586015〉

Partager

Métriques

Consultations de la notice

389

Téléchargements de fichiers

968