inria-00586015, version 1
A High-Performance Superpipeline Protocol for InfiniBand
Euro-Par 2011 6853 (2011) 276-287
Résumé : InfiniBand high performance networks require that the buffers used for sending or receiving data are registered. Since memory registration is an expensive operation, some communication libraries use caching (rcache) to amortize its cost, and copy data into pre-registered buffers for small messages. In this paper, we present a software protocol for InfiniBand that always uses a memory copy, and amortizes the cost of this copy with a superpipeline to overlap the memory copy and the RDMA. We propose a performance model of our protocol to study its behavior and optimize its parameters. We have implemented our protocol in the NewMadeleine communication library. The results of MPI benchmarks show a significant improvement in cache-unfriendly applications that do not reuse the same memory blocks all over the time, without degradation for cache-friendly applications.
- 1 : RUNTIME (INRIA Bordeaux - Sud-Ouest)
- INRIA – CNRS : UMR5800 – Université Sciences et Technologies - Bordeaux I – École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)
- 2 : Laboratoire Bordelais de Recherche en Informatique (LaBRI)
- CNRS : UMR5800 – Université Sciences et Technologies - Bordeaux I – École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB) – Université Victor Segalen - Bordeaux II
- Collaboration : Grid'5000
- Domaine : Informatique/Réseaux et télécommunications
- inria-00586015, version 1
- http://hal.inria.fr/inria-00586015
- oai:hal.inria.fr:inria-00586015
- Contributeur : Alexandre Denis
- Soumis le : Jeudi 14 Avril 2011, 14:08:43
- Dernière modification le : Lundi 23 Avril 2012, 16:43:48







Documents associés
Exporter