pioman: a pthread-based Multithreaded Communication Engine

Alexandre Denis 1, 2, 3, *
* Auteur correspondant
1 RUNTIME - Efficient runtime systems for parallel architectures
Inria Bordeaux - Sud-Ouest, UB - Université de Bordeaux, CNRS - Centre National de la Recherche Scientifique : UMR5800
2 TADAAM - Topology-Aware System-Scale Data Management for High-Performance Computing
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest
Abstract : Recent cluster architectures include dozens of cores per node, with all cores sharing the network resources. To program such architectures, hybrid models mixing MPI+threads, and in particular MPI+OpenMP are gaining popularity. This imposes new requirements on communication libraries, such as the need for MPI_THREAD_MULTIPLE level of multi-threading support. Moreover, the high number of cores brings new op-portunities to parallelize communication libraries, so as to have proper background progression of communication and commu-nication/computation overlap. In this paper, we present pioman, a generic framework to be used by MPI implementations, that brings seamless asynchronous progression of communication by opportunistically using available cores. It uses system threads and thus is composable with any runtime system used for multithreading. Through various benchmarks, we demonstrate that our pioman-based MPI implementation exhibits very good properties regarding overlap, progression, and multithreading, and outperforms state-of-art MPI implementations.
Keywords : MPI pioman NewMadeleine
Type de document :
Communication dans un congrès
Euromicro International Conference on Parallel, Distributed and Network-based Processing, Mar 2015, Turku, Finland. 2015
Liste complète des métadonnées

Littérature citée [23 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01087775
Contributeur : Alexandre Denis <>
Soumis le : mercredi 26 novembre 2014 - 16:00:40
Dernière modification le : mercredi 29 novembre 2017 - 15:10:25
Document(s) archivé(s) le : vendredi 27 février 2015 - 12:35:45

Fichier

final.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01087775, version 1

Collections

Citation

Alexandre Denis. pioman: a pthread-based Multithreaded Communication Engine. Euromicro International Conference on Parallel, Distributed and Network-based Processing, Mar 2015, Turku, Finland. 2015. 〈hal-01087775〉

Partager

Métriques

Consultations de la notice

304

Téléchargements de fichiers

196