Skip to Main content Skip to Navigation
Conference papers

pioman: a Generic Framework for Asynchronous Progression and Multithreaded Communications

Alexandre Denis 1, 2
2 RUNTIME - Efficient runtime systems for parallel architectures
CNRS - Centre National de la Recherche Scientifique : UMR5800, UB - Université de Bordeaux, Inria Bordeaux - Sud-Ouest
Abstract : Recent cluster architectures include dozens of cores per node, with all cores sharing the network resources. To program such architectures, hybrid models mixing MPI+threads, and in particular MPI+OpenMP are gaining popularity. This imposes new requirements on communication libraries, such as the need for MPI_THREAD_MULTIPLE level of multi-threading support. Moreover, the high number of cores brings new opportunities to parallelize communication libraries, so as to have proper background progression of communication and communication/computation overlap. In this paper, we present pioman, a generic framework to be used by MPI implementations, that brings seamless asynchronous progression of communication by opportunistically using available cores. It uses system threads and thus is composable with any runtime system used for multithreading. Through various benchmarks, we demonstrate that our \texttt{pioman}-based MPI implementation exhibits very good properties regarding overlap, progression, and multithreading, and outperforms state-of-art MPI implementations.
Keywords : MPI pioman NewMadeleine
Document type :
Conference papers
Complete list of metadata
Contributor : Alexandre Denis Connect in order to contact the contributor
Submitted on : Tuesday, September 16, 2014 - 5:19:51 PM
Last modification on : Tuesday, August 24, 2021 - 11:02:04 AM
Long-term archiving on: : Wednesday, December 17, 2014 - 11:46:03 AM


  • HAL Id : hal-01064652, version 1



Alexandre Denis. pioman: a Generic Framework for Asynchronous Progression and Multithreaded Communications. IEEE International Conference on Cluster Computing (IEEE Cluster), Sep 2014, Madrid, Spain. ⟨hal-01064652⟩



Record views


Files downloads