Scalability of the NewMadeleine Communication Library for Large Numbers of MPI Point-to-Point Requests - Archive ouverte HAL Access content directly
Conference Papers Year :

Scalability of the NewMadeleine Communication Library for Large Numbers of MPI Point-to-Point Requests

(1, 2)
1
2

Abstract

New kinds of applications with lots of threads or irregular communication patterns which rely a lot on point-to-point MPI communications have emerged. It stresses the MPI library with potentially a lot of simultaneous MPI requests for sending and receiving at the same time. To deal with large numbers of simultaneous requests, the bottleneck lies in two main mechanisms: the tag-matching (the algorithm that matches an incoming packet with a posted receive request), and the progression engine. In this paper, we propose algorithms and implementations that overcome these issues so as to scale up to thousands of requests if needed. In particular our algorithms are able to perform constant-time tag-matching even with any-source and any-tag support. We have implemented these mechanisms in our New-Madeleine communication library. Through micro-benchmarks and computation kernel benchmarks, we demonstrate that our MPI library exhibits better performance than state-of-the-art MPI implementations in cases with many simultaneous requests.
Fichier principal
Vignette du fichier
article.pdf (282.94 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02103700 , version 1 (18-04-2019)

Identifiers

  • HAL Id : hal-02103700 , version 1

Cite

Alexandre Denis. Scalability of the NewMadeleine Communication Library for Large Numbers of MPI Point-to-Point Requests. CCGrid 2019 - 19th Annual IEEE/ACM International Symposium in Cluster, Cloud, and Grid Computing, May 2019, Larnaca, Cyprus. ⟨hal-02103700⟩

Collections

CNRS INRIA INRIA2
114 View
137 Download

Share

Gmail Facebook Twitter LinkedIn More