Skip to Main content Skip to Navigation
Conference papers

Scalability of the NewMadeleine Communication Library for Large Numbers of MPI Point-to-Point Requests

Abstract : New kinds of applications with lots of threads or irregular communication patterns which rely a lot on point-to-point MPI communications have emerged. It stresses the MPI library with potentially a lot of simultaneous MPI requests for sending and receiving at the same time. To deal with large numbers of simultaneous requests, the bottleneck lies in two main mechanisms: the tag-matching (the algorithm that matches an incoming packet with a posted receive request), and the progression engine. In this paper, we propose algorithms and implementations that overcome these issues so as to scale up to thousands of requests if needed. In particular our algorithms are able to perform constant-time tag-matching even with any-source and any-tag support. We have implemented these mechanisms in our New-Madeleine communication library. Through micro-benchmarks and computation kernel benchmarks, we demonstrate that our MPI library exhibits better performance than state-of-the-art MPI implementations in cases with many simultaneous requests.
Complete list of metadatas

Cited literature [24 references]  Display  Hide  Download

https://hal.inria.fr/hal-02103700
Contributor : Alexandre Denis <>
Submitted on : Thursday, April 18, 2019 - 4:12:22 PM
Last modification on : Monday, December 9, 2019 - 3:56:07 PM

File

article.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02103700, version 1

Collections

Citation

Alexandre Denis. Scalability of the NewMadeleine Communication Library for Large Numbers of MPI Point-to-Point Requests. CCGrid 2019 - 19th Annual IEEE/ACM International Symposium in Cluster, Cloud, and Grid Computing, May 2019, Larnaca, Cyprus. ⟨hal-02103700⟩

Share

Metrics

Record views

107

Files downloads

137