An Emulation Layer for Dynamic Resources with MPI Sessions - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

An Emulation Layer for Dynamic Resources with MPI Sessions

Résumé

The current static job scheduling on supercomputers for MPI-based applications is well known to be a limiting factor for the exploitation of a system's top performance in terms of application throughput. Hence, allowing fully flexible and dynamically varying job sizes would provide multiple advantages compared to the current approach, e.g., by prioritizing jobs dynamically and optimizing resource usage by transferring resources economically. A critical step in achieving dynamic resource management with MPI on supercomputers is the development of sound and robust interfaces between MPI applications and the runtime system. Our approach extends the concept of MPI Sessions, a new concept introduced with MPI 4.0, by adding new features to support varying computing resources via the MPI process set abstraction. We then show how these features can be used, as a proof of concept, to request (active) and cope with (passive) varying resources from an application's perspective. To validate of our approach, we develop libmpidynres, a C library providing an emulated MPI Sessions environment on top of existing MPI implementations without MPI Sessions support, which we then use to integrate our proposed extensions to the interface specification. Using this proof-of-concept environment, we show how an MPI Sessions enabled application can use process sets to handle dynamically varying resources.
Fichier principal
Vignette du fichier
2022_fecht_et_al_an_emu_mpi_sessions.pdf (368.03 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03856702 , version 1 (16-11-2022)

Identifiants

  • HAL Id : hal-03856702 , version 1

Citer

Jan Fecht, Martin Schreiber, Martin Schulz, Howard Pritchard, Daniel J Holmes. An Emulation Layer for Dynamic Resources with MPI Sessions. HPCMALL 2022 - Malleability Techniques Applications in High-Performance Computing, Jun 2022, Hambourg, Germany. ⟨hal-03856702⟩
58 Consultations
88 Téléchargements

Partager

Gmail Facebook X LinkedIn More