On the Overhead of Topology Discovery for Locality-aware Scheduling in HPC - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

On the Overhead of Topology Discovery for Locality-aware Scheduling in HPC

Résumé

The increasing complexity of parallel computing platforms requires a deep knowledge of the hardware and of the application needs. Locality a key criteria for performance optimization. It involves software tools to expose information about the hardware topology to high performance runtime libraries. We show that the overhead of gathering such information from the operating system is significant on large computing nodes that run Linux. This overhead also increases more than linearly with the number of processes that perform it simultaneously. We then study the actual needs of the HPC software ecosystem in terms of topology information. We propose some ways to avoid multiple expensive topology discovery and to share topology information between components such as the resource manager or the runtime libraries.
Fichier principal
Vignette du fichier
article.pdf (227.75 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01402755 , version 1 (25-11-2016)
hal-01402755 , version 2 (03-12-2016)
hal-01402755 , version 3 (13-07-2017)

Identifiants

  • HAL Id : hal-01402755 , version 1

Citer

Brice Goglin. On the Overhead of Topology Discovery for Locality-aware Scheduling in HPC. Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP2017), Mar 2017, St Petersburg, Russia. pp.9. ⟨hal-01402755v1⟩
600 Consultations
389 Téléchargements

Partager

Gmail Facebook X LinkedIn More