hwloc: a Generic Framework for Managing Hardware Affinities in HPC Applications

François Broquedis 1, 2 Jérôme Clet-Ortega 1, 2 Stéphanie Moreaud 1, 2 Nathalie Furmento 1, 2 Brice Goglin 1, 2 Guillaume Mercier 1, 2 Samuel Thibault 1, 2 Raymond Namyst 1, 2
2 RUNTIME - Efficient runtime systems for parallel architectures
Inria Bordeaux - Sud-Ouest, UB - Université de Bordeaux, CNRS - Centre National de la Recherche Scientifique : UMR5800
Abstract : The increasing numbers of cores, shared caches and memory nodes within machines introduces a complex hardware topology. High-performance computing applications now have to carefully adapt their placement and behavior according to the underlying hierarchy of hardware resources and their software affinities. We introduce the Hardware Locality (hwloc) software which gathers hardware information about processors, caches, memory nodes and more, and exposes it to applications and runtime systems in a abstracted and portable hierarchical manner. hwloc may significantly help performance by having runtime systems place their tasks or adapt their communication strategies depending on hardware affinities. We show that hwloc can already be used by popular high-performance OpenMP or MPI software. Indeed, scheduling OpenMP threads according to their affinities or placing MPI processes according to their communication patterns shows interesting performance improvement thanks to hwloc. An optimized MPI communication strategy may also be dynamically chosen according to the location of the communicating processes in the machine and its hardware characteristics.
Type de document :
Communication dans un congrès
IEEE. PDP 2010 - The 18th Euromicro International Conference on Parallel, Distributed and Network-Based Computing, Feb 2010, Pisa, Italy. 2010, <10.1109/PDP.2010.67>


https://hal.inria.fr/inria-00429889
Contributeur : Brice Goglin <>
Soumis le : mercredi 4 novembre 2009 - 20:07:08
Dernière modification le : jeudi 10 septembre 2015 - 01:06:37
Document(s) archivé(s) le : mardi 16 octobre 2012 - 13:16:22

Fichier

main.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

François Broquedis, Jérôme Clet-Ortega, Stéphanie Moreaud, Nathalie Furmento, Brice Goglin, et al.. hwloc: a Generic Framework for Managing Hardware Affinities in HPC Applications. IEEE. PDP 2010 - The 18th Euromicro International Conference on Parallel, Distributed and Network-Based Computing, Feb 2010, Pisa, Italy. 2010, <10.1109/PDP.2010.67>. <inria-00429889>

Exporter

Partager

Métriques

Consultations de
la notice

1240

Téléchargements du document

701