Towards the Structural Modeling of the Topology of next-generation heterogeneous cluster Nodes with hwloc - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2016

Towards the Structural Modeling of the Topology of next-generation heterogeneous cluster Nodes with hwloc

Résumé

Parallel computing platforms are increasingly complex, with multiple cores, shared caches, and NUMA memory interconnects, as well as asymmetric I/O access. Upcoming architectures will add a heterogeneous memory subsystem with non-volatile and/or high-bandwidth memory banks. Parallel applications developers have to take locality into account before they can expect good efficiency on these platforms. Thus there is a strong need for a portable tool gathering and exposing this information. The Hardware Locality project (hwloc) offers a tree representation of the hardware based on the inclusion of CPU resources and localities of memory and I/O devices. It is already widely used for affinity-based task placement in high performance computing. We present how hwloc represents parallel computing nodes, from the hierarchy of computing and memory resources to I/O device locality. It builds a structural model of the hardware to help application find the best resources fitting their needs. hwloc also annotates objects to ease identification of resources from different programming points of view. We finally describe how it helps process managers and batch schedulers to deal with the topology of multiple cluster nodes, by offering different compression techniques for better management of thousands of nodes.
Fichier principal
Vignette du fichier
article.pdf (328.54 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01400264 , version 1 (21-11-2016)
hal-01400264 , version 2 (25-11-2016)
hal-01400264 , version 3 (13-07-2017)
hal-01400264 , version 4 (10-11-2017)

Identifiants

  • HAL Id : hal-01400264 , version 2

Citer

Brice Goglin. Towards the Structural Modeling of the Topology of next-generation heterogeneous cluster Nodes with hwloc. [Research Report] Inria. 2016. ⟨hal-01400264v2⟩
556 Consultations
481 Téléchargements

Partager

Gmail Facebook X LinkedIn More