Topology and affinity aware hierarchical and distributed load-balancing in Charm++

Emmanuel Jeannot 1, 2 Guillaume Mercier 1, 2 François Tessier 3
1 TADAAM - Topology-Aware System-Scale Data Management for High-Performance Computing
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest
2 LaBRI - Laboratoire Bordelais de Recherche en Informatique
3 ANL - Argonne National Laboratory [Lemont]
Abstract : The evolution of massively parallel supercomputers make palpable two issues in particular: the load imbalance and the poor management of data locality in applications. Thus, with the increase of the number of cores and the drastic decrease of amount of memory per core, the large performance needs imply to particularly take care of the load-balancing and as much as possible of the locality of data. One mean to take into account this locality issue relies on the placement of the processing entities and load balancing techniques are relevant in order to improve application performance. With large-scale platforms in mind, we developed a hierarchical and distributed algorithm which aim is to perform a topology-aware load balancing tailored for Charm++ applications. This algorithm is based on both LibTopoMap for the network awareness aspects and on TREEMATCH to determine a relevant placement of the processing entities. We show that the proposed algorithm improves the overall execution time in both the cases of real applications and a synthetic benchmark as well. For this last experiment, we show a scalability up to one millions processing entities.
Document type :
Conference papers
Complete list of metadatas

Cited literature [30 references]  Display  Hide  Download
https://hal.inria.fr/hal-01394748
Contributor : Emmanuel Jeannot <>
Submitted on : Monday, November 14, 2016 - 11:23:18 AM
Last modification on : Tuesday, August 13, 2019 - 3:20:09 PM
Long-term archiving on: Wednesday, March 15, 2017 - 4:23:55 AM

File

tmlb-paper.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01394748, version 1

Collections

CNRS | UNIV-BORDEAUX | LABRI | INRIA

Citation

Emmanuel Jeannot, Guillaume Mercier, François Tessier. Topology and affinity aware hierarchical and distributed load-balancing in Charm++. 1st Workshop on Optimization of Communication in HPC runtime systems (IEEE COM-HPC16), Nov 2016, Salt-Lake City, United States. ⟨hal-01394748⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

236

Files downloads

727

Contact


archive-ouverte@inria.fr