Influence of Tasks Duration Variability on Task-Based Runtime Schedulers

Olivier Beaumont 1 Lionel Eyraud-Dubois 1 Yihong Gao 1
1 Realopt - Reformulations based algorithms for Combinatorial Optimization
LaBRI - Laboratoire Bordelais de Recherche en Informatique, IMB - Institut de Mathématiques de Bordeaux, Inria Bordeaux - Sud-Ouest
Abstract : In the context of HPC platforms, individual nodes nowadays consist in heterogenous processing resources such as GPU units and multicores. Those resources share communication and storage resources , what induces complex co-scheduling effects, and makes it hard to predict the exact duration of a task or of a communication. To cope with these issues, runtime dynamic schedulers such as StarPU have been developed. These systems base their decisions at runtime on the state of the platform and possibly on static priorities of tasks computed offline. In this paper, our goal is to quantify performance variability in the context of HPC heterogeneous nodes, by focusing on very regular dense linear algebra kernels. Then, we analyze the impact of this variability on a dynamic runtime scheduler such as StarPU, in order to analyze whether the strategies that have been designed in the context of MapReduce applications to cope with stragglers could be transferred to HPC systems, or if the dynamic nature of runtime schedulers is enough to cope with actual performance variations.
Complete list of metadatas

Cited literature [28 references]  Display  Hide  Download

https://hal.inria.fr/hal-01716489
Contributor : Lionel Eyraud-Dubois <>
Submitted on : Wednesday, February 28, 2018 - 3:53:35 PM
Last modification on : Tuesday, May 7, 2019 - 11:42:03 AM
Long-term archiving on : Monday, May 28, 2018 - 6:42:52 PM

File

report.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01716489, version 2

Citation

Olivier Beaumont, Lionel Eyraud-Dubois, Yihong Gao. Influence of Tasks Duration Variability on Task-Based Runtime Schedulers. [Research Report] INRIA. 2018. ⟨hal-01716489v2⟩

Share

Metrics

Record views

148

Files downloads

220