Skip to Main content Skip to Navigation

Influence of Tasks Duration Variability on Task-Based Runtime Schedulers

Olivier Beaumont 1 Lionel Eyraud-Dubois 1 Yihong Gao 1
1 Realopt - Reformulations based algorithms for Combinatorial Optimization
LaBRI - Laboratoire Bordelais de Recherche en Informatique, IMB - Institut de Mathématiques de Bordeaux, Inria Bordeaux - Sud-Ouest
Abstract : In the context of HPC platforms, individual nodes nowadays consist in heterogenous processing resources such as GPU units and multicores. Those resources share communication and storage resources , what induces complex co-scheduling effects, and makes it hard to predict the exact duration of a task or of a communication. To cope with these issues, runtime dynamic schedulers such as StarPU have been developed. These systems base their decisions at runtime on the state of the platform and possibly on static priorities of tasks computed offline. In this paper, our goal is to quantify performance variability in the context of HPC heterogeneous nodes, by focusing on very regular dense linear algebra kernels. Then, we analyze the impact of this variability on a dynamic runtime scheduler such as StarPU, in order to analyze whether the strategies that have been designed in the context of MapReduce applications to cope with stragglers could be transferred to HPC systems, or if the dynamic nature of runtime schedulers is enough to cope with actual performance variations.
Complete list of metadata

Cited literature [28 references]  Display  Hide  Download
Contributor : Lionel Eyraud-Dubois Connect in order to contact the contributor
Submitted on : Wednesday, February 28, 2018 - 3:53:35 PM
Last modification on : Tuesday, October 19, 2021 - 11:00:06 AM
Long-term archiving on: : Monday, May 28, 2018 - 6:42:52 PM


Files produced by the author(s)


  • HAL Id : hal-01716489, version 2



Olivier Beaumont, Lionel Eyraud-Dubois, Yihong Gao. Influence of Tasks Duration Variability on Task-Based Runtime Schedulers. [Research Report] INRIA. 2018. ⟨hal-01716489v2⟩



Record views


Files downloads