Hierarchical Work-Stealing

Abstract : In this paper, we study the problem of dynamic load-balancing on heterogeneous hierarchical platforms. In particular, we consider here applications involving heavy communications on a distributed platform. The work-stealing algorithm introduced by Blumofe and Leiserson is a commonly used technique to distribute load in a distributed environment but it suffers from poor performances in some cases of communications-intensive applications. We present here several variants of this algorithm found in the literature and different grid middlewares like Satin and Kaapi. In addition, we propose two new variations of the work-stealing algorithm : HWS and PWS. These algorithms improve performances by taking the networking structure into account within the scheduling. We conduct a theoretical analysis of HWS in the case of fork-join task graphs and present experimental results comparing the most relevant algorithms. Experiments on Grid'5000 show that HWS and PWS allow us to obtain performance gains of up to twenty per cent when compared to the standard algorithm. Moreover in some case, the standard algorithm reaches worse performances on the distributed platform than on a single machine while PWS and HWS achieve some speedup.
Complete list of metadatas

Cited literature [10 references]  Display  Hide  Download

https://hal.inria.fr/inria-00429624
Contributor : Jean-Noel Quintin <>
Submitted on : Thursday, November 5, 2009 - 8:59:48 AM
Last modification on : Friday, October 12, 2018 - 1:18:08 AM
Long-term archiving on : Saturday, November 26, 2016 - 2:28:04 PM

File

RR-7077.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00429624, version 2

Citation

Jean-Noel Quintin, Frédéric Wagner. Hierarchical Work-Stealing. [Research Report] INRIA. 2009, pp.24. ⟨inria-00429624v2⟩

Share

Metrics

Record views

212

Files downloads

236