Optimal Algorithms for Scheduling Divisible Workloads on Heterogeneous Systems

Olivier Beaumont 1, 2 Arnaud Legrand 3 Yves Robert 3
2 SCALAPPLIX - Algorithms and high performance computing for grand challenge applications
INRIA Futurs, Université Bordeaux Segalen - Bordeaux 2, Université Sciences et Technologies - Bordeaux 1, École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), CNRS - Centre National de la Recherche Scientifique : UMR5800
3 GRAAL - Algorithms and Scheduling for Distributed Heterogeneous Platforms
Inria Grenoble - Rhône-Alpes, LIP - Laboratoire de l'Informatique du Parallélisme
Abstract : In this paper, we discuss several algorithms for scheduling divisible loads on heterogeneous systems. Our main contributions are (i) new optimality results for single-round algorithms and (ii) the design of an asymptotically optimal multi-round algorithm. This multi-round algorithm automatically performs resource selection, a difficult task that was previously left to the user. Because it is periodic, it is simpler to implement, and more robust to changes in the speeds of the processors and/or communication links. On the theoretical side, to the best of our knowledge, this is the first published result assessing the absolute performance of a multi-round algorithm. On the practical side, extensive simulations reveal that our multi-round algorithm outperforms existing solution on a large variety of platforms, especially when the communication-to-computation ratio is not very high (the difficult case).
Complete list of metadatas

https://hal.inria.fr/hal-00789449
Contributor : Arnaud Legrand <>
Submitted on : Monday, February 18, 2013 - 11:51:41 AM
Last modification on : Friday, April 20, 2018 - 3:44:24 PM

Links full text

Identifiers

Citation

Olivier Beaumont, Arnaud Legrand, Yves Robert. Optimal Algorithms for Scheduling Divisible Workloads on Heterogeneous Systems. IPDS'2003, Parallel and Distributed Processing Symposium, 2003, Feb 2003, Nice, France. ⟨10.1109/IPDPS.2003.1213202⟩. ⟨hal-00789449⟩

Share

Metrics

Record views

351