From Flow Control in Multi-path Networks to Multiple Bag-of-tasks Application Scheduling on Grids

Rémi Bertin 1, 2 Sascha Hunold 1 Arnaud Legrand 1, 2 Corinne Touati 1, 2
2 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : A very large number of applications that are currently deployed on large scale distributed systems such as grids or volunteer computing systems are Bag-of-Tasks (BoT) applications. Up until now, simple mechanisms have been used to ensure a fair sharing of resources amongst these applications. Although these mechanisms have proved efficient for CPU-bound applications, they are known to be ineffective in the presence of network-bound applications. In this article, we propose a fully distributed algorithm for fairly scheduling BoT applications on a computing grid while respecting resource constraints. This algorithm is inspired by techniques used in flow control mechanisms in multi-path networks. Yet, we prove that the context of BoT scheduling is significantly more difficult in practice and that a set of non-trivial adaptations are required to ensure convergence. We prove their effectiveness through an extensive set of simulations that enables to deeply understand the potential benefits as well as the limitations of this technique in the context of grid computing.
Liste complète des métadonnées

Cited literature [2 references]  Display  Hide  Download

https://hal.inria.fr/inria-00627532
Contributor : Arnaud Legrand <>
Submitted on : Wednesday, September 28, 2011 - 11:22:43 PM
Last modification on : Thursday, January 11, 2018 - 6:21:39 AM
Document(s) archivé(s) le : Tuesday, November 13, 2012 - 2:46:33 PM

File

RR-7745.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00627532, version 1

Collections

Citation

Rémi Bertin, Sascha Hunold, Arnaud Legrand, Corinne Touati. From Flow Control in Multi-path Networks to Multiple Bag-of-tasks Application Scheduling on Grids. [Research Report] RR-7745, INRIA. 2011, pp.26. 〈inria-00627532〉

Share

Metrics

Record views

339

Files downloads

100