Grid Differentiated Services: a Reinforcement Learning Approach

Cécile Germain Renaud 1 Julien Perez 1 Balázs Kégl 1, 2, 3 C. Loomis 2
3 TAO - Machine Learning and Optimisation
INRIA Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, CNRS : UMR8623, LRI - Laboratoire de Recherche en Informatique
Abstract : Large scale production grids are a major case for autonomic computing. Following the classical definition of Kephart, an autonomic computing system should optimize its own behavior in accordance with high level guidance from humans. This central tenet of this paper is that the combination of utility functions and reinforcement learning (RL) can provide a general and efficient method for dynamically allocating grid resources in order to optimize the satisfaction of both endusers and participating institutions. The flexibility of an RLbased system allows to model the state of the grid, the jobs to be scheduled, and the high-level objectives of the various actors on the grid. RL-based scheduling can seamlessly adapt its decisions to changes in the distributions of inter-arrival time, QoS requirements, and resource availability. Moreover, it requires minimal prior knowledge about the target environment, including user requests and infrastructure. Our experimental results, both on a synthetic workload and a real trace, show that RL is not only a realistic alternative to empirical scheduler design, but is able to outperform them.
Document type :
Conference papers
8th IEEE International Symposium on Cluster Computing and the Grid, May 2008, Lyon, France. 2008


https://hal.inria.fr/inria-00287826
Contributor : Julien Perez <>
Submitted on : Friday, June 13, 2008 - 9:30:06 AM
Last modification on : Tuesday, November 22, 2011 - 2:58:08 PM

File

RLccg08.pdf
fileSource_public_author

Identifiers

  • HAL Id : inria-00287826, version 1

Collections

Citation

Cécile Germain Renaud, Julien Perez, Balázs Kégl, C. Loomis. Grid Differentiated Services: a Reinforcement Learning Approach. 8th IEEE International Symposium on Cluster Computing and the Grid, May 2008, Lyon, France. 2008. <inria-00287826>

Export

Share

Metrics

Consultation de
la notice

154

Téléchargement du document

58