A Mean Field Approach for Optimization in Particle Systems and Applications

Nicolas Gast 1 Bruno Gaujal 1
1 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : This paper investigates the limit behavior of Markov decision processes made of independent particles evolving in a common environment, when the number of particles goes to infnity. In the fnite horizon case or with a discounted cost and an infnite horizon, we show that when the number of particles becomes large, the optimal cost of the system converges to the optimal cost of a deterministic system. Convergence also holds for optimal policies. We further provide insights on the speed of convergence by proving several central limits theorems for the cost and the state of the Markov decision process with explicit formulas for the limit. Then, our framework is applied to a brokering problem in grid computing. Several simulations with growing numbers of processors are reported. They compare the performance of the optimal policy of the limit system used in the fnite case with classical policies by measuring its asymptotic gain.
Type de document :
Communication dans un congrès
Fourth International Conference on Performance Evaluation Methodologies and Tools, Valuetools, 2009, Pisa, Italy. pp.10, 2009, 〈10.4108/ICST.VALUETOOLS2009.7477〉
Liste complète des métadonnées

https://hal.inria.fr/hal-00788908
Contributeur : Arnaud Legrand <>
Soumis le : vendredi 15 février 2013 - 13:46:09
Dernière modification le : mercredi 11 avril 2018 - 01:56:16

Lien texte intégral

Identifiants

Collections

Citation

Nicolas Gast, Bruno Gaujal. A Mean Field Approach for Optimization in Particle Systems and Applications. Fourth International Conference on Performance Evaluation Methodologies and Tools, Valuetools, 2009, Pisa, Italy. pp.10, 2009, 〈10.4108/ICST.VALUETOOLS2009.7477〉. 〈hal-00788908〉

Partager

Métriques

Consultations de la notice

135