A Mean Field Approach for Optimization in Particle Systems and Applications - Archive ouverte HAL Access content directly
Conference Papers Year : 2009

A Mean Field Approach for Optimization in Particle Systems and Applications

(1) , (1)
1
Nicolas Gast
Bruno Gaujal

Abstract

This paper investigates the limit behavior of Markov decision processes made of independent particles evolving in a common environment, when the number of particles goes to infnity. In the fnite horizon case or with a discounted cost and an infnite horizon, we show that when the number of particles becomes large, the optimal cost of the system converges to the optimal cost of a deterministic system. Convergence also holds for optimal policies. We further provide insights on the speed of convergence by proving several central limits theorems for the cost and the state of the Markov decision process with explicit formulas for the limit. Then, our framework is applied to a brokering problem in grid computing. Several simulations with growing numbers of processors are reported. They compare the performance of the optimal policy of the limit system used in the fnite case with classical policies by measuring its asymptotic gain.

Dates and versions

hal-00788908 , version 1 (15-02-2013)

Identifiers

Cite

Nicolas Gast, Bruno Gaujal. A Mean Field Approach for Optimization in Particle Systems and Applications. Fourth International Conference on Performance Evaluation Methodologies and Tools, Valuetools, 2009, Pisa, Italy. pp.10, ⟨10.4108/ICST.VALUETOOLS2009.7477⟩. ⟨hal-00788908⟩
92 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More