Markov chains with discontinuous drifts have differential inclusions limits. Application to stochastic stability and mean field approximation.

Nicolas Gast 1, 2 Bruno Gaujal 1
1 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : In this paper, we study deterministic limits of Markov processes having discontinuous drifts. While most results assume that the limiting dynamics is continuous, we show that these conditions are not necessary to prove convergence to a deterministic system. More precisely, we show that under mild assumptions, the stochastic system is a stochastic approximation algorithm with constant step size that converges to a differential inclusion. This differential inclusion is obtained by convexifying the rescaled drift of the Markov chain. This generic convergence result is used to compute stability conditions of stochastic systems, via their fluid limits. It is also used to analyze systems where discontinuous dynamics arise naturally, such as queueing systems with boundary conditions or with threshold control policies, via mean field approximations.
Liste complète des métadonnées

Cited literature [33 references]  Display  Hide  Download

https://hal.inria.fr/inria-00491859
Contributor : Nicolas Gast <>
Submitted on : Monday, March 12, 2012 - 2:45:59 PM
Last modification on : Thursday, October 11, 2018 - 8:48:02 AM
Document(s) archivé(s) le : Wednesday, December 14, 2016 - 12:05:20 PM

File

GastGaujal_MarkovDifferentialI...
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00491859, version 4

Collections

Citation

Nicolas Gast, Bruno Gaujal. Markov chains with discontinuous drifts have differential inclusions limits. Application to stochastic stability and mean field approximation.. [Research Report] RR-7315, INRIA. 2012. ⟨inria-00491859v4⟩

Share

Metrics

Record views

595

Files downloads

253