E. Altman, K. Avrachenkov, and J. A. Filar, Asymptotic linear programming and policy improvement for singularly perturbed Markov decision processes, ZOR: Mathematical Methods of Operations Research, vol.49, issue.1, pp.97-109, 1999.

E. Altman, E. A. Feinberg, and A. Shwartz, Weighted Discounted Stochastic Games with Perfect Information, Annals of the International Society of Dynamic Games, pp.303-324, 2000.
DOI : 10.1007/978-1-4612-1336-9_17
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.38.7628

T. Bewley and E. Kohlberg, The Asymptotic Theory of Stochastic Games, Mathematics of Operations Research, vol.1, issue.3, pp.197-208, 1976.
DOI : 10.1287/moor.1.3.197

K. Chatterjee, R. Majumdar, and T. A. Henzinger, Stochastic limit-average games are in EXPTIME, International Journal of Game Theory, vol.158, issue.2, pp.219-234, 2008.
DOI : 10.1007/s00182-007-0110-5

B. C. Eaves and U. G. Rothblum, Formulation of linear problems and solution by a universal machine, Mathematical Programming, vol.5, issue.B, pp.263-309, 1994.
DOI : 10.1007/BF01581699

J. A. Filar, E. Altman, and K. Avrachenkov, An asymptotic simplex method for singularly perturbed linear programs, Operations Research Letters, vol.30, issue.5, pp.295-307, 2002.
DOI : 10.1016/S0167-6377(02)00152-9

D. Gillette, Stochastic games with zero stop probabilities, Contributions to the theory of games, pp.179-187, 1957.

A. Hordijk, R. Dekker, and L. C. Kallenberg, Sensitivity-analysis in discounted Markovian decision problems, OR Spektrum, vol.14, issue.3, pp.143-151, 1985.
DOI : 10.1007/BF01721353

J. F. Mertens and A. Neyman, Stochastic games, International Journal of Game Theory, vol.39, issue.2, pp.53-66, 1981.
DOI : 10.1007/BF01769259

T. Parthasarathy and T. E. Raghavan, An orderfield property for stochastic games when one player controls transition probabilities, Journal of Optimization Theory and Applications, vol.15, issue.3, pp.375-392, 1981.
DOI : 10.1007/BF00935250

T. E. Raghavan and Z. Syed, A policy-improvement type algorithm for solving zero-sum two-person stochastic games of perfect information, Mathematical Programming, vol.95, issue.3, pp.513-532, 2003.
DOI : 10.1007/s10107-002-0312-3

L. S. Shapley, Stochastic Games, Proceedings of the National Academy of Sciences, vol.39, issue.10, pp.1095-1100, 1953.
DOI : 10.1073/pnas.39.10.1953

E. Solan and N. Vieille, Computing uniformly optimal strategies in two-player stochastic games, Economic Theory, vol.12, issue.1, pp.237-253, 2010.
DOI : 10.1007/s00199-009-0437-1
URL : https://hal.archives-ouvertes.fr/hal-00528413

F. Thuijsman and T. E. Raghavan, Perfect information stochastic games and related classes, International Journal of Game Theory, vol.5, issue.3, pp.403-408, 1997.
DOI : 10.1007/BF01263280

I. Unité-de-recherche-inria-sophia and . Antipolis, route des Lucioles -BP 93 -06902 Sophia Antipolis Cedex (France) Unité de recherche INRIA Futurs : Parc Club Orsay Université -ZAC des Vignes 4, 2004.

I. Unité-de-recherche and . Lorraine, Technopôle de Nancy-Brabois -Campus scientifique 615, rue du Jardin Botanique -BP 101 -54602 Villers-lès-Nancy Cedex (France) Unité de recherche INRIA Rennes : IRISA, Campus universitaire de Beaulieu -35042 Rennes Cedex (France) Unité de recherche INRIA Rhône-Alpes : 655, avenue de l'Europe -38334 Montbonnot Saint-Ismier (France) Unité de recherche INRIA Rocquencourt, Domaine de Voluceau -Rocquencourt -BP 105 -78153 Le Chesnay Cedex