J. M. Alden and R. L. Smith, Rolling Horizon Procedures in Nonhomogeneous Markov Decision Processes, Operations Research, vol.40, issue.3-supplement-2, pp.183-194, 1992.
DOI : 10.1287/opre.40.3.S183

D. P. Bertsekas, Dynamic Programming: Deterministic and Stochastic Models, 1987.

C. Derman, Finite State Markovian Decision Processes, 1970.

A. Federgruen, P. Schweitzer, and C. Tijms, Contraction mappings underlying undiscounted Markov decision problems, Journal of Mathematical Analysis and Applications, vol.65, issue.3, pp.711-730, 1978.
DOI : 10.1016/0022-247X(78)90174-9
URL : http://doi.org/10.1016/0022-247x(78)90174-9

X. Guo and P. Shi, Limiting Average Criteria For Nonstationary Markov Decision Processes, SIAM Journal on Optimization, vol.11, issue.4, pp.1037-1053, 2001.
DOI : 10.1137/S1052623499355235

O. Hernández-lerma and J. B. Lasserre, Error bounds for rolling horizon policies in discrete-time Markov control processes, IEEE Transactions on Automatic Control, vol.35, issue.10, pp.1118-1124, 1990.
DOI : 10.1109/9.58554

L. Kallenberg, Finite state and action MDPS, in Handbook of Markov Decision Processes, Kluwer's international Series, 2002.

L. Kallenberg, Markov decision processes, Lectures Notes, 2009.

E. Lanery, Etude asymptotique des systèmes markoviensàmarkoviens`markoviensà commande, Rev.Informat. Recherche Operat, vol.1, pp.3-56, 1967.
DOI : 10.1051/m2an/1967010500031
URL : http://archive.numdam.org/article/M2AN_1967__1_5_3_0.pdf

S. M. Ross, Applied Probability Models with Optimization Applications, 1970.

P. J. Schweitzer, Iterative solution of the functional equations of undiscounted Markov renewal programming, Journal of Mathematical Analysis and Applications, vol.34, issue.3, pp.495-501, 1971.
DOI : 10.1016/0022-247X(71)90094-1

P. J. Schweitzer and A. Federgruen, The Asymptotic Behavior of Undiscounted Value Iteration in Markov Decision Problems, Mathematics of Operations Research, vol.2, issue.4, pp.360-381, 1977.
DOI : 10.1287/moor.2.4.360

P. J. Schweitzer and A. Federgruen, Geometric convergence of value-iteration in multichain Markov decision problems, Advances in Applied Probability, vol.1, issue.01, pp.188-217, 1979.
DOI : 10.1016/0022-247X(63)90017-9

H. C. Tijms, Stochastic Modelling and Analysis, A Computational Approach, 1986.

D. J. White, Markov decision processes, route des Lucioles -BP 93 -06902 Sophia, 1993.