A. Bertoni, The solution of problems relative to probabilistic automata in the frame of the formal languages theory, Proc. of the 4th GI Jahrestagung, pp.107-112, 1974.

J. F. Canny, Some algebraic and geometric computations in PSPACE, Proceedings of the twentieth annual ACM symposium on Theory of computing , STOC '88, pp.460-467, 1988.
DOI : 10.1145/62212.62257

R. Chadha, V. Korthikanti, M. Vishwanathan, G. Agha, and Y. Kwon, Model Checking MDPs with a Unique Compact Invariant Set of Distributions, 2011 Eighth International Conference on Quantitative Evaluation of SysTems, 2011.
DOI : 10.1109/QEST.2011.22

L. Doyen, T. A. Henzinger, and J. Raskin, EQUIVALENCE OF LABELED MARKOV CHAINS, International Journal of Foundations of Computer Science, vol.19, issue.03, pp.549-563, 2008.
DOI : 10.1142/S0129054108005814

J. G. Kemeny and J. L. Snell, Finite Markov chains, 1960.

V. A. Korthikanti, M. Viswanathan, G. Agha, and Y. Kwon, Reasoning about MDPs as Transformers of Probability Distributions, 2010 Seventh International Conference on the Quantitative Evaluation of Systems, 2010.
DOI : 10.1109/QEST.2010.35

J. R. Norris, Markov chains, volume 2 of Cambridge series on statistical and probabilistic mathematics, 1997.

M. L. Puterman, Markov decision processes: discrete stochastic dynamic programming, 1994.
DOI : 10.1002/9780470316887

C. Roos, T. Terlaky, and J. Vial, Theory and Algorithms for Linear Optimization: An interior point approach, 1997.

O. Sigaud and O. Buffet, (editors) Markov decision processes in artifical intelligence, 2010.

D. Thorsley and D. Teneketzis, Diagnosability of stochastic discrete-event systems, IEEE Transactions on Automatic Control, vol.50, issue.4, pp.476-492, 2005.
DOI : 10.1109/TAC.2005.844722