P. Blanchet, Modular growing network architectures for td learning, From animals to animats 4, pp.343-352, 1996.

E. Diday, The dynamic clusters method and optimization in non hierarchical-clustering, SpringerVerlag 5th Conference on optimization technique, pp.241-258, 1973.
DOI : 10.1007/3-540-06583-0_24

B. Digney, Emergent hierarchical control structures: Learning reactive hierarchical relationships in reinforcement environments, 1996.

E. Forgy, Cluster analysis of multivariate data: efficiency versus interpretability of classifications, Biometrics, p.768, 1965.

M. Hauskrecht, N. Meuleau, L. P. Kaelbling, T. Dean, and C. Boutilier, Hierarchical solution of Markov Decision Processes using macro-actions, In Uncertainty in Artificial Intelligence, pp.220-229, 1998.

R. Jacobs, M. Jordan, and A. Barto, Task Decomposition Through Competition in a Modular Connectionist Architecture: The What and Where Vision Tasks, Cognitive Science, vol.I, issue.2, pp.219-250, 1991.
DOI : 10.1207/s15516709cog1502_2

L. P. Kaelbling, Hierarchical Learning in Stochastic Domains: Preliminary Results, International Conference on Machine Learning, pp.167-173, 1993.
DOI : 10.1016/B978-1-55860-307-3.50028-9

J. Lange, H. Voigt, and D. Wolf, Growing artificial neural networks based on correlation measures, taske decomposition and local attention neurons, 1994.
DOI : 10.1109/icnn.1994.374482

M. L. Littman, T. L. Dean, and L. P. Kaelbling, On the complexity of solving Markov decision problems, Proceedings of the Eleventh Annual Conference on Uncertainty in Artificial Intelligence (UAI?95), pp.394-402, 1995.

R. Munos and A. Moore, Rates of convergence for variable resolution schemes in optimal control, International Conference on Machine Learning, 2000.

R. Munos and A. Moore, Variable resolution discretization in optimal control, Machine Learning, vol.49, issue.2/3, pp.291-323, 2002.
DOI : 10.1023/A:1017992615625

M. Puterman, Markov Decision Processes, 1994.
DOI : 10.1002/9780470316887

R. S. Sutton, On the significance of Markov decision processes, ICANN, pp.273-282, 1997.
DOI : 10.1007/BFb0020167

R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, IEEE Transactions on Neural Networks, vol.9, issue.5, 1998.
DOI : 10.1109/TNN.1998.712192

G. Theocharous, K. Rohanimanesh, and S. Mahadevan, Learning and planning with hierarchical stochastic models for robot navigation, ICML 2000 Workshop on Machine Learning of Spatial Knowledge, 2000.