State Aggregation for Solving Markov Decision Problems - An Application to Mobile Robotics

Pierre Laroche 1 François Charpillet 1
1 MAIA - Autonomous intelligent machine
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : In this paper, we present two state aggregation methods, used to build stochastic plans, modelling our environment with Markov Decision Processes. Classical methods used to compute stochastic plans are highly untractable for problems necessiting a large number of states, like our robotics application. The use of aggregation techniques allows to reduce the number of states to take into account, and our methods give nearly optimal plans in a significantly reduced time.
Type de document :
Communication dans un congrès
IEEE International Conference Tools with Artificial Intelligence - ICTAI'98, 1998, none, 8 p, 1998
Liste complète des métadonnées

https://hal.inria.fr/inria-00098464
Contributeur : Publications Loria <>
Soumis le : lundi 25 septembre 2006 - 17:01:43
Dernière modification le : jeudi 11 janvier 2018 - 06:19:51

Identifiants

  • HAL Id : inria-00098464, version 1

Collections

Citation

Pierre Laroche, François Charpillet. State Aggregation for Solving Markov Decision Problems - An Application to Mobile Robotics. IEEE International Conference Tools with Artificial Intelligence - ICTAI'98, 1998, none, 8 p, 1998. 〈inria-00098464〉

Partager

Métriques

Consultations de la notice

212