A Closer Look at MOMDPs

Mauricio Araya-López 1 Vincent Thomas 1 Olivier Buffet 1 François Charpillet 1
1 MAIA - Autonomous intelligent machine
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : The difficulties encountered in sequential decision-making problems under uncertainty are often linked to the large size of the state space. Exploiting the structure of the problem, for example by employing a factored representation, is usually an efficient approach but, in the case of partially observable Markov decision processes, the fact that some state variables may be visible has not been sufficiently appreciated. In this article, we present a complementary analysis and discussion about MOMDPs, a formalism that exploits the fact that the state space may be factored in one visible part and one hidden part. Starting from a POMDP description, we dig into the structure of the belief update, value function, and the consequences in value iteration, specifically how classical algorithms can be adapted to this factorization, and demonstrate the resulting benefits through an empirical evaluation.
Type de document :
Communication dans un congrès
22nd International Conference on Tools with Artificial Intelligence - ICTAI 2010, Oct 2010, Arras, France. IEEE, 2010, Proceedings of the 22nd International Conference on Tools with Artificial Intelligence
Liste complète des métadonnées

Littérature citée [18 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00535559
Contributeur : Olivier Buffet <>
Soumis le : jeudi 11 novembre 2010 - 20:16:21
Dernière modification le : jeudi 11 janvier 2018 - 06:19:51
Document(s) archivé(s) le : samedi 12 février 2011 - 02:41:12

Fichier

ictai10.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00535559, version 1

Collections

Citation

Mauricio Araya-López, Vincent Thomas, Olivier Buffet, François Charpillet. A Closer Look at MOMDPs. 22nd International Conference on Tools with Artificial Intelligence - ICTAI 2010, Oct 2010, Arras, France. IEEE, 2010, Proceedings of the 22nd International Conference on Tools with Artificial Intelligence. 〈inria-00535559〉

Partager

Métriques

Consultations de la notice

386

Téléchargements de fichiers

280