GraphMDP: A New Decomposition Tool for Solving Markov Decision Processes - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue International Journal on Artificial Intelligence Tools Année : 2001

GraphMDP: A New Decomposition Tool for Solving Markov Decision Processes

Pierre Laroche

Résumé

In this paper, we present a new tool for solving weakly-coupled Markov Decision Processes using decomposition techniques. Using a predefined partition of the MDP, a directed graph is built to decompose the global MDP into small local MDPs which are independently solved. An approximate solution for the global MDP is obtained by combining local solutions. Our approach has been tested on a mobile robotics application. It allows near-optimal solutions to be obtained in significantly reduced time. We also present preliminary results concerning a parallel implantation of our tool.
Fichier non déposé

Dates et versions

inria-00100821 , version 1 (26-09-2006)

Identifiants

  • HAL Id : inria-00100821 , version 1

Citer

Pierre Laroche. GraphMDP: A New Decomposition Tool for Solving Markov Decision Processes. International Journal on Artificial Intelligence Tools, 2001, 10 (3), pp.325-343. ⟨inria-00100821⟩
142 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More