Skip to Main content Skip to Navigation
Conference papers

Exploiting Separability in Multiagent Planning with Continuous-State MDPs

Jilles Dibangoye 1, * Christopher Amato 2 Olivier Buffet 1, * François Charpillet 1 
* Corresponding author
1 MAIA - Autonomous intelligent machine
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : Recent years have seen significant advances in techniques for optimally solving multiagent problems represented as decentralized partially observable Markov decision processes (Dec-POMDPs). A new method achieves scalability gains by converting Dec-POMDPs into continuous state MDPs. This method relies on the assumption of a centralized planning phase that generates a set of decentralized policies for the agents to execute. However, scalability remains limited when the number of agents or problem variables becomes large. In this paper, we show that, under certain separability conditions of the optimal value function, the scalability of this approach can increase considerably. This separability is present when there is locality of interaction, which — as other approaches (such as those based on the ND-POMDP subclass) have already shown — can be exploited to improve performance. Unlike most previous methods, the novel continuous-state MDP algorithm retains optimality and convergence guarantees. Results show that the extension using separability can scale to a large number of agents and domain variables while maintaining optimality.
Document type :
Conference papers
Complete list of metadata

Cited literature [35 references]  Display  Hide  Download
Contributor : Olivier Buffet Connect in order to contact the contributor
Submitted on : Wednesday, December 10, 2014 - 3:32:32 PM
Last modification on : Monday, July 25, 2022 - 3:44:46 AM
Long-term archiving on: : Wednesday, March 11, 2015 - 10:10:54 AM


Publisher files allowed on an open archive


  • HAL Id : hal-01092066, version 1


Jilles Dibangoye, Christopher Amato, Olivier Buffet, François Charpillet. Exploiting Separability in Multiagent Planning with Continuous-State MDPs. AAMAS 2014 - 13th International Conference on Autonomous Agents and Multiagent Systems, May 2014, Paris, France. ⟨hal-01092066⟩



Record views


Files downloads