Skip to Main content Skip to Navigation
Conference papers

Exploiting Separability in Multiagent Planning with Continuous-State MDPs

Jilles Dibangoye 1, * Christopher Amato 2 Olivier Buffet 1, * François Charpillet 1
* Corresponding author
1 MAIA - Autonomous intelligent machine
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : Recent years have seen significant advances in techniques for optimally solving multiagent problems represented as decentralized partially observable Markov decision processes (Dec-POMDPs). A new method achieves scalability gains by converting Dec-POMDPs into continuous state MDPs. This method relies on the assumption of a centralized planning phase that generates a set of decentralized policies for the agents to execute. However, scalability remains limited when the number of agents or problem variables becomes large. In this paper, we show that, under certain separability conditions of the optimal value function, the scalability of this approach can increase considerably. This separability is present when there is locality of interaction, which — as other approaches (such as those based on the ND-POMDP subclass) have already shown — can be exploited to improve performance. Unlike most previous methods, the novel continuous-state MDP algorithm retains optimality and convergence guarantees. Results show that the extension using separability can scale to a large number of agents and domain variables while maintaining optimality.
Document type :
Conference papers
Complete list of metadata

Cited literature [35 references]  Display  Hide  Download

https://hal.inria.fr/hal-01092066
Contributor : Olivier Buffet <>
Submitted on : Wednesday, December 10, 2014 - 3:32:32 PM
Last modification on : Wednesday, March 24, 2021 - 3:13:11 PM
Long-term archiving on: : Wednesday, March 11, 2015 - 10:10:54 AM

File

aamas14a.pdf
Publisher files allowed on an open archive

Identifiers

  • HAL Id : hal-01092066, version 1

Collections

Citation

Jilles Dibangoye, Christopher Amato, Olivier Buffet, François Charpillet. Exploiting Separability in Multiagent Planning with Continuous-State MDPs. AAMAS 2014 - 13th International Conference on Autonomous Agents and Multiagent Systems, May 2014, Paris, France. ⟨hal-01092066⟩

Share

Metrics

Record views

410

Files downloads

365