MOMDPs: a Solution for Modelling Adaptive Management Problems

Iadine Chadès 1, * Josie Carwardine 1 Tara Martin 2 Samuel Nicol 3 Régis Sabbadin 4 Olivier Buffet 5
* Auteur correspondant
1 CSIRO Ecosystem Sciences
2 Ecosystem Sciences
CSIRO Ecosystem Sciences
3 Institute of Arctic Biology
4 UBIA - Unité de Biométrie et Intelligence Artificielle
5 MAIA - Autonomous intelligent machine
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : In conservation biology and natural resource management, adaptive management is an iterative process of improving management by reducing uncertainty via monitoring. Adaptive management is the principal tool for conserving endangered species under global change, yet adaptive management problems suffer from a poor suite of solution methods. The common approach used to solve an adaptive management problem is to assume the system state is known and the system dynamics can be one of a set of pre-defined models. The solution method used is unsatisfactory, employing value iteration on a discretized belief MDP which restricts the study to very small problems. We show how to overcome this limitation by modelling an adaptive management problem as a restricted Mixed Observability MDP called hidden model MDP (hmMDP). We demonstrate how to simplify the value function, the backup operator and the belief update computation. We show that, although a simplified case of POMDPs, hmMDPs are PSPACE-complete in the finite-horizon case. We illustrate the use of this model to manage a population of the threatened Gouldian finch, a bird species endemic to North- ern Australia. Our simple modelling approach is an important step towards efficient algorithms for solving adaptive management problems.
Type de document :
Communication dans un congrès
Twenty-Sixth AAAI Conference on Artificial Intelligence (AAAI-12), Jul 2012, Toronto, Canada. 2012
Liste complète des métadonnées

Littérature citée [18 références]  Voir  Masquer  Télécharger
https://hal.inria.fr/hal-00755264
Contributeur : Olivier Buffet <>
Soumis le : mardi 20 novembre 2012 - 18:16:37
Dernière modification le : mardi 18 décembre 2018 - 16:40:21
Document(s) archivé(s) le : jeudi 21 février 2013 - 12:31:27

Fichier

aaai12-a.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00755264, version 1

Collections

INRIA | INRA | UNIV-LORRAINE | LORIA-AIS | LORIA

Citation

Iadine Chadès, Josie Carwardine, Tara Martin, Samuel Nicol, Régis Sabbadin, et al.. MOMDPs: a Solution for Modelling Adaptive Management Problems. Twenty-Sixth AAAI Conference on Artificial Intelligence (AAAI-12), Jul 2012, Toronto, Canada. 2012. 〈hal-00755264〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

684

Téléchargements de fichiers

218

Contact


archive-ouverte@inria.fr