MOMDPs: a Solution for Modelling Adaptive Management Problems - Archive ouverte HAL Access content directly
Conference Papers Year : 2012

MOMDPs: a Solution for Modelling Adaptive Management Problems

(1) , (1) , (2) , (3) , (4) , (5)
1
2
3
4
5
Iadine Chadès
  • Function : Correspondent author
Josie Carwardine
  • Function : Author
  • PersonId : 914249
Tara G. Martin
  • Function : Author
  • PersonId : 914250
Samuel Nicol
  • Function : Author
  • PersonId : 914251
Olivier Buffet

Abstract

In conservation biology and natural resource management, adaptive management is an iterative process of improving management by reducing uncertainty via monitoring. Adaptive management is the principal tool for conserving endangered species under global change, yet adaptive management problems suffer from a poor suite of solution methods. The common approach used to solve an adaptive management problem is to assume the system state is known and the system dynamics can be one of a set of pre-defined models. The solution method used is unsatisfactory, employing value iteration on a discretized belief MDP which restricts the study to very small problems. We show how to overcome this limitation by modelling an adaptive management problem as a restricted Mixed Observability MDP called hidden model MDP (hmMDP). We demonstrate how to simplify the value function, the backup operator and the belief update computation. We show that, although a simplified case of POMDPs, hmMDPs are PSPACE-complete in the finite-horizon case. We illustrate the use of this model to manage a population of the threatened Gouldian finch, a bird species endemic to North- ern Australia. Our simple modelling approach is an important step towards efficient algorithms for solving adaptive management problems.
Fichier principal
Vignette du fichier
aaai12-a.pdf (133.51 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00755264 , version 1 (20-11-2012)

Identifiers

  • HAL Id : hal-00755264 , version 1
  • PRODINRA : 166686

Cite

Iadine Chadès, Josie Carwardine, Tara G. Martin, Samuel Nicol, Régis Sabbadin, et al.. MOMDPs: a Solution for Modelling Adaptive Management Problems. Twenty-Sixth AAAI Conference on Artificial Intelligence (AAAI-12), Jul 2012, Toronto, Canada. 7 p. ⟨hal-00755264⟩
411 View
295 Download

Share

Gmail Facebook Twitter LinkedIn More