K-N-MOMDPs: Towards Interpretable Solutions for Adaptive Management - Archive ouverte HAL Access content directly
Conference Papers Year :

K-N-MOMDPs: Towards Interpretable Solutions for Adaptive Management

(1) , (2) , (3) , (1)
1
2
3

Abstract

In biodiversity conservation, adaptive management (AM) is the principal tool for decision making under uncertainty. AM problems are planning problems that can be modelled using Mixed Observability MDPs (MOMDPs). MOMDPs tackle decision problems where state variables are completely or partially observable. Unfortunately, MOMDP solutions (policy graphs) are too complex to be interpreted by human decision-makers. Here, we provide algorithms to solve K-N-MOMDPs, where K represents the maximum number of fully observable states and N represents the maximum number of alpha-vectors. Our algorithms calculate compact and more interpretable policy graphs from existing MOMDP models and solutions. We apply these algorithms to two computational sustainability applications: optimal release of bio-control agents to prevent dengue epidemics and conservation of the threatened bird species Gouldian finch. The methods dramatically reduce the number of states and alpha-vectors in MOMDP problems without significantly reducing their quality. The resulting policies have small policy graphs (4-6 nodes) that can be easily interpreted by human decision-makers.
Not file

Dates and versions

hal-03523504 , version 1 (12-01-2022)

Identifiers

  • HAL Id : hal-03523504 , version 1

Cite

Jonathan Ferrer-Mestres, Thomas G. Dietterich, Olivier Buffet, Iadine Chadès. K-N-MOMDPs: Towards Interpretable Solutions for Adaptive Management. AAAI 2021 - 35th AAAI Conference on Artificial Intelligence, Feb 2021, Virtual, United States. ⟨hal-03523504⟩
21 View
0 Download

Share

Gmail Facebook Twitter LinkedIn More