A Dynamic Programming Approach to Viability Problems - Archive ouverte HAL Access content directly
Conference Papers Year : 2007

A Dynamic Programming Approach to Viability Problems

(1, 2) , (3) , (1)
Rémi Munos
  • Function : Author
  • PersonId : 836863


Viability theory considers the problem of maintaining a system under a set of viability constraints. The main tool for solving viability problems lies in the construction of the {\em viability kernel}, defined as the set of initial states from which there exists a trajectory that remains in the set of constraints indefinitely. The theory is very elegant and appears naturally in many applications. Unfortunately, the current numerical approaches suffer from low computational efficiency, which limits the potential range of applications of this domain. In this paper we show that the viability kernel is the zero-level set of a related dynamic programming problem, which opens promising research directions for numerical approximation of the viability kernel using tools from approximate dynamic programming. We illustrate the approach using k-nearest neighbors on a toy problem in two dimensions and on a complex dynamical model for anaerobic digestion process in four dimensions.
Fichier principal
Vignette du fichier
viabilite.pdf (913.17 Ko) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Dates and versions

inria-00125423 , version 1 (19-01-2007)


  • HAL Id : inria-00125423 , version 1


Pierre-Arnaud Coquelin, Sophie Martin, Rémi Munos. A Dynamic Programming Approach to Viability Problems. IEEE ADPRL, IEEE Computational Intelligence Society, Apr 2007, Hawai, United States. pp.178-184. ⟨inria-00125423⟩
200 View
279 Download


Gmail Facebook Twitter LinkedIn More