A general Hamilton-Jacobi framework for nonlinear state-constrained control problems

Albert Altarovici 1 Olivier Bokanowski 1, 2 Hasnaa Zidani 1, 3
1 Commands - Control, Optimization, Models, Methods and Applications for Nonlinear Dynamical Systems
UMA - Unité de Mathématiques Appliquées, Inria Saclay - Ile de France, CMAP - Centre de Mathématiques Appliquées - Ecole Polytechnique
Abstract : The paper deals with deterministic optimal control problem with state constraints and non-linear dynamics. It is known for such a problem that the value function is in general discontinuous and its characterization by means of an HJ equation requires some controllability assumptions involving the dynamics and the set of state constraints. Here, we first adopt the viability point of view and look at the value function as its epigraph. Then, we prove that this epigraph can always be described by an auxiliary optimal control problem free of state constraints, and for which the value function is Lipschitz continuous and can be characterized, without any additional assumption, as the unique viscosity solution of a Hamilton-Jacobi equation. The idea introduced in this paper bypass the regularity issues on the value function of the constrained control problem and leads to a constructive way to compute its epigraph by a large panel of numerical schemes. Our approach can be extended to more general control problems. We study in this paper the extension to the infinite horizon problem as well as for the two-player game setting. Finally, an illustrative numerical example is given to show the relevance of the approach.
Document type :
Journal articles
Complete list of metadatas

Cited literature [31 references]  Display  Hide  Download

https://hal.inria.fr/hal-00653337
Contributor : Hasnaa Zidani <>
Submitted on : Friday, January 13, 2012 - 11:32:27 PM
Last modification on : Monday, September 30, 2019 - 10:46:02 AM
Long-term archiving on : Tuesday, December 13, 2016 - 10:34:28 PM

File

MAIN_Hal.pdf
Files produced by the author(s)

Identifiers

Citation

Albert Altarovici, Olivier Bokanowski, Hasnaa Zidani. A general Hamilton-Jacobi framework for nonlinear state-constrained control problems. ESAIM: Control, Optimisation and Calculus of Variations, EDP Sciences, 2013, 19 (2), pp.337--357. ⟨10.1051/cocv/2012011⟩. ⟨hal-00653337v3⟩

Share

Metrics

Record views

1148

Files downloads

1920