Skip to Main content Skip to Navigation
New interface
Journal articles

An information-theoretic approach to assess practical identifiability of parametric dynamical systems

Sanjay Pant 1 Damiano Lombardi 1 
1 REO - Numerical simulation of biological flows
LJLL - Laboratoire Jacques-Louis Lions, Inria Paris-Rocquencourt, UPMC - Université Pierre et Marie Curie - Paris 6
Abstract : A new approach for assessing parameter identifiability of dynamical systems in a Bayesian setting is presented. The concept of Shannon entropy is employed to measure the inherent uncertainty in the parameters. The expected reduction in this uncertainty is seen as the amount of information one expects to gain about the parameters due to the availability of noisy measurements of the dynamical system. Such expected information gain is interpreted in terms of the variance of a hypothetical measurement device that can measure the parameters directly, and is related to practical identifiability of the parameters. If the individual parameters are unidentifiable, correlation between parameter combinations is assessed through conditional mutual information to determine which sets of parameters can be identified together. The information theoretic quantities of entropy and information are evaluated numerically through a combination of Monte Carlo and k-nearest neighbour methods in a non-parametric fashion. Unlike many methods to evaluate identifiability proposed in the literature, the proposed approach takes the measurement-noise into account and is not restricted to any particular noise-structure. Whilst computationally intensive for large dynamical systems, it is easily parallelisable and is non-intrusive as it does not necessitate re-writing of the numerical solvers of the dynamical system. The application of such an approach is presented for a variety of dynamical systems – ranging from systems governed by ordinary differential equations to partial differential equations – and, where possible, validated against results previously published in the literature.
Complete list of metadata

Cited literature [22 references]  Display  Hide  Download
Contributor : Damiano Lombardi Connect in order to contact the contributor
Submitted on : Monday, January 5, 2015 - 3:08:46 PM
Last modification on : Friday, January 21, 2022 - 3:22:28 AM
Long-term archiving on: : Wednesday, June 3, 2015 - 4:42:04 PM


Files produced by the author(s)



Sanjay Pant, Damiano Lombardi. An information-theoretic approach to assess practical identifiability of parametric dynamical systems. Mathematical Biosciences, 2015, pp.66-79. ⟨10.1016/j.mbs.2015.08.005⟩. ⟨hal-01099901⟩



Record views


Files downloads