A representation of the relative entropy with respect to a diffusion process in terms of its infinitesimal-generator

Olivier Faugeras 1 James Maclaurin 1, *
* Corresponding author
1 NEUROMATHCOMP - Mathematical and Computational Neuroscience
CRISAM - Inria Sophia Antipolis - Méditerranée , JAD - Laboratoire Jean Alexandre Dieudonné : UMR6621
Abstract : In this paper we derive an integral (with respect to time) representation of the relative entropy (or Kullback-Leibler Divergence) R(µ||P), where µ and P are measures on C([0, T ]; R d). The underlying measure P is a weak solution to a Martingale Problem with continuous coefficients. Our representation is in the form of an integral with respect to its infinitesimal generator. This representation is of use in statistical inference (particularly involving medical imaging). Since R(µ||P) governs the exponential rate of convergence of the empirical measure (according to Sanov's Theorem), this representation is also of use in the numerical and analytical investigation of finite-size effects in systems of interacting diffusions.
Document type :
Journal articles
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download

https://hal.inria.fr/hal-01096777
Contributor : Olivier Faugeras <>
Submitted on : Thursday, December 18, 2014 - 11:23:24 AM
Last modification on : Thursday, February 7, 2019 - 3:50:21 PM
Long-term archiving on : Monday, March 23, 2015 - 4:35:53 PM

File

entropy-68596-revised-layout.p...
Files produced by the author(s)

Identifiers

Collections

Citation

Olivier Faugeras, James Maclaurin. A representation of the relative entropy with respect to a diffusion process in terms of its infinitesimal-generator. Entropy, MDPI, 2014, 16, pp.17. ⟨10.3390/e16126705⟩. ⟨hal-01096777⟩

Share

Metrics

Record views

373

Files downloads

391