Numerical methods for sensitivity analysis of Feynman-Kac models

Pierre-Arnaud Coquelin 1, 2 Romain Deguest 2 Rémi Munos 1
1 SEQUEL - Sequential Learning
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe, LAGIS - Laboratoire d'Automatique, Génie Informatique et Signal
Abstract : The aim of this work is to provide efficient numerical methods to estimate the gradient of a Feynman-Kac flow with respect to a parameter of the model. The underlying idea is to view a Feynman-Kac flow as an expectation of a product of potential functions along a canonical Markov chain, and to use usual techniques of gradient estimation in Markov chains. Combining this idea with the use of interacting particle methods enables us to obtain two new algorithms that provide tight estimations of the sensitivity of a Feynman-Kac flow. Each algorithm has a linear computational complexity in the number of particles and is demonstrated to be asymptotically consistent. We also carefully analyze the differences between these new algorithms and existing ones. We provide numerical experiments to assess the practical efficiency of the proposed methods and explain how to use them to solve a parameter estimation problem in Hidden Markov Models. To conclude we can say that these algorithms outperform the existing ones in terms of trade-off between computational complexity and estimation quality.
Type de document :
Rapport
[Research Report] 2007
Liste complète des métadonnées

Littérature citée [21 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00125427
Contributeur : Pierre-Arnaud Coquelin <>
Soumis le : vendredi 19 janvier 2007 - 14:29:41
Dernière modification le : jeudi 10 mai 2018 - 02:03:59
Document(s) archivé(s) le : mercredi 7 avril 2010 - 02:24:11

Fichier

gradient.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00125427, version 1

Collections

Citation

Pierre-Arnaud Coquelin, Romain Deguest, Rémi Munos. Numerical methods for sensitivity analysis of Feynman-Kac models. [Research Report] 2007. 〈inria-00125427〉

Partager

Métriques

Consultations de la notice

517

Téléchargements de fichiers

131