Variance Calculation through Large Deviation Techniques

Abstract : In this paper, we show how to use the expression of entropy in order to calculate variances. Three cases are analyzed: independent and identically distributed (iid) variables, Markov chains (in discrete time) and jump Markov processes (in continuous time). This framework is valid far beyond these case studies, e.g. in transportation and telecommunication networks and likely in all models where the entropy is explicit. The method allows to derive the variance from the entropy function, which is a classical quantity in large deviations. Moreover, the entropy has often a rather simple expression (e.g. for networks). Here we show a closed formula expressing the variance in terms of derivatives of the entropy; by-products are also obtained, such as martingales, used in the proof of the central limit theorem. These results might be a good starting point for further developments, e.g. calculation of exact asymptotics (instead of logarithmic ones in large deviation) or solving entropy minimization problems.
Type de document :
Rapport
[Research Report] RR-4441, INRIA. 2002
Liste complète des métadonnées

https://hal.inria.fr/inria-00072147
Contributeur : Rapport de Recherche Inria <>
Soumis le : mardi 23 mai 2006 - 19:54:28
Dernière modification le : vendredi 25 mai 2018 - 12:02:03
Document(s) archivé(s) le : dimanche 4 avril 2010 - 22:55:31

Fichiers

Identifiants

  • HAL Id : inria-00072147, version 1

Collections

Citation

Arnaud De La Fortelle. Variance Calculation through Large Deviation Techniques. [Research Report] RR-4441, INRIA. 2002. 〈inria-00072147〉

Partager

Métriques

Consultations de la notice

152

Téléchargements de fichiers

121