Skip to Main content Skip to Navigation
Reports

Moments analysis in Markov reward models

François Castella 1, 2 Guillaume Dujardin 1, 2 Bruno Sericola 3 
2 IPSO - Invariant Preserving SOlvers
IRMAR - Institut de Recherche Mathématique de Rennes, Inria Rennes – Bretagne Atlantique
3 DIONYSOS - Dependability Interoperability and perfOrmance aNalYsiS Of networkS
Inria Rennes – Bretagne Atlantique , IRISA-D2 - RÉSEAUX, TÉLÉCOMMUNICATION ET SERVICES
Abstract : We analyze the moments of the accumulated reward over the interval (0, t) in a continuous-time Markov chain. We develop a numerical procedure to efficiently compute the normalized moments using the uniformization technique. Our algorithm involves auxiliary quantities whose convergence is analyzed, and for which we provide a probabilistic interpretation.
Complete list of metadata

https://hal.inria.fr/inria-00182497
Contributor : Anne Jaigu Connect in order to contact the contributor
Submitted on : Thursday, November 15, 2007 - 9:41:05 AM
Last modification on : Friday, May 20, 2022 - 9:04:52 AM
Long-term archiving on: : Thursday, September 23, 2010 - 4:47:55 PM

File

RR-6339.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00182497, version 3

Citation

François Castella, Guillaume Dujardin, Bruno Sericola. Moments analysis in Markov reward models. [Research Report] RR-6339, INRIA. 2007, pp.21. ⟨inria-00182497v3⟩

Share

Metrics

Record views

259

Files downloads

84