Discrete Time Markov chains competing over resources: product form steady-state distribution - Archive ouverte HAL Access content directly
Conference Papers Year : 2008

Discrete Time Markov chains competing over resources: product form steady-state distribution

(1, 2)
1
2

Abstract

We consider discrete time Markov chains in competition over a set of resources. We build a multidimensional Markov process based on the Cartesian product of the states space and on competition rules between the chains. When a resource is owned by a chain it affects the transition probabilities of the other components of the process. We prove that under some competition rules the steady-state distribution of the chain has a product form. This work extends Boucherie's theory based on continuous-time chains. The effects of the competition are slightly different from the restricted transitions studied by Boucherie. The proof is much more general and relies on algebraic properties of the generalized tensor product defined by Plateau and Stewart.
Not file

Dates and versions

hal-00953623 , version 1 (28-02-2014)

Identifiers

Cite

Jean-Michel Fourneau. Discrete Time Markov chains competing over resources: product form steady-state distribution. Fith International Conference on the Quantitative Evaluation of Systems (QEST 2008), 2008, St. Malo, France. ⟨10.1109/QEST.2008.31⟩. ⟨hal-00953623⟩
112 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More