Skip to Main content Skip to Navigation
New interface
Reports (Research report)

Rolling horizon procedures in Semi-Markov Games: The Discounted Case

Eugenio Della Vecchia 1 Silvia C. Di Marco 1 Alain Jean-Marie 2, 3 
2 MAESTRO - Models for the performance analysis and the control of networks
CRISAM - Inria Sophia Antipolis - Méditerranée
3 LIRMM/HE - Hors Équipe
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
Abstract : We study the properties of the rolling horizon and the approximate rolling horizon procedures for the case of two-person zero-sum discounted semi-Markov games with infi nite horizon, under several assumptions on the reward function, when the state space is a borelian set and the action spaces are considered compact. Under suitable conditions, we prove that the equilibrium is the unique solution of its dynamic programming equation, and we prove bounds which imply the convergence of the procedures when the horizon length tends to in finity. The approach is based on the formalism for Semi-Markov games developed by Luque-Vásquez, together with extensions of the results of Hernández-Lerma and Lasserre for Markov Decision Processes and Chang and Marcus for Markov Games, both in discrete time. In this way we generalize the results on the rolling horizon and approximate rolling horizon procedures previously obtained for discrete-time problems.
Document type :
Reports (Research report)
Complete list of metadata

Cited literature [16 references]  Display  Hide  Download
Contributor : Alain Jean-Marie Connect in order to contact the contributor
Submitted on : Thursday, May 22, 2014 - 3:03:40 PM
Last modification on : Wednesday, October 26, 2022 - 8:16:39 AM
Long-term archiving on: : Friday, August 22, 2014 - 12:45:27 PM


Files produced by the author(s)


  • HAL Id : hal-00720351, version 2


Eugenio Della Vecchia, Silvia C. Di Marco, Alain Jean-Marie. Rolling horizon procedures in Semi-Markov Games: The Discounted Case. [Research Report] RR-8019, INRIA. 2012. ⟨hal-00720351v2⟩



Record views


Files downloads