HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation

On Submodular Value Functions of Dynamic Programming

Abstract : We investigate in this paper submodular properties of the value function arrizing in complex Dynamic programming (DPs). We consider in particular DPs that include concatenation and linear combinations of standard DP operators, as well as combination of maximizations and minimizations. These DPs have many applications and interpretations, both in stochastic control (and stochastic zero-sum games as well as in the analysis of (non-controlled) discrete-event dynamic systems. The submodularity implies the monotonicity of the selectors appearing in the DP equations, which translates, in the context of stochastic control and stochastic games, to monotone optimal policies. Our work is based on the score-space approach of Glasserman and Yao.
Document type :
Complete list of metadata

Contributor : Rapport de Recherche Inria Connect in order to contact the contributor
Submitted on : Wednesday, May 24, 2006 - 2:21:24 PM
Last modification on : Friday, February 4, 2022 - 3:16:13 AM
Long-term archiving on: : Thursday, March 24, 2011 - 1:58:45 PM


  • HAL Id : inria-00074031, version 1



Eitan Altman, Ger Koole. On Submodular Value Functions of Dynamic Programming. RR-2658, INRIA. 1995. ⟨inria-00074031⟩



Record views


Files downloads