HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation

Stationary Strong Stackelberg Equilibrium in Discounted Stochastic Games

Víctor Bucarey 1, 2 Eugenio Della Vecchia 3 Alain Jean-Marie 4 Fernando Ordóñez 5
2 INOCS - Integrated Optimization with Complex Structure
Inria Lille - Nord Europe, ULB - Université libre de Bruxelles, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
4 NEO - Network Engineering and Operations
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : In this work we focus on Stackelberg equilibria for discounted stochastic games. We begin by formalizing the concept of Stationary Strong Stackelberg Equlibrium (SSSE) policies for such games. We provide classes of games where the SSSE exists, and we prove via counterexamples that SSSE does not exist in the general case. We define suitable dynamic programming operators whose fixed points are referred to as Fixed Point Equilibrium (FPE). We show that the FPE and SSSE coincide for a class of games with Myopic Follower Strategy. We provide numerical examples that shed light on the relationship between SSSE and FPE and the behavior of Value Iteration, Policy Iteration and Mathematical programming formulations for this problem. Finally, we present a security application to illustrate the solution concepts and the efficiency of the algorithms studied in this article.
Complete list of metadata

Contributor : Alain Jean-Marie Connect in order to contact the contributor
Submitted on : Friday, March 12, 2021 - 3:58:30 PM
Last modification on : Thursday, March 24, 2022 - 3:42:49 AM


Files produced by the author(s)


  • HAL Id : hal-02144095, version 3


Víctor Bucarey, Eugenio Della Vecchia, Alain Jean-Marie, Fernando Ordóñez. Stationary Strong Stackelberg Equilibrium in Discounted Stochastic Games. [Research Report] RR-9271, Inria. 2021, pp.62. ⟨hal-02144095v3⟩



Record views


Files downloads