Learning in time-varying games

Abstract : In this paper, we examine the long-term behavior of regret-minimizing agents in time-varying games with continuous action spaces. In its most basic form, (external) regret minimization guarantees that an agent's cumulative payoff is no worse in the long run than that of the agent's best fixed action in hindsight. Going beyond this worst-case guarantee, we consider a dynamic regret variant that compares the agent's accrued rewards to those of any sequence of play. Specializing to a wide class of no-regret strategies based on mirror descent, we derive explicit rates of regret minimization relying only on imperfect gradient obvservations. We then leverage these results to show that players are able to stay close to Nash equilibrium in time-varying monotone games - and even converge to Nash equilibrium if the sequence of stage games admits a limit.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

https://hal.inria.fr/hal-01891545
Contributor : Panayotis Mertikopoulos <>
Submitted on : Tuesday, October 9, 2018 - 4:49:57 PM
Last modification on : Friday, April 19, 2019 - 4:55:28 PM

Links full text

Identifiers

  • HAL Id : hal-01891545, version 1
  • ARXIV : 1809.03066

Citation

Benoît Duvocelle, Panayotis Mertikopoulos, Mathias Staudigl, Dries Vermeulen. Learning in time-varying games. 2018. ⟨hal-01891545⟩

Share

Metrics

Record views

75