Regret lower bounds and extended Upper Confidence Bounds policies in stochastic multi-armed bandit problem - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Preprints, Working Papers, ... Year : 2011

Regret lower bounds and extended Upper Confidence Bounds policies in stochastic multi-armed bandit problem

Abstract

This paper is devoted to regret lower bounds in the classical model of stochastic multi-armed bandit. A well-known result of Lai and Robbins, which has then been extended by Burnetas and Katehakis, has established the presence of a logarithmic bound for all consistent policies. We relax the notion of consistence, and exhibit a generalisation of the logarithmic bound. We also show the non existence of logarithmic bound in the general case of Hannan consistency. To get these results, we study variants of popular Upper Confidence Bounds (ucb) policies. As a by-product, we prove that it is impossible to design an adaptive policy that would select the best of two algorithms by taking advantage of the properties of the environment.
Fichier principal
Vignette du fichier
consistence.pdf (206.36 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-00652865 , version 1 (16-12-2011)

Identifiers

Cite

Antoine Salomon, Jean-Yves Audibert, Issam El Alaoui. Regret lower bounds and extended Upper Confidence Bounds policies in stochastic multi-armed bandit problem. 2011. ⟨hal-00652865⟩
597 View
1310 Download

Altmetric

Share

Gmail Facebook X LinkedIn More