Strategic Choices in Optimization

Cheng-Wei Chou 1 Ping-Chiang Chou 2 Jean-Joseph Christophe 3 Adrien Couetoux 3, 4 Pierre de Freminville 4 Nicolas Galichet 3, 4 Chang-Shing Lee 2 Jialin Liu 3 David L. St-Pierre 5 Michèle Sebag 3 Olivier Teytaud 3 Mei-Hui Wang 2 Li-Wen Wu 2 Shi-Jim Yen 1
3 TAO - Machine Learning and Optimisation
CNRS - Centre National de la Recherche Scientifique : UMR8623, Inria Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, LRI - Laboratoire de Recherche en Informatique
Abstract : Many decision problems have two levels: one for strategic decisions, and an- other for tactical management. This paper focuses on the strategic level, more specifically the sequential exploration of the possible options and the final selec- tion (recommendation) of the best option. Several sequential exploration and recommendation criteria are considered and empirically compared on real world problems (board games, card games and energy management problems) in the uniform (1-player) and adversarial (2-player) settings. W.r.t. the sequential ex- ploration part, the classical upper confidence bound algorithm, the exponential exploration-exploitation algorithm, the successive reject algorithm (designed specifically for simple regret), and the Bernstein races, are considered. W.r.t. the recommendation part, the selection is based on the empirically best arm, most played arm, lower confidence bounds, based on the reward distribution or variants thereof designed for risk control. This paper presents a systematic study, comparing the coupling of the sequential exploration and recommenda- tion variants on the considered problems in terms of their simple regret. A secondary contribution is that, to the best of our knowledge, this is the first win ever of a computer-kill-all Go player against professional human players.
Complete list of metadatas

https://hal.inria.fr/hal-00863577
Contributor : Jialin Liu <>
Submitted on : Thursday, September 19, 2013 - 11:06:12 AM
Last modification on : Thursday, April 5, 2018 - 12:30:12 PM

Identifiers

  • HAL Id : hal-00863577, version 1

Collections

Citation

Cheng-Wei Chou, Ping-Chiang Chou, Jean-Joseph Christophe, Adrien Couetoux, Pierre de Freminville, et al.. Strategic Choices in Optimization. Journal of Information Sciences and Engineering, Institute of Information Science, 2013. ⟨hal-00863577⟩

Share

Metrics

Record views

943