Bandits attack function optimization

Philippe Preux 1 Rémi Munos 1 Michal Valko 1
1 SEQUEL - Sequential Learning
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe, LAGIS - Laboratoire d'Automatique, Génie Informatique et Signal
Abstract : We consider function optimization as a sequential decision making problem under the budget constraint. Such constraint limits the number of objective function evaluations allowed during the optimization. We consider an algorithm inspired by a continuous version of a multi-armed bandit problem which attacks this optimization problem by solving the tradeoff between exploration (initial quasi-uniform search of the domain) and exploitation (local optimization around the potentially global maxima). We introduce the so-called Simultaneous Optimistic Optimization (SOO), a deterministic algorithm that works by domain partitioning. The benefit of such an approach are the guarantees on the returned solution and the numerical eficiency of the algorithm. We present this machine learning rooted approach to optimization, and provide the empirical assessment of SOO on the CEC'2014 competition on single objective real-parameter numerical optimization testsuite.
Type de document :
Communication dans un congrès
IEEE Congress on Evolutionary Computation, Jul 2014, Beijing, China
Liste complète des métadonnées

Littérature citée [15 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00978637
Contributeur : Michal Valko <>
Soumis le : lundi 14 avril 2014 - 14:32:03
Dernière modification le : jeudi 11 janvier 2018 - 06:22:13
Document(s) archivé(s) le : lundi 14 juillet 2014 - 11:45:56

Fichier

preux2014bandits.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00978637, version 1

Citation

Philippe Preux, Rémi Munos, Michal Valko. Bandits attack function optimization. IEEE Congress on Evolutionary Computation, Jul 2014, Beijing, China. 〈hal-00978637〉

Partager

Métriques

Consultations de la notice

719

Téléchargements de fichiers

343