Extreme Compass and Dynamic Multi-Armed Bandits for Adaptive Operator Selection

Jorge Maturana 1 Álvaro Fialho 2 Frédéric Saubion 1 Marc Schoenauer 2, 3, 4 Michèle Sebag 2, 3, 4
4 TAO - Machine Learning and Optimisation
CNRS - Centre National de la Recherche Scientifique : UMR8623, Inria Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, LRI - Laboratoire de Recherche en Informatique
Abstract : The goal of Adaptive Operator Selection (AOS) is the on-line control of the choice of variation operators within Evolutionary Algorithms. The control process is based on two main components, the credit assignment, that defines the reward that will be used to evaluate the quality of an operator after it has been applied, and the operator selection mechanism, that selects one operator based on some operators qualities. Two previously developed AOS methods are combined here: Compass evaluates the performance of operators by considering not only the fitness improvements from parent to offspring, but also the way they modify the diversity of the population, and their execution time; Dynamic Multi-Armed Bandit proposes a selection strategy based on the well-known UCB algorithm, achieving a compromise between exploitation and exploration, while nevertheless quickly adapting to changes. Tests with the proposed method, called ExCoDyMAB, are carried out using several hard instances of the Satisfiability problem (SAT). Results show the good synergetic effect of combining both approaches.
Type de document :
Communication dans un congrès
IEEE Congress on Evolutionary Computation (CEC), May 2009, Trondheim, Norway. pp.365-372, 2009, 〈10.1109/CEC.2009.4982970〉
Liste complète des métadonnées

Littérature citée [25 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00377450
Contributeur : Álvaro Fialho <>
Soumis le : mercredi 3 mars 2010 - 17:58:52
Dernière modification le : jeudi 5 avril 2018 - 12:30:12
Document(s) archivé(s) le : jeudi 23 septembre 2010 - 17:52:54

Fichier

PaperCEC09.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Jorge Maturana, Álvaro Fialho, Frédéric Saubion, Marc Schoenauer, Michèle Sebag. Extreme Compass and Dynamic Multi-Armed Bandits for Adaptive Operator Selection. IEEE Congress on Evolutionary Computation (CEC), May 2009, Trondheim, Norway. pp.365-372, 2009, 〈10.1109/CEC.2009.4982970〉. 〈inria-00377450v3〉

Partager

Métriques

Consultations de la notice

518

Téléchargements de fichiers

1016