Skip to Main content Skip to Navigation
Conference papers

Toward Comparison-based Adaptive Operator Selection

Álvaro Fialho 1 Marc Schoenauer 1, 2, 3 Michèle Sebag 1, 2, 3
2 TAO - Machine Learning and Optimisation
CNRS - Centre National de la Recherche Scientifique : UMR8623, Inria Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, LRI - Laboratoire de Recherche en Informatique
Abstract : Adaptive Operator Selection (AOS) turns the impacts of the applications of variation operators into Operator Selection through a Credit Assignment mechanism. However, most Credit Assignment schemes make direct use of the fitness gain between parent and offspring. A first issue is that the Operator Selection technique that uses such kind of Credit Assignment is likely to be highly dependent on the a priori unknown bounds of the fitness function. Additionally, these bounds are likely to change along evolution, as fitness gains tend to get smaller as convergence occurs. Furthermore, and maybe more importantly, a fitness-based credit assignment forbid any invariance by monotonous transformation of the fitness, what is a usual source of robustness for comparison-based Evolutionary Algorithms. In this context, this paper proposes two new Credit Assignment mechanisms, one inspired by the Area Under the Curve paradigm, and the other close to the Sum of Ranks. Using fitness improvement as raw reward, and directly coupled to a Multi-Armed Bandit Operator Selection Rule, the resulting AOS obtain very good performances on both the OneMax problem and some artificial scenarios, while demonstrating their robustness with respect to hyper-parameter and fitness transformations. Furthermore, using fitness ranks as raw reward results in a fully comparison-based AOS with reasonable performances.
Document type :
Conference papers
Complete list of metadata

Cited literature [2 references]  Display  Hide  Download
Contributor : Álvaro Fialho Connect in order to contact the contributor
Submitted on : Sunday, July 11, 2010 - 2:14:58 AM
Last modification on : Thursday, July 8, 2021 - 3:48:09 AM
Long-term archiving on: : Tuesday, October 12, 2010 - 10:07:37 AM



  • HAL Id : inria-00471264, version 2



Álvaro Fialho, Marc Schoenauer, Michèle Sebag. Toward Comparison-based Adaptive Operator Selection. Genetic and Evolutionary Computation Conference (GECCO 2010), Jul 2010, Portland, United States. pp.767-774. ⟨inria-00471264v2⟩



Les métriques sont temporairement indisponibles