Toward Comparison-based Adaptive Operator Selection - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2010

Toward Comparison-based Adaptive Operator Selection

Abstract

Adaptive Operator Selection (AOS) turns the impacts of the applications of variation operators into Operator Selection through a Credit Assignment mechanism. However, most Credit Assignment schemes make direct use of the fitness gain between parent and offspring. A first issue is that the Operator Selection technique that uses such kind of Credit Assignment is likely to be highly dependent on the a priori unknown bounds of the fitness function. Additionally, these bounds are likely to change along evolution, as fitness gains tend to get smaller as convergence occurs. Furthermore, and maybe more importantly, a fitness-based credit assignment forbid any invariance by monotonous transformation of the fitness, what is a usual source of robustness for comparison-based Evolutionary Algorithms. In this context, this paper proposes two new Credit Assignment mechanisms, one inspired by the Area Under the Curve paradigm, and the other close to the Sum of Ranks. Using fitness improvement as raw reward, and directly coupled to a Multi-Armed Bandit Operator Selection Rule, the resulting AOS obtain very good performances on both the OneMax problem and some artificial scenarios, while demonstrating their robustness with respect to hyper-parameter and fitness transformations. Furthermore, using fitness ranks as raw reward results in a fully comparison-based AOS with reasonable performances.
Fichier principal
Vignette du fichier
banditGECCO10.pdf (225.4 Ko) Télécharger le fichier
gecco10.pdf (1.08 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Format : Other
Loading...

Dates and versions

inria-00471264 , version 1 (07-04-2010)
inria-00471264 , version 2 (11-07-2010)

Identifiers

  • HAL Id : inria-00471264 , version 2

Cite

Álvaro Fialho, Marc Schoenauer, Michèle Sebag. Toward Comparison-based Adaptive Operator Selection. Genetic and Evolutionary Computation Conference (GECCO 2010), Jul 2010, Portland, United States. pp.767-774. ⟨inria-00471264v2⟩
195 View
797 Download

Share

Gmail Facebook X LinkedIn More