Analysis of Adaptive Strategy Selection within Differential Evolution on the BBOB-2010 Noiseless Benchmark

Álvaro Fialho 1 Raymond Ros 2
2 TAO - Machine Learning and Optimisation
CNRS - Centre National de la Recherche Scientifique : UMR8623, Inria Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, LRI - Laboratoire de Recherche en Informatique
Abstract : This document presents an empirical analysis of the Fitness-based Area-Under-Curve - Bandit (F-AUC-Bandit), an adaptive strategy (or operator) selection method recently proposed in the context of Genetic Algorithms. It is here used to select, while solving the problem, the strategy to be applied for the next offspring generation based on the recent known performance of each of the available ones, within a Differential Evolution algorithm applied to contin- uous optimization problems. Experimental results are obtained on a testbed of single-objective noiseless functions. The performance gain achieved by the use of adaptive strategy selection methods is shown by comparing F-AUC-Bandit with what would be the common naïve choices: the use of a single strategy or the uniform selection between a sub-set of available strategies. F-AUC-Bandit is also compared to previously proposed adaptive schemes, showing a significantly better performance (w.r.t. expected running time to achieve a target solution) on most of the functions, while presenting a robust hyper-parameter setting. Although still being not competitive with state-of-the-art continuous optimizers such as the CMA-ES (to which an empirical comparison is also presented), a big enhancement is achieved over the use of the basic Differential Evolution, while also improving over both naïve and existent adaptive methods.
Complete list of metadatas

Cited literature [28 references]  Display  Hide  Download

https://hal.inria.fr/inria-00476160
Contributor : Raymond Ros <>
Submitted on : Friday, April 30, 2010 - 2:28:08 PM
Last modification on : Monday, December 9, 2019 - 5:24:06 PM
Long-term archiving on: Thursday, September 30, 2010 - 4:44:03 PM

Files

RR-7259.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00476160, version 2

Collections

Citation

Álvaro Fialho, Raymond Ros. Analysis of Adaptive Strategy Selection within Differential Evolution on the BBOB-2010 Noiseless Benchmark. [Research Report] RR-7259, INRIA. 2010. ⟨inria-00476160v2⟩

Share

Metrics

Record views

333

Files downloads

199