How to Assess Step-Size Adaptation Mechanisms in Randomised Search

Nikolaus Hansen 1 Asma Atamna 1 Anne Auger 1
1 TAO - Machine Learning and Optimisation
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
Abstract : Step-size adaptation for randomised search algorithms like evolution strategies is a crucial feature for their performance. The adaptation must, depending on the situation, sustain a large diversity or entertain fast convergence to the desired optimum. The assessment of step-size adaptation mechanisms is therefore non-trivial and often done in too restricted scenarios, possibly only on the sphere function. This paper introduces a (minimal) methodology combined with a practical procedure to conduct a more thorough assessment of the overall population diversity of a randomised search algorithm in different scenarios. We illustrate the methodology on evolution strategies with $\sigma$-self-adaptation, cumulative step-size adaptation and two-point adaptation. For the latter, we introduce a variant that abstains from additional samples by constructing two particular individuals within the given population to decide on the step-size change. We find that results on the sphere function alone can be rather misleading to assess mechanisms to control overall population diversity. We observed the most striking flaws for self-adaptation: on the linear function, the step-size increments are rather small, and on a moderately conditioned ellipsoid function, the adapted step-size is 20 times smaller than optimal.
Document type :
Conference papers
T. Bartz-Beielstein et al. Parallel Problem Solving from Nature, PPSN XIII, Sep 2014, Ljubljana, Slovenia. Springer, 8672, pp.60-69, 2014, LNCS. <10.1007/978-3-319-10762-2_6>
Liste complète des métadonnées

https://hal.inria.fr/hal-00997294
Contributor : Asma Atamna <>
Submitted on : Thursday, January 8, 2015 - 3:04:45 PM
Last modification on : Thursday, February 9, 2017 - 3:54:34 PM
Document(s) archivé(s) le : Saturday, April 15, 2017 - 2:41:27 PM

Identifiers

Collections

Citation

Nikolaus Hansen, Asma Atamna, Anne Auger. How to Assess Step-Size Adaptation Mechanisms in Randomised Search. T. Bartz-Beielstein et al. Parallel Problem Solving from Nature, PPSN XIII, Sep 2014, Ljubljana, Slovenia. Springer, 8672, pp.60-69, 2014, LNCS. <10.1007/978-3-319-10762-2_6>. <hal-00997294v3>

Share

Metrics

Record views

804

Document downloads

310