How to Assess Step-Size Adaptation Mechanisms in Randomised Search

Nikolaus Hansen 1 Asma Atamna 1 Anne Auger 1
1 TAO - Machine Learning and Optimisation
CNRS - Centre National de la Recherche Scientifique : UMR8623, Inria Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, LRI - Laboratoire de Recherche en Informatique
Abstract : Step-size adaptation for randomised search algorithms like evolution strategies is a crucial feature for their performance. The adaptation must, depending on the situation, sustain a large diversity or entertain fast convergence to the desired optimum. The assessment of step-size adaptation mechanisms is therefore non-trivial and often done in too restricted scenarios, possibly only on the sphere function. This paper introduces a (minimal) methodology combined with a practical procedure to conduct a more thorough assessment of the overall population diversity of a randomised search algorithm in different scenarios. We illustrate the methodology on evolution strategies with $\sigma$-self-adaptation, cumulative step-size adaptation and two-point adaptation. For the latter, we introduce a variant that abstains from additional samples by constructing two particular individuals within the given population to decide on the step-size change. We find that results on the sphere function alone can be rather misleading to assess mechanisms to control overall population diversity. We observed the most striking flaws for self-adaptation: on the linear function, the step-size increments are rather small, and on a moderately conditioned ellipsoid function, the adapted step-size is 20 times smaller than optimal.
Document type :
Conference papers
Complete list of metadatas
Contributor : Asma Atamna <>
Submitted on : Thursday, January 8, 2015 - 3:04:45 PM
Last modification on : Thursday, April 5, 2018 - 12:30:12 PM
Long-term archiving on : Saturday, April 15, 2017 - 2:41:27 PM




Nikolaus Hansen, Asma Atamna, Anne Auger. How to Assess Step-Size Adaptation Mechanisms in Randomised Search. Parallel Problem Solving from Nature, PPSN XIII, Sep 2014, Ljubljana, Slovenia. pp.60-69, ⟨10.1007/978-3-319-10762-2_6⟩. ⟨hal-00997294v3⟩



Record views


Files downloads