How to Assess Step-Size Adaptation Mechanisms in Randomised Search - Archive ouverte HAL Access content directly
Conference Papers Year : 2014

## How to Assess Step-Size Adaptation Mechanisms in Randomised Search

Nikolaus Hansen
Asma Atamna
• Function : Author
• PersonId : 736387
• IdHAL : asma-atamna
Anne Auger
• Function : Author
• PersonId : 751513
• IdHAL : anne-auger

#### Abstract

Step-size adaptation for randomised search algorithms like evolution strategies is a crucial feature for their performance. The adaptation must, depending on the situation, sustain a large diversity or entertain fast convergence to the desired optimum. The assessment of step-size adaptation mechanisms is therefore non-trivial and often done in too restricted scenarios, possibly only on the sphere function. This paper introduces a (minimal) methodology combined with a practical procedure to conduct a more thorough assessment of the overall population diversity of a randomised search algorithm in different scenarios. We illustrate the methodology on evolution strategies with $\sigma$-self-adaptation, cumulative step-size adaptation and two-point adaptation. For the latter, we introduce a variant that abstains from additional samples by constructing two particular individuals within the given population to decide on the step-size change. We find that results on the sphere function alone can be rather misleading to assess mechanisms to control overall population diversity. We observed the most striking flaws for self-adaptation: on the linear function, the step-size increments are rather small, and on a moderately conditioned ellipsoid function, the adapted step-size is 20 times smaller than optimal.

#### Domains

Computer Science [cs] Machine Learning [cs.LG]

### Dates and versions

hal-00997294 , version 1 (22-07-2014)
hal-00997294 , version 2 (22-07-2014)
hal-00997294 , version 3 (08-01-2015)

### Identifiers

• HAL Id : hal-00997294 , version 3
• DOI :

### Cite

Nikolaus Hansen, Asma Atamna, Anne Auger. How to Assess Step-Size Adaptation Mechanisms in Randomised Search. Parallel Problem Solving from Nature, PPSN XIII, Sep 2014, Ljubljana, Slovenia. pp.60-69, ⟨10.1007/978-3-319-10762-2_6⟩. ⟨hal-00997294v3⟩

### Export

BibTeX TEI Dublin Core DC Terms EndNote Datacite

570 View