Log-linear Convergence of the Scale-invariant $(\mu/\mu_w,\lambda)$-{ES} and Optimal $\mu$ for Intermediate Recombination for Large Population Sizes

Mohamed Jebalia 1 Anne Auger 1
1 TAO - Machine Learning and Optimisation
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
Abstract : Evolution Strategies (ESs) are population-based methods well suited for parallelization. In this paper, we study the convergence of the (mu/mu_w,lambda)-ES, an ES with weighted recombination, and derive its optimal convergence rate and optimal mu especially for large population sizes. First, we theoretically prove the log-linear convergence of the algorithm using a scale-invariant adaptation rule for the step-size and minimizing spherical objective functions and identify its convergence rate as the expectation of an underlying random variable. Then, using Monte-Carlo computations of the convergence rate in the case of equal weights, we derive optimal values for mu that we compare with previously proposed rules. Our numerical computations show also a dependency of the optimal convergence rate in ln(lambda) in agreement with previous theoretical results.
Type de document :
Communication dans un congrès
Robert Schaefer, Carlos Cotta, Joanna Kolodziej, Günter Rudolph. Parallel Problem Solving From Nature (PPSN2010), Sep 2010, Krakow, Poland. Springer, pp.xxxx-xxx, 2010, Lecture Notes in Computer Science
Liste complète des métadonnées

Littérature citée [17 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00494478
Contributeur : Mohamed Jebalia <>
Soumis le : jeudi 24 juin 2010 - 11:19:29
Dernière modification le : jeudi 11 janvier 2018 - 01:49:38
Document(s) archivé(s) le : lundi 22 octobre 2012 - 14:42:03

Fichier

ppsn2010JebaliaAuger.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00494478, version 1

Citation

Mohamed Jebalia, Anne Auger. Log-linear Convergence of the Scale-invariant $(\mu/\mu_w,\lambda)$-{ES} and Optimal $\mu$ for Intermediate Recombination for Large Population Sizes. Robert Schaefer, Carlos Cotta, Joanna Kolodziej, Günter Rudolph. Parallel Problem Solving From Nature (PPSN2010), Sep 2010, Krakow, Poland. Springer, pp.xxxx-xxx, 2010, Lecture Notes in Computer Science. 〈inria-00494478〉

Partager

Métriques

Consultations de la notice

409

Téléchargements de fichiers

139