Handling Expensive Optimization with Large Noise - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2011

Handling Expensive Optimization with Large Noise

Résumé

This paper exhibits lower and upper bounds on runtimes for expensive noisy optimization problems. Runtimes are expressed in terms of number of fitness evaluations. Fitnesses considered are monotonic transformations of the {\em sphere} function. The analysis focuses on the common case of fitness functions quadratic in the distance to the optimum in the neighborhood of this optimum---it is nonetheless also valid for any monotonic polynomial of degree p>2. Upper bounds are derived via a bandit-based estimation of distribution algorithm that relies on Bernstein races called R-EDA. It is known that the algorithm is consistent even in non-differentiable cases. Here we show that: (i) if the variance of the noise decreases to 0 around the optimum, it can perform optimally for quadratic transformations of the norm to the optimum, (ii) otherwise, it provides a slower convergence rate than the one exhibited empirically by an algorithm called Quadratic Logistic Regression based on surrogate models---although QLR requires a probabilistic prior on the fitness class.
Fichier principal
Vignette du fichier
foga10noise.pdf (179.69 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00517157 , version 1 (13-09-2010)
hal-00517157 , version 2 (08-12-2010)

Identifiants

  • HAL Id : hal-00517157 , version 2

Citer

Rémi Coulom, Philippe Rolet, Nataliya Sokolovska, Olivier Teytaud. Handling Expensive Optimization with Large Noise. Foundations of Genetic Algorithms, Jan 2011, Austria. pp.TBA. ⟨hal-00517157v2⟩
488 Consultations
337 Téléchargements

Partager

Gmail Facebook X LinkedIn More