Benchmarking the Local Metamodel CMA-ES on the Noiseless BBOB'2013 Test Bed

Anne Auger 1 Dimo Brockhoff 2 Nikolaus Hansen 1
1 TAO - Machine Learning and Optimisation
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
2 DOLPHIN - Parallel Cooperative Multi-criteria Optimization
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe
Abstract : This paper evaluates the performance of a variant of the local-meta-model CMA-ES (lmm-CMA) in the BBOB 2013 expensive setting. The lmm-CMA is a surrogate variant of the CMA-ES algorithm. Function evaluations are saved by building, with weighted regression, full quadratic metamodels to estimate the candidate solutions' function values. The quality of the approximation is appraised by checking how much the predicted rank changes when evaluating a fraction of the candidate solutions on the original objective function. The results are compared with the CMA-ES without meta-modeling and with previously benchmarked algorithms, namely BFGS, NEWUOA and saACM. It turns out that the additional meta-modeling improves the performance of CMA-ES on almost all BBOB functions while giving significantly worse results only on the attractive sector function. Over all functions, the performance is comparable with saACM and the lmm-CMA often outperforms NEWUOA and BFGS starting from about 2D^2 function evaluations with D being the search space dimension.
Type de document :
Communication dans un congrès
GECCO (Companion), workshop on Black-Box Optimization Benchmarking (BBOB'2013), Jul 2013, Amsterdam, Netherlands. 2013
Liste complète des métadonnées

Littérature citée [11 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00825840
Contributeur : Dimo Brockhoff <>
Soumis le : vendredi 24 mai 2013 - 16:47:57
Dernière modification le : jeudi 5 avril 2018 - 12:30:12
Document(s) archivé(s) le : dimanche 25 août 2013 - 07:40:07

Fichier

w0313-augerPS-FINAL.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

  • HAL Id : hal-00825840, version 1

Citation

Anne Auger, Dimo Brockhoff, Nikolaus Hansen. Benchmarking the Local Metamodel CMA-ES on the Noiseless BBOB'2013 Test Bed. GECCO (Companion), workshop on Black-Box Optimization Benchmarking (BBOB'2013), Jul 2013, Amsterdam, Netherlands. 2013. 〈hal-00825840〉

Partager

Métriques

Consultations de la notice

721

Téléchargements de fichiers

304