A Global Surrogate Assisted CMA-ES

Abstract : We explore the arguably simplest way to build an effective surrogate fitness model in continuous search spaces. The model complexity is linear or diagonal-quadratic or full quadratic, depending on the number of available data. The model parameters are computed from the Moore-Penrose pseudoinverse. The model is used as a surrogate fitness for CMA-ES if the rank correlation between true fitness and surrogate value of recently sampled data points is high. Otherwise, further samples from the current population are successively added as data to the model. We empirically compare the IPOP scheme of the new model assisted lq-CMA-ES with a variety of previously proposed methods and with a simple portfolio algorithm using SLSQP and CMA-ES. We conclude that a global quadratic model and a simple portfolio algorithm are viable options to enhance CMA-ES. The model building code is available as part of the pycma Python module on Github and PyPI.
Complete list of metadatas

Cited literature [31 references]  Display  Hide  Download

https://hal.inria.fr/hal-02143961
Contributor : Nikolaus Hansen <>
Submitted on : Wednesday, May 29, 2019 - 4:56:58 PM
Last modification on : Monday, July 22, 2019 - 10:24:25 PM

File

hansen2019global_author_versio...
Files produced by the author(s)

Identifiers

Citation

Nikolaus Hansen. A Global Surrogate Assisted CMA-ES. GECCO 2019 - The 28th Genetic and Evolutionary Computation Conference., ACM, Jul 2019, Prague, Czech Republic. pp.664-672, ⟨10.1145/3321707.3321842⟩. ⟨hal-02143961⟩

Share

Metrics

Record views

147

Files downloads

890