A Comparative Study of Large-scale Variants of CMA-ES

Abstract : The CMA-ES is one of the most powerful stochastic numerical optimizers to address difficult black-box problems. Its intrinsic time and space complexity is quadratic-limiting its applicability with increasing problem dimensionality. To circumvent this limitation, different large-scale variants of CMA-ES with subquadratic complexity have been proposed over the past ten years. To-date however, these variants have been tested and compared only in rather restrictive settings, due to the lack of a comprehensive large-scale testbed to assess their performance. In this context, we introduce a new large-scale testbed with dimension up to 640, implemented within the COCO benchmarking platform. We use this testbed to assess the performance of several promising variants of CMA-ES and the standard limited-memory L-BFGS. In all tested dimensions, the best CMA-ES variant solves more problems than L-BFGS for larger budgets while L-BFGS outperforms the best CMA-ES variant for smaller budgets. However, over all functions, the cumulative runtime distributions between L-BFGS and the best CMA-ES variants are close (less than a factor of 4 in high dimension). Our results illustrate different scaling behaviors of the methods, expose a few defects of the algorithms and reveal that for dimension larger than 80, LM-CMA solves more problems than VkD-CMA while in the cumulative runtime distribution over all functions the VkD-CMA dominates LM-CMA for budgets up to 10 4 times dimension and for all budgets up to dimension 80.
Complete list of metadatas

Cited literature [13 references]  Display  Hide  Download

Contributor : Konstantinos Varelas <>
Submitted on : Wednesday, September 26, 2018 - 12:23:21 AM
Last modification on : Wednesday, May 22, 2019 - 10:10:39 AM
Long-term archiving on : Thursday, December 27, 2018 - 12:33:20 PM


Files produced by the author(s)



Konstantinos Varelas, Anne Auger, Dimo Brockhoff, Nikolaus Hansen, Ouassim Elhara, et al.. A Comparative Study of Large-scale Variants of CMA-ES. PPSN XV 2018 - 15th International Conference on Parallel Problem Solving from Nature, Sep 2018, Coimbra, Portugal. pp.3-15, ⟨10.1007/978-3-319-99253-2_1⟩. ⟨hal-01881454⟩



Record views


Files downloads