Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

COCO: Performance Assessment

Nikolaus Hansen 1 Anne Auger 1 Dimo Brockhoff 2 Dejan Tusar 2, 1 Tea Tušar 2
1 TAO - Machine Learning and Optimisation
CNRS - Centre National de la Recherche Scientifique : UMR8623, Inria Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, LRI - Laboratoire de Recherche en Informatique
2 DOLPHIN - Parallel Cooperative Multi-criteria Optimization
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe
Abstract : We present an any-time performance assessment for benchmarking numerical optimization algorithms in a black-box scenario, applied within the COCO benchmarking platform. The performance assessment is based on runtimes measured in number of objective function evaluations to reach one or several quality indicator target values. We argue that runtime is the only available measure with a generic, meaningful, and quantitative interpretation. We discuss the choice of the target values, runlength-based targets, and the aggregation of results by using simulated restarts, averages, and empirical distribution functions.
Complete list of metadatas

https://hal.inria.fr/hal-01315318
Contributor : Nikolaus Hansen <>
Submitted on : Friday, May 13, 2016 - 12:52:37 AM
Last modification on : Tuesday, April 21, 2020 - 1:07:15 AM

Links full text

Identifiers

  • HAL Id : hal-01315318, version 1
  • ARXIV : 1605.03560

Citation

Nikolaus Hansen, Anne Auger, Dimo Brockhoff, Dejan Tusar, Tea Tušar. COCO: Performance Assessment. 2016. ⟨hal-01315318⟩

Share

Metrics

Record views

316