A Bug in the Multiobjective Optimizer IBEA: Salutary Lessons for Code Release and a Performance Re-Assessment

Dimo Brockhoff 1, *
* Auteur correspondant
1 DOLPHIN - Parallel Cooperative Multi-criteria Optimization
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
Abstract : The Indicator-Based Evolutionary Algorithm (IBEA) is one of the first indicator-based multiobjective optimization algorithms and due to its wide availability in several algorithm packages is often used as a reference algorithm when benchmarking multiobjective optimizers. The original publication on IBEA proposes to use two specific variants: one based on the ε-indicator and one based on the hypervolume. Several experimental studies concluded that, surprisingly, the IBEA variant with the ε-indicator performs better than the one with the hypervolume—even if the (unary) hypervolume indicator itself is the quality measure used in the performance assessment. Recently, a small bug has been found in the hypervolume variant of IBEA with large implications on its performance. Here, we not only explain the bug in detail and correct it, but also present the (improved) results of the corrected version. Moreover, and probably even more important for the scientific community, we point out that this bug has been transferred to other than the original software package, discuss how this obscured the bug, and argue in favor of some simple, even obvious guidelines how the optimization community should deal with algorithm source codes, documentation, and the (natural) existence of bugs in the future.
Type de document :
Communication dans un congrès
Evolutionary Multi-Criterion Optimization, Mar 2015, Guimarães, Portugal. 9018, pp.187-201, 2015, Lecture Notes in Computer Science. 〈10.1007/978-3-319-15934-8_13〉
Liste complète des métadonnées

Littérature citée [12 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01161943
Contributeur : Dimo Brockhoff <>
Soumis le : mardi 9 juin 2015 - 14:26:51
Dernière modification le : mardi 3 juillet 2018 - 11:42:45
Document(s) archivé(s) le : mardi 15 septembre 2015 - 13:41:33

Fichier

ibeabug-authorversion.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Dimo Brockhoff. A Bug in the Multiobjective Optimizer IBEA: Salutary Lessons for Code Release and a Performance Re-Assessment. Evolutionary Multi-Criterion Optimization, Mar 2015, Guimarães, Portugal. 9018, pp.187-201, 2015, Lecture Notes in Computer Science. 〈10.1007/978-3-319-15934-8_13〉. 〈hal-01161943〉

Partager

Métriques

Consultations de la notice

264

Téléchargements de fichiers

163