28604 articles – 22086 Notices  [english version]

inria-00250078, version 2

PSO Facing Non-Separable and Ill-Conditioned Problems

Nikolaus Hansen (Auteur à contacter de préférence) 1, Raymond Ros () 1, Nikolas Mauny 1, Marc Schoenauer () 1, Anne Auger () 1

N° RR-6447 (2008)

Résumé : This report investigates the behavior of particle swarm optimization (PSO) on ill-conditioned functions. We find that PSO performs very well on separable, ill-conditioned functions. If the function is rotated such that it becomes non-separable, the performance declines dramatically. On non-separable, ill-conditioned functions we find the search costs (number of function evaluations) of PSO increasing roughly proportional with the condition number. We never observe premature convergence, but on non-separable, ill-conditioned problems PSO is outperformed by a contemporary evolution strategy by orders of magnitude. The strong dependency of PSO on rotations originates from random events that are only independent within the given coordinate system. We argue that invariance properties, like rotational invariance, are desirable, because they increase the predictive power of performance results.

  • 1 :  TAO (INRIA Futurs)
  • INRIA – CNRS : UMR8623 – Université Paris XI - Paris Sud
  • Domaine : Informatique/Apprentissage
  • Mots-clés : Particle Swarm Optimization – performance assessment – ill-conditioned problems – non-separable problems – invariance
  • Référence interne : RR-6447
  • Versions disponibles :  v1 (09-02-2008) v2 (11-02-2008)
 
  • inria-00250078, version 2
  • oai:hal.inria.fr:inria-00250078
  • Contributeur : 
  • Soumis le : Lundi 11 Février 2008, 09:56:32
  • Dernière modification le : Dimanche 27 Avril 2008, 14:51:21