hal-00601503, version 1
Information-Geometric Optimization Algorithms: A Unifying Picture via Invariance Principles
(2011)
Résumé : We present the information-geometric optimization (IGO) method, which turns any smooth parametric family of probability distributions on an arbitrary search space $X$ into a continuous-time black-box optimization method on $X$. Invariance as a design principle keeps the number of arbitrary choices to a minimum. IGO conducts a natural gradient ascent using an adaptive, time-dependent transformation of the objective function. The cross-entropy method is recovered in a particular case with a large time step. From specific families of distributions on discrete or continuous spaces, IGO naturally recovers versions of known algorithms: CMA-ES for Gaussian distributions, and PBIL for Bernoulli distributions. IGO is invariant under reparametrization of the search space $X$, under a change of parameters of the probability distribution, and under increasing transformation of the function to be optimized. Theoretical considerations suggest that IGO achives minimal diversity loss through optimization. First experiments using restricted Boltzmann machines show that IGO may be able to spontaneously perform multimodal optimization.
- 1 :
- CNRS : UMR8623 – Université Paris XI - Paris Sud
- 2 :
- INRIA – CNRS : UMR8623 – Université Paris XI - Paris Sud
- 3 :
- INRIA – Microsoft – Microsoft Research Laboratory Cambridge
- Domaine : Mathématiques/Optimisation et contrôle
Informatique/Recherche opérationnelle - Mots-clés : Optimization – Fisher information – Natural gradient – CMA-ES – Boltzmann machines
- hal-00601503, version 1
- http://hal.archives-ouvertes.fr/hal-00601503
- oai:hal.archives-ouvertes.fr:hal-00601503
- Contributeur :
- Soumis le : Vendredi 17 Juin 2011, 22:20:52
- Dernière modification le : Dimanche 19 Juin 2011, 08:18:11




Documents associés

Exporter