inria-00321482, version 2
Accelerated greedy mixture learning
Jan Nunnink a, 1Jakob Verbeek
1Nikos Vlassis
1
Benelearn: Annual Machine Learning Conference of Belgium and the Netherlands (2004)
Résumé : Mixture probability densities are popular models that are used in several data mining and machine learning applications, e.g., clustering. A standard algorithm for learning such models from data is the Expectation-Maximization (EM) algorithm. However, EM can be slow with large datasets, and therefore approximation techniques are needed. In this paper we propose a variational approximation to the greedy EM algorithm which oers speedups that are at least linear in the number of data points. Moreover, by strictly increasing a lower bound on the data log-likelihood in every learning step, our algorithm guarantees convergence. We demonstrate the proposed algorithm on a synthetic experiment where satisfactory results are obtained.
- a – Universiteit van Amsterdam
- 1 : Instituut voor Informatica (IvI)
- Universiteit van Amsterdam
- Domaine : Informatique/Apprentissage
- Versions disponibles : v1 (03-02-2011) v2 (05-04-2011)
- inria-00321482, version 2
- http://hal.inria.fr/inria-00321482
- oai:hal.inria.fr:inria-00321482
- Contributeur : Jakob Verbeek
- Soumis le : Mardi 5 Avril 2011, 14:55:51
- Dernière modification le : Mardi 5 Avril 2011, 15:38:28







Documents associés
Exporter