Non-negative Spectral Learning for Linear Sequential Systems

Abstract : Method of moments (MoM) has recently become an appealing alternative to standard iterative approaches like Expectation Maximization (EM) to learn latent variable models. In addition, MoM-based algorithms come with global convergence guarantees in the form of finite sample bounds. However, given enough computation time, by using restarts and heuristics to avoid local optima, iterative approaches often achieve better performance. We believe that this performance gap is in part due to the fact that MoM-based algorithms can output negative probabilities. By constraining the search space, we propose a non-negative spectral algorithm (NNSpectral) avoiding computing negative probabilities by design. NNSpectral is compared to other MoM-based algorithms and EM on synthetic problems of the PAutomaC challenge. Not only, NNSpectral outperforms other MoM-based algorithms, but also, achieves very competitive results in comparison to EM.
Type de document :
Communication dans un congrès
22nd International Conference on Neural Information Processing (ICONIP2015), Nov 2015, Istanbul, Turkey. 〈http://iconip2015.org/〉
Liste complète des métadonnées

Littérature citée [17 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01225838
Contributeur : Olivier Pietquin <>
Soumis le : vendredi 6 novembre 2015 - 18:26:40
Dernière modification le : mercredi 25 avril 2018 - 15:42:58
Document(s) archivé(s) le : lundi 8 février 2016 - 13:02:10

Fichier

ICONIP_2015_HGCEOP.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01225838, version 1

Collections

Citation

Hadrien Glaude, Cyrille Enderli, Olivier Pietquin. Non-negative Spectral Learning for Linear Sequential Systems. 22nd International Conference on Neural Information Processing (ICONIP2015), Nov 2015, Istanbul, Turkey. 〈http://iconip2015.org/〉. 〈hal-01225838〉

Partager

Métriques

Consultations de la notice

198

Téléchargements de fichiers

137