Non-negative Spectral Learning for Linear Sequential Systems - Archive ouverte HAL Access content directly
Conference Papers Year :

Non-negative Spectral Learning for Linear Sequential Systems


Method of moments (MoM) has recently become an appealing alternative to standard iterative approaches like Expectation Maximization (EM) to learn latent variable models. In addition, MoM-based algorithms come with global convergence guarantees in the form of finite sample bounds. However, given enough computation time, by using restarts and heuristics to avoid local optima, iterative approaches often achieve better performance. We believe that this performance gap is in part due to the fact that MoM-based algorithms can output negative probabilities. By constraining the search space, we propose a non-negative spectral algorithm (NNSpectral) avoiding computing negative probabilities by design. NNSpectral is compared to other MoM-based algorithms and EM on synthetic problems of the PAutomaC challenge. Not only, NNSpectral outperforms other MoM-based algorithms, but also, achieves very competitive results in comparison to EM.
Fichier principal
Vignette du fichier
ICONIP_2015_HGCEOP.pdf (294.15 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01225838 , version 1 (06-11-2015)


  • HAL Id : hal-01225838 , version 1


Hadrien Glaude, Cyrille Enderli, Olivier Pietquin. Non-negative Spectral Learning for Linear Sequential Systems. 22nd International Conference on Neural Information Processing (ICONIP2015), Nov 2015, Istanbul, Turkey. ⟨hal-01225838⟩
152 View
139 Download


Gmail Facebook Twitter LinkedIn More