| HAL-Inria | Publications, software ... of Inria's scientists |
Conference papers
Sketching for Large-Scale Learning of Mixture Models
Abstract : Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning'' framework where we first sketch the data by computing random generalized moments of the underlying probability distribution, then estimate mixture model parameters from the sketch using an iterative algorithm analogous to greedy sparse signal recovery. We exemplify our framework with the sketched estimation of Gaussian Mixture Models (GMMs). We experimentally show that our approach yields results comparable to the classical Expectation-Maximization (EM) technique while requiring significantly less memory and fewer computations when the number of database elements is large. We report large-scale experiments in speaker verification, where our approach makes it possible to fully exploit a corpus of 1000 hours of speech signal to learn a universal background model at scales computationally inaccessible to EM.
https://hal.inria.fr/hal-01208027
Contributor : Nicolas Keriven <>
Submitted on : Friday, October 23, 2015 - 3:35:41 PM
Last modification on : Wednesday, February 19, 2020 - 6:40:04 PM
Long-term archiving on: : Sunday, January 24, 2016 - 1:45:41 PM
Contributor : Nicolas Keriven <>
Submitted on : Friday, October 23, 2015 - 3:35:41 PM
Last modification on : Wednesday, February 19, 2020 - 6:40:04 PM
Long-term archiving on: : Sunday, January 24, 2016 - 1:45:41 PM
File
paper.pdf
Files produced by the author(s)