FAST INCREMENTAL EXPECTATION-MAXIMIZATION ALGORITHM: √ N ITERATIONS FOR AN $\epsilon$-STATIONARY POINT ? - Centre de mathématiques appliquées (CMAP) Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2020

FAST INCREMENTAL EXPECTATION-MAXIMIZATION ALGORITHM: √ N ITERATIONS FOR AN $\epsilon$-STATIONARY POINT ?

Résumé

Fast Incremental Expectation Maximization (FIEM) is an iterative algorithm, based on the Expectation Maximization (EM) algorithm, which was introduced to design EM for the large scale learning framework by avoiding the full data set to be processed at each iteration. In this paper, we first recast this algorithm in the Stochastic Approximation (SA) within EM framework. Then, we provide non asymptotic convergence rates as a function of the batch size n and of the maximal number of iterations Kmax fixed by the user. This allows a complexity analysis: in order to reach an-approximate solution, how does Kmax depend upon n and ?
Fichier principal
Vignette du fichier
PID6384755_versionsoumise.pdf (575.27 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02509621 , version 1 (17-03-2020)
hal-02509621 , version 2 (08-02-2021)

Identifiants

  • HAL Id : hal-02509621 , version 1

Citer

Pierre Gach, Gersende Fort, Eric Moulines. FAST INCREMENTAL EXPECTATION-MAXIMIZATION ALGORITHM: √ N ITERATIONS FOR AN $\epsilon$-STATIONARY POINT ?. 2020. ⟨hal-02509621v1⟩
344 Consultations
427 Téléchargements

Partager

Gmail Facebook X LinkedIn More