A simpler approach to obtaining an O(1/t) convergence rate for the projected stochastic subgradient method - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2012

A simpler approach to obtaining an O(1/t) convergence rate for the projected stochastic subgradient method

Résumé

In this note, we present a new averaging technique for the projected stochastic subgradient method. By using a weighted average with a weight of t+1 for each iterate w_t at iteration t, we obtain the convergence rate of O(1/t) with both an easy proof and an easy implementation. The new scheme is compared empirically to existing techniques, with similar performance behavior.

Dates et versions

hal-00768187 , version 1 (21-12-2012)

Identifiants

Citer

Simon Lacoste-Julien, Mark Schmidt, Francis Bach. A simpler approach to obtaining an O(1/t) convergence rate for the projected stochastic subgradient method. 2012. ⟨hal-00768187⟩
223 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More