Optimization with First-Order Surrogate Functions - Archive ouverte HAL Access content directly
Conference Papers Year : 2013

Optimization with First-Order Surrogate Functions


In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we make two main contributions. First, we provide a unified viewpoint for several first-order optimization techniques such as accelerated proximal gradient, block coordinate descent, or Frank-Wolfe algorithms. Second, we introduce a new incremental scheme that experimentally matches or outperforms state-of-the-art solvers for large-scale optimization problems typically arising in machine learning.
Fichier principal
Vignette du fichier
main.pdf (650.1 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-00822229 , version 1 (14-05-2013)



Julien Mairal. Optimization with First-Order Surrogate Functions. ICML 2013 - International Conference on Machine Learning, Jun 2013, Atlanta, United States. pp.783-791. ⟨hal-00822229⟩
6421 View
1494 Download



Gmail Facebook Twitter LinkedIn More