Skip to Main content Skip to Navigation
Conference papers

Optimization with First-Order Surrogate Functions

Julien Mairal 1, *
* Corresponding author
1 LEAR - Learning and recognition in vision
Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology, LJK - Laboratoire Jean Kuntzmann, Inria Grenoble - Rhône-Alpes
Abstract : In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we make two main contributions. First, we provide a unified viewpoint for several first-order optimization techniques such as accelerated proximal gradient, block coordinate descent, or Frank-Wolfe algorithms. Second, we introduce a new incremental scheme that experimentally matches or outperforms state-of-the-art solvers for large-scale optimization problems typically arising in machine learning.
Complete list of metadatas
Contributor : Julien Mairal <>
Submitted on : Tuesday, May 14, 2013 - 12:28:06 PM
Last modification on : Thursday, November 19, 2020 - 1:00:21 PM
Long-term archiving on: : Thursday, August 15, 2013 - 4:15:18 AM


Files produced by the author(s)


  • HAL Id : hal-00822229, version 1
  • ARXIV : 1305.3120



Julien Mairal. Optimization with First-Order Surrogate Functions. ICML 2013 - International Conference on Machine Learning, Jun 2013, Atlanta, United States. pp.783-791. ⟨hal-00822229⟩



Record views


Files downloads