Learning step sizes for unfolded sparse coding - Archive ouverte HAL Access content directly
Conference Papers Year :

Learning step sizes for unfolded sparse coding

(1) , (1) , (1) , (1)
1

Abstract

Sparse coding is typically solved by iterative optimization techniques, such as the Iterative Shrinkage-Thresholding Algorithm (ISTA). Unfolding and learning weights of ISTA using neural networks is a practical way to accelerate estimation. In this paper, we study the selection of adapted step sizes for ISTA. We show that a simple step size strategy can improve the convergence rate of ISTA by leveraging the sparsity of the iterates. However, it is impractical in most large-scale applications. Therefore, we propose a network architecture where only the step sizes of ISTA are learned. We demonstrate that for a large class of unfolded algorithms, if the algorithm converges to the solution of the Lasso, its last layers correspond to ISTA with learned step sizes. Experiments show that our method is competitive with state-of-the-art networks when the solutions are sparse enough.
Fichier principal
Vignette du fichier
main.pdf (1.92 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02140383 , version 1 (27-05-2019)

Identifiers

  • HAL Id : hal-02140383 , version 1

Cite

Pierre Ablin, Thomas Moreau, Mathurin Massias, Alexandre Gramfort. Learning step sizes for unfolded sparse coding. NeurIPS 2019 - Advances in Neural Information Processing Systems, Dec 2019, Vancouver, Canada. ⟨hal-02140383⟩
312 View
479 Download

Share

Gmail Facebook Twitter LinkedIn More