Skip to Main content Skip to Navigation
Conference papers

Learning Hierarchical and Topographic Dictionaries with Structured Sparsity

Julien Mairal 1, * Rodolphe Jenatton 2, 3 Guillaume Obozinski 2, 3 Francis Bach 2, 3
* Corresponding author
3 SIERRA - Statistical Machine Learning and Parsimony
DI-ENS - Département d'informatique de l'École normale supérieure, Inria Paris-Rocquencourt, CNRS - Centre National de la Recherche Scientifique : UMR8548
Abstract : Recent work in signal processing and statistics have focused on defining new regularization functions, which not only induce sparsity of the solution, but also take into account the structure of the problem. We present in this paper a class of convex penalties introduced in the machine learning community, which take the form of a sum of l_2 and l_infinity-norms over groups of variables. They extend the classical group-sparsity regularization in the sense that the groups possibly overlap, allowing more flexibility in the group design. We review efficient optimization methods to deal with the corresponding inverse problems, and their application to the problem of learning dictionaries of natural image patches: On the one hand, dictionary learning has indeed proven effective for various signal processing tasks. On the other hand, structured sparsity provides a natural framework for modeling dependencies between dictionary elements. We thus consider a structured sparse regularization to learn dictionaries embedded in a particular structure, for instance a tree or a two-dimensional grid. In the latter case, the results we obtain are similar to the dictionaries produced by topographic independent component analysis.
Complete list of metadata

Cited literature [51 references]  Display  Hide  Download

https://hal.inria.fr/inria-00633983
Contributor : Julien Mairal <>
Submitted on : Thursday, October 20, 2011 - 1:37:52 AM
Last modification on : Thursday, July 1, 2021 - 5:58:07 PM
Long-term archiving on: : Saturday, January 21, 2012 - 2:22:09 AM

Files

wavelets.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Julien Mairal, Rodolphe Jenatton, Guillaume Obozinski, Francis Bach. Learning Hierarchical and Topographic Dictionaries with Structured Sparsity. SPIE Wavelets and Sparsity XIV, Aug 2011, San Diego, United States. ⟨10.1117/12.893811⟩. ⟨inria-00633983⟩

Share

Metrics

Record views

552

Files downloads

989