Learning to Learn for Structured Sparsity - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2014

Learning to Learn for Structured Sparsity

Résumé

Structured sparsity has recently emerged in statistics, machine learning and signal processing as a promising paradigm for learning in high-dimensional settings. A number of methods have been proposed for learning under the assumption of structured sparsity, including group LASSO and graph LASSO. All of these methods rely on prior knowledge on how to weight (equivalently, how to penalize) individual subsets of variables during the subset selection process. However, these weights on groups of variables are in general unknown. Inferring group weights from data is a key open problem in research on structured sparsity. In this paper, we propose a Bayesian approach to the problem of group weight learning. We model the group weights as hyperparameters of heavy-tailed priors on groups of variables and derive an approximate inference scheme to infer these hyperparameters. We empirically show that we are able to recover the model hyperparameters when the data are generated from the model, and moreover, we demonstrate the utility of learning group weights in synthetic and real denoising problems.
Fichier principal
Vignette du fichier
ShervashidzeBach14.1.pdf (545.46 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-00986380 , version 1 (02-05-2014)
hal-00986380 , version 2 (17-10-2014)
hal-00986380 , version 3 (10-03-2015)
hal-00986380 , version 4 (15-09-2015)

Identifiants

  • HAL Id : hal-00986380 , version 1

Citer

Nino Shervashidze, Francis Bach. Learning to Learn for Structured Sparsity. 2014. ⟨hal-00986380v1⟩
807 Consultations
1087 Téléchargements

Partager

Gmail Facebook X LinkedIn More