Structured Variable Selection with Sparsity-Inducing Norms - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2009

Structured Variable Selection with Sparsity-Inducing Norms

Résumé

We consider the empirical risk minimization problem for linear supervised learning, with regularization by structured sparsity-inducing norms. These are defined as sums of Euclidean norms on certain subsets of variables, extending the usual $\ell_1$-norm and the group $\ell_1$-norm by allowing the subsets to overlap. This leads to a specific set of allowed nonzero patterns for the solutions of such problems. We first explore the relationship between the groups defining the norm and the resulting nonzero patterns, providing both forward and backward algorithms to go back and forth from groups to patterns. This allows the design of norms adapted to specific prior knowledge expressed in terms of nonzero patterns. We also present an efficient active set algorithm, and analyze the consistency of variable selection for least-squares linear regression in low and high-dimensional settings.
Fichier principal
Vignette du fichier
StructuredSparsityInducingNorms_HAL.pdf (365.18 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

inria-00377732 , version 1 (22-04-2009)
inria-00377732 , version 2 (16-09-2009)
inria-00377732 , version 3 (29-03-2010)

Identifiants

  • HAL Id : inria-00377732 , version 2
  • ARXIV : 0904.3523

Citer

Rodolphe Jenatton, Jean-Yves Audibert, Francis Bach. Structured Variable Selection with Sparsity-Inducing Norms. [Research Report] 2009, pp.40. ⟨inria-00377732v2⟩

Collections

IMAGINE
528 Consultations
453 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More