# Structured Variable Selection with Sparsity-Inducing Norms

1 SIERRA - Statistical Machine Learning and Parsimony
DI-ENS - Département d'informatique de l'École normale supérieure, ENS Paris - École normale supérieure - Paris, Inria Paris-Rocquencourt, CNRS - Centre National de la Recherche Scientifique : UMR8548
2 IMAGINE [Marne-la-Vallée]
LIGM - Laboratoire d'Informatique Gaspard-Monge, CSTB - Centre Scientifique et Technique du Bâtiment, ENPC - École des Ponts ParisTech
Abstract : We consider the empirical risk minimization problem for linear supervised learning, with regularization by structured sparsity-inducing norms. These are defined as sums of Euclidean norms on certain subsets of variables, extending the usual $\ell_1$-norm and the group $\ell_1$-norm by allowing the subsets to overlap. This leads to a specific set of allowed nonzero patterns for the solutions of such problems. We first explore the relationship between the groups defining the norm and the resulting nonzero patterns, providing both forward and backward algorithms to go back and forth from groups to patterns. This allows the design of norms adapted to specific prior knowledge expressed in terms of nonzero patterns. We also present an efficient active set algorithm, and analyze the consistency of variable selection for least-squares linear regression in low and high-dimensional settings.
Keywords :
Type de document :
Article dans une revue
Journal of Machine Learning Research, Journal of Machine Learning Research, 2011, 12, pp.2777-2824
Liste complète des métadonnées

Littérature citée [50 références]

https://hal.inria.fr/inria-00377732
Contributeur : Rodolphe Jenatton <>
Soumis le : lundi 29 mars 2010 - 19:16:07
Dernière modification le : jeudi 31 mai 2018 - 01:04:43
Document(s) archivé(s) le : jeudi 23 septembre 2010 - 18:10:13

### Fichiers

StructuredSparsityInducingNorm...
Fichiers produits par l'(les) auteur(s)

### Identifiants

• HAL Id : inria-00377732, version 3
• ARXIV : 0904.3523

### Citation

Rodolphe Jenatton, Jean-Yves Audibert, Francis Bach. Structured Variable Selection with Sparsity-Inducing Norms. Journal of Machine Learning Research, Journal of Machine Learning Research, 2011, 12, pp.2777-2824. 〈inria-00377732v3〉

### Métriques

Consultations de la notice

## 642

Téléchargements de fichiers