Slice inverse regression with score functions

Dmitry Babichev 1, 2 Francis Bach 1, 2
1 SIERRA - Statistical Machine Learning and Parsimony
DI-ENS - Département d'informatique de l'École normale supérieure, CNRS - Centre National de la Recherche Scientifique, Inria de Paris
Abstract : We consider non-linear regression problems where we assume that the response depends non-linearly on a linear projection of the covariates. We propose score function extensions to sliced inverse regression problems, both for the first-order and second-order score functions. We show that they provably improve estimation in the population case over the non-sliced versions and we study finite sample estimators and their consistency given the exact score functions. We also propose to learn the score function as well, in two steps, i.e., first learning the score function and then learning the effective dimension reduction space, or directly, by solving a convex optimization problem regularized by the nuclear norm. We illustrate our results on a series of experiments.
Type de document :
Pré-publication, Document de travail
2016
Liste complète des métadonnées

Littérature citée [28 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01388498
Contributeur : Dmitry Babichev <>
Soumis le : jeudi 27 octobre 2016 - 10:37:08
Dernière modification le : jeudi 26 avril 2018 - 10:29:13

Fichier

Sliced Inverse regression with...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01388498, version 1

Collections

Citation

Dmitry Babichev, Francis Bach. Slice inverse regression with score functions. 2016. 〈hal-01388498〉

Partager

Métriques

Consultations de la notice

282

Téléchargements de fichiers

942