Gaussian Regularized Sliced Inverse Regression

Caroline Bernard-Michel 1 Laurent Gardes 1 Stephane Girard 1
1 MISTIS - Modelling and Inference of Complex and Structured Stochastic Systems
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : Sliced Inverse Regression (SIR) is an effective method for dimension reduction in high-dimensional regression problems. The original method, however, requires the inversion of the predictors covariance matrix. In case of collinearity between these predictors or small sample sizes compared to the dimension, the inversion is not possible and a regularization technique has to be used. Our approach is based on a Fisher Lecture given by R.D. Cook where it is shown that SIR axes can be interpreted as solutions of an inverse regression problem. In this paper, a Gaussian prior distribution is introduced on the unknown parameters of the inverse regression problem in order to regularize their estimation. We show that some existing SIR regularizations can enter our framework, which permits a global understanding of these methods. Three new priors are proposed leading to new regularizations of the SIR method. A comparison on simulated data is provided.
Document type :
Journal articles
Statistics and Computing, Springer Verlag (Germany), 2009, 19 (1), pp.85-98. 〈10.1007/s11222-008-9073-z〉
Liste complète des métadonnées

Cited literature [33 references]  Display  Hide  Download

https://hal.inria.fr/inria-00180458
Contributor : Stephane Girard <>
Submitted on : Tuesday, April 23, 2013 - 10:44:25 AM
Last modification on : Saturday, November 18, 2017 - 1:09:49 AM
Document(s) archivé(s) le : Thursday, July 25, 2013 - 11:28:43 AM

File

sir_regul5.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Caroline Bernard-Michel, Laurent Gardes, Stephane Girard. Gaussian Regularized Sliced Inverse Regression. Statistics and Computing, Springer Verlag (Germany), 2009, 19 (1), pp.85-98. 〈10.1007/s11222-008-9073-z〉. 〈inria-00180458v3〉

Share

Metrics

Record views

295

Files downloads

162