Collaborative Sliced Inverse Regression

Abstract : Sliced Inverse Regression (SIR) is an effective method for dimensionality reduction in high-dimensional regression problems. However, the method has requirements on the distribution of the predictors that are hard to check since they depend on unobserved variables. It has been shown that, if the distribution of the predictors is elliptical, then these requirements are satisfied. In case of mixture models, the ellipticity is violated and in addition there is no assurance of a single underlying regression model among the different components. Our approach clusterizes the predictors space to force the condition to hold on each cluster and includes a merging technique to look for different underlying models in the data. A study on simulated data as well as two real applications are provided. It appears that SIR, unsurprisingly, is not capable of dealing with a mixture of Gaussians involving different underlying models whereas our approach is able to correctly investigate the mixture.
Document type :
Journal articles
Complete list of metadatas

Cited literature [29 references]  Display  Hide  Download

https://hal.inria.fr/hal-01158061
Contributor : Stephane Girard <>
Submitted on : Tuesday, October 13, 2015 - 3:42:48 PM
Last modification on : Monday, July 8, 2019 - 4:56:07 PM
Long-term archiving on : Thursday, April 27, 2017 - 12:12:35 AM

File

CollaborativeSIR4.pdf
Files produced by the author(s)

Identifiers

Citation

Alessandro Chiancone, Stephane Girard, Jocelyn Chanussot. Collaborative Sliced Inverse Regression. Communication in Statistics - Theory and Methods, Taylor & Francis, 2017, 46 (12), pp.6035--6053. ⟨10.1080/03610926.2015.1116578⟩. ⟨hal-01158061v2⟩

Share

Metrics

Record views

825

Files downloads

522