A sliced inverse regression approach for data stream

Abstract : In this article, we focus on data arriving sequentially by blocks in a stream. A semiparametric regression model involving a common EDR (Effective Dimension Reduction) direction is assumed in each block. Our goal is to estimate this direction at each arrival of a new block. A simple direct approach consists of pooling all the observed blocks and estimating the EDR direction by the SIR (Sliced Inverse Regression) method. But in practice, some disadvantages appear such as the storage of the blocks and the running time for large sample sizes. To overcome these drawbacks, we propose an adaptive SIR estimator of based on the optimization of a quality measure. The corresponding approach is faster both in terms of computational complexity and running time, and provides data storage benefits. The consistency of our estimator is established and its asymptotic distribution is given. An extension to multiple indices model is proposed. A graphical tool is also provided in order to detect changes in the underlying model, i.e., drift in the EDR direction or aberrant blocks in the data stream. A simulation study illustrates the numerical behavior of our estimator. Finally, an application to real data concerning the estimation of physical properties of the Mars surface is presented.
Document type :
Journal articles
Complete list of metadatas

Cited literature [26 references]  Display  Hide  Download

https://hal.inria.fr/hal-01139870
Contributor : Stephane Girard <>
Submitted on : Wednesday, October 9, 2013 - 11:57:23 AM
Last modification on : Tuesday, September 3, 2019 - 1:11:01 AM
Long-term archiving on : Friday, April 7, 2017 - 8:41:01 AM

File

article-SIRdatastream-revision...
Files produced by the author(s)

Identifiers

Citation

Marie Chavent, Stephane Girard, Vanessa Kuentz, Benoit Liquet, Thi Mong Ngoc Nguyen, et al.. A sliced inverse regression approach for data stream. Computational Statistics, Springer Verlag, 2014, 29 (5), pp.1129-1152. ⟨10.1007/s00180-014-0483-4⟩. ⟨hal-01139870v4⟩

Share

Metrics

Record views

1175

Files downloads

936