Function selection in mixed models using L1-penalization

Abstract : The penalization of likelihoods by L1–norms has become an established and relatively standard technique for high-dimensional data when the assumed models are based on n independent and identically distributed observations. These techniques may improve prediction accuracy (since regularization leads to variance reduction) together with interpretability (since sparsity identifies a subset of variables with strong effects). Computationally, these penalties are attractive and their theoretical properties have been intensively studied during the last years. Several authors have recently developed suggestions to analyze high-dimensional clustered or longitudinal data using L1–penalization methods in mixed effects models. These approaches are mostly developed for variable selection purposes in linear and generalized linear mixed effects models (LME and GLMM, respectively) and also, but less extensive, in parametric nonlinear mixed effects (NLME) models. Only a few works have considered the problem of selecting nonlinear functions using L1–penalization methods in nonparametric mixed effects models, with additive (GAMM) or nonadditive predictors. Nonlinear functions are approximated by a linear combination of smooth functions (spline, wavelet or Fourier basis functions, for example) possibly combined with more irregular functions (spiky basis functions, for example). The resulting estimator depends only on a relatively small number of variables and/or a relatively small number of basis functions. In this study we review recent advances in function selection in mixed effects models using L1–penalization, focusing on computational strategies. We illustrate the interest of such approaches in the analysis of a twenty–year longitudinal study of training practices of elite athletes. We discuss practical aspects, including the determination of an appropriate collection of basis functions (according to the knowledge of the application field), the estimation of optimal regularization parameter (by different model selection criteria) and the choice of covariance structures.
Liste complète des métadonnées
Contributeur : Marta Avalos <>
Soumis le : jeudi 7 janvier 2016 - 13:43:41
Dernière modification le : vendredi 1 septembre 2017 - 11:24:45


  • HAL Id : hal-01252267, version 1



Perrine Soret, Cristian Meza, Karine Bertin, Marta Avalos, Philippe Hellard. Function selection in mixed models using L1-penalization . XVth Spanish Biometric Conference and the Vth Ibéro-American Biometric Meeting 2015, 2015, Bilbao, Spain. 2015, 〈〉. 〈hal-01252267〉



Consultations de la notice