Conditional Density Estimation by Penalized Likelihood Model Selection and Applications - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2011

Conditional Density Estimation by Penalized Likelihood Model Selection and Applications

Résumé

In this technical report, we consider conditional density estimation with a maximum likelihood approach. Under weak assumptions, we obtain a theoretical bound for a Kullback-Leibler type loss for a single model maximum likelihood estimate. We use a penalized model selection technique to select a best model within a collection. We give a general condition on penalty choice that leads to oracle type inequality for the resulting estimate. This construction is applied to two examples of partition-based conditional density models, models in which the conditional density depends only in a piecewise manner from the covariate. The first example relies on classical piecewise polynomial densities while the second uses Gaussian mixtures with varying mixing proportion but same mixture components. We show how this last case is related to an unsupervised segmentation application that has been the source of our motivation to this study.
Fichier principal
Vignette du fichier
ConditionalDensityPreprint.pdf (726.63 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

inria-00575462 , version 1 (10-03-2011)
inria-00575462 , version 2 (07-04-2011)
inria-00575462 , version 3 (08-08-2011)
inria-00575462 , version 4 (09-12-2011)
inria-00575462 , version 5 (09-07-2012)

Identifiants

  • HAL Id : inria-00575462 , version 5
  • ARXIV : 1103.2021

Citer

Serge X. Cohen, Erwan Le Pennec. Conditional Density Estimation by Penalized Likelihood Model Selection and Applications. [Research Report] RR-7596, Inria Saclay -Île de France. 2011. ⟨inria-00575462v5⟩
315 Consultations
217 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More