hal-00373799, version 1
Statistical properties of Kernel Prinicipal Component Analysis
Laurent Zwald 1Olivier Bousquet 2Gilles Blanchard 3
COLT (2004)
Abstract: The properties of the eigenvalues of Gram matrices are studied in a non-asymptotic setting. Using local Rademacher averages, we provide data-dependent and tight bounds for their convergence towards eigenvalues of the corresponding kernel operator. We perform these computations in a functional analytic framework which allows to deal implicitly with reproducing kernel Hilbert spaces of infinite dimension. This can have applications to various kernel algorithms, such as Support Vector Machines (SVM). We focus on Kernel Principal Component Analysis (KPCA) and, using such techniques, we obtain sharp excess risk bounds for the reconstruction error. In these bounds, the dependence on the decay of the spectrum and on the closeness of successive eigenvalues is made explicit.
- 1: Laboratoire Jean Kuntzmann (LJK)
- CNRS : UMR5224 – Université Joseph Fourier - Grenoble I – Université Pierre Mendès-France - Grenoble II – Institut Polytechnique de Grenoble - Grenoble Institute of Technology
- 2: Max Planck Institute for Biological Cybernetics (MPI)
- Max-Planck-Institut
- 3: Fraunhofer First (IDA)
- Fraunhofer FIRST
- Domain : Statistics/Machine Learning
- hal-00373799, version 1
- http://hal.archives-ouvertes.fr/hal-00373799
- oai:hal.archives-ouvertes.fr:hal-00373799
- From: Laurent Zwald
- Submitted on: Tuesday, 7 April 2009 14:25:26
- Updated on: Tuesday, 7 April 2009 14:49:33






Associated documents

Export