Non-linear CCA and PCA by alignment of local models

Abstract : We propose a non-linear Canonical Correlation Analysis (CCA) method which works by coordinating or aligning mixtures of linear models. In the same way that CCA extends the idea of PCA, our work extends recent methods for non-linear dimensionality reduction to the case where multiple embeddings of the same underlying low dimensional coordinates are observed, each lying on a different high dimensional manifold. We also show that a special case of our method, when applied to only a single manifold, reduces to the Laplacian Eigenmaps algorithm. As with previous alignment schemes, once the mixture models have been estimated, all of the parameters of our model can be estimated in closed form without local optima in the learning. Experimental results illustrate the viability of the approach as a non-linear extension of CCA.
Document type :
Conference papers
Complete list of metadatas

Cited literature [12 references]  Display  Hide  Download


https://hal.inria.fr/inria-00321485
Contributor : Jakob Verbeek <>
Submitted on : Tuesday, April 5, 2011 - 2:54:32 PM
Last modification on : Wednesday, October 10, 2018 - 9:28:02 PM
Long-term archiving on : Wednesday, July 6, 2011 - 2:57:12 AM

Files

verbeek04nips.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00321485, version 2

Citation

Jakob Verbeek, Sam Roweis, Nikos Vlassis. Non-linear CCA and PCA by alignment of local models. Seventeenth Annual Conference on Neural Information Processing Systems (NIPS '03), Dec 2003, Vancouver, Canada. pp.297--304. ⟨inria-00321485v2⟩

Share

Metrics

Record views

286

Files downloads

291