Learning nonlinear image manifolds by global alignment of local linear models

Jakob Verbeek 1
1 LEAR - Learning and recognition in vision
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : Appearance based methods, based on statistical models of the pixels values in an image (region) rather than geometrical object models, are increasingly popular in computer vision. In many applications the number of degrees of freedom (DOF) in the image generating process is much lower than the number of pixels in the image. If there is a smooth function that maps the DOF to the pixel values, then the images are confined to a low dimensional manifold embedded in the image space. We propose a method based on probabilistic mixtures of factor analyzers to (i) model the density of images sampled from such manifolds and (ii) recover global parameterizations of the manifold. A globally non-linear probabilistic two-way mapping between coordinates on the manifold and images is obtained by combining several, locally valid, linear mappings. We propose a parameter estimation scheme that improves upon an existing scheme, and experimentally compare the presented approach to self-organizing maps, generative topographic mapping, and mixtures of factor analyzers. In addition, we show that the approach also applies to find mappings between different embeddings of the same manifold.
Document type :
Journal articles
Complete list of metadatas

Cited literature [51 references]  Display  Hide  Download


https://hal.inria.fr/inria-00321131
Contributor : Jakob Verbeek <>
Submitted on : Friday, April 8, 2011 - 2:22:06 PM
Last modification on : Wednesday, April 11, 2018 - 1:57:38 AM
Long-term archiving on : Thursday, November 8, 2012 - 3:46:11 PM

Files

verbeek05pami_final.pdf
Files produced by the author(s)

Identifiers

Collections

IMAG | INRIA | UGA

Citation

Jakob Verbeek. Learning nonlinear image manifolds by global alignment of local linear models. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2006, 28 (8), pp.1236--1250. ⟨http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1642659⟩. ⟨10.1109/TPAMI.2006.166⟩. ⟨inria-00321131v2⟩

Share

Metrics

Record views

489

Files downloads

690