Eigen Appearance Maps of Dynamic Shapes

Adnane Boukhayma 1 Vagia Tsiminaki 1 Jean-Sébastien Franco 1 Edmond Boyer 1
1 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : We address the problem of building efficient appearance representations of shapes observed from multiple viewpoints and in several movements. Multi-view systems now allow the acquisition of spatio-temporal models of such moving objects. While efficient geometric representations for these models have been widely studied, appearance information, as provided by the observed images, is mainly considered on a per frame basis, and no global strategy yet addresses the case where several temporal sequences of a shape are available. We propose a per subject representation that builds on PCA to identify the underlying manifold structure of the appearance information relative to a shape. The resulting eigen representation encodes shape appearance variabilities due to viewpoint and motion, with Eigen textures, and due to local inaccuracies in the geometric model, with Eigen warps. In addition to providing compact representations, such decompositions also allow for appearance interpolation and appearance completion. We evaluate their performances over different characters and with respect to their ability to reproduce compelling appearances in a compact way.
Document type :
Conference papers
Complete list of metadatas

Cited literature [29 references]  Display  Hide  Download


https://hal.inria.fr/hal-01348837
Contributor : Adnane Boukhayma <>
Submitted on : Friday, October 7, 2016 - 11:27:49 PM
Last modification on : Wednesday, April 11, 2018 - 1:58:56 AM
Long-term archiving on : Saturday, February 4, 2017 - 12:14:58 AM

Identifiers

Collections

Citation

Adnane Boukhayma, Vagia Tsiminaki, Jean-Sébastien Franco, Edmond Boyer. Eigen Appearance Maps of Dynamic Shapes. ECCV 2016 - European Conference on Computer Vision, Oct 2016, Amsterdam, Netherlands. pp.230-245, ⟨10.1007/978-3-319-46448-0_14⟩. ⟨hal-01348837⟩

Share

Metrics

Record views

933

Files downloads

1300