On Mean Pose and Variability of 3D Deformable Models

Benjamin Allain 1, * Jean-Sébastien Franco 1 Edmond Boyer 1 Tony Tung 2
* Corresponding author
1 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : We present a novel methodology for the analysis of complex object shapes in motion observed by multiple video cameras. In particular, we propose to learn local surface rigidity probabilities (i.e., deformations), and to estimate a mean pose over a temporal sequence. Local deformations can be used for rigidity-based dynamic surface segmentation, while a mean pose can be used as a sequence keyframe or a cluster prototype and has therefore numerous applications, such as motion synthesis or sequential alignment for compression or morphing. We take advantage of recent advances in surface tracking techniques to formulate a generative model of 3D temporal sequences using a probabilistic framework, which conditions shape fitting over all frames to a simple set of intrinsic surface rigidity properties. Surface tracking and rigidity variable estimation can then be formulated as an Expectation-Maximization inference problem and solved by alternatively minimizing two nested fixed point iterations. We show that this framework provides a new fundamental building block for various applications of shape analysis, and achieves comparable tracking performance to state of the art surface tracking techniques on real datasets, even compared to approaches using strong kinematic priors such as rigid skeletons.
Liste complète des métadonnées

Cited literature [29 references]  Display  Hide  Download

Contributor : Benjamin Allain <>
Submitted on : Thursday, July 2, 2015 - 4:37:13 PM
Last modification on : Wednesday, April 11, 2018 - 1:58:54 AM
Document(s) archivé(s) le : Friday, May 5, 2017 - 1:31:19 PM




Benjamin Allain, Jean-Sébastien Franco, Edmond Boyer, Tony Tung. On Mean Pose and Variability of 3D Deformable Models. ECCV 2014 - European Conference on Computer Vision, Sep 2014, Zurich, Switzerland. pp.284-297, ⟨10.1007/978-3-319-10605-2_19⟩. ⟨hal-01016981⟩



Record views


Files downloads