On Mean Pose and Variability of 3D Deformable Models

Benjamin Allain 1, * Jean-Sébastien Franco 1 Edmond Boyer 1 Tony Tung 2
* Auteur correspondant
1 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : We present a novel methodology for the analysis of complex object shapes in motion observed by multiple video cameras. In particular, we propose to learn local surface rigidity probabilities (i.e., deformations), and to estimate a mean pose over a temporal sequence. Local deformations can be used for rigidity-based dynamic surface segmentation, while a mean pose can be used as a sequence keyframe or a cluster prototype and has therefore numerous applications, such as motion synthesis or sequential alignment for compression or morphing. We take advantage of recent advances in surface tracking techniques to formulate a generative model of 3D temporal sequences using a probabilistic framework, which conditions shape fitting over all frames to a simple set of intrinsic surface rigidity properties. Surface tracking and rigidity variable estimation can then be formulated as an Expectation-Maximization inference problem and solved by alternatively minimizing two nested fixed point iterations. We show that this framework provides a new fundamental building block for various applications of shape analysis, and achieves comparable tracking performance to state of the art surface tracking techniques on real datasets, even compared to approaches using strong kinematic priors such as rigid skeletons.
Type de document :
Communication dans un congrès
David Fleet; Tomas Pajdla; Bernt Schiele; Tinne Tuytelaars. ECCV 2014 - European Conference on Computer Vision, Sep 2014, Zurich, Switzerland. Springer, Lecture Notes in Computer Science, 8690, pp.284-297, 2014, Computer Vision – ECCV 2014. 〈10.1007/978-3-319-10605-2_19〉
Liste complète des métadonnées

Littérature citée [29 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/hal-01016981
Contributeur : Benjamin Allain <>
Soumis le : jeudi 2 juillet 2015 - 16:37:13
Dernière modification le : vendredi 24 novembre 2017 - 13:30:28
Document(s) archivé(s) le : vendredi 5 mai 2017 - 13:31:19

Identifiants

Collections

Citation

Benjamin Allain, Jean-Sébastien Franco, Edmond Boyer, Tony Tung. On Mean Pose and Variability of 3D Deformable Models. David Fleet; Tomas Pajdla; Bernt Schiele; Tinne Tuytelaars. ECCV 2014 - European Conference on Computer Vision, Sep 2014, Zurich, Switzerland. Springer, Lecture Notes in Computer Science, 8690, pp.284-297, 2014, Computer Vision – ECCV 2014. 〈10.1007/978-3-319-10605-2_19〉. 〈hal-01016981〉

Partager

Métriques

Consultations de la notice

1225

Téléchargements de fichiers

1807