A Bayesian Approach to Multi-view 4D Modeling

Chun-Hao Huang 1 Cedric Cagniart 1 Edmond Boyer 2 Slobodan Ilic 1
2 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : This paper considers the problem of automatically recovering temporally consistent animated 3D models of arbitrary shapes in multi-camera setups. An approach is presented that takes as input a sequence of frame-wise reconstructed surfaces and iteratively deforms a reference surface such that it fits the input observations. This approach addresses several issues in this field that include: large frame-to-frame deformations, noise, missing data, outliers and shapes composed of multiple components with arbitrary geometries. The problem is cast as a geometric registration with two major features. First, surface deformations are modeled using mesh decomposition into elements called patches. This strategy ensures robustness by enabling flexible regularization priors through inter-patch rigidity constraints. Second, registration is formulated as a Bayesian estimation that alternates between probabilistic datal-model association and deformation parameter estimation. This accounts for uncertainties in the acquisition process and allows for noise, outliers and missing geometries in the observed meshes. In the case of marker-less 3D human motion capture, this framework can be specialized further with additional articulated motion constraints. Extensive experiments on various 4D datasets show that complex scenes with multiple objects of arbitrary nature can be processed in a robust way. They alsodemonstrate that the framework can capture human motion and provide s visually convincing as well as quantitatively reliable human poses.
Type de document :
Article dans une revue
International Journal of Computer Vision, Springer Verlag, 2016, 116 (2), pp.115-135. <http://www.springer.com/gp/>. <10.1007/s11263-015-0832-y>
Liste complète des métadonnées

Contributeur : Edmond Boyer <>
Soumis le : lundi 5 octobre 2015 - 18:33:26
Dernière modification le : mercredi 15 février 2017 - 23:55:53




Chun-Hao Huang, Cedric Cagniart, Edmond Boyer, Slobodan Ilic. A Bayesian Approach to Multi-view 4D Modeling. International Journal of Computer Vision, Springer Verlag, 2016, 116 (2), pp.115-135. <http://www.springer.com/gp/>. <10.1007/s11263-015-0832-y>. <hal-01211810>



Consultations de la notice