Skip to Main content Skip to Navigation
Journal articles

A Bayesian Approach to Multi-view 4D Modeling

Chun-Hao Huang 1 Cedric Cagniart 1 Edmond Boyer 2 Slobodan Ilic 1
2 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology, LJK - Laboratoire Jean Kuntzmann
Abstract : This paper considers the problem of automatically recovering temporally consistent animated 3D models of arbitrary shapes in multi-camera setups. An approach is presented that takes as input a sequence of frame-wise reconstructed surfaces and iteratively deforms a reference surface such that it fits the input observations. This approach addresses several issues in this field that include: large frame-to-frame deformations, noise, missing data, outliers and shapes composed of multiple components with arbitrary geometries. The problem is cast as a geometric registration with two major features. First, surface deformations are modeled using mesh decomposition into elements called patches. This strategy ensures robustness by enabling flexible regularization priors through inter-patch rigidity constraints. Second, registration is formulated as a Bayesian estimation that alternates between probabilistic datal-model association and deformation parameter estimation. This accounts for uncertainties in the acquisition process and allows for noise, outliers and missing geometries in the observed meshes. In the case of marker-less 3D human motion capture, this framework can be specialized further with additional articulated motion constraints. Extensive experiments on various 4D datasets show that complex scenes with multiple objects of arbitrary nature can be processed in a robust way. They alsodemonstrate that the framework can capture human motion and provide s visually convincing as well as quantitatively reliable human poses.
Document type :
Journal articles
Complete list of metadata
Contributor : Edmond Boyer Connect in order to contact the contributor
Submitted on : Monday, October 5, 2015 - 6:33:26 PM
Last modification on : Thursday, January 20, 2022 - 4:20:48 PM




Chun-Hao Huang, Cedric Cagniart, Edmond Boyer, Slobodan Ilic. A Bayesian Approach to Multi-view 4D Modeling. International Journal of Computer Vision, Springer Verlag, 2016, 116 (2), pp.115-135. ⟨10.1007/s11263-015-0832-y⟩. ⟨hal-01211810⟩



Les métriques sont temporairement indisponibles