Robust Human Body Shape and Pose Tracking

Chun-Hao Huang 1 Edmond Boyer 2, * Slobodan Ilic 1
* Auteur correspondant
2 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : In this paper we address the problem of markerless human performance capture from multiple camera videos. We consider in particular the recovery of both shape and parametric motion information as often required in applications that produce and manipulate animated 3D contents using multiple videos. To this aim, we propose an approach that jointly estimates skeleton joint positions and surface deformations by fitting a reference surface model to 3D point reconstructions. The approach is based on a probabilistic deformable surface registration framework coupled with a bone binding energy. The former makes soft assignments between the model and the observations while the latter guides the skeleton fitting. The main benefit of this strategy lies in its ability to handle outliers and erroneous observations frequently present in multi view data. For the same purpose, we also introduce a learning based method that partition the point cloud observations into different rigid body parts that further discriminate input data into classes in addition to reducing the complexity of the association between the model and the observations. We argue that such combination of a learning based matching and of a probabilistic fitting framework efficiently handle unreliable observations with fake geometries or missing data and hence, it reduces the need for tedious manual interventions. A thorough evaluation of the method is presented that includes comparisons with related works on most publicly available multi-view datasets.
Type de document :
Communication dans un congrès
3DV - International Conference on 3D Vision - 2013, Jun 2013, Seattle, United States. pp.287-294, 2013, 〈10.1109/3DV.2013.45〉
Liste complète des métadonnées

Littérature citée [19 références]  Voir  Masquer  Télécharger
Contributeur : Edmond Boyer <>
Soumis le : mardi 31 décembre 2013 - 15:40:56
Dernière modification le : mercredi 11 avril 2018 - 01:57:52
Document(s) archivé(s) le : lundi 31 mars 2014 - 22:15:21


Fichiers éditeurs autorisés sur une archive ouverte




Chun-Hao Huang, Edmond Boyer, Slobodan Ilic. Robust Human Body Shape and Pose Tracking. 3DV - International Conference on 3D Vision - 2013, Jun 2013, Seattle, United States. pp.287-294, 2013, 〈10.1109/3DV.2013.45〉. 〈hal-00922934〉



Consultations de la notice


Téléchargements de fichiers