Human Motion Tracking with a Kinematic Parameterization of Extremal Contours

David Knossow 1 Rémi Ronfard 2, * Radu Horaud 1
* Auteur correspondant
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : This paper addresses the problem of human motion tracking from multiple image sequences. The human body is described by five articulated mechanical chains and human body-parts are described by volumetric primiti ves with curved surfaces. If such a surface is observed with a camera, an extremal contour appears in the image whenever the surface turns smoothly away from the viewer. We describe a method that recovers human motion through a kinematic parameterization of these extremal contours. The method exploits the fact that the observed image motion of these contours is a function of both the rigid displacement of the surface and of the relative position and orientation between the viewer and the curved surface. First, we describe a parameterization of an extremal-contour point velocity for the case of developable surfaces. Second, we use the zero-reference kinematic representation and we derive an explicit formula that links extremal contour velocities to the angular velocities associated with the kinematic model. Third, we show how the chamfer-distance may be used to measure the discrepancy between predicted extremal contours and observed image contours; Moreover we show how the chamfer distance can be used as a differentiable multi-valued function and how the tracker based on this distance can be cast into a continuous non-linear optimization framework. Fourth, we describe implementation issues associated with a practical human-body tracker that may use an arbitrary number of cameras. One great methodological and practical advantage of our method is that it relies neither on model-to-image, nor on image-to-image point matches. In practice we model people with 5 kinematic chains, 19 volumetric primitives, and 54 degrees of freedom; We observe silhouettes in images gathered with several synchronized and calibrated cameras. The tracker has been successfully applied to several complex motions gathered at 30 frames/second.
Type de document :
Article dans une revue
International Journal of Computer Vision, Springer Verlag, 2008, 79 (3), pp.247-269. 〈http://www.springerlink.com/content/b271666024554508/〉. 〈10.1007/s11263-007-0116-2〉
Liste complète des métadonnées

Littérature citée [39 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/inria-00590247
Contributeur : Team Perception <>
Soumis le : mardi 3 mai 2011 - 09:49:41
Dernière modification le : vendredi 24 novembre 2017 - 13:29:11
Document(s) archivé(s) le : jeudi 4 août 2011 - 03:08:22

Identifiants

Citation

David Knossow, Rémi Ronfard, Radu Horaud. Human Motion Tracking with a Kinematic Parameterization of Extremal Contours. International Journal of Computer Vision, Springer Verlag, 2008, 79 (3), pp.247-269. 〈http://www.springerlink.com/content/b271666024554508/〉. 〈10.1007/s11263-007-0116-2〉. 〈inria-00590247〉

Partager

Métriques

Consultations de la notice

650

Téléchargements de fichiers

573