Human Motion Tracking with a Kinematic Parameterization of Extremal Contours

David Knossow 1 Rémi Ronfard 2, * Radu Horaud 1
* Corresponding author
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : This paper addresses the problem of human motion tracking from multiple image sequences. The human body is described by five articulated mechanical chains and human body-parts are described by volumetric primiti ves with curved surfaces. If such a surface is observed with a camera, an extremal contour appears in the image whenever the surface turns smoothly away from the viewer. We describe a method that recovers human motion through a kinematic parameterization of these extremal contours. The method exploits the fact that the observed image motion of these contours is a function of both the rigid displacement of the surface and of the relative position and orientation between the viewer and the curved surface. First, we describe a parameterization of an extremal-contour point velocity for the case of developable surfaces. Second, we use the zero-reference kinematic representation and we derive an explicit formula that links extremal contour velocities to the angular velocities associated with the kinematic model. Third, we show how the chamfer-distance may be used to measure the discrepancy between predicted extremal contours and observed image contours; Moreover we show how the chamfer distance can be used as a differentiable multi-valued function and how the tracker based on this distance can be cast into a continuous non-linear optimization framework. Fourth, we describe implementation issues associated with a practical human-body tracker that may use an arbitrary number of cameras. One great methodological and practical advantage of our method is that it relies neither on model-to-image, nor on image-to-image point matches. In practice we model people with 5 kinematic chains, 19 volumetric primitives, and 54 degrees of freedom; We observe silhouettes in images gathered with several synchronized and calibrated cameras. The tracker has been successfully applied to several complex motions gathered at 30 frames/second.
Document type :
Journal articles
Complete list of metadatas

Cited literature [39 references]  Display  Hide  Download


https://hal.inria.fr/inria-00590247
Contributor : Team Perception <>
Submitted on : Tuesday, May 3, 2011 - 9:49:41 AM
Last modification on : Monday, December 17, 2018 - 11:22:02 AM
Long-term archiving on : Thursday, August 4, 2011 - 3:08:22 AM

Identifiers

Citation

David Knossow, Rémi Ronfard, Radu Horaud. Human Motion Tracking with a Kinematic Parameterization of Extremal Contours. International Journal of Computer Vision, Springer Verlag, 2008, 79 (3), pp.247-269. ⟨10.1007/s11263-007-0116-2⟩. ⟨inria-00590247⟩

Share

Metrics

Record views

1216

Files downloads

856