Human Motion Tracking with a Kinematic Parameterization of Extremal Contours - Archive ouverte HAL Access content directly
Journal Articles International Journal of Computer Vision Year : 2008

Human Motion Tracking with a Kinematic Parameterization of Extremal Contours

Abstract

This paper addresses the problem of human motion tracking from multiple image sequences. The human body is described by five articulated mechanical chains and human body-parts are described by volumetric primiti ves with curved surfaces. If such a surface is observed with a camera, an extremal contour appears in the image whenever the surface turns smoothly away from the viewer. We describe a method that recovers human motion through a kinematic parameterization of these extremal contours. The method exploits the fact that the observed image motion of these contours is a function of both the rigid displacement of the surface and of the relative position and orientation between the viewer and the curved surface. First, we describe a parameterization of an extremal-contour point velocity for the case of developable surfaces. Second, we use the zero-reference kinematic representation and we derive an explicit formula that links extremal contour velocities to the angular velocities associated with the kinematic model. Third, we show how the chamfer-distance may be used to measure the discrepancy between predicted extremal contours and observed image contours; Moreover we show how the chamfer distance can be used as a differentiable multi-valued function and how the tracker based on this distance can be cast into a continuous non-linear optimization framework. Fourth, we describe implementation issues associated with a practical human-body tracker that may use an arbitrary number of cameras. One great methodological and practical advantage of our method is that it relies neither on model-to-image, nor on image-to-image point matches. In practice we model people with 5 kinematic chains, 19 volumetric primitives, and 54 degrees of freedom; We observe silhouettes in images gathered with several synchronized and calibrated cameras. The tracker has been successfully applied to several complex motions gathered at 30 frames/second.
Vignette du fichier
FC-3D-100-C.png (17.35 Ko) Télécharger le fichier Fichier principal
Vignette du fichier
KnossowRonfardHoraud-IJCV08.pdf (1.85 Mo) Télécharger le fichier
crawl.avi (1.99 Mo) Télécharger le fichier
Vignette du fichier
FC-Actor-100-C.png (88.96 Ko) Télécharger le fichier
Vignette du fichier
FC-Orig-100-I.png (138.27 Ko) Télécharger le fichier
taekwondo.avi (721.11 Ko) Télécharger le fichier
Format : Figure, Image
Origin : Files produced by the author(s)
Format : Other
Format : Figure, Image
Format : Figure, Image
Format : Other
Loading...

Dates and versions

inria-00590247 , version 1 (03-05-2011)

Identifiers

Cite

David Knossow, Rémi Ronfard, Radu Horaud. Human Motion Tracking with a Kinematic Parameterization of Extremal Contours. International Journal of Computer Vision, 2008, 79 (3), pp.247-269. ⟨10.1007/s11263-007-0116-2⟩. ⟨inria-00590247⟩
674 View
457 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More