inria-00590247, version 1
Human Motion Tracking with a Kinematic Parameterization of Extremal Contours
David Knossow
a, 1, 2Remi Ronfard
2, 3Radu Horaud
a, 1, 2
International Journal of Computer Vision 79, 3 (2008) 247--269
Abstract: This paper addresses the problem of human motion tracking from multiple image sequences. The human body is described by five articulated mechanical chains and human body-parts are described by volumetric primiti ves with curved surfaces. If such a surface is observed with a camera, an extremal contour appears in the image whenever the surface turns smoothly away from the viewer. We describe a method that recovers human motion through a kinematic parameterization of these extremal contours. The method exploits the fact that the observed image motion of these contours is a function of both the rigid displacement of the surface and of the relative position and orientation between the viewer and the curved surface. First, we describe a parameterization of an extremal-contour point velocity for the case of developable surfaces. Second, we use the zero-reference kinematic representation and we derive an explicit formula that links extremal contour velocities to the angular velocities associated with the kinematic model. Third, we show how the chamfer-distance may be used to measure the discrepancy between predicted extremal contours and observed image contours; Moreover we show how the chamfer distance can be used as a differentiable multi-valued function and how the tracker based on this distance can be cast into a continuous non-linear optimization framework. Fourth, we describe implementation issues associated with a practical human-body tracker that may use an arbitrary number of cameras. One great methodological and practical advantage of our method is that it relies neither on model-to-image, nor on image-to-image point matches. In practice we model people with 5 kinematic chains, 19 volumetric primitives, and 54 degrees of freedom; We observe silhouettes in images gathered with several synchronized and calibrated cameras. The tracker has been successfully applied to several complex motions gathered at 30 frames/second.
- a – INRIA
- 1: PERCEPTION (INRIA Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann)
- INRIA – Laboratoire Jean Kuntzmann – CNRS : UMR5224 – Université Joseph Fourier - Grenoble I – Institut National Polytechnique de Grenoble (INPG) – Université Pierre Mendès-France - Grenoble II
- 2: Laboratoire Jean Kuntzmann (LJK)
- CNRS : UMR5224 – Université Joseph Fourier - Grenoble I – Université Pierre Mendès-France - Grenoble II – Institut Polytechnique de Grenoble - Grenoble Institute of Technology
- 3: LEAR (INRIA Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann)
- CNRS : FR71 – CNRS : UMR5527 – INRIA – Laboratoire Jean Kuntzmann – Université Joseph Fourier - Grenoble I – Institut National Polytechnique de Grenoble (INPG)
- Domain : Computer Science/Computer Graphics and Virtual Reality
- Keywords : Articulated motion representation – Human-body tracking – Zero-reference kinematics – Developable surfaces – Extremal contours – Chamfer distance – Chamfer matching – Multiple-camera motion capture
- inria-00590247, version 1
- http://hal.inria.fr/inria-00590247
- oai:hal.inria.fr:inria-00590247
- From: Team Perception
- Submitted for:
- Submitted on: Tuesday, 3 May 2011 09:49:41
- Updated on: Friday, 13 May 2011 11:44:28









Associated documents

Export