Skip to Main content Skip to Navigation
Journal articles

Kinematic sets for real-time robust articulated object tracking

Andrew Comport 1 E. Marchand 1 François Chaumette 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : In this article a new approach is given for real-time visual tracking of a class of articulated non-rigid objects in 3D. The main contribution of this paper consists in symmetrically modeling the motion and velocity of an articulated object via a novel kinematic set approach. This is likened to a Lagrange-d'Alembert formulation in classical physics. The advantages of this new model over pre-existing methods include improved precision, robustness and efficiency, leading to real-time performance. Furthermore, a general class of mechanical joints can be considered and the method can track objects where previous approaches have failed due to a lack of visual information. In summary, a joint configuration is modeled by using Pfaffian velocity constraints. The configuration and location of a joint is then used to build a general Jacobian Matrix which relates individual rigid body velocities(twists) to an underlying minimal subspace. A closed loop control law is then derived in order to minimize a set of distance errors in the image and estimate the system parameters. The tracking is locally based upon efficient distance criterion. Experimental results show prismatic, rotational and helical type links and up to eight general parameters. A statistical M-estimation technique is applied to improve robustness. A monocular camera system was used as a real-time sensor to verify the theory.
Document type :
Journal articles
Complete list of metadata

Cited literature [29 references]  Display  Hide  Download

https://hal.inria.fr/inria-00350642
Contributor : Eric Marchand <>
Submitted on : Wednesday, January 7, 2009 - 2:26:58 PM
Last modification on : Thursday, January 7, 2021 - 4:36:05 PM
Long-term archiving on: : Tuesday, June 8, 2010 - 6:54:18 PM

File

2006_ivc_comport.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00350642, version 1

Citation

Andrew Comport, E. Marchand, François Chaumette. Kinematic sets for real-time robust articulated object tracking. Image and Vision Computing, Elsevier, 2007, 25 (3), pp.374-391. ⟨inria-00350642⟩

Share

Metrics

Record views

700

Files downloads

411