Skip to Main content Skip to Navigation
New interface
Journal articles

Multiple Camera Tracking of Rigid Objects

Frederick Martin 1 Radu Horaud 1 
1 MOVI - Modeling, localization, recognition and interpretation in computer vision
GRAVIR - IMAG - Laboratoire d'informatique GRAphique, VIsion et Robotique de Grenoble, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : In this paper we describe a method for tracking rigid objects using one or several cameras. The tracking process consists of aligning a 3-D model representation of an object with image contours by measuring and minimizing the image error between predicted model points and image contours. The tracker behaves like a visual servo loop where the internal and external camera parameters are updated at each new image acquisition. We study in detail the Jacobian matrix associated with this minimization process in the presence of both point-to-point and point-to-contour matches. We establish the minimal number of matches that are needed as well as the singular configurations leading to a rank-defficient Jacobian matrix. We find a mathematical link between the point-to-point and point-to-contour cases. Based on this link we show that the latter has the same kind of singularities than the former. Moreover, we study multiple camera configurations which optimize the robustness of the method in the presence of single-camera singularities, bad, noisy, or missing data. Extensive experiments done with a complex ship part and with up to three cameras validate the method. In particular we show that the tracker may well be used as a camera calibration procedure.
Document type :
Journal articles
Complete list of metadata
Contributor : Perception team Connect in order to contact the contributor
Submitted on : Tuesday, May 3, 2011 - 9:29:10 AM
Last modification on : Wednesday, May 4, 2022 - 12:12:03 PM
Long-term archiving on: : Thursday, August 4, 2011 - 3:00:52 AM


Files produced by the author(s)




Frederick Martin, Radu Horaud. Multiple Camera Tracking of Rigid Objects. The International Journal of Robotics Research, 2002, 21 (2), pp.97--113. ⟨10.1177/027836402760475324⟩. ⟨inria-00590160⟩



Record views


Files downloads