Multiple Camera Tracking of Rigid Objects

Frederick Martin 1 Radu Horaud 1
1 MOVI - Modeling, localization, recognition and interpretation in computer vision
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : In this paper we describe a method for tracking rigid objects using one or several cameras. The tracking process consists of aligning a 3-D model representation of an object with image contours by measuring and minimizing the image error between predicted model points and image contours. The tracker behaves like a visual servo loop where the internal and external camera parameters are updated at each new image acquisition. We study in detail the Jacobian matrix associated with this minimization process in the presence of both point-to-point and point-to-contour matches. We establish the minimal number of matches that are needed as well as the singular configurations leading to a rank-defficient Jacobian matrix. We find a mathematical link between the point-to-point and point-to-contour cases. Based on this link we show that the latter has the same kind of singularities than the former. Moreover, we study multiple camera configurations which optimize the robustness of the method in the presence of single-camera singularities, bad, noisy, or missing data. Extensive experiments done with a complex ship part and with up to three cameras validate the method. In particular we show that the tracker may well be used as a camera calibration procedure.
Document type :
Journal articles
Complete list of metadatas

https://hal.inria.fr/inria-00590160
Contributor : Team Perception <>
Submitted on : Tuesday, May 3, 2011 - 9:29:10 AM
Last modification on : Tuesday, September 3, 2019 - 1:11:03 AM
Long-term archiving on : Thursday, August 4, 2011 - 3:00:52 AM

Files

martinhoraud-ijrr02.pdf
Files produced by the author(s)

Identifiers

Collections

IMAG | INRIA | UGA

Citation

Frederick Martin, Radu Horaud. Multiple Camera Tracking of Rigid Objects. The International Journal of Robotics Research, SAGE Publications, 2002, 21 (2), pp.97--113. ⟨10.1177/027836402760475324⟩. ⟨inria-00590160⟩

Share

Metrics

Record views

207

Files downloads

304