Skip to Main content Skip to Navigation
Book sections

Visual Servoing/Tracking Using Central Catadioptric Images

Joao Barreto 1 Frederick Martin 2 Radu Horaud 2
2 MOVI - Modeling, localization, recognition and interpretation in computer vision
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : Visual control of robot motion may benefit from enhanced camera field of view. With traditional cameras the available fields of view are only enough to view a region around the observed object (for eye-in-hand systems) or around the end-effector (for independent-eye systems). Central catadioptric systems have larger fields of view thus allowing the entire robot AND the surrounding objects to be imaged with a unique camera. Therefore, the whole robot's articulated mechanism can be observed and its joints can be tracked and controlled simultaneously. This results in a new visual robot control concept where tracking and control are embedded together. Key to the understanding of both servoing and tracking is the central catadioptric Jacobian matrix linking the robot's joint velocities to image observations. In spite of a more complex projection matrix associated with catadioptric sensors, we study the catadioptric Jacobian matrix and we show that it does not introduce any additional singularity with respect to the traditional pinhole camera model. Experiments showing a rigid body being tracked with a catadioptric camera are described.
Document type :
Book sections
Complete list of metadatas

Cited literature [13 references]  Display  Hide  Download
Contributor : Team Perception <>
Submitted on : Tuesday, May 3, 2011 - 9:29:40 AM
Last modification on : Friday, June 26, 2020 - 4:04:03 PM
Long-term archiving on: : Thursday, August 4, 2011 - 3:01:42 AM


Files produced by the author(s)





Joao Barreto, Frederick Martin, Radu Horaud. Visual Servoing/Tracking Using Central Catadioptric Images. Bruno Siciliano and Paolo Dario. Experimental Robotics VIII, Springer Verlag, pp.245--254, 2003, Springer Tracts in Advanced Robotics, ⟨10.1007/3-540-36268-1_21⟩. ⟨inria-00590167⟩



Record views


Files downloads