HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Journal articles

Coupling Active Depth Estimation and Visual Servoing via a Large Projection Operator

Riccardo Spica 1 Paolo Robuffo Giordano 1 François Chaumette 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : The goal of this paper is to propose a coupling between the execution of a Image-Based Visual Servoing (IBVS) task and an active Structure from Motion (SfM) strategy. The core idea is to modify online the camera trajectory in the null-space of the (main) servoing task for rendering the camera motion 'more informative' w.r.t. the estimation of the 3-D structure. Consequently, the SfM convergence rate and accuracy is maximized during the servoing transient. The improved SfM performance also benefits the servoing execution, since a higher accuracy in the 3-D parameters involved in the interaction matrix improves the IBVS convergence by significantly mitigating the negative effects (instability, loss of feature visibility) of a poor knowledge of the scene structure. Active maximization of the SfM performance results, in general, in a deformed camera trajectory w.r.t. what would be obtained with a classical IBVS: therefore, we also propose an adaptive strategy able to automatically activate/deactivate the SfM optimization as a function of the current level of accuracy in the estimated 3-D structure. We finally report a thorough experimental validation of the overall approach under different conditions and case studies. The reported experiments support well the theoretical analysis and clearly show the benefits of the proposed coupling between visual control and active perception.
Document type :
Journal articles
Complete list of metadata

Cited literature [40 references]  Display  Hide  Download

Contributor : Eric Marchand Connect in order to contact the contributor
Submitted on : Monday, August 7, 2017 - 10:25:14 AM
Last modification on : Friday, April 8, 2022 - 4:04:03 PM


Files produced by the author(s)


  • HAL Id : hal-01572366, version 1


Riccardo Spica, Paolo Robuffo Giordano, François Chaumette. Coupling Active Depth Estimation and Visual Servoing via a Large Projection Operator. The International Journal of Robotics Research, SAGE Publications, 2017, 36 (11), pp.1177-1194. ⟨hal-01572366⟩



Record views


Files downloads