Skip to Main content Skip to Navigation
Journal articles

Coupling Active Depth Estimation and Visual Servoing via a Large Projection Operator

Riccardo Spica 1 Paolo Robuffo Giordano 1 François Chaumette 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : The goal of this paper is to propose a coupling between the execution of a Image-Based Visual Servoing (IBVS) task and an active Structure from Motion (SfM) strategy. The core idea is to modify online the camera trajectory in the null-space of the (main) servoing task for rendering the camera motion 'more informative' w.r.t. the estimation of the 3-D structure. Consequently, the SfM convergence rate and accuracy is maximized during the servoing transient. The improved SfM performance also benefits the servoing execution, since a higher accuracy in the 3-D parameters involved in the interaction matrix improves the IBVS convergence by significantly mitigating the negative effects (instability, loss of feature visibility) of a poor knowledge of the scene structure. Active maximization of the SfM performance results, in general, in a deformed camera trajectory w.r.t. what would be obtained with a classical IBVS: therefore, we also propose an adaptive strategy able to automatically activate/deactivate the SfM optimization as a function of the current level of accuracy in the estimated 3-D structure. We finally report a thorough experimental validation of the overall approach under different conditions and case studies. The reported experiments support well the theoretical analysis and clearly show the benefits of the proposed coupling between visual control and active perception.
Document type :
Journal articles
Complete list of metadata

Cited literature [40 references]  Display  Hide  Download

https://hal.inria.fr/hal-01572366
Contributor : Eric Marchand <>
Submitted on : Monday, August 7, 2017 - 10:25:14 AM
Last modification on : Saturday, July 11, 2020 - 3:14:11 AM

File

main.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01572366, version 1

Citation

Riccardo Spica, Paolo Robuffo Giordano, François Chaumette. Coupling Active Depth Estimation and Visual Servoing via a Large Projection Operator. The International Journal of Robotics Research, SAGE Publications, 2017, 36 (11), pp.1177-1194. ⟨hal-01572366⟩

Share

Metrics

Record views

465

Files downloads

557