Coupling Active Depth Estimation and Visual Servoing via a Large Projection Operator

Riccardo Spica 1 Paolo Robuffo Giordano 1 François Chaumette 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA_D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : The goal of this paper is to propose a coupling between the execution of a Image-Based Visual Servoing (IBVS) task and an active Structure from Motion (SfM) strategy. The core idea is to modify online the camera trajectory in the null-space of the (main) servoing task for rendering the camera motion 'more informative' w.r.t. the estimation of the 3-D structure. Consequently, the SfM convergence rate and accuracy is maximized during the servoing transient. The improved SfM performance also benefits the servoing execution, since a higher accuracy in the 3-D parameters involved in the interaction matrix improves the IBVS convergence by significantly mitigating the negative effects (instability, loss of feature visibility) of a poor knowledge of the scene structure. Active maximization of the SfM performance results, in general, in a deformed camera trajectory w.r.t. what would be obtained with a classical IBVS: therefore, we also propose an adaptive strategy able to automatically activate/deactivate the SfM optimization as a function of the current level of accuracy in the estimated 3-D structure. We finally report a thorough experimental validation of the overall approach under different conditions and case studies. The reported experiments support well the theoretical analysis and clearly show the benefits of the proposed coupling between visual control and active perception.
Type de document :
Article dans une revue
International Journal of Robotics Research, SAGE Publications, 2017, 36 (11), pp.1177-1194
Liste complète des métadonnées

Littérature citée [40 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01572366
Contributeur : Eric Marchand <>
Soumis le : lundi 7 août 2017 - 10:25:14
Dernière modification le : jeudi 26 octobre 2017 - 14:18:04

Fichier

main.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01572366, version 1

Citation

Riccardo Spica, Paolo Robuffo Giordano, François Chaumette. Coupling Active Depth Estimation and Visual Servoing via a Large Projection Operator. International Journal of Robotics Research, SAGE Publications, 2017, 36 (11), pp.1177-1194. 〈hal-01572366〉

Partager

Métriques

Consultations de
la notice

166

Téléchargements du document

49