Adaptive Direct RGB-D Registration and Mapping for Large Motions

Renato Martins 1 Eduardo Fernandez-Moral 1 Patrick Rives 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : Dense direct RGB-D registration methods are widely used in tasks ranging from localization and tracking to 3D scene reconstruction. This work addresses a peculiar aspect which drastically limits the applicability of direct registration, namely the weakness of the convergence domain. First, we propose an activation function based on the conditioning of the RGB and ICP point-to-plane error terms. This function strengthens the geometric error influence in the first coarse iterations, while the intensity data term dominates in the finer increments. The information gathered from the geometric and photometric cost functions is not only considered for improving the system observability, but for exploiting the different convergence properties and convexity of each data term. Next, we develop a set of strategies as a flexible regularization and a pixel saliency selection to further improve the quality and robustness of this approach. The methodology is formulated for a generic warping model and results are given using perspective and spherical sensor models. Finally, our method is validated in different RGB-D spherical datasets, including both indoor and outdoor real sequences and using the KITTI VO/SLAM benchmark dataset. We show that the different proposed techniques (weighted activation function, regularization, saliency pixel selection), lead to faster convergence and larger convergence domains, which are the main limitations to the use of direct methods.
Type de document :
Communication dans un congrès
Asian Conference on Computer Vision, ACCV 2016, Nov 2016, Taipei, Taiwan
Liste complète des métadonnées

Littérature citée [32 références]  Voir  Masquer  Télécharger
Contributeur : Eric Marchand <>
Soumis le : lundi 28 novembre 2016 - 10:59:05
Dernière modification le : lundi 14 janvier 2019 - 10:15:06


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-01403953, version 1


Renato Martins, Eduardo Fernandez-Moral, Patrick Rives. Adaptive Direct RGB-D Registration and Mapping for Large Motions. Asian Conference on Computer Vision, ACCV 2016, Nov 2016, Taipei, Taiwan. 〈hal-01403953〉



Consultations de la notice


Téléchargements de fichiers