Skip to Main content Skip to Navigation
Conference papers

Adaptive Direct RGB-D Registration and Mapping for Large Motions

Renato Martins 1 Eduardo Fernandez-Moral 1 Patrick Rives 1 
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : Dense direct RGB-D registration methods are widely used in tasks ranging from localization and tracking to 3D scene reconstruction. This work addresses a peculiar aspect which drastically limits the applicability of direct registration, namely the weakness of the convergence domain. First, we propose an activation function based on the conditioning of the RGB and ICP point-to-plane error terms. This function strengthens the geometric error influence in the first coarse iterations, while the intensity data term dominates in the finer increments. The information gathered from the geometric and photometric cost functions is not only considered for improving the system observability, but for exploiting the different convergence properties and convexity of each data term. Next, we develop a set of strategies as a flexible regularization and a pixel saliency selection to further improve the quality and robustness of this approach. The methodology is formulated for a generic warping model and results are given using perspective and spherical sensor models. Finally, our method is validated in different RGB-D spherical datasets, including both indoor and outdoor real sequences and using the KITTI VO/SLAM benchmark dataset. We show that the different proposed techniques (weighted activation function, regularization, saliency pixel selection), lead to faster convergence and larger convergence domains, which are the main limitations to the use of direct methods.
Document type :
Conference papers
Complete list of metadata

Cited literature [32 references]  Display  Hide  Download
Contributor : Eric Marchand Connect in order to contact the contributor
Submitted on : Monday, November 28, 2016 - 10:59:05 AM
Last modification on : Saturday, June 25, 2022 - 7:45:38 PM


Files produced by the author(s)



Renato Martins, Eduardo Fernandez-Moral, Patrick Rives. Adaptive Direct RGB-D Registration and Mapping for Large Motions. Computer Vision – ACCV 2016 13th Asian Conference on Computer Vision, Nov 2016, Taipei, Taiwan. pp.191-206, ⟨10.1007/978-3-319-54190-7_12⟩. ⟨hal-01403953⟩



Record views


Files downloads