High-Resolution Depth Maps Based on TOF-Stereo Fusion

Vineet Gandhi 1 Jan Cech 1 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : The combination of range sensors with color cameras can be very useful for robot navigation, semantic perception, manipulation, and telepresence. Several methods of combining range- and color-data have been investigated and successfully used in various robotic applications. Most of these systems suffer from the problems of noise in the range-data and resolution mismatch between the range sensor and the color cameras, since the resolution of current range sensors is much less than the resolution of color cameras. High-resolution depth maps can be obtained using stereo matching, but this often fails to construct accurate depth maps of weakly/repetitively textured scenes, or if the scene exhibits complex self-occlusions. Range sensors provide coarse depth information regardless of presence/absence of texture. The use of a calibrated system, composed of a time-of-flight (TOF) camera and of a stereoscopic camera pair, allows data fusion thus overcoming the weaknesses of both individual sensors. We propose a novel TOF-stereo fusion method based on an efficient seed-growing algorithm which uses the TOF data projected onto the stereo image pair as an initial set of correspondences. These initial ''seeds'' are then propagated based on a Bayesian model which combines an image similarity score with rough depth priors computed from the low-resolution range data. The overall result is a dense and accurate depth map at the resolution of the color cameras at hand. We show that the proposed algorithm outperforms 2D image-based stereo algorithms and that the results are of higher resolution than off-the-shelf color-range sensors, e.g., Kinect. Moreover, the algorithm potentially exhibits real-time performance on a single CPU.
Type de document :
Communication dans un congrès
ICRA 2012 - IEEE International Conference on Robotics and Automation, May 2012, Saint-Paul, Minnesota, United States. IEEE, pp.4742-4749, 2012, 〈10.1109/ICRA.2012.6224771〉
Liste complète des métadonnées

Littérature citée [22 références]  Voir  Masquer  Télécharger

Contributeur : Team Perception <>
Soumis le : lundi 27 août 2012 - 15:01:50
Dernière modification le : jeudi 11 janvier 2018 - 06:22:00
Document(s) archivé(s) le : mercredi 28 novembre 2012 - 03:32:08


Fichiers produits par l'(les) auteur(s)




Vineet Gandhi, Jan Cech, Radu Horaud. High-Resolution Depth Maps Based on TOF-Stereo Fusion. ICRA 2012 - IEEE International Conference on Robotics and Automation, May 2012, Saint-Paul, Minnesota, United States. IEEE, pp.4742-4749, 2012, 〈10.1109/ICRA.2012.6224771〉. 〈hal-00725616〉



Consultations de la notice


Téléchargements de fichiers