Multiperspective Stereo Matching and Volumetric Reconstruction

Yuanyuan Ding 1 Jingyi Yu 1 Peter Sturm 2
2 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : Stereo matching and volumetric reconstruction are the most explored 3D scene recovery techniques in computer vision. Many existing approaches assume perspective input images and use the epipolar constraint to reduce the search space and improve the accuracy. In this paper we present a novel framework that uses multi-perspective cameras for stereo matching and volumetric reconstruction. Our approach first decomposes a multi-perspective camera into piecewise primitive General Linear Cameras or GLCs. A pair of GLCs in general do not satisfy the epipolar constraint. However, they still form a nearly stereo pair. We develop a new Graph-Cut-based algorithm to account for the slight vertical parallax using the GLC ray geometry. We show that the recovered pseudo disparity map conveys important depth cues analogous to perspective stereo matching. To more accurately reconstruct a 3D scene, we develop a new multi-perspective volumetric reconstruction method. We discretize the scene into voxels and apply the GLC back-projections to map the voxel onto each input multi-perspective camera. Finally, we apply the graph-cut algorithm to optimize the 3D embedded voxel graph. We demonstrate our algorithms on both synthetic and real multi-perspective cameras. Experimental results show that our methods are robust and reliable.
Type de document :
Communication dans un congrès
ICCV 2009 - 12th IEEE International Conference on Computer Vision, Sep 2009, Kyoto, Japan. IEEE, pp.1827-1834, 2009, 〈10.1109/ICCV.2009.5459406〉
Liste complète des métadonnées

https://hal.inria.fr/inria-00434341
Contributeur : Peter Sturm <>
Soumis le : dimanche 22 novembre 2009 - 23:43:20
Dernière modification le : jeudi 11 janvier 2018 - 06:21:59

Lien texte intégral

Identifiants

Collections

Citation

Yuanyuan Ding, Jingyi Yu, Peter Sturm. Multiperspective Stereo Matching and Volumetric Reconstruction. ICCV 2009 - 12th IEEE International Conference on Computer Vision, Sep 2009, Kyoto, Japan. IEEE, pp.1827-1834, 2009, 〈10.1109/ICCV.2009.5459406〉. 〈inria-00434341〉

Partager

Métriques

Consultations de la notice

181