Multiperspective Stereo Matching and Volumetric Reconstruction

Yuanyuan Ding 1 Jingyi Yu 1 Peter Sturm 2
2 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : Stereo matching and volumetric reconstruction are the most explored 3D scene recovery techniques in computer vision. Many existing approaches assume perspective input images and use the epipolar constraint to reduce the search space and improve the accuracy. In this paper we present a novel framework that uses multi-perspective cameras for stereo matching and volumetric reconstruction. Our approach first decomposes a multi-perspective camera into piecewise primitive General Linear Cameras or GLCs. A pair of GLCs in general do not satisfy the epipolar constraint. However, they still form a nearly stereo pair. We develop a new Graph-Cut-based algorithm to account for the slight vertical parallax using the GLC ray geometry. We show that the recovered pseudo disparity map conveys important depth cues analogous to perspective stereo matching. To more accurately reconstruct a 3D scene, we develop a new multi-perspective volumetric reconstruction method. We discretize the scene into voxels and apply the GLC back-projections to map the voxel onto each input multi-perspective camera. Finally, we apply the graph-cut algorithm to optimize the 3D embedded voxel graph. We demonstrate our algorithms on both synthetic and real multi-perspective cameras. Experimental results show that our methods are robust and reliable.
Document type :
Conference papers
Complete list of metadatas

https://hal.inria.fr/inria-00434341
Contributor : Peter Sturm <>
Submitted on : Sunday, November 22, 2009 - 11:43:20 PM
Last modification on : Wednesday, April 11, 2018 - 1:57:56 AM

Links full text

Identifiers

Collections

Citation

Yuanyuan Ding, Jingyi Yu, Peter Sturm. Multiperspective Stereo Matching and Volumetric Reconstruction. ICCV 2009 - 12th IEEE International Conference on Computer Vision, Sep 2009, Kyoto, Japan. pp.1827-1834, ⟨10.1109/ICCV.2009.5459406⟩. ⟨inria-00434341⟩

Share

Metrics

Record views

248