Skip to Main content Skip to Navigation
Conference papers

Multiperspective Stereo Matching and Volumetric Reconstruction

Yuanyuan Ding 1 Jingyi Yu 1 Peter Sturm 2
2 PERCEPTION [2007-2015] - Interpretation and Modelling of Images and Videos [2007-2015]
Inria Grenoble - Rhône-Alpes, LJK [2007-2015] - Laboratoire Jean Kuntzmann [2007-2015], Grenoble INP [2007-2019] - Institut polytechnique de Grenoble - Grenoble Institute of Technology [2007-2019]
Abstract : Stereo matching and volumetric reconstruction are the most explored 3D scene recovery techniques in computer vision. Many existing approaches assume perspective input images and use the epipolar constraint to reduce the search space and improve the accuracy. In this paper we present a novel framework that uses multi-perspective cameras for stereo matching and volumetric reconstruction. Our approach first decomposes a multi-perspective camera into piecewise primitive General Linear Cameras or GLCs. A pair of GLCs in general do not satisfy the epipolar constraint. However, they still form a nearly stereo pair. We develop a new Graph-Cut-based algorithm to account for the slight vertical parallax using the GLC ray geometry. We show that the recovered pseudo disparity map conveys important depth cues analogous to perspective stereo matching. To more accurately reconstruct a 3D scene, we develop a new multi-perspective volumetric reconstruction method. We discretize the scene into voxels and apply the GLC back-projections to map the voxel onto each input multi-perspective camera. Finally, we apply the graph-cut algorithm to optimize the 3D embedded voxel graph. We demonstrate our algorithms on both synthetic and real multi-perspective cameras. Experimental results show that our methods are robust and reliable.
Document type :
Conference papers
Complete list of metadatas
Contributor : Peter Sturm <>
Submitted on : Sunday, November 22, 2009 - 11:43:20 PM
Last modification on : Thursday, July 23, 2020 - 10:02:02 AM

Links full text




Yuanyuan Ding, Jingyi Yu, Peter Sturm. Multiperspective Stereo Matching and Volumetric Reconstruction. ICCV 2009 - 12th IEEE International Conference on Computer Vision, Sep 2009, Kyoto, Japan. pp.1827-1834, ⟨10.1109/ICCV.2009.5459406⟩. ⟨inria-00434341⟩