Minimizing the Multi-view Stereo Reprojection Error for Triangular Surface Meshes

Amael Delaunoy 1 Emmanuel Prados 1 Pau Gargallo I Piracés 1 Jean-Philippe Pons 2 Peter Sturm 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 CERTIS - Centre d'Enseignement et de Recherche en Technologies de l'Information et Systèmes
Abstract : This article proposes a variational multi-view stereo vision method based on meshes for recovering 3D scenes (shape and radiance) from images. Our method is based on generative models and minimizes the reprojection error (difference between the observed images and the images synthesized from the reconstruction). Our contributions are twofold. 1) For the first time, we rigorously compute the gradient of the reprojection error for non smooth surfaces defined by discrete triangular meshes. The gradient correctly takes into account the visibility changes that occur when a surface moves; this forces the contours generated by the reconstructed surface to perfectly match with the apparent contours in the input images. 2) We propose an original modification of the Lambertian model to take into account deviations from the constant brightness assumption without explicitly modelling the reflectance properties of the scene or other photometric phenomena involved by the camera model. Our method is thus able to recover the shape and the diffuse radiance of non Lambertian scenes.
Keywords : 3D reconstruction multiview stereo deformable models variational method meshes
Document type :
Conference papers
Complete list of metadatas

Cited literature [23 references]  Display  Hide  Download

mesh-1.png
mesh-1.png
https://hal.inria.fr/inria-00308944
Contributor : Amaël Delaunoy <>
Submitted on : Monday, August 4, 2008 - 4:02:51 PM
Last modification on : Wednesday, April 11, 2018 - 1:59:00 AM
Long-term archiving on: Friday, October 5, 2012 - 11:37:23 AM

Files

delaunoy-prados-etal-BMVC08.pd...
Files produced by the author(s)

Identifiers

Collections

CNRS | INRIA | ENPC | IMAGINE | PARISTECH | LJK_GI_PERCEPTION | LJK_GI | LJK | UGA

Citation

Amael Delaunoy, Emmanuel Prados, Pau Gargallo I Piracés, Jean-Philippe Pons, Peter Sturm. Minimizing the Multi-view Stereo Reprojection Error for Triangular Surface Meshes. BMVC 2008 - British Machine Vision Conference, Sep 2008, Leeds, United Kingdom. pp.1-10, ⟨10.5244/C.22.58⟩. ⟨inria-00308944⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

1440

Files downloads

1006

 

 

Contact

archive-ouverte@inria.fr