3-D Reconstruction of Shaded Objects from Multiple Images Under Unknown Illumination

Hailin Jin 1 Daniel Cremers 2 Dejun Wang 3 Emmanuel Prados 4 Anthony Yezzi 5 Stefano Soatto 3
1 Adobe Advanced Technology Labs - Adobe Systems Inc.
2 Computer vision group [Bonn]
3 UCLA-CS - Computer Science Department [UCLA]
4 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
5 UMI2958 - Georgia Tech - CNRS [Metz]
Abstract : We propose a variational algorithm to jointly estimate the shape, albedo, and light configuration of a Lambertian scene from a collection of images taken from different vantage points. Our work can be thought of as extending classical multi-view stereo to cases where point correspondence cannot be established, or extending classical shape from shading to the case of multiple views with unknown light sources. We show that a first naive formalization of this problem yields algorithms that are numerically unstable, no matter how close the initialization is to the true geometry. We then propose a computational scheme to overcome this problem, resulting in provably stable algorithms that converge to (local) minima of the cost functional. We develop a new model that explicitly enforces positivity in the light sources with the assumption that the object is Lambertian and its albedo is piecewise constant and show that the new model significantly improves the accuracy and robustness relative to existing approaches.
Keywords : Stereoscopic segmentation Shape from shading Multi-view stereo Variational 3D reconstruction Level set methods Lighting and appearance reconstruction
Document type :
Journal articles
Complete list of metadatas

Cited literature [40 references]  Display  Hide  Download

img.jpg
img.jpg
https://hal.inria.fr/inria-00260433
Contributor : Emmanuel Prados <>
Submitted on : Tuesday, March 4, 2008 - 11:08:32 AM
Last modification on : Wednesday, August 7, 2019 - 12:14:40 PM
Long-term archiving on : Friday, September 28, 2012 - 10:35:35 AM

Files

Jin-Wang-Cremers-Prados-Yezzi-...
Files produced by the author(s)

Identifiers

Collections

INRIA | UNIV-FCOMTE | SUPELEC | LJK_GI_PERCEPTION | UGA | LJK | LJK_GI | UMI-GTL

Citation

Hailin Jin, Daniel Cremers, Dejun Wang, Emmanuel Prados, Anthony Yezzi, et al.. 3-D Reconstruction of Shaded Objects from Multiple Images Under Unknown Illumination. International Journal of Computer Vision, Springer Verlag, 2008, 76 (3), pp.245-256. ⟨10.1007/s11263-007-0055-y⟩. ⟨inria-00260433⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

840

Files downloads

713

Contact


archive-ouverte@inria.fr