Skip to Main content Skip to Navigation
Reports

Rich Intrinsic Image Separation for Multi-View Outdoor Scenes

Pierre-yves Laffont 1, * Adrien Bousseau 1 George Drettakis 1 
* Corresponding author
1 REVES - Rendering and virtual environments with sound
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : Intrinsic images aim at separating an image into its reflectance and illumination components to facilitate further analysis or manipulation. This separation is severely ill-posed and the most successful methods rely on user indications or precise geometry to resolve the ambiguities inherent to this problem. In this paper we propose a method to estimate intrinsic images from multiple views of an outdoor scene without the need for precise geometry or involved user intervention. We use multiview stereo to automatically reconstruct a 3D point cloud of the scene. Although this point cloud is sparse and incomplete, we show that it provides the necessary information to compute plausible sky and indirect illumination at each 3D point. We then introduce an optimization method to estimate sun visibility over the point cloud. This algorithm compensates for the lack of accurate geometry and allows the extraction of precise shadows in the final image. We finally propagate the information computed over the sparse point cloud to every pixel in the photograph using image-guided propagation. Our propagation not only separates reflectance from illumination, but also decomposes the illumination into a sun, sky and indirect layer. This rich decomposition allows novel image manipulations as demonstrated by our results.
Document type :
Reports
Complete list of metadata

Cited literature [41 references]  Display  Hide  Download

https://hal.inria.fr/hal-00654202
Contributor : Adrien Bousseau Connect in order to contact the contributor
Submitted on : Wednesday, December 21, 2011 - 10:51:17 AM
Last modification on : Thursday, January 20, 2022 - 4:12:20 PM
Long-term archiving on: : Thursday, March 22, 2012 - 2:25:23 AM

File

rr-7851.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00654202, version 1

Collections

Citation

Pierre-yves Laffont, Adrien Bousseau, George Drettakis. Rich Intrinsic Image Separation for Multi-View Outdoor Scenes. [Research Report] RR-7851, INRIA. 2011, pp.28. ⟨hal-00654202⟩

Share

Metrics

Record views

343

Files downloads

1700