Skip to Main content Skip to Navigation
Journal articles

Detecting Specular Reflections and Cast Shadows to Estimate Reflectance and Illumination of Dynamic Indoor Scenes

Salma Jiddi 1, 2 Philippe Robert 1, 3 Eric Marchand 4
4 RAINBOW - Sensor-based and interactive robotics
Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : The goal of Mixed Reality (MR) is to achieve a seamless and realistic blending between real and virtual worlds. This requires the estimation of reflectance properties and lighting characteristics of the real scene. One of the main challenges within this task consists in recovering such properties using a single RGB-D camera. In this paper, we introduce a novel framework to recover both the position and color of multiple light sources as well as the specular reflectance of real scene surfaces. This is achieved by detecting and incorporating information from both specular reflections and cast shadows. Our approach is capable of handling any textured surface and considers both static and dynamic light sources. Its effectiveness is demonstrated through a range of applications including visually-consistent mixed reality scenarios (e.g. correct real specularity removal, coherent shadows in terms of shape and intensity) and retexturing where the texture of the scene is altered whereas the incident lighting is preserved.
Document type :
Journal articles
Complete list of metadata

Cited literature [30 references]  Display  Hide  Download

https://hal.inria.fr/hal-02475059
Contributor : Eric Marchand <>
Submitted on : Tuesday, February 11, 2020 - 5:47:13 PM
Last modification on : Thursday, April 22, 2021 - 9:36:14 AM
Long-term archiving on: : Tuesday, May 12, 2020 - 4:05:18 PM

File

bare_jrnl_compsoc.pdf
Files produced by the author(s)

Identifiers

Citation

Salma Jiddi, Philippe Robert, Eric Marchand. Detecting Specular Reflections and Cast Shadows to Estimate Reflectance and Illumination of Dynamic Indoor Scenes. IEEE Transactions on Visualization and Computer Graphics, Institute of Electrical and Electronics Engineers, 2020, pp.12. ⟨10.1109/TVCG.2020.2976986⟩. ⟨hal-02475059⟩

Share

Metrics

Record views

164

Files downloads

1059