Skip to Main content Skip to Navigation
Conference papers

Photometric Registration using Specular Reflections and Application to Augmented Reality

Salma Jiddi 1, 2 Philippe Robert 1 Eric Marchand 2
2 RAINBOW - Sensor-based and interactive robotics
Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : Photometric registration consists in blending real and virtual scenes in a visually coherent way. To achieve this goal, both reflectance and illumination properties must be estimated. These estimates are then used, within a rendering pipeline, to virtually simulate the real lighting's interaction with the scene. In this paper, we are interested in indoor scenes where light bounces off of objects with different reflective properties (diffuse and/or specular). In these scenarios, existing solutions often assume distant lighting or limit the analysis to a single specular object. We address scenes with various objects captured by a moving RGB-D camera and estimate the 3D position of light sources. Furthermore, using spatio-temporal data, our algorithm recovers dense diffuse and specular reflectance maps. Finally, using our estimates, we demonstrate photo-realistic augmentations of real scenes (virtual shadows, specular occlusions) as well as virtual spec-ular reflections on real world surfaces.
Document type :
Conference papers
Complete list of metadata

Cited literature [12 references]  Display  Hide  Download

https://hal.inria.fr/hal-01792254
Contributor : Eric Marchand <>
Submitted on : Tuesday, May 15, 2018 - 12:40:22 PM
Last modification on : Friday, July 10, 2020 - 4:01:51 PM
Long-term archiving on: : Tuesday, September 25, 2018 - 12:33:21 AM

File

Photometric Registration using...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01792254, version 1

Citation

Salma Jiddi, Philippe Robert, Eric Marchand. Photometric Registration using Specular Reflections and Application to Augmented Reality. APMAR 2018 - 2nd Asia Pacific Workshop on Mixed and Augmented Reality, Apr 2018, Taipe, Taiwan. pp.1-4. ⟨hal-01792254⟩

Share

Metrics

Record views

367

Files downloads

268