Interactive Virtual Relighting of Real Scenes

Céline Loscos 1 George Drettakis Luc Robert
1 iMAGIS - Models, Algorithms and Geometry for Computer Generated Image Graphics
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes
Abstract : Computer augmented reality (CAR) is a rapidly emerging field which enables users to mix real and virtual worlds. Our goal is to provide interactive tools to perform common illumination, i.e., light interactions between real and virtual objects, including shadows and relighting (real and virtual light source modification). In particular, we concentrate on virtually modifying real light source intensities and inserting virtual sources into a real scene. Real shadows already exist in the textures representing the real world; Thus, when real light sources are, for example, virtually switched off, the shadows they cause must be removed from the textures. Real shadows need to be reprojected using an alternative rendering approach, which will allow the modification of real and virtual light intensities, as well as interactive manipulation of additional virtual objects. To achieve this, we present a three-step method. We first reconstruct a simplifie- d representation of real scene geometry using semi-automatic vision-based techniques. Using the simplified geometry, and adapting recent hierarchical radiosity algorithms, we construct an approximation of real scene light exchanges. We next perform a preprocessing step, based on the radiosity system, which removes shadows from real world textures. Since our goal is to achieve a convincing relighting effect, rather than an accurate solution, we present a heuristic correction process which results in visually plausible renderings. Finally, we perform an interactive process to compute new illumination with modified real and virtual light intensities. Our results show that we are able to interactively relight real scenes, including additional virtual light sources and objects.
Document type :
Reports
Complete list of metadatas

Cited literature [21 references]  Display  Hide  Download


https://hal.inria.fr/inria-00069946
Contributor : Rapport de Recherche Inria <>
Submitted on : Friday, May 19, 2006 - 6:41:14 PM
Last modification on : Monday, May 6, 2019 - 11:18:04 AM
Long-term archiving on : Saturday, April 3, 2010 - 11:26:22 PM

Identifiers

  • HAL Id : inria-00069946, version 1

Collections

Citation

Céline Loscos, George Drettakis, Luc Robert. Interactive Virtual Relighting of Real Scenes. RT-0225, INRIA. 1998, pp.31. ⟨inria-00069946⟩

Share

Metrics

Record views

304

Files downloads

687