Online Tracking of Outdoor Lighting Variations for Augmented Reality with Moving Cameras

Yanli Liu 1, 2, * Xavier Granier 3, 4, 1
* Corresponding author
1 MANAO - Melting the frontiers between Light, Shape and Matter
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, LP2N - Laboratoire Photonique, Numérique et Nanosciences
Abstract : In augmented reality, one of key tasks to achieve a convincing visual appearance consistency between virtual objects and video scenes is to have a coherent illumination along the whole sequence. As outdoor illumination is largely dependent on the weather, the lighting condition may change from frame to frame. In this paper, we propose a full image-based approach for online tracking of outdoor illumination variations from videos captured with moving cameras. Our key idea is to estimate the relative intensities of sunlight and skylight via a sparse set of planar feature-points extracted from each frame. To address the inevitable feature misalignments, a set of constraints are introduced to select the most reliable ones. Exploiting the spatial and temporal coherence of illumination, the relative intensities of sunlight and skylight are finally estimated by using an optimization process. We validate our technique on a set of real-life videos and show that the results with our estimations are visually coherent along the video sequences.
Complete list of metadatas

Cited literature [33 references]  Display  Hide  Download


https://hal.inria.fr/hal-00664943
Contributor : Xavier Granier <>
Submitted on : Wednesday, March 7, 2012 - 6:07:03 PM
Last modification on : Thursday, July 4, 2019 - 4:02:33 PM
Long-term archiving on : Friday, November 23, 2012 - 4:00:40 PM

Identifiers

Citation

Yanli Liu, Xavier Granier. Online Tracking of Outdoor Lighting Variations for Augmented Reality with Moving Cameras. IEEE Transactions on Visualization and Computer Graphics, Institute of Electrical and Electronics Engineers, 2012, 18 (4), pp.573-580. ⟨10.1109/TVCG.2012.53⟩. ⟨hal-00664943⟩

Share

Metrics

Record views

1137

Files downloads

1941