Multi-View Intrinsic Images of Outdoors Scenes with an Application to Relighting

Abstract : Inria We introduce a method to compute intrinsic images for a multi-view set of outdoor photos with cast shadows, taken under the same lighting. We use an automatic 3D reconstruction from these photos and the sun direction as input and decompose each image into reflectance and shading layers, despite the inaccuracies and missing data of the 3D model. Our approach is based on two key ideas. First, we progressively improve the accuracy of the parameters of our image formation model by performing iterative estimation and combining 3D lighting simulation with 2D image optimization methods. Second we use the image formation model to express reflectance as a function of discrete visibility values for shadow and light, which allows us to introduce a robust visibility classifier for pairs of points in a scene. This classifier is used for shadow labelling, allowing us to compute high quality reflectance and shading layers. Our multi-view intrinsic decomposition is of sufficient quality to allow relighting of the input images. We create shadow-caster geometry which preserves shadow silhouettes and using the intrinsic layers, we can perform multi-view relighting with moving cast shadows. We present results on several multi-view datasets, and show how it is now possible to perform image-based rendering with changing illumination conditions.
Type de document :
Article dans une revue
ACM Transactions on Graphics, Association for Computing Machinery, 2015, pp.16
Liste complète des métadonnées

Littérature citée [55 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01164841
Contributeur : Team Reves <>
Soumis le : vendredi 30 octobre 2015 - 11:14:07
Dernière modification le : lundi 23 avril 2018 - 13:54:02
Document(s) archivé(s) le : dimanche 31 janvier 2016 - 11:01:07

Identifiants

  • HAL Id : hal-01164841, version 1

Collections

Citation

Sylvain Duchêne, Clement Riant, Gaurav Chaurasia, Jorge Lopez-Moreno, Pierre-Yves Laffont, et al.. Multi-View Intrinsic Images of Outdoors Scenes with an Application to Relighting. ACM Transactions on Graphics, Association for Computing Machinery, 2015, pp.16. 〈hal-01164841〉

Partager

Métriques

Consultations de la notice

749

Téléchargements de fichiers

561