Flexible SVBRDF Capture with a Multi-Image Deep Network - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Computer Graphics Forum Année : 2019

Flexible SVBRDF Capture with a Multi-Image Deep Network

Résumé

Empowered by deep learning, recent methods for material capture can estimate a spatially-varying reflectance from a single photograph. Such lightweight capture is in stark contrast with the tens or hundreds of pictures required by traditional optimization-based approaches. However, a single image is often simply not enough to observe the rich appearance of real-world materials. We present a deep-learning method capable of estimating material appearance from a variable number of uncalibrated and unordered pictures captured with a handheld camera and flash. Thanks to an order-independent fusing layer, this architecture extracts the most useful information from each picture, while benefiting from strong priors learned from data. The method can handle both view and light direction variation without calibration. We show how our method improves its prediction with the number of input pictures, and reaches high quality reconstructions with as little as 1 to 10 images-a sweet spot between existing single-image and complex multi-image approaches.
Fichier principal
Vignette du fichier
multi_inputs_EGSR.pdf (30.5 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02164993 , version 1 (25-06-2019)
hal-02164993 , version 2 (27-06-2019)

Identifiants

Citer

Valentin Deschaintre, Miika Aittala, Frédo Durand, George Drettakis, Adrien Bousseau. Flexible SVBRDF Capture with a Multi-Image Deep Network. Computer Graphics Forum, 2019, 38, ⟨10.1111/cgf.13765⟩. ⟨hal-02164993v2⟩
181 Consultations
72 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More