Scalable Inside-Out Image-Based Rendering

Abstract : Our aim is to give users real-time free-viewpoint rendering of real indoor scenes, captured with off-the-shelf equipment such as a high-quality color camera and a commodity depth sensor. Image-based Rendering (IBR) can provide the realistic imagery required at real-time speed. For indoor scenes however, two challenges are especially prominent. First, the reconstructed 3D geometry must be compact, but faithful enough to respect occlusion relationships when viewed up close. Second, man-made materials call for view-dependent tex-turing, but using too many input photographs reduces performance. We customize a typical RGB-D 3D surface reconstruction pipeline to produce a coarse global 3D surface, and local, per-view geometry for each input image. Our tiled IBR preserves quality by economizing on the expected contributions that entire groups of input pixels make to a final image. The two components are designed to work together, giving real-time performance, while hardly sacrificing quality. Testing on a variety of challenging scenes shows that our inside-out IBR scales favorably with the number of input images.
Type de document :
Article dans une revue
ACM Transactions on Graphics, Association for Computing Machinery, 2016, 35 (6)
Liste complète des métadonnées

Littérature citée [55 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01369382
Contributeur : Team Reves <>
Soumis le : mardi 20 septembre 2016 - 22:43:04
Dernière modification le : lundi 9 avril 2018 - 15:23:37

Fichier

insideout_siggasia_2016_prepri...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01369382, version 1

Collections

Citation

Peter Hedman, Tobias Ritschel, George Drettakis, Gabriel Brostow. Scalable Inside-Out Image-Based Rendering. ACM Transactions on Graphics, Association for Computing Machinery, 2016, 35 (6). 〈hal-01369382〉

Partager

Métriques

Consultations de la notice

159

Téléchargements de fichiers

374