Depth Synthesis and Local Warps for Plausible Image-based Navigation

Abstract : Modern camera calibration and multiview stereo techniques enable users to smoothly navigate between different views of a scene captured using standard cameras. The underlying automatic 3D reconstruction methods work well for buildings and regular structures but often fail on vegetation, vehicles and other complex geometry present in everyday urban scenes. Consequently, missing depth information makes image-based rendering (IBR) for such scenes very challenging. Our goal is to provide plausible free-viewpoint navigation for such datasets. To do this, we introduce a new IBR algorithm that is robust to missing or unreliable geometry, providing plausible novel views even in regions quite far from the input camera positions. We first oversegment the input images, creating superpixels of homogeneous color content which often tends to preserve depth discontinuities. We then introduce a depth-synthesis approach for poorly reconstructed regions based on a graph structure on the oversegmentation and appropriate traversal of the graph. The superpixels augmented with synthesized depth allow us to define a local shape-preserving warp which compensates for inaccurate depth. Our rendering algorithm blends the warped images, and generates plausible image-based novel views for our challenging target scenes. Our results demonstrate novel view synthesis in real time for multiple challenging scenes with significant depth complexity, providing a convincing immersive navigation experience.
Type de document :
Article dans une revue
ACM Transactions on Graphics, Association for Computing Machinery, 2013, 32 (3), 〈10.1145/2487228.2487238〉
Liste complète des métadonnées

Littérature citée [45 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/hal-00907793
Contributeur : Team Reves <>
Soumis le : jeudi 21 novembre 2013 - 17:26:22
Dernière modification le : jeudi 11 janvier 2018 - 16:47:37
Document(s) archivé(s) le : samedi 22 février 2014 - 04:42:42

Fichiers

spixel_warp_preprint.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Gaurav Chaurasia, Sylvain Duchene, Olga Sorkine-Hornung, George Drettakis. Depth Synthesis and Local Warps for Plausible Image-based Navigation. ACM Transactions on Graphics, Association for Computing Machinery, 2013, 32 (3), 〈10.1145/2487228.2487238〉. 〈hal-00907793〉

Partager

Métriques

Consultations de la notice

346

Téléchargements de fichiers

546