Bayesian View Synthesis and Image-Based Rendering Principles

Sergi Pujades 1, * Frédéric Devernay 1 Bastian Goldluecke 2
* Auteur correspondant
1 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : UMR5217, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble
Abstract : In this paper, we address the problem of synthesizing novel views from a set of input images. State of the art methods, such as the Unstructured Lumigraph, have been using heuristics to combine information from the original views, often using an explicit or implicit approximation of the scene geometry. While the proposed heuristics have been largely explored and proven to work effectively, a Bayesian formulation was recently introduced, formalizing some of the previously proposed heuristics, pointing out which physical phenomena could lie behind each. However, some important heuristics were still not taken into account and lack proper formalization. We contribute a new physics-based generative model and the corresponding Maximum a Posteriori estimate, providing the desired unification between heuristics-based methods and a Bayesian formulation. The key point is to systematically consider the error induced by the uncertainty in the geometric proxy. We provide an extensive discussion, analyzing how the obtained equations explain the heuristics developed in previous methods. Furthermore, we show that our novel Bayesian model significantly improves the quality of novel views, in particular if the scene geometry estimate is inaccurate.
Type de document :
Communication dans un congrès
CVPR - 27th IEEE Conference on Computer Vision and Pattern Recognition, Jun 2014, Columbus, United States. pp.3906 - 3913, 2014, <10.1109/CVPR.2014.499>


https://hal.inria.fr/hal-00983315
Contributeur : Sergi Pujades <>
Soumis le : lundi 9 février 2015 - 10:02:32
Dernière modification le : mercredi 14 décembre 2016 - 01:09:29
Document(s) archivé(s) le : samedi 12 septembre 2015 - 09:45:31

Identifiants

Collections

Citation

Sergi Pujades, Frédéric Devernay, Bastian Goldluecke. Bayesian View Synthesis and Image-Based Rendering Principles. CVPR - 27th IEEE Conference on Computer Vision and Pattern Recognition, Jun 2014, Columbus, United States. pp.3906 - 3913, 2014, <10.1109/CVPR.2014.499>. <hal-00983315>

Partager

Métriques

Consultations de
la notice

439

Téléchargements du document

496