Skip to Main content Skip to Navigation
Conference papers

Plane-Based Multi-View Inpainting for Image-Based Rendering in Large Scenes

Julien Philip 1 George Drettakis 1
1 GRAPHDECO - GRAPHics and DEsign with hEterogeneous COntent
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : Image-Based Rendering (IBR) allows high-fidelity free-viewpoint navigation using only a set of photographs and 3D reconstruction as input. It is often necessary or convenient to remove objects from the captured scenes, allowing a form of scene editing for IBR. This requires multi-view inpainting of the input images. Previous methods suffer from several major limitations: they lack true multi-view coherence, resulting in artifacts such as blur, they do not preserve perspective during inpainting, provide inaccurate depth completion and can only handle scenes with a few tens of images. Our approach addresses these limitations by introducing a new multi-view method that performs inpainting in intermediate, locally common planes. Use of these planes results in correct perspective and multi-view coherence of inpainting results. For efficient treatment of large scenes, we present a fast planar region extraction method operating on small image clusters. We adapt the resolution of inpainting to that required in each input image of the multi-view dataset, and carefully handle image resampling between the input images and rectified planes. We show results on large indoors and outdoors environments.
Document type :
Conference papers
Complete list of metadata

Cited literature [41 references]  Display  Hide  Download

https://hal.inria.fr/hal-01745568
Contributor : Team Reves <>
Submitted on : Wednesday, March 28, 2018 - 2:13:00 PM
Last modification on : Tuesday, December 8, 2020 - 10:09:05 AM
Long-term archiving on: : Thursday, September 13, 2018 - 11:01:14 AM

File

philip2018mvplanarInpaint.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Julien Philip, George Drettakis. Plane-Based Multi-View Inpainting for Image-Based Rendering in Large Scenes. I3D 2018 - ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, May 2018, Montréal, Canada. pp.1-11, ⟨10.1145/3190834.3190846⟩. ⟨hal-01745568⟩

Share

Metrics

Record views

363

Files downloads

1402