Skip to Main content Skip to Navigation
New interface
Conference papers

Plane-Based Multi-View Inpainting for Image-Based Rendering in Large Scenes

Julien Philip 1 George Drettakis 1 
1 GRAPHDECO - GRAPHics and DEsign with hEterogeneous COntent
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : Image-Based Rendering (IBR) allows high-fidelity free-viewpoint navigation using only a set of photographs and 3D reconstruction as input. It is often necessary or convenient to remove objects from the captured scenes, allowing a form of scene editing for IBR. This requires multi-view inpainting of the input images. Previous methods suffer from several major limitations: they lack true multi-view coherence, resulting in artifacts such as blur, they do not preserve perspective during inpainting, provide inaccurate depth completion and can only handle scenes with a few tens of images. Our approach addresses these limitations by introducing a new multi-view method that performs inpainting in intermediate, locally common planes. Use of these planes results in correct perspective and multi-view coherence of inpainting results. For efficient treatment of large scenes, we present a fast planar region extraction method operating on small image clusters. We adapt the resolution of inpainting to that required in each input image of the multi-view dataset, and carefully handle image resampling between the input images and rectified planes. We show results on large indoors and outdoors environments.
Document type :
Conference papers
Complete list of metadata

Cited literature [41 references]  Display  Hide  Download
Contributor : Team Reves Connect in order to contact the contributor
Submitted on : Wednesday, March 28, 2018 - 2:13:00 PM
Last modification on : Saturday, June 25, 2022 - 11:29:49 PM
Long-term archiving on: : Thursday, September 13, 2018 - 11:01:14 AM


Files produced by the author(s)




Julien Philip, George Drettakis. Plane-Based Multi-View Inpainting for Image-Based Rendering in Large Scenes. I3D 2018 - ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, May 2018, Montréal, Canada. pp.1-11, ⟨10.1145/3190834.3190846⟩. ⟨hal-01745568⟩



Record views


Files downloads