Skip to Main content Skip to Navigation
Journal articles

Silhouette-Aware Warping for Image-Based Rendering

Abstract : Image-based rendering (IBR) techniques allow capture and display of 3D environments using photographs. Modern IBR pipelines reconstruct proxy geometry using multi-view stereo, reproject the photographs onto the proxy and blend them to create novel views. The success of these methods depends on accurate 3D proxies, which are difficult to obtain for complex objects such as trees and cars. Large number of input images do not improve reconstruction proportionally; surface extraction is challenging even from dense range scans for scenes containing such objects. Our approach does not depend on dense accurate geometric reconstruction; instead we compensate for sparse 3D information by variational image warping. In particular, we formulate silhouette-aware warps that preserve salient depth discontinuities. This improves the rendering of difficult foreground objects, even when deviating from view interpolation. We use a semi-automatic step to identify depth discontinuities and extract a sparse set of depth constraints used to guide the warp. Our framework is lightweight and results in good quality IBR for previously challenging environments.
Document type :
Journal articles
Complete list of metadata

Cited literature [34 references]  Display  Hide  Download


https://hal.inria.fr/inria-00607039
Contributor : Team Reves <>
Submitted on : Thursday, November 21, 2013 - 5:38:27 PM
Last modification on : Thursday, May 27, 2021 - 1:54:04 PM
Long-term archiving on: : Saturday, February 22, 2014 - 4:42:58 AM

Files

warpibr_paper_preprint.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Gaurav Chaurasia, Olga Sorkine, George Drettakis. Silhouette-Aware Warping for Image-Based Rendering. Computer Graphics Forum, Wiley, 2011, Proceedings of the Eurographics Symposium on Rendering, 30 (4), ⟨10.1111/j.1467-8659.2011.01981.x⟩. ⟨inria-00607039v2⟩

Share

Metrics

Record views

311

Files downloads

986