HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Automatic 3D Car Model Alignment for Mixed Image-Based Rendering

Abstract : Image-Based Rendering (IBR) allows good-quality free-viewpoint navigation in urban scenes, but suffers from arti-facts on poorly reconstructed objects, e.g., reflective surfaces such as cars. To alleviate this problem, we propose a method that automatically identifies stock 3D models , aligns them in the 3D scene and performs morphing to better capture image contours. We do this by first adapting learning-based methods to detect and identify an object class and pose in images. We then propose a method which exploits all available information, namely partial and inaccurate 3D reconstruction, multi-view calibration, image contours and the 3D model to achieve accurate object alignment suitable for subsequent morphing. These steps provide models which are well-aligned in 3D and to contours in all the images of the multi-view dataset, allowing us to use the resulting model in our mixed IBR algorithm. Our results show significant improvement in image quality for free-viewpoint IBR, especially when moving far from the captured viewpoints.
Complete list of metadata

Cited literature [56 references]  Display  Hide  Download

https://hal.inria.fr/hal-01368355
Contributor : Team Reves Connect in order to contact the contributor
Submitted on : Monday, September 19, 2016 - 2:09:20 PM
Last modification on : Tuesday, December 8, 2020 - 9:43:28 AM

File

final_IBRMixed_3dv.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01368355, version 1

Collections

Citation

Rodrigo Ortiz-Cayon, Abdelaziz Djelouah, Francisco Massa, Mathieu Aubry, George Drettakis. Automatic 3D Car Model Alignment for Mixed Image-Based Rendering. 2016 International Conference on 3D Vision (3DV), Oct 2016, Stanford, United States. ⟨hal-01368355⟩

Share

Metrics

Record views

219

Files downloads

934