Multi-view Structure-from-Motion for Hybrid Camera Scenarios

Abstract : We describe a pipeline for structure-from-motion (SfM) with mixed camera types, namely omnidirectional and perspective cameras. For the steps of this pipeline, we propose new approaches or adapt the existing perspective camera methods to make the pipeline effective and automatic. We model our cameras of different types with the sphere camera model. To match feature points, we describe a preprocessing algorithm which significantly increases scale invariant feature transform (SIFT) matching performance for hybrid image pairs. With this approach, automatic point matching between omnidirectional and perspective images is achieved. We robustly estimate the hybrid fundamental matrix with the obtained point correspondences. We introduce the normalization matrices for lifted coordinates so that normalization and denormalization can be performed linearly for omnidirectional images. We evaluate the alternatives of estimating camera poses in hybrid pairs. A weighting strategy is proposed for iterative linear triangulation which improves the structure estimation accuracy. Following the addition of multiple perspective and omnidirectional images to the structure, we perform sparse bundle adjustment on the estimated structure by adapting it to use the sphere camera model. Demonstrations of the end-to-end multi-view SfM pipeline with the real images of mixed camera types are presented.
Document type :
Journal articles
Complete list of metadatas

https://hal.inria.fr/hal-00746530
Contributor : Peter Sturm <>
Submitted on : Monday, October 29, 2012 - 12:02:49 PM
Last modification on : Wednesday, April 11, 2018 - 1:58:58 AM

Identifiers

Collections

Citation

Yalin Bastanlar, Alptekin Temizel, Yasemin Yardimci, Peter Sturm. Multi-view Structure-from-Motion for Hybrid Camera Scenarios. Image and Vision Computing, Elsevier, 2012, 30 (8), pp.557-572. ⟨10.1016/j.imavis.2012.06.001⟩. ⟨hal-00746530⟩

Share

Metrics

Record views

460