Multi-view Structure-from-Motion for Hybrid Camera Scenarios

Abstract : We describe a pipeline for structure-from-motion (SfM) with mixed camera types, namely omnidirectional and perspective cameras. For the steps of this pipeline, we propose new approaches or adapt the existing perspective camera methods to make the pipeline effective and automatic. We model our cameras of different types with the sphere camera model. To match feature points, we describe a preprocessing algorithm which significantly increases scale invariant feature transform (SIFT) matching performance for hybrid image pairs. With this approach, automatic point matching between omnidirectional and perspective images is achieved. We robustly estimate the hybrid fundamental matrix with the obtained point correspondences. We introduce the normalization matrices for lifted coordinates so that normalization and denormalization can be performed linearly for omnidirectional images. We evaluate the alternatives of estimating camera poses in hybrid pairs. A weighting strategy is proposed for iterative linear triangulation which improves the structure estimation accuracy. Following the addition of multiple perspective and omnidirectional images to the structure, we perform sparse bundle adjustment on the estimated structure by adapting it to use the sphere camera model. Demonstrations of the end-to-end multi-view SfM pipeline with the real images of mixed camera types are presented.
Type de document :
Article dans une revue
Image and Vision Computing, Elsevier, 2012, 30 (8), pp.557-572. 〈10.1016/j.imavis.2012.06.001〉
Liste complète des métadonnées
Contributeur : Peter Sturm <>
Soumis le : lundi 29 octobre 2012 - 12:02:49
Dernière modification le : mercredi 11 avril 2018 - 01:58:58




Yalin Bastanlar, Alptekin Temizel, Yasemin Yardimci, Peter Sturm. Multi-view Structure-from-Motion for Hybrid Camera Scenarios. Image and Vision Computing, Elsevier, 2012, 30 (8), pp.557-572. 〈10.1016/j.imavis.2012.06.001〉. 〈hal-00746530〉



Consultations de la notice