A hybrid multi-view stereo algorithm for modeling urban scenes

Florent Lafarge 1 Renaud Keriven 2 Mathieu Brédif 3 Hoang-Hiep Vu 4, 5
1 TITANE - Geometric Modeling of 3D Environments
CRISAM - Inria Sophia Antipolis - Méditerranée
4 IMAGINE [Marne-la-Vallée]
LIGM - Laboratoire d'Informatique Gaspard-Monge, CSTB - Centre Scientifique et Technique du Bâtiment, ENPC - École des Ponts ParisTech
Abstract : We present an original multi-view stereo reconstruction algorithm which allows the 3D-modeling of urban scenes as a combination of meshes and geometric primitives. The method provides a compact model while preserving details: irregular elements such as statues and ornaments are described by meshes whereas regular structures such as columns and walls are described by primitives (planes, spheres, cylinders, cones and tori). We adopt a two-step strategy consisting first in segmenting the initial meshbased surface using a multi-label Markov Random Field based model and second, in sampling primitive and mesh components simultaneously on the obtained partition by a Jump-Diffusion process. The quality of a reconstruction is measured by a multi-object energy model which takes into account both photo-consistency and semantic considerations (i.e. geometry and shape layout). The segmentation and sampling steps are embedded into an iterative refinement procedure which provides an increasingly accurate hybrid representation. Experimental results on complex urban structures and large scenes are presented and compared to the state-of-the-art multi-view stereo meshing algorithms.
Type de document :
Article dans une revue
IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2013, 35 (1), pp.5-17. 〈10.1109/TPAMI.2012.84〉
Liste complète des métadonnées

Littérature citée [55 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/hal-00759261
Contributeur : Florent Lafarge <>
Soumis le : vendredi 30 novembre 2012 - 12:42:16
Dernière modification le : jeudi 5 juillet 2018 - 14:26:41
Document(s) archivé(s) le : vendredi 1 mars 2013 - 03:51:06

Fichiers

pami_2012.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Florent Lafarge, Renaud Keriven, Mathieu Brédif, Hoang-Hiep Vu. A hybrid multi-view stereo algorithm for modeling urban scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2013, 35 (1), pp.5-17. 〈10.1109/TPAMI.2012.84〉. 〈hal-00759261〉

Partager

Métriques

Consultations de la notice

1062

Téléchargements de fichiers

5268