Monocular Surface Reconstruction using 3D Deformable Part Models

Abstract : Our goal in this work is to recover an estimate of an object's surface from a single image. We address this severely ill-posed problem by employing a discriminatively-trained graphical model: we incorporate prior information about the 3D shape of an object category in terms of pairwise terms among parts, while using powerful CNN features to construct unary terms that dictate the part placement in the image. Our contributions are threefold: firstly, we extend the Deformable Part Model (DPM) paradigm to operate in a three-dimensional pose space that encodes the putative real-world coordinates of object parts. Secondly, we use branch-and-bound to perform efficient inference with DPMs, resulting in accelerations by two orders of magnitude over linear-time algorithms. Thirdly, we use Structured SVM training to properly penalize deviations between the model predictions and the 3D ground truth information during learning. Our inference requires a fraction of a second at test time and our results outperform those published recently in [17] on the PASCAL 3D+ dataset.
Type de document :
Communication dans un congrès
"Geometry Meets Deep Learning" in ECCV 2016, Oct 2016, Amsterdam, Netherlands. 9915, pp 296-308, 2016, ECCV 2016 Workshops, Part III, LNCS 9915 proceedings. 〈10.1007/978-3-319-49409-8_24〉
Liste complète des métadonnées

Littérature citée [29 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01416479
Contributeur : Stefan Kinauer <>
Soumis le : mercredi 14 décembre 2016 - 15:07:48
Dernière modification le : vendredi 6 avril 2018 - 13:32:01
Document(s) archivé(s) le : mercredi 15 mars 2017 - 13:37:27

Fichier

0028.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Stefan Kinauer, Maxim Berman, Iasonas Kokkinos. Monocular Surface Reconstruction using 3D Deformable Part Models. "Geometry Meets Deep Learning" in ECCV 2016, Oct 2016, Amsterdam, Netherlands. 9915, pp 296-308, 2016, ECCV 2016 Workshops, Part III, LNCS 9915 proceedings. 〈10.1007/978-3-319-49409-8_24〉. 〈hal-01416479〉

Partager

Métriques

Consultations de la notice

458

Téléchargements de fichiers

155