HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

3D-Aware Ellipse Prediction for Object-Based Camera Pose Estimation

Matthieu Zins 1 Gilles Simon 1 Marie-Odile Berger 1, 2
1 MAGRIT-POST - Augmentation visuelle d'environnements complexes
Inria Nancy - Grand Est, LORIA - ALGO - Department of Algorithms, Computation, Image and Geometry
2 MAGRIT - Visual Augmentation of Complex Environments
Inria Nancy - Grand Est, LORIA - ALGO - Department of Algorithms, Computation, Image and Geometry
Abstract : In this paper, we propose a method for coarse camera pose computation which is robust to viewing conditions and does not require a detailed model of the scene. This method meets the growing need of easy deployment of robotics or augmented reality applications in any environments, especially those for which no accurate 3D model nor huge amount of ground truth data are available. It exploits the ability of deep learning techniques to reliably detect objects regardless of viewing conditions. Previous works have also shown that abstracting the geometry of a scene of objects by an ellipsoid cloud allows to compute the camera pose accurately enough for various application needs. Though promising, these approaches use the ellipses fitted to the detection bounding boxes as an approximation of the im-aged objects. In this paper, we go one step further and propose a learning-based method which detects improved elliptic approximations of objects which are coherent with the 3D ellipsoid in terms of perspective projection. Experiments prove that the accuracy of the computed pose significantly increases thanks to our method and is more robust to the variability of the boundaries of the detection boxes. This is achieved with very little effort in terms of training data acquisition-a few hundred calibrated images of which only three need manual object annotation. Code and models are released at https://github.com/zinsmatt/3D-Aware-Ellipses-for-Visual-Localization.
Document type :
Conference papers
Complete list of metadata

Contributor : Matthieu Zins Connect in order to contact the contributor
Submitted on : Monday, May 24, 2021 - 4:08:24 PM
Last modification on : Wednesday, March 9, 2022 - 11:02:02 AM


Files produced by the author(s)


  • HAL Id : hal-02975379, version 2



Matthieu Zins, Gilles Simon, Marie-Odile Berger. 3D-Aware Ellipse Prediction for Object-Based Camera Pose Estimation. 3DV 2020 - International Virtual Conference on 3D Vision, Nov 2020, Fukuoka / Virtual, Japan. ⟨hal-02975379v2⟩



Record views


Files downloads