LMI-based 2D-3D Registration: from Uncalibrated Images to Euclidean Scene

Abstract : This paper investigates the problem of registering a scanned scene, represented by 3D Euclidean point coordinates , and two or more uncalibrated cameras. An unknown subset of the scanned points have their image projections detected and matched across images. The proposed approach assumes the cameras only known in some arbitrary projective frame and no calibration or autocalibration is required. The devised solution is based on a Linear Matrix Inequality (LMI) framework that allows simultaneously estimating the projective transformation relating the cameras to the scene and establishing 2D-3D correspondences without triangulating image points. The proposed LMI framework allows both deriving triangulation-free LMI cheirality conditions and establishing putative correspondences between 3D volumes (boxes) and 2D pixel coordinates. Two registration algorithms, one exploiting the scene's structure and the other concerned with robustness, are presented. Both algorithms employ the Branch-and-Prune paradigm and guarantee convergence to a global solution under mild initial bound conditions. The results of our experiments are presented and compared against other approaches.
Complete list of metadatas

Cited literature [29 references]  Display  Hide  Download

https://hal.inria.fr/hal-01149529
Contributor : Cédric Demonceaux <>
Submitted on : Monday, June 8, 2015 - 10:41:01 PM
Last modification on : Friday, May 3, 2019 - 1:38:13 PM
Long-term archiving on : Tuesday, April 25, 2017 - 5:52:28 AM

File

2145.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01149529, version 3

Citation

Danda Pani Paudel, Adlane Habed, Cedric Demonceaux, Pascal Vasseur. LMI-based 2D-3D Registration: from Uncalibrated Images to Euclidean Scene. CVPR 2015 - 28th IEEE Conference on Computer Vision and Pattern Recognition, Jun 2015, Boston, United States, Jun 2015, Boston, United States. ⟨hal-01149529v3⟩

Share

Metrics

Record views

562

Files downloads

435