Cross-Calibration of Time-of-flight and Colour Cameras

Miles Hansard 1 Georgios Evangelidis 2, * Quentin Pelorson 2, * Radu Horaud 2, *
* Corresponding author
1 School of Electronic Engineering and Computer Science
EECS - School of Electronic Engineering and Computer Science
2 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : Time-of-flight cameras provide depth information, which is complementary to the photometric appearance of the scene in ordinary images. It is desirable to merge the depth and colour information, in order to obtain a coherent scene representation. However, the individual cameras will have different viewpoints, resolutions and fields of view, which means that they must be mutually calibrated. This paper presents a geometric framework for the resulting multi-view and multi-modal calibration problem. It is shown that three-dimensional projective transformations can be used to align depth and parallax-based representations of the scene, with or without Euclidean reconstruction. A new evaluation procedure is also developed; this allows the reprojection error to be decomposed into calibration and sensor-dependent components. The complete approach is demonstrated on a network of three time-of-flight and six colour cameras. The applications of such a system, to a range of automatic scene-interpretation problems, are discussed.
Document type :
Journal articles
Computer Vision and Image Understanding, Elsevier, 2015, Image Understanding for Real-world Distributed Video Networks, 134, pp.105-115. 〈http://www.sciencedirect.com/science/article/pii/S1077314214001830〉. 〈10.1016/j.cviu.2014.09.001〉
Liste complète des métadonnées

Cited literature [47 references]  Display  Hide  Download


https://hal.inria.fr/hal-01059891
Contributor : Team Perception <>
Submitted on : Tuesday, September 2, 2014 - 11:10:18 AM
Last modification on : Wednesday, April 11, 2018 - 1:50:52 AM
Document(s) archivé(s) le : Wednesday, December 3, 2014 - 10:46:10 AM

Files

tofcalib_revised.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Miles Hansard, Georgios Evangelidis, Quentin Pelorson, Radu Horaud. Cross-Calibration of Time-of-flight and Colour Cameras. Computer Vision and Image Understanding, Elsevier, 2015, Image Understanding for Real-world Distributed Video Networks, 134, pp.105-115. 〈http://www.sciencedirect.com/science/article/pii/S1077314214001830〉. 〈10.1016/j.cviu.2014.09.001〉. 〈hal-01059891〉

Share

Metrics

Record views

1010

Files downloads

651