Scene Flow by Tracking in Intensity and Depth Data

Julian Quiroga 1, * Frédéric Devernay 1, * James L. Crowley 1, *
* Auteur correspondant
1 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
Abstract : The scene flow describes the motion of each 3D point between two times steps. With the arrival of new depth sensors, as the Microsfot Kinect, it is now possible to compute scene flow with a single camera, with promising repercussion in a wide range of computer vision scenarios. We propose a novel method to compute scene flow by tracking in a Lucas-Kanade framework. Scene flow is estimated using a pair of aligned intensity and depth images, but rather than computing a dense scene flow as in most previous methods, we get a set of 3D motion fields by tracking surface patches. Assuming a 3D local rigidity of the scene, we propose a rigid translation flow model that allows to solve directly for the scene flow by constraining the 3D motion field both in intensity and depth data. In our experimentation we achieve very encouraging results. Since this approach solves simultaneously for the 2D tracking and for the scene flow, it can be used for action recognition in existing 2D tracking based methods or to define scene flow descriptors.
Type de document :
Communication dans un congrès
Wanqing Li and Zhengyou Zhang. CVPRW 2012 - Computer Vision and Pattern Recognition Workshops, Jun 2012, Providence, RI, United States. IEEE, pp.50-57, 2012, Proceedings of the IEEE Computer Society Conference on CVPRW. <http://www.proceedings.com/15310.html>. <10.1109/CVPRW.2012.6239237>
Liste complète des métadonnées

https://hal.inria.fr/hal-00762557
Contributeur : Frédéric Devernay <>
Soumis le : vendredi 7 décembre 2012 - 12:46:39
Dernière modification le : mardi 15 janvier 2013 - 18:11:01
Document(s) archivé(s) le : vendredi 8 mars 2013 - 06:05:08

Identifiants

Collections

Citation

Julian Quiroga, Frédéric Devernay, James L. Crowley. Scene Flow by Tracking in Intensity and Depth Data. Wanqing Li and Zhengyou Zhang. CVPRW 2012 - Computer Vision and Pattern Recognition Workshops, Jun 2012, Providence, RI, United States. IEEE, pp.50-57, 2012, Proceedings of the IEEE Computer Society Conference on CVPRW. <http://www.proceedings.com/15310.html>. <10.1109/CVPRW.2012.6239237>. <hal-00762557>

Partager

Métriques

Consultations de
la notice

401

Téléchargements du document

430