Skip to Main content Skip to Navigation
New interface
Reports (Research report)

A Variational Method for Scene Flow Estimation from Stereo Sequences

Frédéric Huguet 1 Frédéric Devernay 1 
1 PRIMA - Perception, recognition and integration for observation of activity
GRAVIR - IMAG - Laboratoire d'informatique GRAphique, VIsion et Robotique de Grenoble, Inria Grenoble - Rhône-Alpes
Abstract : This report presents a method for scene flow estimation from a calibrated stereo image sequence. The scene flow contains the 3-D displacement field of scene points, so that the 2-D optical flow can be seen as a projection of the scene flow onto the images. We propose to recover the scene flow by coupling the optical flow estimation in both cameras with dense stereo matching between the images, thus reducing the number of unknowns per image point. The use of a variational framework allows us to properly handle discontinuities in the observed surfaces and in the 3-D displacement field. Moreover our approach handles occlusions both for the optical flow and the stereo. We obtain a partial differential equations system coupling both the optical flow and the stereo, which is numerically solved using an original multi-resolution algorithm. Whereas previous variational methods were estimating the 3-D reconstruction at time t and the scene flow separately, our method jointly estimates both in a single optimization. We present numerical results on synthetic data with ground truth information, and we also compare the accuracy of the scene flow projected in one camera with a state-of-the-art single-camera optical flow computation method. Results are also presented on a real stereo sequence with large motion and stereo discontinuities.
Complete list of metadata

Cited literature [24 references]  Display  Hide  Download
Contributor : Rapport De Recherche Inria Connect in order to contact the contributor
Submitted on : Wednesday, August 8, 2007 - 11:14:03 AM
Last modification on : Thursday, October 27, 2022 - 4:03:00 AM
Long-term archiving on: : Friday, November 25, 2016 - 4:45:44 PM


Files produced by the author(s)


  • HAL Id : inria-00166589, version 2


Frédéric Huguet, Frédéric Devernay. A Variational Method for Scene Flow Estimation from Stereo Sequences. [Research Report] RR-6267, INRIA. 2007, pp.20. ⟨inria-00166589v2⟩



Record views


Files downloads