A Joint Framework for Disparity and Surface Normal Estimation

Ramya Narasimha 1 Elise Arnaud 1 Florence Forbes 2 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 MISTIS - Modelling and Inference of Complex and Structured Stochastic Systems
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : This paper deals with the stereo matching problem, while moving away from the traditional fronto-parallel assumption. We propose an algorithm that provides disparities in accordance with the surface properties of the scene under consideration. To do so, we carry out cooperatively both disparity and surface normal estimations by setting the two tasks in a unified Markovian framework. A novel joint probabilistic model is defined through two Markov Random Fields (MRF) to favor both intra field (within neighboring disparities and neighboring normals) and inter field (between disparities and normals) consistency. Geometric contextual information is introduced in the pair-wise Markovian regularizing term used in both MRFs. Segmentation and plane fitting procedures, usually performed as final steps to increase the quality results are here explicitly used in one of the MRF data terms. We then design an appropriate alternating maximization procedure based on standard Belief Propagation. We illustrate the performance of our approach on synthetic and real data. The results obtained are comparable to the state-of-the-art and show improvement in many cases.
Document type :
Reports
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download

https://hal.inria.fr/inria-00430635
Contributor : Elise Arnaud <>
Submitted on : Monday, November 9, 2009 - 1:02:27 PM
Last modification on : Wednesday, April 11, 2018 - 1:59:33 AM
Long-term archiving on : Tuesday, October 16, 2012 - 1:31:21 PM

File

RR-7090.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00430635, version 1

Citation

Ramya Narasimha, Elise Arnaud, Florence Forbes, Radu Horaud. A Joint Framework for Disparity and Surface Normal Estimation. [Research Report] RR-7090, INRIA. 2009, pp.17. ⟨inria-00430635⟩

Share

Metrics

Record views

504

Files downloads

251