Skip to Main content Skip to Navigation
Conference papers

A New Spatio-Temporal MRF Framework for Video-based Object Segmentation

Abstract : In this paper we propose a general framework for video-based object segmentation using a new spatio-temporal Markov Random Field (MRF) model. Video-based object segmentation has the potential to improve the performance of static image segmentation by fusing in- formation over the temporal scale. Built upon a spatio-temporal MRF model, our method offers three advantages in a unified framework. First, our model is defined on a flexible graph structure induced by the local motion information instead of the regular 3D grid, allowing the model nodes to be connected to more reliable temporal neighbors. Second, the segmentation task is considered in unison with foreground/background modeling, leading to more accurate appearance models suitable for object segmentation. Third, the inclusion of shape priors as a top-down high- level object constraints as guides for the bottom-up low-level image cues leads to improved segmentation. The object segmentation is solved as an MRF-MAP inference problem by the Loopy Belief Propagation (LBP) algorithm effectively and efficiently. Estimation of the model parameters can be accomplished simultaneously with the inference problem, using an Expectation Maximization (EM) algorithm. In our experiments, we show promising object segmentation results by combining multiple modules in the same framework.
Document type :
Conference papers
Complete list of metadata

Cited literature [26 references]  Display  Hide  Download
Contributor : Peter Sturm Connect in order to contact the contributor
Submitted on : Tuesday, September 30, 2008 - 1:58:37 PM
Last modification on : Monday, August 24, 2020 - 4:20:18 PM
Long-term archiving on: : Friday, June 4, 2010 - 12:01:29 PM


Files produced by the author(s)


  • HAL Id : inria-00325811, version 1



Rui Huang, Vladimir Pavlovic, Dimitris Metaxas. A New Spatio-Temporal MRF Framework for Video-based Object Segmentation. The 1st International Workshop on Machine Learning for Vision-based Motion Analysis - MLVMA'08, Oct 2008, Marseille, France. ⟨inria-00325811⟩



Record views


Files downloads