A New Spatio-Temporal MRF Framework for Video-based Object Segmentation

Abstract : In this paper we propose a general framework for video-based object segmentation using a new spatio-temporal Markov Random Field (MRF) model. Video-based object segmentation has the potential to improve the performance of static image segmentation by fusing in- formation over the temporal scale. Built upon a spatio-temporal MRF model, our method offers three advantages in a unified framework. First, our model is defined on a flexible graph structure induced by the local motion information instead of the regular 3D grid, allowing the model nodes to be connected to more reliable temporal neighbors. Second, the segmentation task is considered in unison with foreground/background modeling, leading to more accurate appearance models suitable for object segmentation. Third, the inclusion of shape priors as a top-down high- level object constraints as guides for the bottom-up low-level image cues leads to improved segmentation. The object segmentation is solved as an MRF-MAP inference problem by the Loopy Belief Propagation (LBP) algorithm effectively and efficiently. Estimation of the model parameters can be accomplished simultaneously with the inference problem, using an Expectation Maximization (EM) algorithm. In our experiments, we show promising object segmentation results by combining multiple modules in the same framework.
Type de document :
Communication dans un congrès
The 1st International Workshop on Machine Learning for Vision-based Motion Analysis - MLVMA'08, Oct 2008, Marseille, France. 2008
Liste complète des métadonnées

Littérature citée [26 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00325811
Contributeur : Peter Sturm <>
Soumis le : mardi 30 septembre 2008 - 13:58:37
Dernière modification le : mardi 30 septembre 2008 - 14:43:13
Document(s) archivé(s) le : vendredi 4 juin 2010 - 12:01:29

Fichier

mlvma08_submission_4.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00325811, version 1

Collections

Citation

Rui Huang, Vladimir Pavlovic, Dimitris Metaxas. A New Spatio-Temporal MRF Framework for Video-based Object Segmentation. The 1st International Workshop on Machine Learning for Vision-based Motion Analysis - MLVMA'08, Oct 2008, Marseille, France. 2008. 〈inria-00325811〉

Partager

Métriques

Consultations de la notice

171

Téléchargements de fichiers

169