Scene Segmentation with CRFs Learned from Partially Labeled Images

Jakob Verbeek 1 William Triggs 2
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 AI - Artificial Intelligence
LJK - Laboratoire Jean Kuntzmann
Abstract : Conditional Random Fields (CRFs) are an effective tool for a variety of different data segmentation and labeling tasks including visual scene interpretation, which seeks to partition images into their constituent semantic-level regions and assign appropriate class labels to each region. For accurate labeling it is important to capture the global context of the image as well as local information. We introduce a CRF based scene labeling model that incorporates both local features and features aggregated over the whole image or large sections of it. Secondly, traditional CRF learning requires fully labeled datasets which can be costly and troublesome to produce. We introduce a method for learning CRFs from datasets with many unlabeled nodes by marginalizing out the unknown labels so that the log-likelihood of the known ones can be maximized by gradient ascent. Loopy Belief Propagation is used to approximate the marginals needed for the gradient and log-likelihood calculations and the Bethe free-energy approximation to the log-likelihood is monitored to control the step size. Our experimental results show that effective models can be learned from fragmentary labelings and that incorporating top-down aggregate features significantly improves the segmentations. The resulting segmentations are compared to the state-of-the-art on three different image datasets.
Type de document :
Communication dans un congrès
John C. Platt and Daphne Koller and Yoram Singer and Sam Roweis. NIPS 2007 - Advances in Neural Information Processing Systems, Dec 2007, Vancouver, Canada. MIT Press, 20, pp.1553-1560, 2008, 〈http://books.nips.cc/nips20.html〉
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger

VT08.png
VT08.png
https://hal.inria.fr/inria-00321051
Contributeur : Jakob Verbeek <>
Soumis le : lundi 11 avril 2011 - 14:36:10
Dernière modification le : lundi 17 décembre 2018 - 11:22:02

Fichiers

verbeek08nips.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00321051, version 2

Collections

INRIA | LJK_GI | LJK_PS | LJK_PS_AI | LJK_GI_LEAR | LJK | UGA

Citation

Jakob Verbeek, William Triggs. Scene Segmentation with CRFs Learned from Partially Labeled Images. John C. Platt and Daphne Koller and Yoram Singer and Sam Roweis. NIPS 2007 - Advances in Neural Information Processing Systems, Dec 2007, Vancouver, Canada. MIT Press, 20, pp.1553-1560, 2008, 〈http://books.nips.cc/nips20.html〉. 〈inria-00321051v2〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

880

Téléchargements de fichiers

950

Contact


archive-ouverte@inria.fr