Scene Segmentation with CRFs Learned from Partially Labeled Images - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2008

Scene Segmentation with CRFs Learned from Partially Labeled Images

Jakob Verbeek
William Triggs

Résumé

Conditional Random Fields (CRFs) are an effective tool for a variety of different data segmentation and labeling tasks including visual scene interpretation, which seeks to partition images into their constituent semantic-level regions and assign appropriate class labels to each region. For accurate labeling it is important to capture the global context of the image as well as local information. We introduce a CRF based scene labeling model that incorporates both local features and features aggregated over the whole image or large sections of it. Secondly, traditional CRF learning requires fully labeled datasets which can be costly and troublesome to produce. We introduce a method for learning CRFs from datasets with many unlabeled nodes by marginalizing out the unknown labels so that the log-likelihood of the known ones can be maximized by gradient ascent. Loopy Belief Propagation is used to approximate the marginals needed for the gradient and log-likelihood calculations and the Bethe free-energy approximation to the log-likelihood is monitored to control the step size. Our experimental results show that effective models can be learned from fragmentary labelings and that incorporating top-down aggregate features significantly improves the segmentations. The resulting segmentations are compared to the state-of-the-art on three different image datasets.
Fichier principal
Vignette du fichier
verbeek08nips.pdf (1.25 Mo) Télécharger le fichier
Vignette du fichier
VT08.png (62.82 Ko) Télécharger le fichier
VT08.poster.pdf (1.3 Mo) Télécharger le fichier
VT08.slides.pdf (1.01 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image
Format : Autre
Format : Autre
Loading...

Dates et versions

inria-00321051 , version 1 (25-01-2011)
inria-00321051 , version 2 (11-04-2011)

Identifiants

  • HAL Id : inria-00321051 , version 2

Citer

Jakob Verbeek, William Triggs. Scene Segmentation with CRFs Learned from Partially Labeled Images. NIPS 2007 - Advances in Neural Information Processing Systems, Dec 2007, Vancouver, Canada. pp.1553-1560. ⟨inria-00321051v2⟩
667 Consultations
714 Téléchargements

Partager

Gmail Facebook X LinkedIn More