Region Classification with Markov Field Aspect Models

Jakob Verbeek 1 William Triggs 1, 2
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 AI - Artificial Intelligence
LJK - Laboratoire Jean Kuntzmann
Abstract : In recent years considerable advances have been made in learning to recognize and localize visual object classes from images annotated with global image-level labels, bounding boxes, or pixel-level segmentations. A second line of research uses unsupervised learning methods such as aspect models to automatically discover the latent object classes of unlabeled image collections. Here we learn spatial aspect models from image-level labels and use them to recover labeled regions in new images. Our models combine low-level texture, color and position cues with spatial random field models that capture the local coherence of region labels. We study two spatial inference models: one based on averaging over forests of minimal spanning trees linking neighboring image regions, the other on an efficient chain-merging Expectation Propagation method for regular 8-neighbor Markov random fields. Experimental results on the MSR Cambridge data sets show that incorporating spatial terms in the aspect model significantly improves the region-level classification rates. So much so, that the spatial random field model trained from image labels only outperforms PLSA trained from segmented images.
Type de document :
Communication dans un congrès
CVPR 2007 - IEEE Conference on Computer Vision & Pattern Recognition, Jun 2007, Minneapolis, United States. IEEE Computer society, pp.1-8, 2007, 〈http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4270123〉. 〈10.1109/CVPR.2007.383098〉
Liste complète des métadonnées

Littérature citée [24 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/inria-00321129
Contributeur : Jakob Verbeek <>
Soumis le : vendredi 8 avril 2011 - 15:26:45
Dernière modification le : mercredi 11 avril 2018 - 01:58:06
Document(s) archivé(s) le : jeudi 30 mars 2017 - 09:21:02

Identifiants

Collections

Citation

Jakob Verbeek, William Triggs. Region Classification with Markov Field Aspect Models. CVPR 2007 - IEEE Conference on Computer Vision & Pattern Recognition, Jun 2007, Minneapolis, United States. IEEE Computer society, pp.1-8, 2007, 〈http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4270123〉. 〈10.1109/CVPR.2007.383098〉. 〈inria-00321129v2〉

Partager

Métriques

Consultations de la notice

670

Téléchargements de fichiers

1214