Category level object segmentation by combining bag-of-words models with Dirichlet processes and random fields

Diane Larlus 1 Jakob Verbeek 1 Frédéric Jurie 1, 2
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen
Abstract : This paper addresses the problem of accurately segmenting instances of object classes in images without any human interaction. Our model combines a bag-of-words recognition component with spatial regularization based on a random field and a Dirichlet process mixture. Bag-ofwords models successfully predict the presence of an object within an image; however, they can not accurately locate object boundaries. Random Fields take into account the spatial layout of images and provide local spatial regularization. Yet, as they use local coupling between image labels, they fail to capture larger scale structures needed for object recognition. These components are combined with a Dirichlet process mixture. It models images as a composition of regions, each representing a single object instance. Gibbs sampling is used for parameter estimations and object segmentation. Our model successfully segments object category instances, despite cluttered backgrounds and large variations in appearance and viewpoints. The strengths and limitations of our model are shown through extensive experimental evaluations. First, we evaluate the result of two methods to build visual vocabularies. Second, we show how to combine strong labeling (segmented images) with weak labeling (images annotated with bounding boxes), in order to limit the labeling effort needed to learn the model. Third, we study the effect of different initializations. We present results on four image databases, including the challenging PASCAL VOC 2007 data set on which we obtain state-of-the art results.
Type de document :
Article dans une revue
International Journal of Computer Vision, Springer Verlag, 2010, 88 (2), pp.238-253. <10.1007/s11263-009-0245-x>
Liste complète des métadonnées



https://hal.inria.fr/inria-00439303
Contributeur : Jakob Verbeek <>
Soumis le : mercredi 27 avril 2011 - 13:30:48
Dernière modification le : mercredi 27 mai 2015 - 10:50:43
Document(s) archivé(s) le : jeudi 8 novembre 2012 - 17:30:19

Fichiers

segmentation.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Diane Larlus, Jakob Verbeek, Frédéric Jurie. Category level object segmentation by combining bag-of-words models with Dirichlet processes and random fields. International Journal of Computer Vision, Springer Verlag, 2010, 88 (2), pp.238-253. <10.1007/s11263-009-0245-x>. <inria-00439303v2>

Partager

Métriques

Consultations de
la notice

511

Téléchargements du document

541