Skip to Main content Skip to Navigation
Journal articles

Weakly supervised learning of visual models and its application to content-based retrieval

Cordelia Schmid 1, * 
* Corresponding author
1 LEAR - Learning and recognition in vision
GRAVIR - IMAG - Laboratoire d'informatique GRAphique, VIsion et Robotique de Grenoble, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : This paper presents a method for weakly supervised learning of visual models. The visual model is based on a two-layer image description: a set of "generic" descriptors and their distribution over neighbourhoods. "Generic" descriptors represent sets of similar rotational invariant feature vectors. Statistical spatial constraints describe the neighborhood structure and make our description more discriminant. The joint probability of the frequencies of "generic" descriptors over a neighbourhood is multi-modal and is represented by a set of "neighbourhood-frequency" clusters. Our image description is rotationally invariant, robust to model deformations and characterizes efficiently "appearance-based" visual structure. The selection of distinctive clusters determines model features (common to the positive and rare in the negative examples). Visual models are retrieved and localized using a probabilistic score. Experimental results for "textured" animals and faces show a very good performance for retrieval as well as localization.
Document type :
Journal articles
Complete list of metadata
Contributor : THOTH Team Connect in order to contact the contributor
Submitted on : Monday, December 20, 2010 - 9:09:43 AM
Last modification on : Wednesday, February 2, 2022 - 3:58:14 PM
Long-term archiving on: : Monday, March 21, 2011 - 3:17:07 AM


Files produced by the author(s)




Cordelia Schmid. Weakly supervised learning of visual models and its application to content-based retrieval. International Journal of Computer Vision, Springer Verlag, 2004, Special Issue on Content-Based Image Retrieval, 56 (1), pp.7--16. ⟨10.1023/B:VISI.0000004829.38247.b0⟩. ⟨inria-00548553⟩



Record views


Files downloads