Multimodal semi-supervised learning for image classification

Matthieu Guillaumin 1 Jakob Verbeek 1 Cordelia Schmid 1
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : In image categorization the goal is to decide if an image belongs to a certain category or not. A binary classifier can be learned from manually labeled images; while using more labeled examples improves performance, obtaining the image labels is a time consuming process. We are interested in how other sources of information can aid the learning process given a fixed amount of labeled images. In particular, we consider a scenario where keywords are associated with the training images, eg as found on photo sharing websites. The goal is to learn a classifier for images alone, but we will use the keywords associated with labeled and unlabeled images to improve the classifier using semi-supervised learning. We first learn a strong Multiple Kernel Learning (MKL) classifier using both the image content and keywords, and use it to score unlabeled images. We then learn classifiers on visual features only, either support vector machines (SVM) or least-squares regression (LSR), from the MKL output values on both the labeled and unlabeled images. In our experiments on 20 classes from the PASCAL VOC'07 set and 38 from the MIR Flickr set, we demonstrate the benefit of our semi-supervised approach over only using the labeled images. We also present results for a scenario where we do not use any manual labeling but directly learn classifiers from the image tags. The semi-supervised approach also improves classification accuracy in this case.
Type de document :
Communication dans un congrès
CVPR 2010 - 23rd IEEE Conference on Computer Vision & Pattern Recognition, Jun 2010, San Francisco, United States. IEEE Computer Society, pp.902-909, 2010, 〈http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5540120〉. 〈10.1109/CVPR.2010.5540120〉
Liste complète des métadonnées


https://hal.inria.fr/inria-00548640
Contributeur : Thoth Team <>
Soumis le : lundi 20 décembre 2010 - 10:23:35
Dernière modification le : vendredi 24 novembre 2017 - 13:31:20
Document(s) archivé(s) le : lundi 21 mars 2011 - 03:26:17

Fichiers

Identifiants

Collections

Citation

Matthieu Guillaumin, Jakob Verbeek, Cordelia Schmid. Multimodal semi-supervised learning for image classification. CVPR 2010 - 23rd IEEE Conference on Computer Vision & Pattern Recognition, Jun 2010, San Francisco, United States. IEEE Computer Society, pp.902-909, 2010, 〈http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5540120〉. 〈10.1109/CVPR.2010.5540120〉. 〈inria-00548640〉

Partager

Métriques

Consultations de la notice

1077

Téléchargements de fichiers

3339