Classification and Automatic Annotation Extension of Images Using Bayesian Network

Sabine Barrat 1 Salvatore Tabbone 1
1 QGAR - Querying Graphics through Analysis and Recognition
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : In many vision problems, instead of having fully annotated training data, it is easier to obtain just a subset of data with annotations, because it is less restrictive for the user. For this reason, in this paper, we consider especially the problem of classifying weakly-annotated images, where just a small subset of the database is annotated with keywords. In this paper we present and evaluate a new method which improves the effectiveness of content-based image classification, by integrating semantic concepts extracted from text, and by automatically extending annotations to the images with missing keywords. Our model is inspired from the probabilistic graphical model theory: we propose a hierarchical mixture model which enables to handle missing values. Results of visual-textual classification, reported on a database of images collected from the Web, partially and manually annotated, show an improvement by 32.3% in terms of recognition rate against only visual information classification. Besides the automatic annotation extension with our model for images with missing keywords outperforms the visual-textual classification by 6.8%. Finally the proposed method is experimentally competitive with the state-of-art classifiers.
Type de document :
Chapitre d'ouvrage
Niels da Vitoria Lobo, Takis Kasparis, Fabio Roli et al. Structural, Syntactic, and Statistical Pattern Recognition, 5342, Springer Verlag, pp.937-946, 2008, Lecture Notes in Computer Science, 978-3-540-89688-3. 〈10.1007/978-3-540-89689-0_97〉
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00389485
Contributeur : Sabine Barrat <>
Soumis le : vendredi 29 mai 2009 - 13:19:31
Dernière modification le : jeudi 11 janvier 2018 - 06:19:59
Document(s) archivé(s) le : vendredi 11 juin 2010 - 00:00:25

Fichier

spr08_vf.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Sabine Barrat, Salvatore Tabbone. Classification and Automatic Annotation Extension of Images Using Bayesian Network. Niels da Vitoria Lobo, Takis Kasparis, Fabio Roli et al. Structural, Syntactic, and Statistical Pattern Recognition, 5342, Springer Verlag, pp.937-946, 2008, Lecture Notes in Computer Science, 978-3-540-89688-3. 〈10.1007/978-3-540-89689-0_97〉. 〈inria-00389485〉

Partager

Métriques

Consultations de la notice

165

Téléchargements de fichiers

119