Skip to Main content Skip to Navigation
Book sections

Classification and Automatic Annotation Extension of Images Using Bayesian Network

Sabine Barrat 1 Salvatore Tabbone 1
1 QGAR - Querying Graphics through Analysis and Recognition
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : In many vision problems, instead of having fully annotated training data, it is easier to obtain just a subset of data with annotations, because it is less restrictive for the user. For this reason, in this paper, we consider especially the problem of classifying weakly-annotated images, where just a small subset of the database is annotated with keywords. In this paper we present and evaluate a new method which improves the effectiveness of content-based image classification, by integrating semantic concepts extracted from text, and by automatically extending annotations to the images with missing keywords. Our model is inspired from the probabilistic graphical model theory: we propose a hierarchical mixture model which enables to handle missing values. Results of visual-textual classification, reported on a database of images collected from the Web, partially and manually annotated, show an improvement by 32.3% in terms of recognition rate against only visual information classification. Besides the automatic annotation extension with our model for images with missing keywords outperforms the visual-textual classification by 6.8%. Finally the proposed method is experimentally competitive with the state-of-art classifiers.
Complete list of metadata

Cited literature [14 references]  Display  Hide  Download

https://hal.inria.fr/inria-00389485
Contributor : Sabine Barrat <>
Submitted on : Friday, May 29, 2009 - 1:19:31 PM
Last modification on : Tuesday, May 18, 2021 - 3:32:05 PM
Long-term archiving on: : Friday, June 11, 2010 - 12:00:25 AM

File

spr08_vf.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Sabine Barrat, Salvatore Tabbone. Classification and Automatic Annotation Extension of Images Using Bayesian Network. Niels da Vitoria Lobo, Takis Kasparis, Fabio Roli et al. Structural, Syntactic, and Statistical Pattern Recognition, 5342, Springer Verlag, pp.937-946, 2008, Lecture Notes in Computer Science, 978-3-540-89688-3. ⟨10.1007/978-3-540-89689-0_97⟩. ⟨inria-00389485⟩

Share

Metrics

Record views

250

Files downloads

455