Integrating Perceptual Signal Features within a Multi-facetted Conceptual Model for Automatic Image Retrieval

Mohammed Belkhatir 1 Philippe Mulhem 1 Yves Chiaramella 1
1 MRIM - Modélisation et Recherche d’Information Multimédia [Grenoble]
LIG - Laboratoire d'Informatique de Grenoble, Inria - Institut National de Recherche en Informatique et en Automatique
Abstract : The majority of the content-based image retrieval (CBIR) systems are restricted to the representation of signal aspects, e.g. color, texture... without explicitly considering the semantic content of images. According to these approaches a sun, for example, is represented by an orange or yellow circle, but not by the term "sun". The signal-oriented solutions are fully automatic, and thus easily usable on substantial amounts of data, but they do not fill the existing gap between the extracted low-level features and semantic descriptions. This obviously penalizes qualitative and quantitative performances in terms of recall and precision, and therefore users' satisfaction. Another class of methods, which were tested within the framework of the Fermi-GC project, consisted in modeling the content of images following a sharp process of human-assisted indexing. This approach, based on an elaborate model of representation (the conceptual graph formalism) provides satisfactory results during the retrieval phase but is not easily usable on large collections of images because of the necessary human intervention required for indexing. The contribution of this paper is twofold: in order to achieve more efficiency as far as user interaction is concerned, we propose to highlight a bond between these two classes of image retrieval systems and integrate signal and semantic features within a unified conceptual framework. Then, as opposed to state-of-the-art relevance feedback systems dealing with this integration, we propose a representation formalism supporting this integration which allows us to specify a rich query language combining both semantic and signal characterizations. We will validate our approach through quantitative (recall-precision curves) evaluations.
Type de document :
Communication dans un congrès
ECIR, 2004, Sunderland, United Kingdom. pp.267--282, 2004
Liste complète des métadonnées

Littérature citée [21 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00953926
Contributeur : Marie-Christine Fauvet <>
Soumis le : lundi 3 mars 2014 - 12:53:20
Dernière modification le : jeudi 11 janvier 2018 - 06:22:06
Document(s) archivé(s) le : samedi 31 mai 2014 - 10:50:57

Fichier

ECIR2004_belkhatir.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00953926, version 1

Collections

Citation

Mohammed Belkhatir, Philippe Mulhem, Yves Chiaramella. Integrating Perceptual Signal Features within a Multi-facetted Conceptual Model for Automatic Image Retrieval. ECIR, 2004, Sunderland, United Kingdom. pp.267--282, 2004. 〈hal-00953926〉

Partager

Métriques

Consultations de la notice

216

Téléchargements de fichiers

108