Combining Textual and Visual Ontologies to Solve Medical Multimodal Queries

Saïd Radhouani Joo Hwee Lim Jean-Pierre Chevallet 1 Gilles Falquet 2
1 MRIM - Modélisation et Recherche d’Information Multimédia [Grenoble]
LIG - Laboratoire d'Informatique de Grenoble, Inria - Institut National de Recherche en Informatique et en Automatique
Abstract : In order to solve medical multimodal queries, we propose to split the queries in different dimensions using ontology. We extract both textual and visual terms depending on the ontology dimension they belong to. Based on these terms, we build different sub queries each corresponds to one query dimension. Then we use Boolean expressions on these sub queries to filter the entire document collection. The filtered document set is ranked using the techniques in Vector Space Model. We also combine the ranked lists generated using both text and image indexes to further improve the retrieval performance. We have achieved the best overall performance for the Medical Image Retrieval Task in CLEF 2005. These experimental results show that while most queries are better handled by the text query processing as most semantic information are contained in the medical text cases, both textual and visual ontology dimensions are complementary in improving the results during media fusion.
Type de document :
Communication dans un congrès
International Conference on Multimedia, and Expo IEEE ICME 2006, 2006, Toronto, Canada. 2006
Liste complète des métadonnées

https://hal.inria.fr/hal-00953896
Contributeur : Marie-Christine Fauvet <>
Soumis le : vendredi 28 février 2014 - 16:03:41
Dernière modification le : jeudi 11 octobre 2018 - 08:48:03

Identifiants

  • HAL Id : hal-00953896, version 1

Collections

Citation

Saïd Radhouani, Joo Hwee Lim, Jean-Pierre Chevallet, Gilles Falquet. Combining Textual and Visual Ontologies to Solve Medical Multimodal Queries. International Conference on Multimedia, and Expo IEEE ICME 2006, 2006, Toronto, Canada. 2006. 〈hal-00953896〉

Partager

Métriques

Consultations de la notice

162