Introducing space and time in local feature-based endomicroscopic image retrieval

Abstract : Interpreting endomicroscopic images is still a significant challenge, especially since one single still image may not always contain enough information to make a robust diagnosis. To aid the physicians, we investigated some local feature-based retrieval methods that provide, given a query image, similar annotated images from a database of endomicroscopic images combined with high-level diagnosis represented as textual information. Local feature-based methods may be limited by the small field of view (FOV) of endomicroscopy and the fact that they do not take into account the spatial relationship between the local features, and the time relationship between successive images of the video sequences. To extract discriminative information over the entire image field, our proposed method collects local features in a dense manner instead of using a standard salient region detector. After the retrieval process, we introduce a verification step driven by the textual information in the database and in which spatial relationship between the local features is used. A spatial criterion is built from the co-occurence matrix of local features and used to remove outliers by thresholding on this criterion. To overcome the small-FOV problem and take advantage of the video sequence, we propose to combine image retrieval and mosaicing. Mosaicing essentially projects the temporal dimension onto a large field of view image. In this framework, videos, represented by mosaics, and single images can be retrieved with the same tools. With a leave-n-out cross-validation, our results show that taking into account the spatial relationship between local features and the temporal information of endomicroscopic videos by image mosaicing improves the retrieval accuracy.
Type de document :
Communication dans un congrès
Proceedings of the MICCAI Workshop - Medical Content-based Retrieval for Clinical Decision (MCBR-CDS'09), 2009, London, United Kingdom. Springer, 5853, pp.18-30, 2010, Lecture Notes in Computer Science. 〈10.1007/978-3-642-11769-5_2〉
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00616139
Contributeur : Project-Team Asclepios <>
Soumis le : vendredi 5 juillet 2013 - 19:20:58
Dernière modification le : jeudi 11 janvier 2018 - 16:43:47
Document(s) archivé(s) le : dimanche 6 octobre 2013 - 02:35:10

Fichier

ANDRE-MCBRCDS09.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Barbara André, Tom Vercauteren, Aymeric Perchant, Anna M. Buchner, Michael B. Wallace, et al.. Introducing space and time in local feature-based endomicroscopic image retrieval. Proceedings of the MICCAI Workshop - Medical Content-based Retrieval for Clinical Decision (MCBR-CDS'09), 2009, London, United Kingdom. Springer, 5853, pp.18-30, 2010, Lecture Notes in Computer Science. 〈10.1007/978-3-642-11769-5_2〉. 〈inria-00616139〉

Partager

Métriques

Consultations de la notice

330

Téléchargements de fichiers

97