Skip to Main content Skip to Navigation
Conference papers

Introducing space and time in local feature-based endomicroscopic image retrieval

Abstract : Interpreting endomicroscopic images is still a significant challenge, especially since one single still image may not always contain enough information to make a robust diagnosis. To aid the physicians, we investigated some local feature-based retrieval methods that provide, given a query image, similar annotated images from a database of endomicroscopic images combined with high-level diagnosis represented as textual information. Local feature-based methods may be limited by the small field of view (FOV) of endomicroscopy and the fact that they do not take into account the spatial relationship between the local features, and the time relationship between successive images of the video sequences. To extract discriminative information over the entire image field, our proposed method collects local features in a dense manner instead of using a standard salient region detector. After the retrieval process, we introduce a verification step driven by the textual information in the database and in which spatial relationship between the local features is used. A spatial criterion is built from the co-occurence matrix of local features and used to remove outliers by thresholding on this criterion. To overcome the small-FOV problem and take advantage of the video sequence, we propose to combine image retrieval and mosaicing. Mosaicing essentially projects the temporal dimension onto a large field of view image. In this framework, videos, represented by mosaics, and single images can be retrieved with the same tools. With a leave-n-out cross-validation, our results show that taking into account the spatial relationship between local features and the temporal information of endomicroscopic videos by image mosaicing improves the retrieval accuracy.
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download
Contributor : Project-Team Asclepios <>
Submitted on : Friday, July 5, 2013 - 7:20:58 PM
Last modification on : Wednesday, August 7, 2019 - 4:10:02 PM
Document(s) archivé(s) le : Sunday, October 6, 2013 - 2:35:10 AM


Files produced by the author(s)




Barbara André, Tom Vercauteren, Aymeric Perchant, Anna M. Buchner, Michael B. Wallace, et al.. Introducing space and time in local feature-based endomicroscopic image retrieval. Proceedings of the MICCAI Workshop - Medical Content-based Retrieval for Clinical Decision (MCBR-CDS'09), 2009, London, United Kingdom. pp.18-30, ⟨10.1007/978-3-642-11769-5_2⟩. ⟨inria-00616139⟩



Record views


Files downloads