Skip to Main content Skip to Navigation
New interface
Conference papers

Semi-automated Query Construction for Content-based Endomicroscopy Video Retrieval

Marzieh Kohandani Tafreshi 1, 2, * Nicolas Linard 1 Barbara André 1 Nicholas Ayache 2 Tom Vercauteren 1 
* Corresponding author
2 ASCLEPIOS - Analysis and Simulation of Biomedical Images
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : Content-based video retrieval has shown promising results to help physicians in their interpretation of medical videos in general and endomicroscopic ones in particular. Defining a relevant query for CBVR can however be a complex and time-consuming task for non-expert and even expert users. Indeed, uncut endomicroscopy videos may very well contain images corresponding to a variety of different tissue types. Using such uncut videos as queries may lead to drastic performance degradations for the system. In this study, we propose a semi-automated methodology that allows the physician to create meaningful and relevant queries in a simple and efficient manner. We believe that this will lead to more reproducible and more consistent results. The validation of our method is divided into two approaches. The first one is an indirect validation based on per video classification results with histopathological ground-truth. The second one is more direct and relies on perceived inter-video visual similarity ground-truth. We demonstrate that our proposed method significantly outperforms the approach with uncut videos and approaches the performance of a tedious manual query construction by an expert. Finally, we show that the similarity perceived between videos by experts is significantly correlated with the inter-video similarity distance computed by our retrieval system.
Document type :
Conference papers
Complete list of metadata

Cited literature [15 references]  Display  Hide  Download
Contributor : Marzieh Kohandani Tafreshi Connect in order to contact the contributor
Submitted on : Friday, June 20, 2014 - 11:31:41 AM
Last modification on : Saturday, June 25, 2022 - 11:14:02 PM
Long-term archiving on: : Saturday, September 20, 2014 - 10:50:56 AM


Files produced by the author(s)


  • HAL Id : hal-01010673, version 1



Marzieh Kohandani Tafreshi, Nicolas Linard, Barbara André, Nicholas Ayache, Tom Vercauteren. Semi-automated Query Construction for Content-based Endomicroscopy Video Retrieval. Medical Image Computing and Computer Assisted Intervention (MICCAI), Sep 2014, Boston, United States. ⟨hal-01010673⟩



Record views


Files downloads