Skip to Main content Skip to Navigation
New interface
Conference papers

Interpretation, Evaluation and the Semantic Gap ... What if we Were on a Side-Track?

Bart Lamiroy 1 
1 QGAR - Querying Graphics through Analysis and Recognition
LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : A significant amount of research in Document Image Analysis, and Machine Perception in general, relies on the extraction and analysis of signal cues with the goal of interpreting them into higher level information. This paper gives an overview on how this interpretation process is usually considered, and how the research communities proceed in evaluating existing approaches and methods developed for realizing these processes. Evaluation being an essential part to measuring the quality of research and assessing the progress of the state-of-the art, our work aims at showing that classical evaluation methods are not necessarily well suited for interpretation problems, or, at least, that they introduce a strong bias, not necessarily visible at first sight, and that new ways of comparing methods and measuring performance are necessary. It also shows that the infamous {\em Semantic Gap} seems to be an inherent and unavoidable part of the general interpretation process, especially when considered within the framework of traditional evaluation. The use of Formal Concept Analysis is put forward to leverage these limitations into a new tool to the analysis and comparison of interpretation contexts.
Document type :
Conference papers
Complete list of metadata

Cited literature [33 references]  Display  Hide  Download
Contributor : Bart Lamiroy Connect in order to contact the contributor
Submitted on : Friday, August 22, 2014 - 1:06:31 PM
Last modification on : Saturday, October 16, 2021 - 11:26:09 AM
Long-term archiving on: : Thursday, November 27, 2014 - 1:45:40 PM


Files produced by the author(s)


  • HAL Id : hal-01057362, version 1



Bart Lamiroy. Interpretation, Evaluation and the Semantic Gap ... What if we Were on a Side-Track?. 10th IAPR International Workshop on Graphics Recognition, GREC 2013, Aug 2013, Bethlehem, PA, United States. pp.213-226. ⟨hal-01057362⟩



Record views


Files downloads