Skip to Main content Skip to Navigation
Conference papers

Interpretation, Evaluation and the Semantic Gap ... What if we Were on a Side-Track?

Bart Lamiroy 1
1 QGAR - Querying Graphics through Analysis and Recognition
LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : A significant amount of research in Document Image Analysis, and Machine Perception in general, relies on the extraction and analysis of signal cues with the goal of interpreting them into higher level information. This paper gives an overview on how this interpretation process is usually considered, and how the research communities proceed in evaluating existing approaches and methods developed for realizing these processes. Evaluation being an essential part to measuring the quality of research and assessing the progress of the state-of-the art, our work aims at showing that classical evaluation methods are not necessarily well suited for interpretation problems, or, at least, that they introduce a strong bias, not necessarily visible at first sight, and that new ways of comparing methods and measuring performance are necessary. It also shows that the infamous {\em Semantic Gap} seems to be an inherent and unavoidable part of the general interpretation process, especially when considered within the framework of traditional evaluation. The use of Formal Concept Analysis is put forward to leverage these limitations into a new tool to the analysis and comparison of interpretation contexts.
Document type :
Conference papers
Complete list of metadatas

Cited literature [33 references]  Display  Hide  Download

https://hal.inria.fr/hal-01057362
Contributor : Bart Lamiroy <>
Submitted on : Friday, August 22, 2014 - 1:06:31 PM
Last modification on : Tuesday, December 18, 2018 - 4:38:34 PM
Long-term archiving on: : Thursday, November 27, 2014 - 1:45:40 PM

File

GREC_2013_LNCS.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01057362, version 1

Collections

Citation

Bart Lamiroy. Interpretation, Evaluation and the Semantic Gap ... What if we Were on a Side-Track?. 10th IAPR International Workshop on Graphics Recognition, GREC 2013, Aug 2013, Bethlehem, PA, United States. pp.213-226. ⟨hal-01057362⟩

Share

Metrics

Record views

310

Files downloads

226