Interpretation, Evaluation and the Semantic Gap ... What if we Were on a Side-Track?

Bart Lamiroy 1
1 QGAR - Querying Graphics through Analysis and Recognition
LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : A significant amount of research in Document Image Analysis, and Machine Perception in general, relies on the extraction and analysis of signal cues with the goal of interpreting them into higher level information. This paper gives an overview on how this interpretation process is usually considered, and how the research communities proceed in evaluating existing approaches and methods developed for realizing these processes. Evaluation being an essential part to measuring the quality of research and assessing the progress of the state-of-the art, our work aims at showing that classical evaluation methods are not necessarily well suited for interpretation problems, or, at least, that they introduce a strong bias, not necessarily visible at first sight, and that new ways of comparing methods and measuring performance are necessary. It also shows that the infamous {\em Semantic Gap} seems to be an inherent and unavoidable part of the general interpretation process, especially when considered within the framework of traditional evaluation. The use of Formal Concept Analysis is put forward to leverage these limitations into a new tool to the analysis and comparison of interpretation contexts.
Type de document :
Communication dans un congrès
Bart Lamiroy and Jean-Marc Ogier. 10th IAPR International Workshop on Graphics Recognition, GREC 2013, Aug 2013, Bethlehem, PA, United States. Springer, 8746, pp.213-226, 2014, LNCS
Liste complète des métadonnées

Littérature citée [33 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01057362
Contributeur : Bart Lamiroy <>
Soumis le : vendredi 22 août 2014 - 13:06:31
Dernière modification le : mardi 24 avril 2018 - 13:21:59
Document(s) archivé(s) le : jeudi 27 novembre 2014 - 13:45:40

Fichier

GREC_2013_LNCS.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01057362, version 1

Collections

Citation

Bart Lamiroy. Interpretation, Evaluation and the Semantic Gap ... What if we Were on a Side-Track?. Bart Lamiroy and Jean-Marc Ogier. 10th IAPR International Workshop on Graphics Recognition, GREC 2013, Aug 2013, Bethlehem, PA, United States. Springer, 8746, pp.213-226, 2014, LNCS. 〈hal-01057362〉

Partager

Métriques

Consultations de la notice

253

Téléchargements de fichiers

85