On fixing semantic alignment evaluation measures

Jérôme David 1 Jérôme Euzenat 1
1 EXMO - Computer mediated exchange of structured knowledge
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : The evaluation of ontology matching algorithms mainly consists of comparing a produced alignment with a reference one. Usually, this evaluation relies on the classical precision and recall measures. This evaluation model is not satisfactory since it does not take into account neither the closeness of correspondances, nor the semantics of alignments. A first solution consists of generalizing the precision and recall measures in order to solve the problem of rigidity of classical model. Another solution aims at taking advantage of the semantic of alignments in the evaluation. In this paper, we show and analyze the limits of these evaluation models. Given that measures values depend on the syntactic form of the alignment, we first propose an normalization of alignment. Then, we propose two new sets of evaluation measures. The first one is a semantic extension of relaxed precision and recall. The second one consists of bounding the alignment space to make ideal semantic precision and recall applicable.
Type de document :
Communication dans un congrès
Proc. 3rd ISWC workshop on ontology matching (OM), Oct 2008, Karlsruhe, Germany. No commercial editor., pp.25-36, 2008
Liste complète des métadonnées

Littérature citée [6 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00793536
Contributeur : Jérôme Euzenat <>
Soumis le : vendredi 22 février 2013 - 15:06:58
Dernière modification le : jeudi 11 janvier 2018 - 06:22:01
Document(s) archivé(s) le : jeudi 23 mai 2013 - 07:30:07

Fichier

om2008_Tpaper3.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00793536, version 1

Collections

Citation

Jérôme David, Jérôme Euzenat. On fixing semantic alignment evaluation measures. Proc. 3rd ISWC workshop on ontology matching (OM), Oct 2008, Karlsruhe, Germany. No commercial editor., pp.25-36, 2008. 〈hal-00793536〉

Partager

Métriques

Consultations de la notice

283

Téléchargements de fichiers

112