Biomedical word Sense Disambiguation with Ontologies and Metadata: Automation Meets Accuracy

Abstract : BACKGROUND: Ontology term labels can be ambiguous and have multiple senses. While this is no problem for human annotators, it is a challenge to automated methods, which identify ontology terms in text. Classical approaches to word sense disambiguation use co-occurring words or terms. However, most treat ontologies as simple terminologies, without making use of the ontology structure or the semantic similarity between terms. Another useful source of information for disambiguation are metadata. Here, we systematically compare three approaches to word sense disambiguation, which use ontologies and metadata, respectively. RESULTS: The 'Closest Sense' method assumes that the ontology defines multiple senses of the term. It computes the shortest path of co-occurring terms in the document to one of these senses. The 'Term Cooc' method defines a log-odds ratio for co-occurring terms including co-occurrences inferred from the ontology structure. The 'MetaData' approach trains a classifier on metadata. It does not require any ontology, but requires training data, which the other methods do not. To evaluate these approaches we defined a manually curated training corpus of 2600 documents for seven ambiguous terms from the Gene Ontology and MeSH. All approaches over all conditions achieve 80\% success rate on average. The 'MetaData' approach performed best with 96\%, when trained on high-quality data. Its performance deteriorates as quality of the training data decreases. The 'Term Cooc' approach performs better on Gene Ontology (92\% success) than on MeSH (73\% success) as MeSH is not a strict is-a/part-of, but rather a loose is-related-to hierarchy. The 'Closest Sense' approach achieves on average 80\% success rate. CONCLUSION: Metadata is valuable for disambiguation, but requires high quality training data. Closest Sense requires no training, but a large, consistently modelled ontology, which are two opposing conditions. Term Cooc achieves greater 90\% success given a consistently modelled ontology. Overall, the results show that well structured ontologies can play a very important role to improve disambiguation. AVAILABILITY: The three benchmark datasets created for the purpose of disambiguation are available in Additional file 1.
Type de document :
Article dans une revue
BMC Bioinformatics, BioMed Central, 2009, 10, 〈10.1186/1471-2105-10-28〉
Liste complète des métadonnées

Littérature citée [48 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00378553
Contributeur : Khaled Khelif <>
Soumis le : vendredi 24 avril 2009 - 14:15:13
Dernière modification le : jeudi 11 janvier 2018 - 17:07:57
Document(s) archivé(s) le : jeudi 10 juin 2010 - 18:53:11

Fichier

1471-2105-10-28.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

Collections

Citation

Dimitra Alexopoulou, Bill Andreopoulos, Heiko Dietze, Andreas Doms, Fabien Gandon, et al.. Biomedical word Sense Disambiguation with Ontologies and Metadata: Automation Meets Accuracy. BMC Bioinformatics, BioMed Central, 2009, 10, 〈10.1186/1471-2105-10-28〉. 〈inria-00378553〉

Partager

Métriques

Consultations de la notice

266

Téléchargements de fichiers

280