hal-00337371, version 1
A test suite for inference involving adjectives
sixth international conference on Language Resources and Evaluation (2008) 19-27
Résumé : Recently, most of the research in NLP has concentrated on the creation of applications coping with textual entailment. However, there still exist very few resourses for the evaluation of such applications. We argue that the reason for this resides not only in the novelty of the research field but also and mainly in the difficulty of defining the linguistic phenomena which are responsible for inference. As the TSNLP project has shown test suites provide an optimal diagnostic and evaluation tools for NLP applications, as contrary to text corpora they provide a deep insight in the linguistic phenomena allowing control over the data. Thus in this paper, we present a test suite specifically developed for studying inference problems shown by English adjectives. The construction of the test suite is based on the deep linguistic analysis and following classification of entailment patterns of adjectives and follows the TSNLP guidelines on linguistic databases providing a clear coverage, systematic annotation of inference tasks, large reusability and simple maintenance. With the design of this test suite we aim at creating a resource supporting the evaluation of computational systems handling natural language inference and in particular at providing a benchmark against which to evaluate and compare existing semantic analysers.
- 1 :
- CNRS : UMR7503 – INRIA – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
- Domaine : Informatique/Traitement du texte et du document
- Mots-clés : textual entailment – adjective semantics – classification
- hal-00337371, version 1
- http://hal.archives-ouvertes.fr/hal-00337371
- oai:hal.archives-ouvertes.fr:hal-00337371
- Contributeur :
- Soumis le : Jeudi 6 Novembre 2008, 17:38:55
- Dernière modification le : Lundi 10 Novembre 2008, 17:26:13




Documents associés
Exporter