Syntactic testsuites and Textual Entailment Recognition

Paul Bedaride 1 Claire Gardent 1
1 TALARIS - Natural Language Processing: representation, inference and semantics
Inria Nancy - Grand Est, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : We focus on textual entailments mediated by syntax and propose a new methodology to evaluate textual entailment recognition systems on such data. The main idea is to generate a syntactically annotated corpus of pairs of (non-)entailments and to use error mining to identify the most likely sources of errors. To illustrate the approach, we apply this methodology to the Afazio RTE system and show how it permits identifying the most likely sources of errors made by this system on a testsuite of 10 000 (non) entailment pairs.
Document type :
Conference papers
Complete list of metadatas

Cited literature [7 references]  Display  Hide  Download

https://hal.inria.fr/inria-00536020
Contributor : Paul Bedaride <>
Submitted on : Monday, November 15, 2010 - 9:39:53 AM
Last modification on : Thursday, January 11, 2018 - 6:21:35 AM
Long-term archiving on : Friday, October 26, 2012 - 3:40:12 PM

File

lrec10-bedgar.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00536020, version 1

Collections

Citation

Paul Bedaride, Claire Gardent. Syntactic testsuites and Textual Entailment Recognition. The seventh International Conference on Language Resources and Evaluation - LREC 2010, May 2010, Valletta, Malta. ⟨inria-00536020⟩

Share

Metrics

Record views

370

Files downloads

110