Skip to Main content Skip to Navigation
New interface
Conference papers

Syntactic testsuites and Textual Entailment Recognition

Paul Bedaride 1 Claire Gardent 1 
1 TALARIS - Natural Language Processing: representation, inference and semantics
Inria Nancy - Grand Est, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : We focus on textual entailments mediated by syntax and propose a new methodology to evaluate textual entailment recognition systems on such data. The main idea is to generate a syntactically annotated corpus of pairs of (non-)entailments and to use error mining to identify the most likely sources of errors. To illustrate the approach, we apply this methodology to the Afazio RTE system and show how it permits identifying the most likely sources of errors made by this system on a testsuite of 10 000 (non) entailment pairs.
Document type :
Conference papers
Complete list of metadata

Cited literature [7 references]  Display  Hide  Download
Contributor : Paul Bedaride Connect in order to contact the contributor
Submitted on : Monday, November 15, 2010 - 9:39:53 AM
Last modification on : Friday, February 4, 2022 - 3:30:17 AM
Long-term archiving on: : Friday, October 26, 2012 - 3:40:12 PM


Files produced by the author(s)


  • HAL Id : inria-00536020, version 1



Paul Bedaride, Claire Gardent. Syntactic testsuites and Textual Entailment Recognition. The seventh International Conference on Language Resources and Evaluation - LREC 2010, May 2010, Valletta, Malta. ⟨inria-00536020⟩



Record views


Files downloads