Annotating omission in statement pairs - Archive ouverte HAL Access content directly
Conference Papers Year : 2017

Annotating omission in statement pairs

(1) , (2, 3) , (1)
1
2
3

Abstract

In this piece of industrial application, we focus on the identification of omission in statement pairs for an online news platform. We compare three annotation schemes, namely two crowdsourcing schemes and an expert annotation. The simplest of the two crowdsourcing approaches yields a better annotation quality than the more complex one. We use a dedicated classifier to assess whether the annotators' behaviour can be explained by straightforward linguistic features. However , for our task, we argue that expert and not crowdsourcing-based annotation is the best compromise between cost and quality.
Fichier principal
Vignette du fichier
annotating-omission-statement.pdf (273.02 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01584035 , version 1 (08-09-2017)

Identifiers

  • HAL Id : hal-01584035 , version 1

Cite

Héctor Martínez Alonso, Amaury Delamaire, Benoît Sagot. Annotating omission in statement pairs. 11th Linguistic Annotation Workshop, Apr 2017, Valencia, Spain. pp.41-45. ⟨hal-01584035⟩
136 View
137 Download

Share

Gmail Facebook Twitter LinkedIn More