From Noisy Questions to Minecraft Texts: Annotation Challenges in Extreme Syntax Scenarios

Abstract : User-generated content presents many challenges for its automatic processing. While many of them do come from out-of-vocabulary effects, others spawn from different linguistic phenomena such as unusual syntax. In this work we present a French three-domain data set made up of question headlines from a cooking forum, game chat logs and associated forums from two popular online games (MINECRAFT & LEAGUE OF LEGENDS). We chose these domains because they encompass different degrees of lexical and syntactic compliance with canonical language. We conduct an automatic and manual evaluation of the difficulties of processing these domains for part-of-speech prediction, and introduce a pilot study to determine whether dependency analysis lends itself well to annotate these data. We also discuss the development cost of our data set.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [30 references]  Display  Hide  Download

https://hal.inria.fr/hal-01584054
Contributor : Benoît Sagot <>
Submitted on : Friday, September 8, 2017 - 11:35:41 AM
Last modification on : Thursday, April 4, 2019 - 1:23:10 AM

File

WNUT18.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01584054, version 1

Citation

Héctor Alonso Martínez, Djamé Seddah, Benoît Sagot. From Noisy Questions to Minecraft Texts: Annotation Challenges in Extreme Syntax Scenarios. 2nd Workshop on Noisy User-generated Text (W-NUT) at CoLing 2016, Dec 2016, Osaka, Japan. ⟨hal-01584054⟩

Share

Metrics

Record views

235

Files downloads

166