Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell

Résumé

We introduce the first treebank for a romanized user-generated content variety of Algerian, a North-African Arabic dialect known for its frequent usage of code-switching. Made of 1500 sentences, fully annotated in morpho-syntax and Universal Dependency syntax, with full translation at both the word and the sentence levels, this treebank is made freely available. It is supplemented with 50k unlabeled sentences collected from Common Crawl and web-crawled data using intensive data-mining techniques. Preliminary experiments demonstrate its usefulness for POS tagging and dependency parsing. We believe that what we present in this paper is useful beyond the low-resource language community. This is the first time that enough unlabeled and annotated data is provided for an emerging user-generated content dialectal language with rich morphology and code switching, making it an challenging test-bed for most recent NLP approaches.
Fichier principal
Vignette du fichier
Building_an_Arabizi_Treebank__Tackling_Hell.pdf (488.8 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02889804 , version 1 (05-07-2020)

Identifiants

Citer

Djamé Seddah, Farah Essaidi, Amal Fethi, Matthieu Futeral, Benjamin Muller, et al.. Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell. ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, United States. ⟨10.18653/v1/2020.acl-main.107⟩. ⟨hal-02889804⟩
137 Consultations
412 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More