Skip to Main content Skip to Navigation
Conference papers

Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell

Abstract : We introduce the first treebank for a romanized user-generated content variety of Algerian, a North-African Arabic dialect known for its frequent usage of code-switching. Made of 1500 sentences, fully annotated in morpho-syntax and Universal Dependency syntax, with full translation at both the word and the sentence levels, this treebank is made freely available. It is supplemented with 50k unlabeled sentences collected from Common Crawl and web-crawled data using intensive data-mining techniques. Preliminary experiments demonstrate its usefulness for POS tagging and dependency parsing. We believe that what we present in this paper is useful beyond the low-resource language community. This is the first time that enough unlabeled and annotated data is provided for an emerging user-generated content dialectal language with rich morphology and code switching, making it an challenging test-bed for most recent NLP approaches.
Document type :
Conference papers
Complete list of metadata

Cited literature [7 references]  Display  Hide  Download

https://hal.inria.fr/hal-02889804
Contributor : Benoît Sagot <>
Submitted on : Sunday, July 5, 2020 - 1:03:13 PM
Last modification on : Tuesday, March 9, 2021 - 8:42:46 AM
Long-term archiving on: : Friday, November 27, 2020 - 11:29:36 AM

File

Building_an_Arabizi_Treebank__...
Files produced by the author(s)

Identifiers

Citation

Djamé Seddah, Farah Essaidi, Amal Fethi, Matthieu Futeral, Benjamin Muller, et al.. Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell. ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, Canada. ⟨10.18653/v1/2020.acl-main.107⟩. ⟨hal-02889804⟩

Share

Metrics

Record views

112

Files downloads

472