Enriching the NArabizi Treebank: A Multifaceted Approach to Supporting an Under-Resourced Language - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Enriching the NArabizi Treebank: A Multifaceted Approach to Supporting an Under-Resourced Language

Résumé

In this paper we address the scarcity of annotated data for NArabizi, a Romanized form of North African Arabic used mostly on social media, which poses challenges for Natural Language Processing (NLP). We introduce an enriched version of NArabizi Treebank (Seddah et al., 2020) with three main contributions: the addition of two novel annotation layers (named entity recognition and offensive language detection) and a re-annotation of the tokenization, morpho-syntactic and syntactic layers that ensure annotation consistency. Our experimental results, using different tokenization schemes, showcase the value of our contributions and highlight the impact of working with non-gold tokenization for NER and dependency parsing. To facilitate future research, we make these annotations publicly available. Our enhanced NArabizi Treebank paves the way for creating sophisticated language models and NLP tools for this under-represented language.
Fichier principal
Vignette du fichier
Narabizi_treebank_V2-11.pdf (186.95 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04243832 , version 1 (16-10-2023)

Licence

Paternité

Identifiants

Citer

Arij Riabi, Menel Mahamdi, Djamé Seddah. Enriching the NArabizi Treebank: A Multifaceted Approach to Supporting an Under-Resourced Language. Proceedings of the 17th Linguistic Annotation Workshop (LAW-XVII), Jul 2023, Toronto, Canada. pp.266-278, ⟨10.18653/v1/2023.law-1.26⟩. ⟨hal-04243832⟩
23 Consultations
16 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More