Skip to Main content Skip to Navigation
New interface
Journal articles

Coupling an annotated corpus and a lexicon for state-of-the-art POS tagging

Pascal Denis 1 Benoît Sagot 1 
1 ALPAGE - Analyse Linguistique Profonde à Grande Echelle ; Large-scale deep linguistic processing
Inria Paris-Rocquencourt, UPD7 - Université Paris Diderot - Paris 7
Abstract : This paper investigates how to best couple hand-annotated data with information extracted from an external lexical resource to improve POS tagging performance. Focusing on French tagging, we introduce a maximum entropy conditional sequence tagging system that is enriched with information extracted from a morphological resource. This system gives a 97.7% accuracy on the French Treebank, an error reduction of 23% (28% on unknown words) over the same tagger without lexical information. We also conduct experiments on datasets and lexicons of varying sizes in order to assess the best trade-off between annotating data vs. developing a lexicon. We find that the use of a lexicon improves the quality of the tagger at any stage of development of either resource, and that for fixed performance levels the availability of the full lexicon consistently reduces the need for supervised data by at least one half.
Document type :
Journal articles
Complete list of metadata

Cited literature [28 references]  Display  Hide  Download
Contributor : Pascal Denis Connect in order to contact the contributor
Submitted on : Friday, July 20, 2012 - 10:40:25 AM
Last modification on : Wednesday, November 2, 2022 - 10:45:54 AM
Long-term archiving on: : Sunday, October 21, 2012 - 2:20:17 AM


Files produced by the author(s)



Pascal Denis, Benoît Sagot. Coupling an annotated corpus and a lexicon for state-of-the-art POS tagging. Language Resources and Evaluation, 2012, 46 (4), pp.721-736. ⟨10.1007/s10579-012-9193-0⟩. ⟨inria-00614819⟩



Record views


Files downloads