Information Extraction with Active Learning: A Case Study in Legal Text

Cristian Cardellino 1, * Serena Villata 2 Laura Alonso Alemany 1 Elena Cabrio 2
* Corresponding author
2 WIMMICS - Web-Instrumented Man-Machine Interactions, Communities and Semantics
CRISAM - Inria Sophia Antipolis - Méditerranée , Laboratoire I3S - SPARKS - Scalable and Pervasive softwARe and Knowledge Systems
Abstract : Active learning has been successfully applied to a number of NLP tasks. In this paper, we present a study on Information Extraction for natural language licenses that need to be translated to RDF. The final purpose of our work is to automatically extract from a natural language document specifying a certain license a machine-readable description of the terms of use and reuse identified in such license. This task presents some peculiarities that make it specially interesting to study: highly repetitive text, few annotated or unannotated examples available, and very fine precision needed. In this paper we compare different active learning settings for this particular application. We show that the most straightforward approach to instance selection, uncertainty sampling, does not provide a good performance in this setting, performing even worse than passive learning. Density-based methods are the usual alternative to uncertainty sampling, in contexts with very few labelled instances. We show that we can obtain a similar effect to that of density-based methods using uncertainty sampling, by just reversing the ranking criterion, and choosing the most certain instead of the most uncertain instances.
Complete list of metadatas

https://hal.inria.fr/hal-01171856
Contributor : Elena Cabrio <>
Submitted on : Wednesday, July 15, 2015 - 11:02:15 AM
Last modification on : Monday, November 5, 2018 - 3:52:09 PM
Long-term archiving on: Wednesday, April 26, 2017 - 12:00:43 AM

File

paper_237.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Cristian Cardellino, Serena Villata, Laura Alonso Alemany, Elena Cabrio. Information Extraction with Active Learning: A Case Study in Legal Text. CICLing 2015 - Proceedings of the 16th International Conference on Intelligence Text Processing and Computational Linguistics, Apr 2015, Il Cairo, Egypt. ⟨10.1007/978-3-319-18117-2_36⟩. ⟨hal-01171856⟩

Share

Metrics

Record views

501

Files downloads

634