Improvements in Information Extraction in Legal Text by Active Learning

Abstract : Managing licensing information and data rights is becoming a crucial issue in the Linked (Open) Data scenario. An open problem in this scenario is how to associate machine-readable licenses specifications to the data, so that automated approaches to treat such information can be fruitfully exploited to avoid data misuse. This means that we need a way to automatically extract from a natural language document specifying a certain license a machine-readable description of the terms of use and reuse identified in such license. Ontology-based Information Extraction is crucial to translate natural language documents into Linked Data. This connection supports consumers in navigating documents and semantically related data. However , the performances of automated information extraction systems are far from being perfect, and rely heavily on human intervention, either to create heuristics, to annotate examples for inferring models, or to interpret or validate patterns emerging from data. In this paper, we apply different Active Learning strategies to Information Extraction (IE) from licenses in English, with highly repetitive text, few annotated or unannotated examples available, and very fine precision needed. We show that the most popular approach to active learning, i.e., uncertainty sampling for instance selection, does not provide a good performance in this setting. We show that we can obtain a similar effect to that of density-based methods using uncertainty sampling , by just reversing the ranking criterion, and choosing the most certain instead of the most uncertain instances.
Document type :
Conference papers
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download

https://hal.inria.fr/hal-01236697
Contributor : Serena Villata <>
Submitted on : Wednesday, December 2, 2015 - 10:17:38 AM
Last modification on : Monday, November 5, 2018 - 3:52:09 PM
Long-term archiving on : Thursday, March 3, 2016 - 11:30:52 AM

File

activeNLL2RDF.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01236697, version 1

Collections

Citation

Cristian Cardellino, Laura Alonso Alemany, Serena Villata, Elena Cabrio. Improvements in Information Extraction in Legal Text by Active Learning. Proceedings of the 28th Annual Conference on Legal Knowledge and Information Systems, Dec 2015, Braga, Portugal. pp.21-30. ⟨hal-01236697⟩

Share

Metrics

Record views

626

Files downloads

401