Efficient and Effective Duplicate Detection in Hierarchical Data - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Knowledge and Data Engineering Année : 2012

Efficient and Effective Duplicate Detection in Hierarchical Data

Résumé

Although there is a long line of work on identifying duplicates in relational data, only a few solutions focus on duplicate detection in more complex hierarchical structures, like XML data. In this paper, we present a novel method for XML duplicate detection, called XMLDup. XMLDup uses a Bayesian network to determine the probability of two XML elements being duplicates, considering not only the information within the elements, but also the way that information is structured. In addition, to improve the efficiency of the network evaluation, a novel pruning strategy, capable of significant gains over the unoptimized version of the algorithm, is presented. Through experiments, we show that our algorithm is able to achieve high precision and recall scores in several datasets. XMLDup is also able to outperform another state of the art duplicate detection solution, both in terms of efficiency and of effectiveness.
Fichier principal
Vignette du fichier
leitao_calado_herschel_tkde12.pdf (541.48 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-00722505 , version 1 (11-04-2014)

Identifiants

Citer

Luís Leitão, Pável Calado, Melanie Herschel. Efficient and Effective Duplicate Detection in Hierarchical Data. IEEE Transactions on Knowledge and Data Engineering, 2012, 99 (PrePrints), ⟨10.1109/TKDE.2012.60⟩. ⟨hal-00722505⟩
274 Consultations
881 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More