Handling probabilistic integrity constraints in pay-as-you-go reconciliation of data models

Abstract : Data models capture the structure and characteristic properties of data entities, e.g., in terms of a database schema or an ontology. They are the backbone of diverse applications, reaching from information integration, through peer-to-peer systems and electronic commerce to social networking. Many of these applications involve models of diverse data sources. Effective utilisation and evolution of data models, therefore, calls for matching techniques that generate correspondences between their elements. Various such matching tools have been developed in the past. Yet, their results are often incomplete or erroneous, and thus need to be reconciled, i.e., validated by an expert. This paper analyses the reconciliation process in the presence of large collections of data models, where the network induced by generated correspondences shall meet consistency expectations in terms of integrity constraints. We specifically focus on how to handle data models that show some internal structure and potentially differ in terms of their assumed level of abstraction. We argue that such a setting calls for a probabilistic model of integrity constraints, for which satisfaction is preferred, but not required. In this work, we present a model for probabilistic constraints that enables reasoning on the correctness of individual correspondences within a network of data models, in order to guide an expert in the validation process. To support pay-as-you-go reconciliation, we also show how to construct a set of high-quality correspondences, even if an expert validates only a subset of all generated correspondences. We demonstrate the efficiency of our techniques for real-world datasets comprising database schemas and ontologies from various application domains.
Document type :
Journal articles
Complete list of metadatas

Cited literature [78 references]  Display  Hide  Download

https://hal.inria.fr/hal-02099877
Contributor : Zoltan Miklos <>
Submitted on : Tuesday, April 16, 2019 - 1:32:44 PM
Last modification on : Monday, July 15, 2019 - 2:11:13 PM

File

 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2019-10-05

Please log in to resquest access to the document

Identifiers

Citation

Nguyen Quoc Viet Hung, Matthias Weidlich, Nguyen Tam, Zoltan Miklos, Karl Aberer, et al.. Handling probabilistic integrity constraints in pay-as-you-go reconciliation of data models. Information Systems, Elsevier, 2019, 83, pp.166-180. ⟨10.1016/j.is.2019.04.002⟩. ⟨hal-02099877⟩

Share

Metrics

Record views

37