Gain Control over your Integration Evaluations - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Proceedings of the VLDB Endowment (PVLDB) Année : 2015

Gain Control over your Integration Evaluations

Patricia C. Arocena
  • Fonction : Auteur
  • PersonId : 969192
Radu Ciucanu
Boris Glavic
  • Fonction : Auteur
  • PersonId : 969193
Renée J. Miller
  • Fonction : Auteur
  • PersonId : 969194

Résumé

Integration systems are typically evaluated using a few real-world scenarios (e.g., bibliographical or biological datasets) or using synthetic scenarios (e.g., based on star-schemas or other patterns for schemas and constraints). Reusing such evaluations is a cumbersome task because their focus is usually limited to showcasing a specific feature of an approach. This makes it difficult to compare integration solutions, understand their generality, and understand their performance for different application scenarios. Based on this observation, we demonstrate some of the requirements for developing integration benchmarks. We argue that the major abstractions used for integration problems have converged in the last decade which enables the application of robust empirical methods to integration problems (from schema evolution, to data exchange, to answering queries using views and many more). Specifically, we demonstrate that schema mappings are the main abstraction that now drives most integration solutions and show how a metadata generator can be used to create more credible evaluations of the performance and scalability of data integration systems. We will use the demonstration to evangelize for more robust, shared empirical evaluations of data integration systems.
Fichier non déposé

Dates et versions

hal-01187990 , version 1 (28-08-2015)

Identifiants

Citer

Patricia C. Arocena, Radu Ciucanu, Boris Glavic, Renée J. Miller. Gain Control over your Integration Evaluations. Proceedings of the VLDB Endowment (PVLDB), 2015, 8 (12), pp.1960-1963. ⟨10.14778/2824032.2824111⟩. ⟨hal-01187990⟩
87 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More