Gain Control over your Integration Evaluations

Patricia Arocena 1 Radu Ciucanu 2, 3 Boris Glavic 4 Renée Miller 1
2 LINKS - Linking Dynamic Data
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
Abstract : Integration systems are typically evaluated using a few real-world scenarios (e.g., bibliographical or biological datasets) or using synthetic scenarios (e.g., based on star-schemas or other patterns for schemas and constraints). Reusing such evaluations is a cumbersome task because their focus is usually limited to showcasing a specific feature of an approach. This makes it difficult to compare integration solutions, understand their generality, and understand their performance for different application scenarios. Based on this observation, we demonstrate some of the requirements for developing integration benchmarks. We argue that the major abstractions used for integration problems have converged in the last decade which enables the application of robust empirical methods to integration problems (from schema evolution, to data exchange, to answering queries using views and many more). Specifically, we demonstrate that schema mappings are the main abstraction that now drives most integration solutions and show how a metadata generator can be used to create more credible evaluations of the performance and scalability of data integration systems. We will use the demonstration to evangelize for more robust, shared empirical evaluations of data integration systems.
Type de document :
Article dans une revue
Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2015, 8 (12), pp.1960-1963. 〈http://vldb.org/2015/index.html〉
Liste complète des métadonnées

https://hal.inria.fr/hal-01187990
Contributeur : Radu Ciucanu <>
Soumis le : vendredi 28 août 2015 - 12:23:10
Dernière modification le : jeudi 11 janvier 2018 - 06:27:32

Identifiants

  • HAL Id : hal-01187990, version 1

Citation

Patricia Arocena, Radu Ciucanu, Boris Glavic, Renée Miller. Gain Control over your Integration Evaluations. Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2015, 8 (12), pp.1960-1963. 〈http://vldb.org/2015/index.html〉. 〈hal-01187990〉

Partager

Métriques

Consultations de la notice

136