Skip to Main content Skip to Navigation
Journal articles

Gain Control over your Integration Evaluations

Patricia C. Arocena 1 Radu Ciucanu 2, 3 Boris Glavic 4 Renée J. Miller 1 
2 LINKS - Linking Dynamic Data
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
Abstract : Integration systems are typically evaluated using a few real-world scenarios (e.g., bibliographical or biological datasets) or using synthetic scenarios (e.g., based on star-schemas or other patterns for schemas and constraints). Reusing such evaluations is a cumbersome task because their focus is usually limited to showcasing a specific feature of an approach. This makes it difficult to compare integration solutions, understand their generality, and understand their performance for different application scenarios. Based on this observation, we demonstrate some of the requirements for developing integration benchmarks. We argue that the major abstractions used for integration problems have converged in the last decade which enables the application of robust empirical methods to integration problems (from schema evolution, to data exchange, to answering queries using views and many more). Specifically, we demonstrate that schema mappings are the main abstraction that now drives most integration solutions and show how a metadata generator can be used to create more credible evaluations of the performance and scalability of data integration systems. We will use the demonstration to evangelize for more robust, shared empirical evaluations of data integration systems.
Document type :
Journal articles
Complete list of metadata
Contributor : Radu Ciucanu Connect in order to contact the contributor
Submitted on : Friday, August 28, 2015 - 12:23:10 PM
Last modification on : Tuesday, May 3, 2022 - 3:14:03 PM



Patricia C. Arocena, Radu Ciucanu, Boris Glavic, Renée J. Miller. Gain Control over your Integration Evaluations. Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2015, 8 (12), pp.1960-1963. ⟨10.14778/2824032.2824111⟩. ⟨hal-01187990⟩



Record views