The iBench Integration Metadata Generator

Abstract : Given the maturity of the data integration field it is surprising that rigorous empirical evaluations of research ideas are so scarce. We identify a major roadblock for empirical work - the lack of comprehensive metadata generators that can be used to create benchmarks for different integration tasks. This makes it difficult to compare integration solutions, understand their generality, and understand their performance. We present iBench, the first metadata generator that can be used to evaluate a wide-range of integration tasks (data exchange, mapping creation, mapping composition, schema evolution, among many others). iBench permits control over the size and characteristics of the metadata it generates (schemas, constraints, and mappings). Our evaluation demonstrates that iBench can efficiently generate very large, complex, yet realistic scenarios with different characteristics. We also present an evaluation of three mapping creation systems using iBench and show that the intricate control that iBench provides over metadata scenarios can reveal new and important empirical insights. iBench is an open-source, extensible tool that we are providing to the community. We believe it will raise the bar for empirical evaluation and comparison of data integration systems.
Type de document :
Article dans une revue
Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2015, 9 (3), pp.108-119. 〈http://www.vldb.org/pvldb/vol9/p108-arocena.pdf〉
Liste complète des métadonnées

https://hal.inria.fr/hal-01251237
Contributeur : Radu Ciucanu <>
Soumis le : mardi 5 janvier 2016 - 18:49:11
Dernière modification le : mardi 5 janvier 2016 - 18:49:10

Identifiants

  • HAL Id : hal-01251237, version 1

Citation

Patricia Arocena, Boris Glavic, Radu Ciucanu, Renée Miller. The iBench Integration Metadata Generator. Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2015, 9 (3), pp.108-119. 〈http://www.vldb.org/pvldb/vol9/p108-arocena.pdf〉. 〈hal-01251237〉

Partager

Métriques

Consultations de la notice

41