Design of ETL Process on Spatio-temporal Data and Study of Quality Control

Abstract : In order to use the space-time data mining technology to conduct operation research in WuLiangSuHai Eutrophication, the water quality sensor parameters of heterogeneous data which reflect the characteristics should set up a spatial data warehouse through ETL process, and water quality sensors for quality control of spatial and temporal data plays a vital role in building an effective analytical environment. The paper designs the ETL process from the data and water quality sensors artificial duty and other heterogeneous data sources spatial data, and proposes data quality control strategy based on the incremental frequency rule engine and the space the inverse distance weighting on the Combination. Experiments show that the incremental frequency rule engine could more effectively find the missing sensor data and abnormal, Space inverse distance weighting method can find the missing data and outliers in the errors within the allowed interpolation processing, ETL procedure is effective and feasible.
Type de document :
Communication dans un congrès
Daoliang Li; Yande Liu; Yingyi Chen. 4th Conference on Computer and Computing Technologies in Agriculture (CCTA), Oct 2010, Nanchang, China. Springer, IFIP Advances in Information and Communication Technology, AICT-344 (Part I), pp.487-494, 2011, Computer and Computing Technologies in Agriculture IV. 〈10.1007/978-3-642-18333-1_57〉
Liste complète des métadonnées

Littérature citée [8 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01559580
Contributeur : Hal Ifip <>
Soumis le : lundi 10 juillet 2017 - 17:28:09
Dernière modification le : mardi 18 juillet 2017 - 15:30:12
Document(s) archivé(s) le : mercredi 24 janvier 2018 - 17:44:16

Fichier

978-3-642-18333-1_57_Chapter.p...
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Buyu Wang, Changyou Li, Xueliang Fu, Meian Li, Dongqing Wang, et al.. Design of ETL Process on Spatio-temporal Data and Study of Quality Control. Daoliang Li; Yande Liu; Yingyi Chen. 4th Conference on Computer and Computing Technologies in Agriculture (CCTA), Oct 2010, Nanchang, China. Springer, IFIP Advances in Information and Communication Technology, AICT-344 (Part I), pp.487-494, 2011, Computer and Computing Technologies in Agriculture IV. 〈10.1007/978-3-642-18333-1_57〉. 〈hal-01559580〉

Partager

Métriques

Consultations de la notice

65

Téléchargements de fichiers

22