Design of ETL Process on Spatio-temporal Data and Study of Quality Control

Abstract : In order to use the space-time data mining technology to conduct operation research in WuLiangSuHai Eutrophication, the water quality sensor parameters of heterogeneous data which reflect the characteristics should set up a spatial data warehouse through ETL process, and water quality sensors for quality control of spatial and temporal data plays a vital role in building an effective analytical environment. The paper designs the ETL process from the data and water quality sensors artificial duty and other heterogeneous data sources spatial data, and proposes data quality control strategy based on the incremental frequency rule engine and the space the inverse distance weighting on the Combination. Experiments show that the incremental frequency rule engine could more effectively find the missing sensor data and abnormal, Space inverse distance weighting method can find the missing data and outliers in the errors within the allowed interpolation processing, ETL procedure is effective and feasible.
Document type :
Conference papers
Complete list of metadatas

Cited literature [8 references]  Display  Hide  Download

https://hal.inria.fr/hal-01559580
Contributor : Hal Ifip <>
Submitted on : Monday, July 10, 2017 - 5:28:09 PM
Last modification on : Tuesday, July 18, 2017 - 3:30:12 PM
Long-term archiving on : Wednesday, January 24, 2018 - 5:44:16 PM

File

978-3-642-18333-1_57_Chapter.p...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Buyu Wang, Changyou Li, Xueliang Fu, Meian Li, Dongqing Wang, et al.. Design of ETL Process on Spatio-temporal Data and Study of Quality Control. 4th Conference on Computer and Computing Technologies in Agriculture (CCTA), Oct 2010, Nanchang, China. pp.487-494, ⟨10.1007/978-3-642-18333-1_57⟩. ⟨hal-01559580⟩

Share

Metrics

Record views

91

Files downloads

98