Skip to Main content Skip to Navigation
Conference papers

A Semantically-Based Big Data Processing System Using Hadoop and Map-Reduce

Abstract : In financial industry, a wide range of financial systems generate vast amount of data in different structures, which change with compliance rules change and hard to manage due to their heterogeneity. This paper introduces a semantically-based big data processing system to integrate the data from different sources, which realizes the query and computation in semantic layer. The system provides a new data management way for the financial industry. With Semantic Web, the information can be managed, integrated, and collaborated in a more fluent way than it in traditional ETL. In order to clear the complex logical relationship among data, the system uses SPARQL to query. Through Map-Reduce, this system, based on Hadoop and Hbase can improve the processing speed for big data.
Complete list of metadata

Cited literature [3 references]  Display  Hide  Download

https://hal.inria.fr/hal-01646637
Contributor : Hal Ifip <>
Submitted on : Thursday, November 23, 2017 - 3:59:04 PM
Last modification on : Tuesday, October 15, 2019 - 11:00:04 AM

File

BookBackmatter_6.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

  • HAL Id : hal-01646637, version 1

Citation

Wang Wanting, Qin Zheng. A Semantically-Based Big Data Processing System Using Hadoop and Map-Reduce. 17th International Conference on Informatics and Semiotics in Organisations (ICISO), Aug 2016, Campinas, Brazil. pp.246-247. ⟨hal-01646637⟩

Share

Metrics

Record views

170

Files downloads

78