Skip to Main content Skip to Navigation
Conference papers

An Efficient Unsavory Data Detection Method for Internet Big Data

Abstract : With the explosion of information technologies, the volume and diversity of the data in the cyberspace are growing rapidly; meanwhile the unsavory data are harming the security of Internet. So how to detect the unsavory data from the Internet big data based on their inner semantic information is of growing importance. In this paper, we propose the i-Tree method, an intelligent semantics-based unsavory data detection method for internet big data. Firstly, the internet big data are mapped into a high-dimensional feature space, representing as high-dimensional points in the feature space. Secondly, to solve the “curse of dimensionality” problem of the high-dimensional feature space, the principal component analysis (PCA) method is used to reduce the dimensionality of the feature space. Thirdly, in the new generated feature space, we cluster the data objects, transform the data clusters into regular unit hyper-cubes and create one-dimensional index for data objects based on the idea of multi-dimensional index. Finally, we realize the semantics-based data detection for a given unsavory data object according to similarity search algorithm and the experimental results proved our method can achieve much better efficiency.
Complete list of metadatas

Cited literature [7 references]  Display  Hide  Download

https://hal.inria.fr/hal-01466222
Contributor : Hal Ifip <>
Submitted on : Monday, February 13, 2017 - 2:31:10 PM
Last modification on : Thursday, March 5, 2020 - 4:47:15 PM
Long-term archiving on: : Sunday, May 14, 2017 - 2:16:48 PM

File

978-3-319-24315-3_21_Chapter.p...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Peige Ren, Xiaofeng Wang, Hao Sun, Fen Xu, Baokang Zhao, et al.. An Efficient Unsavory Data Detection Method for Internet Big Data. 3rd International Conference on Information and Communication Technology-EurAsia (ICT-EURASIA) and 9th International Conference on Research and Practical Issues of Enterprise Information Systems (CONFENIS), Oct 2015, Daejon, South Korea. pp.213-220, ⟨10.1007/978-3-319-24315-3_21⟩. ⟨hal-01466222⟩

Share

Metrics

Record views

323

Files downloads

393