Skip to Main content Skip to Navigation
New interface
Conference papers

An Efficient Unsavory Data Detection Method for Internet Big Data

Abstract : With the explosion of information technologies, the volume and diversity of the data in the cyberspace are growing rapidly; meanwhile the unsavory data are harming the security of Internet. So how to detect the unsavory data from the Internet big data based on their inner semantic information is of growing importance. In this paper, we propose the i-Tree method, an intelligent semantics-based unsavory data detection method for internet big data. Firstly, the internet big data are mapped into a high-dimensional feature space, representing as high-dimensional points in the feature space. Secondly, to solve the “curse of dimensionality” problem of the high-dimensional feature space, the principal component analysis (PCA) method is used to reduce the dimensionality of the feature space. Thirdly, in the new generated feature space, we cluster the data objects, transform the data clusters into regular unit hyper-cubes and create one-dimensional index for data objects based on the idea of multi-dimensional index. Finally, we realize the semantics-based data detection for a given unsavory data object according to similarity search algorithm and the experimental results proved our method can achieve much better efficiency.
Complete list of metadata

Cited literature [7 references]  Display  Hide  Download
Contributor : Hal Ifip Connect in order to contact the contributor
Submitted on : Monday, February 13, 2017 - 2:31:10 PM
Last modification on : Thursday, March 5, 2020 - 4:47:15 PM
Long-term archiving on: : Sunday, May 14, 2017 - 2:16:48 PM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Peige Ren, Xiaofeng Wang, Hao Sun, Fen Xu, Baokang Zhao, et al.. An Efficient Unsavory Data Detection Method for Internet Big Data. 3rd International Conference on Information and Communication Technology-EurAsia (ICT-EURASIA) and 9th International Conference on Research and Practical Issues of Enterprise Information Systems (CONFENIS), Oct 2015, Daejon, South Korea. pp.213-220, ⟨10.1007/978-3-319-24315-3_21⟩. ⟨hal-01466222⟩



Record views


Files downloads