Skip to Main content Skip to Navigation
Journal articles

A detailed study of the distributed rough set based locality sensitive hashing feature selection technique

Zaineb Chelly Dagdia 1, 2, 3 Christine Zarges 2
1 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : In the context of big data, granular computing has recently been implemented by some mathematical tools, especially Rough Set Theory (RST). As a key topic of rough set theory, feature selection has been investigated to adapt the related granular concepts of RST to deal with large amounts of data, leading to the development of the distributed RST version. However, despite of its scalability, the distributed RST version faces a key challenge tied to the partitioning of the feature search space in the distributed environment while guaranteeing data dependency. Therefore, in this manuscript, we propose a new distributed RST version based on Locality Sensitive Hashing (LSH), named LSH-dRST, for big data feature selection. LSH-dRST uses LSH to match similar features into the same bucket and maps the generated buckets into partitions to enable the splitting of the universe in a more efficient way. More precisely, in this paper, we perform a detailed analysis of the performance of LSH-dRST by comparing it to the standard distributed RST version, which is based on a random partitioning of the universe. We demonstrate that our LSH-dRST is scalable when dealing with large amounts of data. We also demonstrate * This work is part of a project that has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 702527. 2 Z. Chelly Dagdia, C. Zarges / LSH-RST for an Efficient Big Data Pre-processing that LSH-dRST ensures the partitioning of the high dimensional feature search space in a more reliable way; hence better preserving data dependency in the distributed environment and ensuring a lower computational cost.
Complete list of metadata

Cited literature [90 references]  Display  Hide  Download

https://hal.inria.fr/hal-02880638
Contributor : Zaineb Chelly Dagdia <>
Submitted on : Thursday, June 25, 2020 - 10:34:54 AM
Last modification on : Wednesday, December 2, 2020 - 5:46:26 PM
Long-term archiving on: : Wednesday, September 23, 2020 - 3:48:40 PM

File

LSH_RST_Journal.pdf
Files produced by the author(s)

Identifiers

Citation

Zaineb Chelly Dagdia, Christine Zarges. A detailed study of the distributed rough set based locality sensitive hashing feature selection technique. Fundamenta Informaticae, Polskie Towarzystwo Matematyczne, In press, ⟨10.3233/FI-2016-0000⟩. ⟨hal-02880638⟩

Share

Metrics

Record views

43

Files downloads

220