Biomarker Discovery Based on Large-Scale Feature Selection and MapReduce

Abstract : Large-scale feature selection is one of the most important fields in the big data domain that can solve real data problems, such as bioinformatics, where it is necessary to process huge amount of data. The efficiency of existing feature selection algorithms significantly downgrades, if not totally inapplicable, when data size exceeds hundreds of gigabytes, because most feature selection algorithms are designed for centralized computing architecture. For that, distributed computing techniques, such as MapReduce can be applied to handle very large data. Our approach is to scale the existing method for feature selection, Kmeans clustering and Signal to Noise Ratio (SNR) combined with optimization technique as Binary Particle Swarm Optimization (BPSO). The proposed method is divided into two stages. In the first stage, we have used parallel Kmeans on MapReduce for clustering features, and then we have applied iterative MapReduce that implement parallel SNR ranking for each cluster. After, we have selected the top ranked feature from each cluster. The top scored features from each cluster are gathered and a new feature subset is generated. In the second stage, the new feature subset is used as input to the proposed BPSO based on MapReduce which provides an optimized feature subset. The proposed method is implemented in a distributed environment, and its efficiency is illustrated through analyzing practical problems such as biomarker discovery.
Document type :
Conference papers
Complete list of metadatas

Cited literature [20 references]  Display  Hide  Download

https://hal.inria.fr/hal-01789929
Contributor : Hal Ifip <>
Submitted on : Friday, May 11, 2018 - 3:09:52 PM
Last modification on : Wednesday, October 31, 2018 - 11:28:09 AM
Long-term archiving on : Monday, September 24, 2018 - 12:50:55 PM

File

339159_1_En_7_Chapter.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Ahlam Kourid, Mohamed Batouche. Biomarker Discovery Based on Large-Scale Feature Selection and MapReduce. 5th International Conference on Computer Science and Its Applications (CIIA), May 2015, Saida, Algeria. pp.81-92, ⟨10.1007/978-3-319-19578-0_7⟩. ⟨hal-01789929⟩

Share

Metrics

Record views

164

Files downloads

135