Massively Parallel Processing of Whole Genome Sequence Data: An In-Depth Performance Study

Abhishek Roy 1 Yanlei Diao 2, 1 Uday Evani 3 Avinash Abhyankar 4, 3 Clinton Howarth 3 Rémi Le Priol 1, 5 Toby Bloom 3
1 UMass Amherst - University of Massachusetts [Amherst]
2 CEDAR - Rich Data Analytics at Cloud Scale
LIX - Laboratoire d'informatique de l'École polytechnique [Palaiseau], Inria Saclay - Ile de France
3 New York Genome Center [New York]
4 St. Giles Laboratory of Human Genetics of Infectious Diseases, Rockefeller Branch
5 X - École polytechnique
Abstract : This paper presents a joint effort between a group of computer scientists and bioinformaticians to take an important step towards a general big data platform for genome analysis pipelines. The key goals of this study are to develop a thorough understanding of the strengths and limitations of big data technology for genomic data analysis, and to identify the key questions that the research community could address to realize the vision of personalized genomic medicine. Our platform, called Gesall, is based on the new " Wrapper Technology " that supports existing genomic data analysis programs in their native forms, without having to rewrite them. To do so, our system provides several layers of software , including a new Genome Data Parallel Toolkit (GDPT), which can be used to " wrap " existing data analysis programs. This platform offers a concrete context for evaluating big data technology for genomics: we report on super-linear speedup and sublinear speedup for various tasks, as well as the reasons why a parallel program could produce different results from those of a serial program. These results lead to key research questions that require a synergy between ge-nomics scientists and computer scientists to find solutions.
Keywords : Big data Bioinfomatics Data management
Document type :
Conference papers
Complete list of metadatas
https://hal.inria.fr/hal-01683398
Contributor : Félix Raimundo <>
Submitted on : Saturday, January 13, 2018 - 3:18:54 PM
Last modification on : Tuesday, August 6, 2019 - 11:38:50 AM

Identifiers

Collections

INRIA | UNIV-PARIS-SACLAY | X | PARISTECH | LIX | X-LIX | X-DEP-INFO

Citation

Abhishek Roy, Yanlei Diao, Uday Evani, Avinash Abhyankar, Clinton Howarth, et al.. Massively Parallel Processing of Whole Genome Sequence Data: An In-Depth Performance Study. SIGMOD '17 Proceedings of the 2017 ACM International Conference on Management of Dat, SIGMOD ACM Special Interest Group on Management of Data, May 2017, Chicago, Illinois, United States. pp.187-202, ⟨10.1145/3035918.3064048⟩. ⟨hal-01683398⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

164

Contact


archive-ouverte@inria.fr