Massive Genomic Data Processing and Deep Analysis

Abhishek Roy,Yanlei Diao,Evan Mauceli,Yiping Shen,Bai-Lin Wu
DOI: https://doi.org/10.14778/2367502.2367534
IF: 2.5
2012-01-01
Proceedings of the VLDB Endowment
Abstract:Today large sequencing centers are producing genomic data at the rate of 10 terabytes a day and require complicated processing to transform massive amounts of noisy raw data into biological information. To address these needs, we develop a system for end-to-end processing of genomic data, including alignment of short read sequences, variation discovery, and deep analysis. We also employ a range of quality control mechanisms to improve data quality and parallel processing techniques for performance. In the demo, we will use real genomic data to show details of data transformation through the workflow, the usefulness of end results (ready for use as testable hypotheses), the effects of our quality control mechanisms and improved algorithms, and finally performance improvement.
What problem does this paper attempt to address?