Abstract:Background: The application of high-throughput sequencing in a broad range of quantitative genomic assays (e.g., DNA-seq, ChIP-seq) has created a high demand for the analysis of large-scale read-count data. Typically, the genome is divided into tiling windows and windowed read-count data is generated for the entire genome from which genomic signals are detected (e.g. copy number changes in DNA-seq, enrichment peaks in ChIP-seq). For accurate analysis of read-count data, many state-of-the-art statistical methods use generalized linear models (GLM) coupled with the negative-binomial (NB) distribution by leveraging its ability for simultaneous bias correction and signal detection. However, although statistically powerful, the GLM+NB method has a quadratic computational complexity and therefore suffers from slow running time when applied to large-scale windowed read-count data. In this study, we aimed to speed up substantially the GLM+NB method by using a randomized algorithm and we demonstrate here the utility of our approach in the application of detecting copy number variants (CNVs) using a real example. Results: We propose an efficient estimator, the randomized GLM+NB coefficients estimator (RGE), for speeding up the GLM+NB method. RGE samples the read-count data and solves the estimation problem on a smaller scale. We first theoretically validated the consistency and the variance properties of RGE. We then applied RGE to GENSENG, a GLM+NB based method for detecting CNVs. We named the resulting method as "R-GENSENG". Based on extensive evaluation using both simulated and empirical data, we concluded that R-GENSENG is ten times faster than the original GENSENG while maintaining GENSENG's accuracy in CNV detection. Conclusions: Our results suggest that RGE strategy developed here could be applied to other GLM+NB based read-count analyses, i.e. ChIP-seq data analysis, to substantially improve their computational efficiency while preserving the analytic power.

Randomized gates eliminate bias in sort‐seq assays

Deep-learning–assisted Sort-Seq enables high-throughput profiling of gene expression characteristics with high precision

Randomized linear gate set tomography

Enhancing RNA-seq bias mitigation with the Gaussian self-benchmarking framework: towards unbiased sequencing data

Optimized experiment design and analysis for fully randomized benchmarking

The consequences of mismatched buffers in spectral cell sorting

Improving the Accuracy of Bulk Fitness Assays by Correcting Barcode Processing Biases

Uncertainty quantification in flow cytometry using a cell sorter

Quantifying molecular bias in DNA data storage

Estimating the bias of CX gates via character randomized benchmarking

Reliable multiplex sequencing with rare index mis-assignment on DNB-based NGS platform

Biases and errors on allele frequency estimation and disease association tests of next-generation sequencing of pooled samples.

Enhancing RNA-seq analysis by addressing all co-existing biases using a self-benchmarking approach with 2D structural insights

Flow Cytometry Sorting for Random Access in DNA Data Storage: Encapsulation for Enhanced Stability and Sequence Integrity of DNA

Sequential design of single-cell experiments to identify discrete stochastic models for gene expression

IVT-seq reveals extreme bias in RNA sequencing

Experimental and Computational Methods for Allelic Imbalance Analysis from Single-Nucleus RNA-seq Data

Randomized Benchmarking of Quantum Gates

The consequence of mismatched buffers in purity checks when spectral cell sorting

The Origin of Biased Sequence Depth in Sequence-Independent Nucleic Acid Amplification and Optimization for Efficient Massive Parallel Sequencing

A Randomized Approach to Speed Up the Analysis of Large-Scale Read-Count Data in the Application of CNV Detection