Abstract:Accounting for batch effects, especially latent batch effects, in differential expression (DE) analysis is critical for identifying true biological effects. Single-cell RNA sequencing (scRNA-seq) is a powerful tool for quantifying cell-to-cell variation in transcript abundance and characterizing cellular dynamics. Although many scRNA-seq DE analysis methods accommodate known batch variables, their performance has not been systematically evaluated. Moreover, the challenge of accounting for latent batch variables in scRNA-seq DE analysis is largely unmet. In contrast, many methods have been developed to account for batch variables (either known or latent) in other high-dimensional data, especially bulk RNA-seq. We extensively evaluate eleven methods for batch variables in different scRNA-seq DE analysis scenarios, with a primary focus on latent batch variables. We demonstrate that for known batch variables, incorporating them as covariates into a regression model outperformed approaches using batch-corrected matrix. For latent batches, fixed effects models have inflated FDRs, whereas aggregation-based methods and mixed effects models have significant power loss. Surrogate variable based methods generally control the FDR well while achieving good power with small group effects. However, their performance (except SVA) deteriorated substantially in scenarios involving large group effects and/or group label impurity. In these settings, SVA achieves relatively good performance despite occasionally inflated FDR (up to 0.2). Finally we make following recommendations for scRNA-seq DE analysis: 1) incorporating known batch variables instead of using batch-corrected data; 2) employing SVA for latent batch correction and 3) better methods are still needed to fully unleash the power of scRNA-seq.<ol class="links-for-figure"><li><a class="anchor download-link u-font-sans" href="https://ars.els-cdn.com/content/image/1-s2.0-S200103701930409X-ga1_lrg.jpg">Download : Download high-res image (88KB)</a></li><li><a class="anchor download-link u-font-sans" href="https://ars.els-cdn.com/content/image/1-s2.0-S200103701930409X-ga1.jpg">Download : Download full-size image</a></li></ol>

Benchmarking integration of single-cell differential expression

A benchmark of batch-effect correction methods for single-cell RNA sequencing data

Benchmarking differential abundance methods for finding condition-specific prototypical cells in multi-sample single-cell datasets

Single-cell differential expression analysis between conditions within nested settings

Influence of single-cell RNA sequencing data integration on the performance of differential gene expression analysis

Benchmarking deep learning methods for biologically conserved single-cell integration

Benchmarking single cell RNA-sequencing analysis pipelines using mixture control experiments

A test metric for assessing single-cell RNA-seq batch correction

A comparison of methods accounting for batch effects in differential expression analysis of UMI count based single cell RNA sequencing

Bias, robustness and scalability in differential expression analysis of single-cell RNA-seq data

Bias, robustness and scalability in single-cell differential expression analysis

Benchmarking algorithms for single-cell multi-omics prediction and integration

Benchmarking atlas-level data integration in single-cell genomics

Assessment of batch-correction methods for scRNA-seq data with a new test metric

scRNA-seq mixology: towards better benchmarking of single cell RNA-seq analysis methods

Multi-task benchmarking of single-cell multimodal omics integration methods

A comprehensive assessment of cell type-specific differential expression methods in bulk data.

Benchmarking multi-omics integration algorithms across single-cell RNA and ATAC data

A multicenter study benchmarking single-cell RNA sequencing technologies using reference samples

The curses of performing differential expression analysis using single-cell data

Benchmarking algorithms for joint integration of unpaired and paired single-cell RNA-seq and ATAC-seq data