Abstract:Accounting for batch effects, especially latent batch effects, in differential expression (DE) analysis is critical for identifying true biological effects. Single-cell RNA sequencing (scRNA-seq) is a powerful tool for quantifying cell-to-cell variation in transcript abundance and characterizing cellular dynamics. Although many scRNA-seq DE analysis methods accommodate known batch variables, their performance has not been systematically evaluated. Moreover, the challenge of accounting for latent batch variables in scRNA-seq DE analysis is largely unmet. In contrast, many methods have been developed to account for batch variables (either known or latent) in other high-dimensional data, especially bulk RNA-seq. We extensively evaluate eleven methods for batch variables in different scRNA-seq DE analysis scenarios, with a primary focus on latent batch variables. We demonstrate that for known batch variables, incorporating them as covariates into a regression model outperformed approaches using batch-corrected matrix. For latent batches, fixed effects models have inflated FDRs, whereas aggregation-based methods and mixed effects models have significant power loss. Surrogate variable based methods generally control the FDR well while achieving good power with small group effects. However, their performance (except SVA) deteriorated substantially in scenarios involving large group effects and/or group label impurity. In these settings, SVA achieves relatively good performance despite occasionally inflated FDR (up to 0.2). Finally we make following recommendations for scRNA-seq DE analysis: 1) incorporating known batch variables instead of using batch-corrected data; 2) employing SVA for latent batch correction and 3) better methods are still needed to fully unleash the power of scRNA-seq.<ol class="links-for-figure"><li><a class="anchor download-link u-font-sans" href="https://ars.els-cdn.com/content/image/1-s2.0-S200103701930409X-ga1_lrg.jpg">Download : Download high-res image (88KB)</a></li><li><a class="anchor download-link u-font-sans" href="https://ars.els-cdn.com/content/image/1-s2.0-S200103701930409X-ga1.jpg">Download : Download full-size image</a></li></ol>

Comparison of Scanpy-based Algorithms to Remove the Batch Effect from Single-Cell RNA-seq Data

A benchmark of batch-effect correction methods for single-cell RNA sequencing data

Assessment of batch-correction methods for scRNA-seq data with a new test metric

Dropout Imputation and Batch Effect Correction for Single-Cell RNA Sequencing Data

Scbatch: Batch-Effect Correction of RNA-seq Data Through Sample Distance Matrix Adjustment

Batch correction methods used in single cell RNA-sequencing analyses are often poorly calibrated

Comprehensive Evaluation of Noise Reduction Methods for Single-Cell RNA Sequencing Data

SSBER: removing batch effect for single-cell RNA sequencing data

Evaluating batch correction methods for image-based cell profiling

scRNABatchQC: multi-samples quality control for single cell RNA-seq data

Scaeqn: A Batch Correction Joint Dimension Reduction Method on Scrna-Seq Data.

A test metric for assessing single-cell RNA-seq batch correction

A comparison of methods accounting for batch effects in differential expression analysis of UMI count based single cell RNA sequencing

SCIBER: a simple method for removing batch effects from single-cell RNA-sequencing data

Ismnn: Batch Effect Correction for Single-Cell RNA-seq Data Via Iterative Supervised Mutual Nearest Neighbor Refinement.

A multicenter study benchmarking single-cell RNA sequencing technologies using reference samples

Ckbet: Assessing Goodness of Batch Effect Correction for Single-Cell RNA-seq

scRNA-seq mixology: towards better benchmarking of single cell RNA-seq analysis methods

Systematic comparative analysis of single cell RNA-sequencing methods

SCRIBE: a new approach to dropout imputation and batch effects correction for single-cell RNA-seq data

Fast-scBatch: Batch Effect Correction Using Neural Network-Driven Distance Matrix Adjustment