Abstract:Accounting for batch effects, especially latent batch effects, in differential expression (DE) analysis is critical for identifying true biological effects. Single-cell RNA sequencing (scRNA-seq) is a powerful tool for quantifying cell-to-cell variation in transcript abundance and characterizing cellular dynamics. Although many scRNA-seq DE analysis methods accommodate known batch variables, their performance has not been systematically evaluated. Moreover, the challenge of accounting for latent batch variables in scRNA-seq DE analysis is largely unmet. In contrast, many methods have been developed to account for batch variables (either known or latent) in other high-dimensional data, especially bulk RNA-seq. We extensively evaluate eleven methods for batch variables in different scRNA-seq DE analysis scenarios, with a primary focus on latent batch variables. We demonstrate that for known batch variables, incorporating them as covariates into a regression model outperformed approaches using batch-corrected matrix. For latent batches, fixed effects models have inflated FDRs, whereas aggregation-based methods and mixed effects models have significant power loss. Surrogate variable based methods generally control the FDR well while achieving good power with small group effects. However, their performance (except SVA) deteriorated substantially in scenarios involving large group effects and/or group label impurity. In these settings, SVA achieves relatively good performance despite occasionally inflated FDR (up to 0.2). Finally we make following recommendations for scRNA-seq DE analysis: 1) incorporating known batch variables instead of using batch-corrected data; 2) employing SVA for latent batch correction and 3) better methods are still needed to fully unleash the power of scRNA-seq.<ol class="links-for-figure"><li><a class="anchor download-link u-font-sans" href="https://ars.els-cdn.com/content/image/1-s2.0-S200103701930409X-ga1_lrg.jpg">Download : Download high-res image (88KB)</a></li><li><a class="anchor download-link u-font-sans" href="https://ars.els-cdn.com/content/image/1-s2.0-S200103701930409X-ga1.jpg">Download : Download full-size image</a></li></ol>

A benchmark of batch-effect correction methods for single-cell RNA sequencing data

Assessment of batch-correction methods for scRNA-seq data with a new test metric

Batch correction methods used in single cell RNA-sequencing analyses are often poorly calibrated

A test metric for assessing single-cell RNA-seq batch correction

Evaluating batch correction methods for image-based cell profiling

Comparison of Scanpy-based Algorithms to Remove the Batch Effect from Single-Cell RNA-seq Data

Scbatch: Batch-Effect Correction of RNA-seq Data Through Sample Distance Matrix Adjustment

SSBER: removing batch effect for single-cell RNA sequencing data

Dropout Imputation and Batch Effect Correction for Single-Cell RNA Sequencing Data

Case-specific selection of batch correction methods for integrating single-cell transcriptomic data from different sources

Ckbet: Assessing Goodness of Batch Effect Correction for Single-Cell RNA-seq

A comparison of methods accounting for batch effects in differential expression analysis of UMI count based single cell RNA sequencing

Ismnn: Batch Effect Correction for Single-Cell RNA-seq Data Via Iterative Supervised Mutual Nearest Neighbor Refinement.

Benchmarking integration of single-cell differential expression

Highly Effective Batch Effect Correction Method for RNA-seq Count Data

Comprehensive Evaluation of Noise Reduction Methods for Single-Cell RNA Sequencing Data

A multicenter study benchmarking single-cell RNA sequencing technologies using reference samples

scRNA-seq mixology: towards better benchmarking of single cell RNA-seq analysis methods

Benchmarking single cell RNA-sequencing analysis pipelines using mixture control experiments

Correcting batch effects in large-scale multiomic studies using a reference-material-based ratio method

Removing Batch Effects in Analysis of Expression Microarray Data: an Evaluation of Six Batch Adjustment Methods