Abstract:Accounting for batch effects, especially latent batch effects, in differential expression (DE) analysis is critical for identifying true biological effects. Single-cell RNA sequencing (scRNA-seq) is a powerful tool for quantifying cell-to-cell variation in transcript abundance and characterizing cellular dynamics. Although many scRNA-seq DE analysis methods accommodate known batch variables, their performance has not been systematically evaluated. Moreover, the challenge of accounting for latent batch variables in scRNA-seq DE analysis is largely unmet. In contrast, many methods have been developed to account for batch variables (either known or latent) in other high-dimensional data, especially bulk RNA-seq. We extensively evaluate eleven methods for batch variables in different scRNA-seq DE analysis scenarios, with a primary focus on latent batch variables. We demonstrate that for known batch variables, incorporating them as covariates into a regression model outperformed approaches using batch-corrected matrix. For latent batches, fixed effects models have inflated FDRs, whereas aggregation-based methods and mixed effects models have significant power loss. Surrogate variable based methods generally control the FDR well while achieving good power with small group effects. However, their performance (except SVA) deteriorated substantially in scenarios involving large group effects and/or group label impurity. In these settings, SVA achieves relatively good performance despite occasionally inflated FDR (up to 0.2). Finally we make following recommendations for scRNA-seq DE analysis: 1) incorporating known batch variables instead of using batch-corrected data; 2) employing SVA for latent batch correction and 3) better methods are still needed to fully unleash the power of scRNA-seq.<ol class="links-for-figure"><li><a class="anchor download-link u-font-sans" href="https://ars.els-cdn.com/content/image/1-s2.0-S200103701930409X-ga1_lrg.jpg">Download : Download high-res image (88KB)</a></li><li><a class="anchor download-link u-font-sans" href="https://ars.els-cdn.com/content/image/1-s2.0-S200103701930409X-ga1.jpg">Download : Download full-size image</a></li></ol>

scRNABatchQC: multi-samples quality control for single cell RNA-seq data

Assessment of batch-correction methods for scRNA-seq data with a new test metric

scQCEA: a framework for annotation and quality control report of single-cell RNA-sequencing data

Comprehensive Evaluation of Noise Reduction Methods for Single-Cell RNA Sequencing Data

A multicenter study benchmarking single-cell RNA sequencing technologies using reference samples

Scbatch: Batch-Effect Correction of RNA-seq Data Through Sample Distance Matrix Adjustment

A test metric for assessing single-cell RNA-seq batch correction

Comprehensive generation, visualization, and reporting of quality control metrics for single-cell RNA sequencing data

scRNA-seq mixology: towards better benchmarking of single cell RNA-seq analysis methods

ScRNAPip: A systematic and dynamic pipeline for single‐cell RNA sequencing analysis

Comparison of Scanpy-based Algorithms to Remove the Batch Effect from Single-Cell RNA-seq Data

Benchmarking single cell RNA-sequencing analysis pipelines using mixture control experiments

RNA-SeQC: RNA-seq metrics for quality control and process optimization

RNA-QC-chain: Comprehensive and Fast Quality Control for RNA-Seq Data

Dropout Imputation and Batch Effect Correction for Single-Cell RNA Sequencing Data

A benchmark of batch-effect correction methods for single-cell RNA sequencing data

Scaeqn: A Batch Correction Joint Dimension Reduction Method on Scrna-Seq Data.

ctQC improves biological inferences from single cell and spatial transcriptomics data

Scater: pre-processing, quality control, normalization and visualization of single-cell RNA-seq data in R

A comparison of methods accounting for batch effects in differential expression analysis of UMI count based single cell RNA sequencing

The impact of package selection and versioning on single-cell RNA-seq analysis