Abstract:Background: While single cell RNA sequencing becomes a powerful technology, the presence of the large number of zero counts represents a challenge for both wet-lab processing and data analysis. Imputation of these dropouts can now be performed by three categories of algorithms: Model or smoothing, Matrix theory or Deep learning. However, two fundamental questions remain unsettled: (1) whether imputation should be performed; (2) which imputation algorithm to use with various downstream applications. Notably, imputation is not commonly used in real scRNA-seq applications because of their uncertain benefits, concerns about false inferences in downstream applications, and the lack of in-depth benchmark. Methods: Here, we performed two tasks. First, we developed an algorithm using adaptive low-rank full matrix factorization (afMF) based on a previous limited implementation confined to using low rank matrix decomposition (ALRA). Second, to evaluate the impact of various imputation algorithms on downstream analyses, a new benchmark framework incorporating commonly used downstream applications was developed. This benchmark framework put emphasis on real datasets which had ground truth or matched bulk data such that algorithm performance was compared to more convinced data rather than less realistic simulated parameters. Results: Our results indicated that afMF and ALRA (matrix based) provided good imputation and outperformed raw log-normalization in various downstream applications. afMF outperformed ALRA in several evaluations (cell-level differential expression analysis, GSEA, classification, biomarker prediction, clustering, SC-bulk profiling similarity). Besides, afMF ranked among the top levels in automatic cell type annotation, trajectory inference by DPT, and AUCell & SCENIC. Both showed acceptable scalability, while afMF had longer running time. MAGIC (smoothing based) and AutoClass (deep learning based) also performed well but may produce false positives. In contrast, more complicated methods (other deep learning or model based) were prone to overfitting and data distortion. We also found that certain downstream algorithms are not compatible with imputation, including trajectory inference with Slingshot and cell-cell communication. Prior imputation either showed no improvement or generated false positive findings with these downstream applications. Conclusions: We hope this in-depth evaluation and the algorithm developed in this study can enhance the selection of appropriate imputation algorithm for specific scRNA-seq downstream analyses.

A novel batch-effect correction method for scRNA-seq data based on Adversarial Information Factorization

Assessment of batch-correction methods for scRNA-seq data with a new test metric

Fast-scBatch: Batch Effect Correction Using Neural Network-Driven Distance Matrix Adjustment

Batch alignment of single-cell transcriptomics data using deep metric learning

Mixed Effects Deep Learning for the interpretable analysis of single cell RNA sequencing data by quantifying and visualizing batch effects

deepMNN: Deep Learning-Based Single-Cell RNA Sequencing Data Batch Correction Using Mutual Nearest Neighbors

Batch Effects Correction in scRNA-seq Based on Biological-noise Decoupling Autoencoder and Central-cross Loss

HDMC: a novel deep learning-based framework for removing batch effects in single-cell RNA-seq data

A benchmark of batch-effect correction methods for single-cell RNA sequencing data

scDisInFact: disentangled learning for integration and prediction of multi-batch multi-condition single-cell RNA-sequencing data

A test metric for assessing single-cell RNA-seq batch correction

Batch correction methods used in single cell RNA-sequencing analyses are often poorly calibrated

Batch correction of single-cell sequencing data via an autoencoder architecture

Deep Batch Integration and Denoise of Single‐Cell RNA‐Seq Data

A comparison of methods accounting for batch effects in differential expression analysis of UMI count based single cell RNA sequencing

SSBER: removing batch effect for single-cell RNA sequencing data

Low-Rank Full Matrix Factorization for dropout imputation in single cell RNA-seq and benchmarking with imputation algorithms for downstream applications

A joint deep learning model enables simultaneous batch effect correction, denoising, and clustering in single-cell transcriptomics

Adversarial learning enables unbiased organism-wide cross-species alignment of single-cell RNA data at scale

BERMUDA: a novel deep transfer learning method for single-cell RNA sequencing batch correction reveals hidden high-resolution cellular subtypes

Propensity score matching enables batch-effect-corrected imputation in single-cell RNA-seq analysis