Abstract:BackgroundThe analysis of single-cell RNA sequencing (scRNAseq) data plays an important role in understanding the intrinsic and extrinsic cellular processes in biological and biomedical research. One significant effort in this area is the detection of differentially expressed (DE) genes. scRNAseq data, however, are highly heterogeneous and have a large number of zero counts, which introduces challenges in detecting DE genes. Addressing these challenges requires employing new approaches beyond the conventional ones, which are based on a nonzero difference in average expression. Several methods have been developed for differential gene expression analysis of scRNAseq data. To provide guidance on choosing an appropriate tool or developing a new one, it is necessary to evaluate and compare the performance of differential gene expression analysis methods for scRNAseq data.ResultsIn this study, we conducted a comprehensive evaluation of the performance of eleven differential gene expression analysis software tools, which are designed for scRNAseq data or can be applied to them. We used simulated and real data to evaluate the accuracy and precision of detection. Using simulated data, we investigated the effect of sample size on the detection accuracy of the tools. Using real data, we examined the agreement among the tools in identifying DE genes, the run time of the tools, and the biological relevance of the detected DE genes.ConclusionsIn general, agreement among the tools in calling DE genes is not high. There is a trade-off between true-positive rates and the precision of calling DE genes. Methods with higher true positive rates tend to show low precision due to their introducing false positives, whereas methods with high precision show low true positive rates due to identifying few DE genes. We observed that current methods designed for scRNAseq data do not tend to show better performance compared to methods designed for bulk RNAseq data. Data multimodality and abundance of zero read counts are the main characteristics of scRNAseq data, which play important roles in the performance of differential gene expression analysis methods and need to be considered in terms of the development of new methods.

Systematic comparison and assessment of RNA-seq procedures for gene expression quantitative analysis

RNAflow: An Effective and Simple RNA-Seq Differential Gene Expression Pipeline Using Nextflow

A comparison of methods for differential expression analysis of RNA-seq data

A systematic evaluation of single cell RNA-seq analysis pipelines

Benchmarking of RNA-sequencing analysis workflows using whole-transcriptome RT-qPCR expression data

Comprehensive evaluation of differential expression analysis methods for RNA-seq data

A Survey of Best Practices for RNA-seq Data Analysis

Impact of RNA-seq data analysis algorithms on gene expression estimation and downstream prediction

Comparative Analysis of NovaSeq 6000 and MGISEQ 2000 Single-Cell RNA Sequencing Data.

Evaluation and comparison of computational tools for RNA-seq isoform quantification

Variability in estimated gene expression among commonly used RNA-seq pipelines

Systematic Assessment of Next Generation Sequencing for Quantitative Small RNA Profiling: a Multiple Protocol Study Across Multiple Laboratories

Systematic comparative analysis of single cell RNA-sequencing methods

Bias, robustness and scalability in differential expression analysis of single-cell RNA-seq data

Systematic evaluation of medium-throughput mRNA abundance platforms

Comparative analysis of differential gene expression analysis tools for single-cell RNA sequencing data

Evaluation of Normalization Methods for RNA-Seq Gene Expression Estimation

Revealing the History and Mystery of RNA-Seq

Toward Best Practice in Identifying Subtle Differential Expression with RNA-seq: A Real-World Multi-Center Benchmarking Study Using Quartet and MAQC Reference Materials

RNA-SeQC: RNA-seq metrics for quality control and process optimization

Comparison of algorithms used in single-cell transcriptomic data analysis