Abstract:BackgroundThe analysis of single-cell RNA sequencing (scRNAseq) data plays an important role in understanding the intrinsic and extrinsic cellular processes in biological and biomedical research. One significant effort in this area is the detection of differentially expressed (DE) genes. scRNAseq data, however, are highly heterogeneous and have a large number of zero counts, which introduces challenges in detecting DE genes. Addressing these challenges requires employing new approaches beyond the conventional ones, which are based on a nonzero difference in average expression. Several methods have been developed for differential gene expression analysis of scRNAseq data. To provide guidance on choosing an appropriate tool or developing a new one, it is necessary to evaluate and compare the performance of differential gene expression analysis methods for scRNAseq data.ResultsIn this study, we conducted a comprehensive evaluation of the performance of eleven differential gene expression analysis software tools, which are designed for scRNAseq data or can be applied to them. We used simulated and real data to evaluate the accuracy and precision of detection. Using simulated data, we investigated the effect of sample size on the detection accuracy of the tools. Using real data, we examined the agreement among the tools in identifying DE genes, the run time of the tools, and the biological relevance of the detected DE genes.ConclusionsIn general, agreement among the tools in calling DE genes is not high. There is a trade-off between true-positive rates and the precision of calling DE genes. Methods with higher true positive rates tend to show low precision due to their introducing false positives, whereas methods with high precision show low true positive rates due to identifying few DE genes. We observed that current methods designed for scRNAseq data do not tend to show better performance compared to methods designed for bulk RNAseq data. Data multimodality and abundance of zero read counts are the main characteristics of scRNAseq data, which play important roles in the performance of differential gene expression analysis methods and need to be considered in terms of the development of new methods.

A method for differential expression analysis and pseudo-temporal locating and ordering of genes in single-cell transcriptomic data

Degps is a Powerful Tool for Detecting Differential Expression in RNA-sequencing Studies

Identification of cell types, states and programs by learning gene set representations

scDEA: differential expression analysis in single-cell RNA-sequencing data via ensemble learning

PseudotimeDE: inference of differential gene expression along cell pseudotime with well-calibrated p-values from single-cell RNA sequencing data

A two-step strategy for detecting differential gene expression in cDNA microarray data

scHD4E: Novel ensemble learning-based differential expression analysis method for single-cell RNA-sequencing data

Differential Expression Analyses for Single-Cell RNA-Seq: Old Questions on New Data

The Lomb-Scargle periodogram-based differentially expressed gene detection along pseudotime

Comparative analysis of differential gene expression analysis tools for single-cell RNA sequencing data

Integrative Analysis of Gene Expression and Alternative Polyadenylation from Single-Cell RNA-seq Data.

A Method Based on Differential Entropy-Like Function for Detecting Differentially Expressed Genes Across Multiple Conditions in RNA-Seq Studies

scMEB: a fast and clustering-independent method for detecting differentially expressed genes in single-cell RNA-seq data

A Rank-Based Algorithm of Differential Expression Analysis for Small Cell Line Data with Statistical Control.

Detecting Fear-Memory-Related Genes from Neuronal scRNA-seq Data by Diverse Distributions and Bhattacharyya Distance

scDAPP: a comprehensive single-cell transcriptomics analysis pipeline optimized for cross-group comparison

Integrative Differential Expression and Gene Set Enrichment Analysis Using Summary Statistics for Scrna-Seq Studies

scDAPA: detection and visualization of dynamic alternative polyadenylation from single cell RNA-seq data.

TabDEG: Classifying differentially expressed genes from RNA-seq data based on feature extraction and deep learning framework

DEApp: an interactive web interface for differential expression analysis of next generation sequence data