Bias, robustness and scalability in single-cell differential expression analysis

Charlotte Soneson,Mark D Robinson

DOI: https://doi.org/10.1038/nmeth.4612

IF: 48

2018-02-26

Nature Methods

Abstract:An extensive evaluation of differential expression methods applied to single-cell expression data, using uniformly processed public data in the new conquer resource.

biochemical research methods

What problem does this paper attempt to address?

Bias, robustness and scalability in differential expression analysis of single-cell RNA-seq data

Charlotte Soneson,Mark D. Robinson

DOI: https://doi.org/10.1101/143289

2017-05-28

Abstract:Abstract Background As single-cell RNA-seq (scRNA-seq) is becoming increasingly common, the amount of publicly available data grows rapidly, generating a useful resource for computational method development and extension of published results. Although processed data matrices are typically made available in public repositories, the procedure to obtain these varies widely between data sets, which may complicate reuse and cross-data set comparison. Moreover, while many statistical methods for performing differential expression analysis of scRNA-seq data are becoming available, their relative merits and the performance compared to methods developed for bulk RNA-seq data are not sufficiently well understood. Results We present conquer , a collection of consistently processed, analysis-ready public single-cell RNA-seq data sets. Each data set has count and transcripts per million (TPM) estimates for genes and transcripts, as well as quality control and exploratory analysis reports. We use a subset of the data sets available in conquer to perform an extensive evaluation of the performance and characteristics of statistical methods for differential gene expression analysis, evaluating a total of 30 statistical approaches on both experimental and simulated scRNA-seq data. Conclusions Considerable differences are found between the methods in terms of the number and characteristics of the genes that are called differentially expressed. Pre-filtering of lowly expressed genes can have important effects on the results, particularly for some of the methods originally developed for analysis of bulk RNA-seq data. Generally, however, methods developed for bulk RNA-seq analysis do not perform notably worse than those developed specifically for scRNA-seq.
Benchmarking integration of single-cell differential expression

Hai C. T. Nguyen,Bukyung Baik,Sora Yoon,Taesung Park,Dougu Nam

DOI: https://doi.org/10.1038/s41467-023-37126-3

IF: 16.6

2023-03-22

Nature Communications

Abstract:Integration of single-cell RNA sequencing data between different samples has been a major challenge for analyzing cell populations. However, strategies to integrate differential expression analysis of single-cell data remain underinvestigated. Here, we benchmark 46 workflows for differential expression analysis of single-cell data with multiple batches. We show that batch effects, sequencing depth and data sparsity substantially impact their performances. Notably, we find that the use of batch-corrected data rarely improves the analysis for sparse data, whereas batch covariate modeling improves the analysis for substantial batch effects. We show that for low depth data, single-cell techniques based on zero-inflation model deteriorate the performance, whereas the analysis of uncorrected data using limmatrend, Wilcoxon test and fixed effects model performs well. We suggest several high-performance methods under different conditions based on various simulation and real data analyses. Additionally, we demonstrate that differential expression analysis for a specific cell type outperforms that of large-scale bulk sample data in prioritizing disease-related genes.

multidisciplinary sciences
Data Exploration, Quality Control and Testing in Single-Cell qPCR-Based Gene Expression Experiments

Andrew McDavid,Greg Finak,Pratip K. Chattopadyay,Maria Dominguez,Laurie Lamoreaux,Steven S. Ma,Mario Roederer,Raphael Gottardo

DOI: https://doi.org/10.48550/arXiv.1210.1226

2012-10-04

Abstract:Cell populations are never truly homogeneous; individual cells exist in biochemical states that define functional differences between them. New technology based on microfluidic arrays combined with multiplexed quantitative polymerase chain reactions (qPCR) now enables high-throughput single-cell gene expression measurement, allowing assessment of cellular heterogeneity. However very little analytic tools have been developed specifically for the statistical and analytical challenges of single-cell qPCR data. We present a statistical framework for the exploration, quality control, and analysis of single-cell gene expression data from microfluidic arrays. We assess accuracy and within-sample heterogeneity of single-cell expression and develop quality control criteria to filter unreliable cell measurements. We propose a statistical model accounting for the fact that genes at the single-cell level can be on (and for which a continuous expression measure is recorded) or dichotomously off (and the recorded expression is zero). Based on this model, we derive a combined likelihood-ratio test for differential expression that incorporates both the discrete and continuous components. Using an experiment that examines treatment-specific changes in expression, we show that this combined test is more powerful than either the continuous or dichotomous component in isolation, or a t-test on the zero-inflated data. While developed for measurements from a specific platform (Fluidigm), these tools are generalizable to other multi-parametric measures over large numbers of events.

Applications,Quantitative Methods
Single-cell differential expression analysis between conditions within nested settings

Leon Hafner,Gregor Sturm,Markus List

DOI: https://doi.org/10.1101/2024.08.01.606200

2024-08-02

Abstract:Differential expression analysis provides insights into fundamental biological processes and with the advent of single-cell transcriptomics, gene expression can now be studied at the level of individual cells. Many analyses treat cells as samples and assume statistical independence. As cells are pseudoreplicates, this assumption does not hold, leading to reduced robustness, reproducibility, and an inflated type 1 error rate. In this study, we investigate various methods for differential expression analysis on single-cell data, conduct extensive benchmarking and give recommendations for method choice. The tested methods include DESeq2, MAST, DREAM, scVI, the Permutation Test and distinct. We additionally adapt Hierarchical Bootstrapping to differential expression analysis on single-cell data and include it in our benchmark. We found that differential expression analysis methods designed specifically for single-cell data do not offer performance advantages over conventional pseudobulk methods such as DESeq2 when applied to individual data sets. In addition, they mostly require significantly longer run times. For atlas-level analysis, permutation-based methods excel in performance but show poor runtime, suggesting to use DREAM as a compromise between quality and runtime. Overall, our study offers the community a valuable benchmark of methods across diverse scenarios and offers guidelines on method selection.

Bioinformatics
Benchmarking differential abundance methods for finding condition-specific prototypical cells in multi-sample single-cell datasets

Haidong Yi,Alec Plotkin,Natalie Stanley

DOI: https://doi.org/10.1186/s13059-023-03143-0

IF: 17.906

2024-01-05

Genome Biology

Abstract:To analyze the large volume of data generated by single-cell technologies and to identify cellular correlates of particular clinical or experimental outcomes, differential abundance analyses are often applied. These algorithms identify subgroups of cells whose abundances change significantly in response to disease progression, or to an experimental perturbation. Despite the effectiveness of differential abundance analyses in identifying critical cell-states, there is currently no systematic benchmarking study to compare their applicability, usefulness, and accuracy in practice across single-cell modalities.

genetics & heredity,biotechnology & applied microbiology
The shaky foundations of simulating single-cell RNA sequencing data

Helena L. Crowell,Sarah X. Morillo Leonardo,Charlotte Soneson,Mark D. Robinson

DOI: https://doi.org/10.1186/s13059-023-02904-1

IF: 17.906

2023-03-31

Genome Biology

Abstract:With the emergence of hundreds of single-cell RNA-sequencing (scRNA-seq) datasets, the number of computational tools to analyze aspects of the generated data has grown rapidly. As a result, there is a recurring need to demonstrate whether newly developed methods are truly performant—on their own as well as in comparison to existing tools. Benchmark studies aim to consolidate the space of available methods for a given task and often use simulated data that provide a ground truth for evaluations, thus demanding a high quality standard results credible and transferable to real data.

genetics & heredity,biotechnology & applied microbiology
A comprehensive assessment of cell type-specific differential expression methods in bulk data.

Guanqun Meng,Wen Tang,Emina Huang,Ziyi Li,Hao Feng

DOI: https://doi.org/10.1093/bib/bbac516

IF: 9.5

2023-01-01

Briefings in Bioinformatics

Abstract:Accounting for cell type compositions has been very successful at analyzing high-throughput data from heterogeneous tissues. Differential gene expression analysis at cell type level is becoming increasingly popular, yielding biomarker discovery in a finer granularity within a particular cell type. Although several computational methods have been developed to identify cell type-specific differentially expressed genes (csDEG) from RNA-seq data, a systematic evaluation is yet to be performed. Here, we thoroughly benchmark six recently published methods: CellDMC, CARseq, TOAST, LRCDE, CeDAR and TCA, together with two classical methods, csSAM and DESeq2, for a comprehensive comparison. We aim to systematically evaluate the performance of popular csDEG detection methods and provide guidance to researchers. In simulation studies, we benchmark available methods under various scenarios of baseline expression levels, sample sizes, cell type compositions, expression level alterations, technical noises and biological dispersions. Real data analyses of three large datasets on inflammatory bowel disease, lung cancer and autism provide evaluation in both the gene level and the pathway level. We find that csDEG calling is strongly affected by effect size, baseline expression level and cell type compositions. Results imply that csDEG discovery is a challenging task itself, with room to improvements on handling low signal-to-noise ratio and low expression genes.
The curses of performing differential expression analysis using single-cell data

Chih-Hsuan Wu,Xiang Zhou,Mengjie Chen

DOI: https://doi.org/10.1101/2024.05.28.596315

2024-06-02

Abstract:Differential expression analysis is pivotal in single-cell transcriptomics for unraveling cell-type-specific responses to stimuli. While numerous methods are available to identify differentially expressed genes in single-cell data, recent evaluations of both single-cell-specific methods and methods adapted from bulk studies have revealed significant shortcomings in performance. In this paper, we dissect the four major challenges in single-cell DE analysis: normalization, excessive zeros, donor effects, and cumulative biases. These "curses" underscore the limitations and conceptual pitfalls in existing workflows. In response, we introduce a novel paradigm addressing several of these issues.

Bioinformatics
Confronting false discoveries in single-cell differential expression

Jordan W. Squair,Matthieu Gautier,Claudia Kathe,Mark A. Anderson,Nicholas D. James,Thomas H. Hutson,Rémi Hudelle,Taha Qaiser,Kaya J. E. Matson,Quentin Barraud,Ariel J. Levine,Gioele La Manno,Michael A. Skinnider,Grégoire Courtine

DOI: https://doi.org/10.1038/s41467-021-25960-2

IF: 16.6

2021-09-28

Nature Communications

Abstract:Abstract Differential expression analysis in single-cell transcriptomics enables the dissection of cell-type-specific responses to perturbations such as disease, trauma, or experimental manipulations. While many statistical methods are available to identify differentially expressed genes, the principles that distinguish these methods and their performance remain unclear. Here, we show that the relative performance of these methods is contingent on their ability to account for variation between biological replicates. Methods that ignore this inevitable variation are biased and prone to false discoveries. Indeed, the most widely used methods can discover hundreds of differentially expressed genes in the absence of biological differences. To exemplify these principles, we exposed true and false discoveries of differentially expressed genes in the injured mouse spinal cord.

multidisciplinary sciences
Critical Differential Expression Assessment for Individual Bulk RNA-Seq Projects

Charles D. Warden,Xiwei Wu

DOI: https://doi.org/10.1101/2024.02.10.579728

2024-02-12

Abstract:Finding the right balance of quality and quantity can be important, and it is essential that project quality does not drop below the level where important main conclusions are missed or misstated. We use knock-out and over-expression studies as a simplification to test recovery of a known causal gene in RNA-Seq cell line experiments. When single-end RNA-Seq reads are aligned with STAR and quantified with htseq-count, we found potential value in testing the use of the Generalized Linear Model (GLM) implementation of edgeR with robust dispersion estimation more frequently for either single-variate or multi-variate 2-group comparisons (with the possibility of defining criteria less stringent than |fold-change| > 1.5 and FDR < 0.05). When considering a limited number of patient sample comparisons with larger sample size, there might be some decreased variability between methods (except for DESeq1). However, at the same time, the ranking of the gene identified using immunohistochemistry (for ER/PR/HER2 in breast cancer samples from The Cancer Genome Atlas) showed as possible shift in performance compared to the cell line comparisons, potentially highlighting utility for standard statistical tests and/or limma-based analysis with larger sample sizes. If this continues to be true in additional studies and comparisons, then that could be consistent with the possibility that it may be important to allocate time for potential methods troubleshooting for genomics projects. Analysis of public data presented in this study does not consider all experimental designs, and presentation of downstream analysis is limited. So, any estimate from this simplification would be an underestimation of the true need for some methods testing for every project. Additionally, this set of independent cell line experiments has a limitation in being able to determine the frequency of missing a highly important gene if the problem is rare (such as 10% or lower). For example, if there was an assumption that only one method can be tested for “initial” analysis, then it is not completely clear to the extent that using edgeR-robust might perform better than DESeq2 in the cell line experiments. Importantly, we do not wish to cause undue concern, and we believe that it should often be possible to define a gene expression differential expression workflow that is suitable for some purposes for many samples. Nevertheless, at the same time, we provide a variety of measures that we believe emphasize the need to critically assess every individual project and maximize confidence in published results.

Genomics
Assessing differential cell composition in single-cell studies using voomCLR

Alemu Takele Assefa,Bie Verbist,Koen Van den Berge

DOI: https://doi.org/10.1101/2024.09.12.612645

2024-09-16

Abstract:In single-cell studies, a common question is whether there is a change in cell composition between conditions. While ideally, one needs absolute cell counts (number of cells per volumetric unit in a sample) to address these questions, current experimentation typically obtains cell counts that only carry relative information. It is therefore crucial to account for the compositional nature of cell count data in the statistical analysis. While recently developed methods address compositionality using compositional transformations together with a bias correction, they do not account for the uncertainty involved in estimation of the bias term, nor do they accommodate the mean-variance structure of the counts. Here, we introduce a statistical method, , for assessing differences in cell composition between conditions incorporating both uncertainty on the bias term as well as acknowledging the mean-variance structure of the transformed data, by leveraging developments from the differential gene expression literature. We demonstrate the performances of , illustrate the benefit of all components and compare the methodology to the state-of-the-art on simulated and real single-cell gene expression datasets.

Bioinformatics
Influence of single-cell RNA sequencing data integration on the performance of differential gene expression analysis

Tomasz Kujawa,Michał Marczyk,Joanna Polanska

DOI: https://doi.org/10.3389/fgene.2022.1009316

IF: 3.7

2022-11-02

Frontiers in Genetics

Abstract:Large-scale comprehensive single-cell experiments are often resource-intensive and require the involvement of many laboratories and/or taking measurements at various times. This inevitably leads to batch effects, and systematic variations in the data that might occur due to different technology platforms, reagent lots, or handling personnel. Such technical differences confound biological variations of interest and need to be corrected during the data integration process. Data integration is a challenging task due to the overlapping of biological and technical factors, which makes it difficult to distinguish their individual contribution to the overall observed effect. Moreover, the choice of integration method may impact the downstream analyses, including searching for differentially expressed genes. From the existing data integration methods, we selected only those that return the full expression matrix. We evaluated six methods in terms of their influence on the performance of differential gene expression analysis in two single-cell datasets with the same biological study design that differ only in the way the measurement was done: one dataset manifests strong batch effects due to the measurements of each sample at a different time. Integrated data were visualized using the UMAP method. The evaluation was done both on individual gene level using parametric and non-parametric approaches for finding differentially expressed genes and on gene set level using gene set enrichment analysis. As an evaluation metric, we used two correlation coefficients, Pearson and Spearman, of the obtained test statistics between reference, test, and corrected studies. Visual comparison of UMAP plots highlighted ComBat-seq, limma, and MNN, which reduced batch effects and preserved differences between biological conditions. Most of the tested methods changed the data distribution after integration, which negatively impacts the use of parametric methods for the analysis. Two algorithms, MNN and Scanorama, gave very poor results in terms of differential analysis on gene and gene set levels. Finally, we highlight ComBat-seq as it led to the highest correlation of test statistics between reference and corrected dataset among others. Moreover, it does not distort the original distribution of gene expression data, so it can be used in all types of downstream analyses.

genetics & heredity
BASiCS workflow: a step-by-step analysis of expression variability using single cell RNA sequencing data

Alan O'Callaghan,Nils Eling,John C. Marioni,Catalina A. Vallejos

DOI: https://doi.org/10.12688/f1000research.74416.1

2022-01-18

F1000Research

Abstract:Cell-to-cell gene expression variability is an inherent feature of complex biological systems, such as immunity and development. Single-cell RNA sequencing is a powerful tool to quantify this heterogeneity, but it is prone to strong technical noise. In this article, we describe a step-by-step computational workflow that uses the BASiCS Bioconductor package to robustly quantify expression variability within and between known groups of cells (such as experimental conditions or cell types). BASiCS uses an integrated framework for data normalisation, technical noise quantification and downstream analyses, propagating statistical uncertainty across these steps. Within a single seemingly homogeneous cell population, BASiCS can identify highly variable genes that exhibit strong heterogeneity as well as lowly variable genes with stable expression. BASiCS also uses a probabilistic decision rule to identify changes in expression variability between cell populations, whilst avoiding confounding effects related to differences in technical noise or in overall abundance. Using a publicly available dataset, we guide users through a complete pipeline that includes preliminary steps for quality control, as well as data exploration using the scater and scran Bioconductor packages. The workflow is accompanied by a Docker image that ensures the reproducibility of our results.
Robust differential expression testing for single-cell CRISPR screens at low multiplicity of infection

Timothy Barry,Kaishu Mason,Kathryn Roeder,Eugene Katsevich

DOI: https://doi.org/10.1186/s13059-024-03254-2

IF: 17.906

2024-05-19

Genome Biology

Abstract:Single-cell CRISPR screens (perturb-seq) link genetic perturbations to phenotypic changes in individual cells. The most fundamental task in perturb-seq analysis is to test for association between a perturbation and a count outcome, such as gene expression. We conduct the first-ever comprehensive benchmarking study of association testing methods for low multiplicity-of-infection (MOI) perturb-seq data, finding that existing methods produce excess false positives. We conduct an extensive empirical investigation of the data, identifying three core analysis challenges: sparsity, confounding, and model misspecification. Finally, we develop an association testing method — SCEPTRE low-MOI — that resolves these analysis challenges and demonstrates improved calibration and power.

genetics & heredity,biotechnology & applied microbiology
Sensitive cluster-free differential expression testing

Alsu Missarova,Emma Dann,Leah Rosen,Rahul Satija,John Marioni

DOI: https://doi.org/10.1101/2023.03.08.531744

2023-03-10

bioRxiv

Abstract:Comparing molecular features, including the identification of genes with differential expression (DE) between conditions, is a powerful approach for characterising disease-specific phenotypes. When testing for DE in single-cell RNA sequencing data, current pipelines first assign cells into discrete clusters (or cell types), followed by testing for differences within each cluster. Consequently, the sensitivity and specificity of DE testing are limited and ultimately dictated by the granularity of the cell type annotation, with discrete clustering being especially suboptimal for continuous trajectories. To overcome these limitations, we present miloDE - a cluster-free framework for differential expression testing. We build on the Milo approach, introduced for differential cell abundance testing, which leverages the graph representation of single-cell data to assign relatively homogenous, 'neighbouring' cells into overlapping neighbourhoods. We address key differences between differential abundance and expression testing at the level of neighbourhood assignment, statistical testing, and multiple testing correction. To illustrate the performance of miloDE we use both simulations and real data, in the latter case identifying a transient haemogenic endothelia-like state in chimeric mouse embryos lacking Tal1 as well as uncovering distinct transcriptional programs that characterise changes in macrophages in patients with Idiopathic Pulmonary Fibrosis. miloDE is available as an open-source R package at https://github.com/MarioniLab/miloDE.
A Two-Part Mixed Model for Differential Expression Analysis in Single-Cell High-Throughput Gene Expression Data.

Yang Shi,Ji-Hyun Lee,Huining Kang,Hui Jiang

DOI: https://doi.org/10.3390/genes13020377

IF: 4.141

2022-01-01

Genes

Abstract:The high-throughput gene expression data generated from recent single-cell RNA sequencing (scRNA-seq) and parallel single-cell reverse transcription quantitative real-time PCR (scRT-qPCR) technologies enable biologists to study the function of transcriptome at the level of individual cells. Compared with bulk RNA-seq and RT-qPCR gene expression data, single-cell data show notable distinct features, including excessive zero expression values, high variability, and clustered design. We propose to model single-cell high-throughput gene expression data using a two-part mixed model, which not only adequately accounts for the aforementioned features of single-cell expression data but also provides the flexibility of adjusting for covariates. An efficient computational algorithm, automatic differentiation, is used for estimating the model parameters. Compared with existing methods, our approach shows improved power for detecting differential expressed genes in single-cell high-throughput gene expression data.
Systematic comparative analysis of single cell RNA-sequencing methods

Jiarui Ding,Xian Adiconis,Sean K. Simmons,Monika S. Kowalczyk,Cynthia C. Hession,Nemanja D. Marjanovic,Travis K. Hughes,Marc H. Wadsworth,Tyler Burks,Lan T. Nguyen,John Y. H. Kwon,Boaz Barak,William Ge,Amanda J. Kedaigle,Shaina Carroll,Shuqiang Li,Nir Hacohen,Orit Rozenblatt-Rosen,Alex K. Shalek,Alexandra-Chloé Villani,Aviv Regev,Joshua Z. Levin

DOI: https://doi.org/10.1101/632216

2019-05-09

Abstract:ABSTRACT A multitude of single-cell RNA sequencing methods have been developed in recent years, with dramatic advances in scale and power, and enabling major discoveries and large scale cell mapping efforts. However, these methods have not been systematically and comprehensively benchmarked. Here, we directly compare seven methods for single cell and/or single nucleus profiling from three types of samples – cell lines, peripheral blood mononuclear cells and brain tissue – generating 36 libraries in six separate experiments in a single center. To analyze these datasets, we developed and applied scumi, a flexible computational pipeline that can be used for any scRNA-seq method. We evaluated the methods for both basic performance and for their ability to recover known biological information in the samples. Our study will help guide experiments with the methods in this study as well as serve as a benchmark for future studies and for computational algorithm development.
Benchmarking single cell RNA-sequencing analysis pipelines using mixture control experiments

Luyi Tian,Xueyi Dong,Saskia Freytag,Kim-Anh Lê Cao,Shian Su,Abolfazl JalalAbadi,Daniela Amann-Zalcenstein,Tom S. Weber,Azadeh Seidi,Jafar S. Jabbari,Shalin H. Naik,Matthew E. Ritchie

DOI: https://doi.org/10.1038/s41592-019-0425-8

IF: 48

2019-05-27

Nature Methods

Abstract:Single cell RNA-sequencing (scRNA-seq) technology has undergone rapid development in recent years, leading to an explosion in the number of tailored data analysis methods. However, the current lack of gold-standard benchmark datasets makes it difficult for researchers to systematically compare the performance of the many methods available. Here, we generated a realistic benchmark experiment that included single cells and admixtures of cells or RNA to create 'pseudo cells' from up to five distinct cancer cell lines. In total, 14 datasets were generated using both droplet and plate-based scRNA-seq protocols. We compared 3,913 combinations of data analysis methods for tasks ranging from normalization and imputation to clustering, trajectory analysis and data integration. Evaluation revealed pipelines suited to different types of data for different tasks. Our data and analysis provide a comprehensive framework for benchmarking most common scRNA-seq analysis steps.

biochemical research methods
Differential expression analysis of multifactor RNA-Seq experiments with respect to biological variation

Davis J. McCarthy,Yunshun Chen,Gordon K. Smyth

DOI: https://doi.org/10.1093/nar/gks042

IF: 14.9

2012-01-28

Nucleic Acids Research

Abstract:A flexible statistical framework is developed for the analysis of read counts from RNA-Seq gene expression studies. It provides the ability to analyse complex experiments involving multiple treatment conditions and blocking variables while still taking full account of biological variation. Biological variation between RNA samples is estimated separately from the technical variation associated with sequencing technologies. Novel empirical Bayes methods allow each gene to have its own specific variability, even when there are relatively few biological replicates from which to estimate such variability. The pipeline is implemented in the edgeR package of the Bioconductor project. A case study analysis of carcinoma data demonstrates the ability of generalized linear model methods (GLMs) to detect differential expression in a paired design, and even to detect tumour-specific expression changes. The case study demonstrates the need to allow for gene-specific variability, rather than assuming a common dispersion across genes or a fixed relationship between abundance and variability. Genewise dispersions de-prioritize genes with inconsistent results and allow the main analysis to focus on changes that are consistent between biological replicates. Parallel computational approaches are developed to make non-linear model fitting faster and more reliable, making the application of GLMs to genomic data more convenient and practical. Simulations demonstrate the ability of adjusted profile likelihood estimators to return accurate estimators of biological variability in complex situations. When variation is gene-specific, empirical Bayes estimators provide an advantageous compromise between the extremes of assuming common dispersion or separate genewise dispersion. The methods developed here can also be applied to count data arising from DNA-Seq applications, including ChIP-Seq for epigenetic marks and DNA methylation analyses.

biochemistry & molecular biology

Bias, robustness and scalability in single-cell differential expression analysis

Bias, robustness and scalability in differential expression analysis of single-cell RNA-seq data

Benchmarking integration of single-cell differential expression

Data Exploration, Quality Control and Testing in Single-Cell qPCR-Based Gene Expression Experiments

Single-cell differential expression analysis between conditions within nested settings

Benchmarking differential abundance methods for finding condition-specific prototypical cells in multi-sample single-cell datasets

The shaky foundations of simulating single-cell RNA sequencing data

A comprehensive assessment of cell type-specific differential expression methods in bulk data.

The curses of performing differential expression analysis using single-cell data

Confronting false discoveries in single-cell differential expression

Critical Differential Expression Assessment for Individual Bulk RNA-Seq Projects

Assessing differential cell composition in single-cell studies using voomCLR

Influence of single-cell RNA sequencing data integration on the performance of differential gene expression analysis

BASiCS workflow: a step-by-step analysis of expression variability using single cell RNA sequencing data

Robust differential expression testing for single-cell CRISPR screens at low multiplicity of infection

Sensitive cluster-free differential expression testing

A Two-Part Mixed Model for Differential Expression Analysis in Single-Cell High-Throughput Gene Expression Data.

Systematic comparative analysis of single cell RNA-sequencing methods

Benchmarking single cell RNA-sequencing analysis pipelines using mixture control experiments

Differential expression analysis of multifactor RNA-Seq experiments with respect to biological variation