Abstract:Finding the right balance of quality and quantity can be important, and it is essential that project quality does not drop below the level where important main conclusions are missed or misstated. We use knock-out and over-expression studies as a simplification to test recovery of a known causal gene in RNA-Seq cell line experiments. When single-end RNA-Seq reads are aligned with STAR and quantified with htseq-count, we found potential value in testing the use of the Generalized Linear Model (GLM) implementation of edgeR with robust dispersion estimation more frequently for either single-variate or multi-variate 2-group comparisons (with the possibility of defining criteria less stringent than |fold-change| > 1.5 and FDR < 0.05). When considering a limited number of patient sample comparisons with larger sample size, there might be some decreased variability between methods (except for DESeq1). However, at the same time, the ranking of the gene identified using immunohistochemistry (for ER/PR/HER2 in breast cancer samples from The Cancer Genome Atlas) showed as possible shift in performance compared to the cell line comparisons, potentially highlighting utility for standard statistical tests and/or limma-based analysis with larger sample sizes. If this continues to be true in additional studies and comparisons, then that could be consistent with the possibility that it may be important to allocate time for potential methods troubleshooting for genomics projects. Analysis of public data presented in this study does not consider all experimental designs, and presentation of downstream analysis is limited. So, any estimate from this simplification would be an underestimation of the true need for some methods testing for every project. Additionally, this set of independent cell line experiments has a limitation in being able to determine the frequency of missing a highly important gene if the problem is rare (such as 10% or lower). For example, if there was an assumption that only one method can be tested for “initial” analysis, then it is not completely clear to the extent that using edgeR-robust might perform better than DESeq2 in the cell line experiments. Importantly, we do not wish to cause undue concern, and we believe that it should often be possible to define a gene expression differential expression workflow that is suitable for some purposes for many samples. Nevertheless, at the same time, we provide a variety of measures that we believe emphasize the need to critically assess every individual project and maximize confidence in published results.

Clover: An unbiased method for prioritizing differentially expressed genes using a data‐driven approach

Gene Set linkage analysis: a tool for interpreting the overall functional impacts of observed transcriptomic changes

DeClUt : Decluttering differentially expressed genes through clustering of their expression profiles

Identification of cell types, states and programs by learning gene set representations

A two-step strategy for detecting differential gene expression in cDNA microarray data

Degps is a Powerful Tool for Detecting Differential Expression in RNA-sequencing Studies

A New Approach To Identify Differentially Expressed Genes By Integrating Cancer Microarray And Sage Data

Recalibrating differential gene expression by genetic dosage variance prioritizes functionally relevant genes

Considering Dependencies Amongst Genes Helps to Adjust the Significance Rank of DEGs

Fused inverse-normal method for integrated differential expression analysis of RNA-seq data

CGPS: A Machine Learning-Based Approach Integrating Multiple Gene Set Analysis Tools for Better Prioritization of Biologically Relevant Pathways.

PONYTA: prioritization of phenotype-related genes from mouse KO events using PU learning on a biological network

A New Method for Disease-Related Gene Prioritization

High-Throughput GoMiner, an 'Industrial-Strength' Integrative Gene Ontology Tool for Interpretation of Multiple-Microarray Experiments, with Application to Studies of Common Variable Immune Deficiency (CVID).

EnRICH: Extraction and Ranking using Integration and Criteria Heuristics

Spring: A Method for Identifying Differentially Expressed Genes in Microarray Data

Critical Differential Expression Assessment for Individual Bulk RNA-Seq Projects

DEApp: an interactive web interface for differential expression analysis of next generation sequence data

Kernel-based data fusion for gene prioritization

iDEP: an integrated web application for differential expression and pathway analysis of RNA-Seq data

DExplore: An Online Tool for Detecting Differentially Expressed Genes from mRNA Microarray Experiments