Leming Shi,Wendell D Jones,Roderick V Jensen,Stephen C Harris,Roger G Perkins,Federico M Goodsaid,Lei Guo,Lisa J Croner,Cecilie Boysen,Hong Fang,Feng Qian,Shashi Amur,Wenjun Bao,Catalin C Barbacioru,Vincent Bertholet,Xiaoxi Megan Cao,Tzu-Ming Chu,Patrick J Collins,Xiao-hui Fan,Felix W Frueh,James C Fuscoe,Xu Guo,Jing Han,Damir Herman,Huixiao Hong,Ernest S Kawasaki,Quan-Zhen Li,Yuling Luo,Yunqing Ma,Nan Mei,Ron L Peterson,Raj K Puri,Richard Shippy,Zhenqiang Su,Yongming Andrew Sun,Hongmei Sun,Brett Thorn,Yaron Turpaz,Charles Wang,Sue Jane Wang,Janet A Warrington,James C Willey,Jie Wu,Qian Xie,Liang Zhang,Lu Zhang,Sheng Zhong,Russell D Wolfinger,Weida Tong

Abstract:Background Reproducibility is a fundamental requirement in scientific experiments. Some recent publications have claimed that microarrays are unreliable because lists of differentially expressed genes (DEGs) are not reproducible in similar experiments. Meanwhile, new statistical methods for identifying DEGs continue to appear in the scientific literature. The resultant variety of existing and emerging methods exacerbates confusion and continuing debate in the microarray community on the appropriate choice of methods for identifying reliable DEG lists. Results Using the data sets generated by the MicroArray Quality Control (MAQC) project, we investigated the impact on the reproducibility of DEG lists of a few widely used gene selection procedures. We present comprehensive results from inter-site comparisons using the same microarray platform, cross-platform comparisons using multiple microarray platforms, and comparisons between microarray results and those from TaqMan – the widely regarded "standard" gene expression platform. Our results demonstrate that (1) previously reported discordance between DEG lists could simply result from ranking and selecting DEGs solely by statistical significance ( P ) derived from widely used simple t -tests; (2) when fold change (FC) is used as the ranking criterion with a non-stringent P -value cutoff filtering, the DEG lists become much more reproducible, especially when fewer genes are selected as differentially expressed, as is the case in most microarray studies; and (3) the instability of short DEG lists solely based on P -value ranking is an expected mathematical consequence of the high variability of the t -values; the more stringent the P -value threshold, the less reproducible the DEG list is. These observations are also consistent with results from extensive simulation calculations. Conclusion We recommend the use of FC-ranking plus a non-stringent P cutoff as a straightforward and baseline practice in order to generate more reproducible DEG lists. Specifically, the P -value cutoff should not be stringent (too small) and FC should be as large as possible. Our results provide practical guidance to choose the appropriate FC and P -value cutoffs when selecting a given number of DEGs. The FC criterion enhances reproducibility, whereas the P criterion balances sensitivity and specificity.

Identifying differentially expressed genes in human acute leukemia and mouse brain microarray datasets utilizing QTModel

A Robust Statistical Procedure to Discover Expression Biomarkers Using Microarray Genomic Expression Data.

A two-step strategy for detecting differential gene expression in cDNA microarray data

Selecting Reliable Mrna Expression Measurements Across Platforms Improves Downstream Analysis

The Microarray Quality Control (Maqc) Project And Cross-Platform Analysis Of Microarray Data

Statistical methods for analyzing microarray feature data with replications.

Investigation of reproducibility of differentially expressed genes in DNA microarrays through statistical simulation

Identification and validation of differentially expressed genes for targeted therapy in NSCLC using integrated bioinformatics analysis

A comparative review of statistical methods for discovering differentially expressed genes in replicated microarray experiments

A new framework for identifying differentially expressed genes

Novel Statistical Framework to Identify Differentially Expressed Genes Allowing Transcriptomic Background Differences

Using simple statistical model to identify differentially expressed genes in microarray experiments

A new algorithm for analysis of oligonucleotide arrays: application to expression profiling in mouse brain regions.

Differential Expression Analysis for RNAseq Using Poisson Mixed Models.

Experimental validation of methods for differential gene expression analysis and sample pooling in RNA-seq

Bioinformatics and Raman spectroscopy-based identification of key pathways and genes enabling differentiation between acute myeloid leukemia and T cell acute lymphoblastic leukemia

Statistical inference for time course RNA-Seq data using a negative binomial mixed-effect model

Integrative Analysis of Gene Expression Data by RNA Sequencing for Differential Diagnosis of Acute Leukemia: Potential Application of Machine Learning

Spring: A Method for Identifying Differentially Expressed Genes in Microarray Data

Gene Mining: a Novel and Powerful Ensemble Decision Approach to Hunting for Disease Genes Using Microarray Expression Profiling.

The balance of reproducibility, sensitivity, and specificity of lists of differentially expressed genes in microarray studies