The Reproducibility of Lists of Differentially Expressed Genes in Microarray Studies
Leming Shi,Wendell Jones,Roderick Jensen,Stephen Harris,Roger Perkins,Federico Goodsaid,Lei Guo,Lisa Croner,Cecilie Boysen,Hong Fang,Shashi Amur,Wenjun Bao,Catalin Barbacioru,Vincent Bertholet,Xiaoxi Megan Cao,Tzu-Ming Chu,Patrick Collins,Xiao-hui Fan,Felix Frueh,James Fuscoe,Xu Guo,Jing Han,Damir Herman,Huixiao Hong,Ernest Kawasaki,Quan-Zhen Li,Yuling Luo,Yunqing Ma,Nan Mei,Ron Peterson,Raj Puri,Feng Qian,Richard Shippy,Zhenqiang Su,Yongming Andrew Sun,Hongmei Sun,Brett Thorn,Yaron Turpaz,Charles Wang,Sue-Jane Wang,Janet Warrington,James Willey,Jie Wu,Qian Xie,Liang Zhang,Lu Zhang,Sheng Zhong,Russell Wolfinger,Weida Tong
DOI: https://doi.org/10.1038/npre.2007.306.1
2007-01-01
Nature Precedings
Abstract:Reproducibility is a fundamental requirement in scientific experiments and clinical contexts. Recent publications raise concerns about the reliability of microarray technology because of the apparent lack of agreement between lists of differentially expressed genes (DEGs). In this study we demonstrate that (1) such discordance may stem from ranking and selecting DEGs solely by statistical significance (P) derived from widely used simple t-tests; (2) when fold change (FC) is used as the ranking criterion, the lists become much more reproducible, especially when fewer genes are selected; and (3) the instability of short DEG lists based on P cutoffs is an expected mathematical consequence of the high variability of the t-values. We recommend the use of FC ranking plus a non-stringent P cutoff as a baseline practice in order to generate more reproducible DEG lists. The FC criterion enhances reproducibility while the P criterion balances sensitivity and specificity.