Abstract:Integrated analysis of human gene expression data from multiple studies has become essential in genomics research for complex traits. However, integrating data generated from different cohorts with different platforms, such as microarray and RNA-seq, often requires data preprocessing, including normalization. In this study, we empirically evaluate 9 commonly used cross-platform normalization methods. We classify these methods into two main types: joint and separate normalization. Joint methods normalize multiple datasets together, while separate methods normalize each dataset independently. We further divide these methods into unsupervised and supervised approaches depending on whether they use outcomes during their normalization process. Examples of joint unsupervised methods include Quantile Normalization (QN), while Rank-in serves as an example of a joint supervised method. Training Distribution Matching (TDM) is an example of a separate unsupervised method. We assess each method's ability to cluster samples, predict outcomes, and detect differentially expressed (DE) genes using three real datasets and simulated data. First, our real data analysis suggests that while joint supervised methods can cluster sample groups better than the other two method groups, they double use the outcome data with artificially inflated clustering performance. Their biases are further demonstrated by their inflated type I error in DE analysis and clustering results from simulated data with no DE genes. Second, for outcome prediction, supervised normalization is no longer applicable. Among the unsupervised methods, QN significantly outperforms the other approaches, regardless of whether RNA-seq data is used to predict microarray outcomes or vice versa. Finally, we compare normalization methods on downstream DE analysis using simulation. In addition to direct DE analysis on the combined normalized data using the non-parametric Wilcoxon rank-sum test, we also perform a meta-analysis that combines p-values of the DE analysis from each individual data. For DE analysis, the meta-analysis consistently achieves the best balance between controlling type I error and maximizing power for DE gene detection. Our research suggests that while normalization is critical for the integrated analysis of transcriptomics data, simple QN is the most efficient and unbiased normalization approach for outcome prediction, and meta-analysis is the most appropriate for DE analysis.

GUANIN: An all-in-one GUi-driven Analyzer for NanoString Interactive Normalization

Development of a robust and generalizable algorithm "gQuant" for accurate normalizer gene selection in qRT-PCR analysis

NACHO: an R package for quality control of NanoString nCounter data

MetaNorm: incorporating meta-analytic priors into normalization of NanoString nCounter data

RCRnorm: An integrated system of random-coefficient hierarchical regression models for normalizing NanoString nCounter data

bayNorm: Bayesian gene expression recovery, imputation and normalization for single-cell RNA-sequencing data

Depth Normalization of Small RNA Sequencing: Using Data and Biology to Select a Suitable Method

SMIXnorm: Fast and Accurate RNA-Seq Data Normalization for Formalin-Fixed Paraffin-Embedded Samples

nf-core/nanostring: a pipeline for reproducible NanoString nCounter analysis

A Novel Normalization Approach for MicroRNA Quantitative PCR

Evaluating Cross-Platform Normalization Methods for Integrated Microarray and RNA-seq Data Analysis

GeneTUKit: a Software for Document-Level Gene Normalization

NormExpression: an R Package to Normalize Gene Expression Data Using Evaluated Methods

Reference gene validation software for improved normalization

proteiNorm – A User-Friendly Tool for Normalization and Analysis of TMT and Label-Free Protein Quantification

ClinQC: a tool for quality control and cleaning of Sanger and NGS data in clinical research

Nanometa live: a user-friendly application for real-time metagenomic data analysis and pathogen identification

CytoBatchNorm: an R package with graphical interface for batch effects correction of cytometry data

Normalization of Real-Time Quantitative Reverse Transcription-PCR Data: A Model-Based Variance Estimation Approach to Identify Genes Suited for Normalization, Applied to Bladder and Colon Cancer Data Sets

SinglePointRNA, an user-friendly application implementing single cell RNA-seq analysis software

iQuant: A fast yet accurate GUI tool for transcript quantification