Abstract:Integrated analysis of human gene expression data from multiple studies has become essential in genomics research for complex traits. However, integrating data generated from different cohorts with different platforms, such as microarray and RNA-seq, often requires data preprocessing, including normalization. In this study, we empirically evaluate 9 commonly used cross-platform normalization methods. We classify these methods into two main types: joint and separate normalization. Joint methods normalize multiple datasets together, while separate methods normalize each dataset independently. We further divide these methods into unsupervised and supervised approaches depending on whether they use outcomes during their normalization process. Examples of joint unsupervised methods include Quantile Normalization (QN), while Rank-in serves as an example of a joint supervised method. Training Distribution Matching (TDM) is an example of a separate unsupervised method. We assess each method's ability to cluster samples, predict outcomes, and detect differentially expressed (DE) genes using three real datasets and simulated data. First, our real data analysis suggests that while joint supervised methods can cluster sample groups better than the other two method groups, they double use the outcome data with artificially inflated clustering performance. Their biases are further demonstrated by their inflated type I error in DE analysis and clustering results from simulated data with no DE genes. Second, for outcome prediction, supervised normalization is no longer applicable. Among the unsupervised methods, QN significantly outperforms the other approaches, regardless of whether RNA-seq data is used to predict microarray outcomes or vice versa. Finally, we compare normalization methods on downstream DE analysis using simulation. In addition to direct DE analysis on the combined normalized data using the non-parametric Wilcoxon rank-sum test, we also perform a meta-analysis that combines p-values of the DE analysis from each individual data. For DE analysis, the meta-analysis consistently achieves the best balance between controlling type I error and maximizing power for DE gene detection. Our research suggests that while normalization is critical for the integrated analysis of transcriptomics data, simple QN is the most efficient and unbiased normalization approach for outcome prediction, and meta-analysis is the most appropriate for DE analysis.

MAnorm2 for Quantitatively Comparing Groups of ChIP-seq Samples

MAnorm: a Robust Model for Quantitative Comparison of ChIP-Seq Data Sets

Quantitative Comparison of ChIP-Seq Data Sets Using MAnorm

Diffreps: Detecting Differential Chromatin Modification Sites from ChIP-seq Data with Biological Replicates.

QChIPat: a quantitative method to identify distinct binding patterns for two biological ChIP-seq samples in different experimental conditions

Comparative ChIP-seq (Comp-ChIP-seq): a practical guideline for experimental design and a novel computational methodology

Normalization and experimental design for ChIP-chip data

Degps is a Powerful Tool for Detecting Differential Expression in RNA-sequencing Studies

Evaluating Cross-Platform Normalization Methods for Integrated Microarray and RNA-seq Data Analysis

Identifying Differentially Spliced Genes from Two Groups of Rna-Seq Samples

Evaluation of ChIC-based data requires normalization that properly retains signal-to-noise ratios

Copy number normalization distinguishes differential signals driven by copy number differences in ATAC-seq and ChIP-seq

Highly quantitative measurement of differential protein-genome binding with PerCell chromatin sequencing

ChIPbinner: An R package for analyzing broad histone marks binned in uniform windows from ChIP-Seq or CUT&RUN/TAG data

Identifying differentially expressed genes in human acute leukemia and mouse brain microarray datasets utilizing QTModel

ChIP-chip versus ChIP-seq: Lessons for experimental design and data analysis

A novel method for the normalization of ChIP-qPCR data

An Integrated Software System for Analyzing ChIP-chip and ChIP-seq Data

A statistical normalization method and differential expression analysis for RNA-seq data between different species

An Alternative Approach to ChIP-Seq Normalization Enables Detection of Genome-Wide Changes in Histone H3 Lysine 27 Trimethylation upon EZH2 Inhibition

ADTnorm: Robust Integration of Single-cell Protein Measurement across CITE-seq Datasets