Abstract:Replicable signals from different yet conceptually related studies provide stronger scientific evidence and more powerful inference. We introduce STAREG, a statistical method for replicability analysis of high throughput experiments, and apply it to analyze spatial transcriptomic studies. STAREG uses summary statistics from multiple studies of high throughput experiments and models the the joint distribution of p -values accounting for the heterogeneity of different studies. It effectively controls the false discovery rate (FDR) and has higher power by information borrowing. Moreover, it provides different rankings of important genes. With the EM algorithm in combination with pool-adjacent-violator-algorithm (PAVA), STAREG is scalable to datasets with millions of genes without any tuning parameters. Analyzing two pairs of spatially resolved transcriptomic datasets, we are able to make biological discoveries that otherwise cannot be obtained by using existing methods. Irreplicable research wastes time, money, and/or resources. Approximately $28 billion is estimated to be spent on preclinical research that cannot be replicated every year in the United States alone. Possible causes of irreplicable research may include experimental design, laboratory practices, and data analysis. We focus on data analysis. The past two decades have witnessed the expansion and increased availability of genomic data from high-throughput experiments. Due to privacy concerns or logistic reasons, raw data can be difficult to access but summary data such as p -values are readily available. We introduce STAREG, which jointly analyzes p -values from multiple genomic datasets that target the same scientific question with different populations or different technologies. This allows us to have more convincing and robust findings. STAREG is computationally scalable with solid statistical analysis. Moreover, it is versatile, platform-independent, and only requires p -values as input. By analyzing data sets from spatially resolved transcriptomic studies, we make biological discoveries that otherwise cannot be obtained with existing methods.

Estimating Reproducibility in Genome-Wide Association Studies

Is Replication The Gold Standard For Validating Genome-Wide Association Findings?

Replicability analysis for genome-wide association studies

A powerful approach to identify replicable variants in genome-wide association studies

Technical reproducibility of genotyping SNP arrays used in genome-wide association studies.

Pitfall of genome-wide association studies: Sources of inconsistency in genotypes and their effects

Validating GWAS Findings through Reverse Engineering of Contingency Tables

Extracting replicable associations across multiple studies: algorithms for controlling the false discovery rate

Nonreplication in Genetic Studies of Complex Diseases—Lessons Learned from Studies of Osteoporosis and Tentative Remedies

Replication of Known and Identification of Novel Associations in Biobank-Scale Datasets: A Survey Using UK Biobank and FinnGen

STAREG: Statistical replicability analysis of high throughput experiments with applications to spatial transcriptomic studies

A new standard for the analysis and design of replication studies

Deciding whether follow-up studies have replicated findings in a preliminary large-scale "omics' study"

Assessing Study Reproducibility through M 2 RI : A Novel Approach for Large-scale High-throughput Association Studies

The assessment of replicability using the sum of p-values

Robust Reference Powered Association Test of Genome-Wide Association Studies

Bias in data-driven estimates of the reproducibility of univariate brain-wide association studies.

Model-based assessment of replicability for genome-wide association meta-analysis

Ensuring Trust in Genomics Research

Revisiting the genome-wide significance threshold for common variant GWAS

Controlling the Rate of GWAS False Discoveries