Abstract:In gene set analysis, a researcher is typically confronted with many uncertainties in choosing the "right" method, corresponding parameter setting, and data preprocessing approach. We aim to offer guidance through these uncertainties by giving an overview of valid approaches and illustrations of their implementations in R. The results images in the graphical abstract were generated using the web‐based application Gene Set Enrichment Analysis (Subramanian et al., 2005, Proceedings of the National Academy of Sciences, 102(43):15545–15550; Mootha et al., 2003, Nature Genetics, 34(3):267–273). Gene set analysis (GSA), a popular approach for analyzing high‐throughput gene expression data, aims to identify sets of related genes that show significantly enriched or depleted expression patterns between different conditions. In the last years, a multitude of methods have been developed for this task. However, clear guidance is lacking: choosing the right method is the first hurdle a researcher is confronted with. No less challenging than overcoming this so‐called method uncertainty is the procedure of preprocessing, from knowing which steps are required to selecting a corresponding approach from the plethora of valid options to create the accepted input object (data preprocessing uncertainty), with clear guidance again being scarce. Here, we provide a practical guide through all steps required to conduct GSA, beginning with a concise overview of a selection of established methods, including Gene Set Enrichment Analysis and Database for Annotation, Visualization, and Integrated Discovery (DAVID). We thereby lay a special focus on reviewing and explaining the necessary preprocessing steps for each method under consideration (e.g., the necessity of a transformation of the RNA sequencing data)—an essential aspect that is typically paid only limited attention to in both existing reviews and applications. To raise awareness of the spectrum of uncertainties, our review is accompanied by an extensive overview of the literature on valid approaches for each step and illustrative R code demonstrating the complex analysis pipelines. It ends with a discussion and recommendations to both users and developers to ensure that the results of GSA are, despite the above‐mentioned uncertainties, replicable and transparent. This article is categorized under: Statistical and Graphical Methods of Data Analysis > Analysis of High Dimensional Data Data: Types and Structure > Data Preparation and Processing Applications of Computational Statistics > Genomics/Proteomics/Genetics

Gene set bagging for estimating replicability of gene set analyses

STAREG: Statistical replicability analysis of high throughput experiments with applications to spatial transcriptomic studies

Bayesian Gene Set Analysis

From RNA sequencing measurements to the final results: A practical guide to navigating the choices and uncertainties of gene set analysis

Evaluating the Reproducibility of Single-Cell Gene Regulatory Network Inference Algorithms

JUMP: replicability analysis of high-throughput experiments with applications to spatial transcriptomic studies

Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles

Investigation of reproducibility of differentially expressed genes in DNA microarrays through statistical simulation

Redundancy-aware unsupervised ranking based on game theory -- application to gene enrichment analysis

Bagged Empirical Null p-values: A Method to Account for Model Uncertainty in Large Scale Inference

The Limitations of Simple Gene Set Enrichment Analysis Assuming Gene Independence

Replicability analysis for genome-wide association studies

Improving data interpretability with new differential sample variance gene set tests

Reconstruction Set Test (RESET): A computationally efficient method for single sample gene set testing based on randomized reduced rank reconstruction error

Analysing multiple types of molecular profiles simultaneously: connecting the needles in the haystack

Toward a gold standard for benchmarking gene set enrichment analysis

Extracting replicable associations across multiple studies: algorithms for controlling the false discovery rate

Gene and Gene-Set Analysis for Genome-Wide Association Studies

Evaluation of Bayesian Linear Regression Derived Gene Set Test Methods

Statistical significance of variables driving systematic variation

A powerful approach to identify replicable variants in genome-wide association studies