Abstract:Single-cell RNA-sequencing (scRNA-seq) is a powerful tool to study cellular heterogeneity. The high dimensional data generated from this technology are complex and require specialised expertise for analysis and interpretation. The core of scRNA-seq data analysis contains several key analytical steps, which include pre-processing, QC, normalisation, dimensionality reduction, integration, and clustering. Each step often has many algorithms developed with varied underlying assumptions and implications. With such a diverse choice of tools available, benchmarking analyses have compared their performances and demonstrated that tools differentially operate according to the data types and complexity. Here, we present Integrated Benchmarking scRNA-seq Analytical Pipeline (IBRAP), a tool which contains a range of analytical components that can be interchanged throughout the pipeline alongside multiple benchmarking metrics that enables users to compare results and determine the optimal pipeline combinations for their data. We apply IBRAP to single and multi-sample integration analysis using pancreas, cell line and simulated data accompanied with ground truth cell labels, demonstrating the interchangeable and benchmarking functionality of IBRAP. Our results confirm that the optimal pipelines are dependant of individual samples and studies, further supporting the rationale and necessity of our tool. We then compare reference-based cell annotation with unsupervised analysis, both included in IBRAP, and demonstrate the superiority of the reference-based method in identifying robust major and minor cell types. Thus, IBRAP presents a valuable tool to integrate multiple samples and studies to create reference maps of normal and diseased tissues, facilitating novel biological discovery using the vast volume of scRNA-seq data available.

Benchmarking UMI-based single-cell RNA-seq preprocessing workflows

Benchmarking UMI-based single cell RNA-sequencing preprocessing workflows

scRNA-seq mixology: towards better benchmarking of single cell RNA-seq analysis methods

Benchmarking single cell RNA-sequencing analysis pipelines using mixture control experiments

A multicenter study benchmarking single-cell RNA sequencing technologies using reference samples

Comparative Analysis of NovaSeq 6000 and MGISEQ 2000 Single-Cell RNA Sequencing Data.

A comprehensive analysis framework for evaluating commercial single-cell RNA sequencing technologies

Systematic comparative analysis of single cell RNA-sequencing methods

Practical bioinformatics pipelines for single-cell RNA-seq data analysis

IBRAP: Integrated Benchmarking Single-cell RNA-sequencing Analytical Pipeline

A systematic evaluation of single cell RNA-seq analysis pipelines

Benchmarking Algorithms for Pathway Activity Transformation of Single-Cell RNA-seq Data

Comprehensive Evaluation of Noise Reduction Methods for Single-Cell RNA Sequencing Data

scRNASequest: an ecosystem of scRNA-seq analysis, visualization, and publishing

Scrna‐seq Data Analysis Method to Improve Analysis Performance

Comparison of high-throughput single-cell RNA sequencing data processing pipelines

The shaky foundations of simulating single-cell RNA sequencing data

Benchmark and Parameter Sensitivity Analysis of Single-Cell RNA Sequencing Clustering Methods

Comparative Analysis of Commercial Single-Cell RNA Sequencing Technologies

Tools for the Analysis of High-Dimensional Single-Cell RNA Sequencing Data

Beyond benchmarking and towards predictive models of dataset-specific single-cell RNA-seq pipeline performance