Abstract:Single-cell RNA-sequencing (scRNA-seq) is a powerful tool to study cellular heterogeneity. The high dimensional data generated from this technology are complex and require specialised expertise for analysis and interpretation. The core of scRNA-seq data analysis contains several key analytical steps, which include pre-processing, QC, normalisation, dimensionality reduction, integration, and clustering. Each step often has many algorithms developed with varied underlying assumptions and implications. With such a diverse choice of tools available, benchmarking analyses have compared their performances and demonstrated that tools differentially operate according to the data types and complexity. Here, we present Integrated Benchmarking scRNA-seq Analytical Pipeline (IBRAP), a tool which contains a range of analytical components that can be interchanged throughout the pipeline alongside multiple benchmarking metrics that enables users to compare results and determine the optimal pipeline combinations for their data. We apply IBRAP to single and multi-sample integration analysis using pancreas, cell line and simulated data accompanied with ground truth cell labels, demonstrating the interchangeable and benchmarking functionality of IBRAP. Our results confirm that the optimal pipelines are dependant of individual samples and studies, further supporting the rationale and necessity of our tool. We then compare reference-based cell annotation with unsupervised analysis, both included in IBRAP, and demonstrate the superiority of the reference-based method in identifying robust major and minor cell types. Thus, IBRAP presents a valuable tool to integrate multiple samples and studies to create reference maps of normal and diseased tissues, facilitating novel biological discovery using the vast volume of scRNA-seq data available.

Benchmarking UMI-based single cell RNA-sequencing preprocessing workflows

Benchmarking UMI-based single-cell RNA-seq preprocessing workflows

scRNA-seq mixology: towards better benchmarking of single cell RNA-seq analysis methods

A multicenter study benchmarking single-cell RNA sequencing technologies using reference samples

Benchmarking single cell RNA-sequencing analysis pipelines using mixture control experiments

Comparative Analysis of NovaSeq 6000 and MGISEQ 2000 Single-Cell RNA Sequencing Data.

Comparison of high-throughput single-cell RNA sequencing data processing pipelines

A systematic evaluation of single cell RNA-seq analysis pipelines

Practical bioinformatics pipelines for single-cell RNA-seq data analysis

Scrna‐seq Data Analysis Method to Improve Analysis Performance

A comprehensive analysis framework for evaluating commercial single-cell RNA sequencing technologies

Systematic comparative analysis of single cell RNA-sequencing methods

Comprehensive Evaluation of Noise Reduction Methods for Single-Cell RNA Sequencing Data

scRNASequest: an ecosystem of scRNA-seq analysis, visualization, and publishing

Tools for the Analysis of High-Dimensional Single-Cell RNA Sequencing Data

Benchmarking Algorithms for Pathway Activity Transformation of Single-Cell RNA-seq Data

A comparison of deep learning-based pre-processing and clustering approaches for single-cell RNA sequencing data

IBRAP: Integrated Benchmarking Single-cell RNA-sequencing Analytical Pipeline

Benchmarking of RNA-sequencing analysis workflows using whole-transcriptome RT-qPCR expression data

Comparative Analysis of Commercial Single-Cell RNA Sequencing Technologies

Goals and Approaches for Each Processing Step for Single-Cell RNA Sequencing Data.