Abstract:Abstract Advances in high-throughput sequencing on single-cell gene expressions [single-cell RNA sequencing (scRNA-seq)] have enabled transcriptome profiling on individual cells from complex samples. A common goal in scRNA-seq data analysis is to discover and characterise cell types, typically through clustering methods. The quality of the clustering therefore plays a critical role in biological discovery. While numerous clustering algorithms have been proposed for scRNA-seq data, fundamentally they all rely on a similarity metric for categorising individual cells. Although several studies have compared the performance of various clustering algorithms for scRNA-seq data, currently there is no benchmark of different similarity metrics and their influence on scRNA-seq data clustering. Here, we compared a panel of similarity metrics on clustering a collection of annotated scRNA-seq datasets. Within each dataset, a stratified subsampling procedure was applied and an array of evaluation measures was employed to assess the similarity metrics. This produced a highly reliable and reproducible consensus on their performance assessment. Overall, we found that correlation-based metrics (e.g. Pearson’s correlation) outperformed distance-based metrics (e.g. Euclidean distance). To test if the use of correlation-based metrics can benefit the recently published clustering techniques for scRNA-seq data, we modified a state-of-the-art kernel-based clustering algorithm (SIMLR) using Pearson’s correlation as a similarity measure and found significant performance improvement over Euclidean distance on scRNA-seq data clustering. These findings demonstrate the importance of similarity metrics in clustering scRNA-seq data and highlight Pearson’s correlation as a favourable choice. Further comparison on different scRNA-seq library preparation protocols suggests that they may also affect clustering performance. Finally, the benchmarking framework is available at http://www.maths.usyd.edu.au/u/SMS/bioinformatics/software.html.

A Gene Rank Based Approach for Single Cell Similarity Assessment and Clustering

BioRank: A Similarity Assessment Method for Single Cell Clustering

Analysis of Single-Cell RNA-seq Data by Clustering Approaches

Clustering Single-Cell RNA-seq Data by Rank Constrained Similarity Learning

Clustering of Single-cell RNA-seq Data by Unsupervised Learning Methods

A clustering method for single-cell RNA-seq data based on automatic weighting penalty and low-rank representation

Impact of similarity metrics on single-cell RNA-seq data clustering

A Network Propagation Based Approach for Measuring Cell-Cell Similarity.

scGIR: deciphering cellular heterogeneity via gene ranking in single-cell weighted gene correlation networks

A Hybrid Clustering Algorithm for Identifying Cell Types from Single-Cell RNA-Seq Data.

Single-cell RNA-seq clustering: datasets, models, and algorithms

Single-cell RNA-seq Data Clustering: A Survey with Performance Comparison Study

Ranking of cell clusters in a single-cell RNA-sequencing analysis framework using prior knowledge

A critical assessment of clustering algorithms to improve cell clustering and identification in single-cell transcriptome study

Identifying Cell Subpopulations and Their Genetic Drivers from Single-Cell RNA-Seq Data Using a Biclustering Approach

Non-Negative Low-Rank Representation with Similarity Correction for Cell Type Identification in Scrna-Seq Data.

A Meta-learning Based Graph-Hierarchical Clustering Method for Single Cell RNA-Seq Data

SCNMLRR: Single Cell Clustering Based on Low-rank Non-negative Matrix Factorization

Machine learning and statistical methods for clustering single-cell RNA-sequencing data

ARGLRR: An Adjusted Random Walk Graph Regularization Sparse Low-Rank Representation Method for Single-Cell RNA-Sequencing Data Clustering

Benchmarking clustering algorithms on estimating the number of cell types from single-cell RNA-sequencing data