Abstract:Abstract Advances in high-throughput sequencing on single-cell gene expressions [single-cell RNA sequencing (scRNA-seq)] have enabled transcriptome profiling on individual cells from complex samples. A common goal in scRNA-seq data analysis is to discover and characterise cell types, typically through clustering methods. The quality of the clustering therefore plays a critical role in biological discovery. While numerous clustering algorithms have been proposed for scRNA-seq data, fundamentally they all rely on a similarity metric for categorising individual cells. Although several studies have compared the performance of various clustering algorithms for scRNA-seq data, currently there is no benchmark of different similarity metrics and their influence on scRNA-seq data clustering. Here, we compared a panel of similarity metrics on clustering a collection of annotated scRNA-seq datasets. Within each dataset, a stratified subsampling procedure was applied and an array of evaluation measures was employed to assess the similarity metrics. This produced a highly reliable and reproducible consensus on their performance assessment. Overall, we found that correlation-based metrics (e.g. Pearson’s correlation) outperformed distance-based metrics (e.g. Euclidean distance). To test if the use of correlation-based metrics can benefit the recently published clustering techniques for scRNA-seq data, we modified a state-of-the-art kernel-based clustering algorithm (SIMLR) using Pearson’s correlation as a similarity measure and found significant performance improvement over Euclidean distance on scRNA-seq data clustering. These findings demonstrate the importance of similarity metrics in clustering scRNA-seq data and highlight Pearson’s correlation as a favourable choice. Further comparison on different scRNA-seq library preparation protocols suggests that they may also affect clustering performance. Finally, the benchmarking framework is available at http://www.maths.usyd.edu.au/u/SMS/bioinformatics/software.html.

Visualization and analysis of single-cell RNA-seq data by kernel-based similarity learning

SIMLR: a Tool for Large-Scale Single-Cell Analysis by Multi-Kernel Learning.

SIMLR: A Tool for Large-Scale Genomic Analyses by Multi-Kernel Learning

Density Peaks Based Clustering for Single-Cell Interpretation Via Multikernel Learning

A Kernel Non-Negative Matrix Factorization Framework for Single Cell Clustering

A spectral clustering with self-weighted multiple kernel learning method for single-cell RNA-seq data

Impact of similarity metrics on single-cell RNA-seq data clustering

A Network Propagation Based Approach for Measuring Cell-Cell Similarity.

scSRL: Siamese Representation Learning-based method for analyzing single-cell RNA-seq data.

Integrated analysis of multimodal single-cell data with structural similarity

Learning Consistency and Specificity of Cells from Single-cell Multi-omic Data

Machine learning and statistical methods for clustering single-cell RNA-sequencing data

Detection of Cell Types from Single-cell RNA-seq Data using Similarity via Kernel Preserving Learning Embedding

Cellular Similarity based Imputation for Single cell RNA Sequencing Data

SSRE: Cell Type Detection Based on Sparse Subspace Representation and Similarity Enhancement

A Global Similarity Learning for Clustering of Single-Cell RNA-Seq Data.

scICML: Information-Theoretic Co-Clustering-Based Multi-View Learning for the Integrative Analysis of Single-Cell Multi-Omics Data

Analysis of Single-Cell RNA-seq Data by Clustering Approaches

Joint learning dimension reduction and clustering of single-cell RNA-sequencing data

Latent cellular analysis robustly reveals subtle diversity in large-scale single-cell RNA-seq data

SMILE: Mutual Information Learning for Integration of Single Cell Omics Data