Abstract:Cell clustering is typically the initial step in single-cell RNA sequencing (scRNA-seq) analyses. The performance of clustering considerably impacts the validity and reproducibility of cell identification. A variety of clustering algorithms have been developed for scRNA-seq data. These algorithms generate cell label sets that assign each cell to a cluster. However, different algorithms usually yield different label sets, which can introduce variations in cell-type identification based on the generated label sets. Currently, the performance of these algorithms has not been systematically evaluated in single-cell transcriptome studies. Herein, we performed a critical assessment of seven state-of-the-art clustering algorithms including four deep learning-based clustering algorithms and commonly used methods Seurat, Cosine-based Tanimoto similarity-refined graph for community detection using Leiden's algorithm (CosTaL) and Single-cell consensus clustering (SC3). We used diverse evaluation indices based on 10 different scRNA-seq benchmarks to systematically evaluate their clustering performance. Our results show that CosTaL, Seurat, Deep Embedding for Single-cell Clustering (DESC) and SC3 consistently outperformed Single-Cell Clustering Assessment Framework and scDeepCluster based on nine effectiveness scores. Notably, CosTaL and DESC demonstrated superior performance in clustering specific cell types. The performance of the single-cell Variational Inference tools varied across different datasets, suggesting its sensitivity to certain dataset characteristics. Notably, DESC exhibited promising results for cell subtype identification and capturing cellular heterogeneity. In addition, SC3 requires more memory and exhibits slower computation speed compared to other algorithms for the same dataset. In sum, this study provides useful guidance for selecting appropriate clustering methods in scRNA-seq data analysis.

A review and performance evaluation of clustering frameworks for single-cell Hi-C data

A novel framework for single-cell Hi-C clustering based on graph-convolution-based imputation and two-phase-based feature extraction

Comparison of computational methods for 3D genome analysis at single-cell Hi-C level

Deciphering Hierarchical Chromatin Domains and Preference of Genomic Position Forming Boundaries in Single Mouse Embryonic Stem Cells

Robust single-cell Hi-C clustering by convolution- and random-walk–based imputation

Revisiting Assessment of Computational Methods for Hi-C Data Analysis

Single-cell RNA-seq Data Clustering: A Survey with Performance Comparison Study

Sci-Hi-C: A single-cell Hi-C method for mapping 3D genome organization in large number of single cells

A critical assessment of clustering algorithms to improve cell clustering and identification in single-cell transcriptome study

Single-cell RNA-seq clustering: datasets, models, and algorithms

Review of Single-cell RNA-seq Data Clustering for Cell Type Identification and Characterization

Deep Generative Modeling and Clustering of Single Cell Hi -C Data

Analysis of Single-Cell RNA-seq Data by Clustering Approaches

A systematic performance evaluation of clustering methods for single-cell RNA-seq data

Dimension Reduction and Clustering Models for Single-Cell RNA Sequencing Data: A Comparative Study

Evaluating the performance of dropout imputation and clustering methods for single-cell RNA sequencing data

A comparison framework and guideline of clustering methods for mass cytometry data

Benchmarking clustering algorithms on estimating the number of cell types from single-cell RNA-sequencing data

Machine learning and statistical methods for clustering single-cell RNA-sequencing data

Every gene everywhere all at once: High-precision measurement of 3D chromosome architecture with single-cell Hi-C

An Overview of Methods for Reconstructing 3-D Chromosome and Genome Structures from Hi-C Data