Abstract:Single-cell RNA sequencing (scRNA-seq) offers unprecedented insights into transcriptome-wide gene expression at the single-cell level. Cell clustering has been long established in the analysis of scRNA-seq data to identify the groups of cells with similar expression profiles. However, cell clustering is technically challenging, as raw scRNA-seq data have various analytical issues, including high dimensionality and dropout values. Existing research has developed deep learning models, such as graph machine learning models and contrastive learning-based models, for cell clustering using scRNA-seq data and has summarized the unsupervised learning of cell clustering into a human-interpretable format. While advances in cell clustering have been profound, we are no closer to finding a simple yet effective framework for learning high-quality representations necessary for robust clustering. In this study, we propose scSimGCL, a novel framework based on the graph contrastive learning paradigm for self-supervised pretraining of graph neural networks. This framework facilitates the generation of high-quality representations crucial for cell clustering. Our scSimGCL incorporates cell-cell graph structure and contrastive learning to enhance the performance of cell clustering. Extensive experimental results on simulated and real scRNA-seq datasets suggest the superiority of the proposed scSimGCL. Moreover, clustering assignment analysis confirms the general applicability of scSimGCL, including state-of-the-art clustering algorithms. Further, ablation study and hyperparameter analysis suggest the efficacy of our network architecture with the robustness of decisions in the self-supervised learning setting. The proposed scSimGCL can serve as a robust framework for practitioners developing tools for cell clustering. The source code of scSimGCL is publicly available at https://github.com/zhangzh1328/scSimGCL.

SimCTC: A Simple Contrast Learning Method of Text Clustering (Student Abstract)

Contrastive Learning Subspace for Text Clustering

Joint unsupervised contrastive learning and robust GMM for text clustering

TeC: A Novel Method for Text Clustering with Large Language Models Guidance and Weakly-Supervised Contrastive Learning

Simple Contrastive Graph Clustering

Graph Contrastive Learning as a Versatile Foundation for Advanced scRNA-seq Data Analysis

scRNA-seq Data Clustering by Cluster-aware Iterative Contrastive Learning

Simple Flow-Based Contrastive Learning for BERT Sentence Representations

Alleviating Over-smoothing for Unsupervised Sentence Representation.

ECCT: Efficient Contrastive Clustering via Pseudo-Siamese Vision Transformer and Multi-view Augmentation

CEIL: A General Classification-Enhanced Iterative Learning Framework for Text Clustering

Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classification

Self-supervised Document Clustering Based on BERT with Data Augment

XSimGCL: Towards Extremely Simple Graph Contrastive Learning for Recommendation

A self-supervised learning of semantic feature consistency for image clustering

Multi-Task Curriculum Graph Contrastive Learning with Clustering Entropy Guidance

Text-Centric Multimodal Contrastive Learning for Sentiment Analysis

A lightweight mixup-based short texts clustering for contrastive learning

Deep Robust Clustering by Contrastive Learning

An Effective Deployment of Contrastive Learning in Multi-label Text Classification