Abstract:Sparse and noisy images (SNIs), like those in spatial gene expression data, pose significant challenges for effective representation learning and clustering, which are essential for thorough data analysis and interpretation. In response to these challenges, we propose Dual Advancement of Representation Learning and Clustering (DARLC), an innovative framework that leverages contrastive learning to enhance the representations derived from masked image modeling. Simultaneously, DARLC integrates cluster assignments in a cohesive, end-to-end approach. This integrated clustering strategy addresses the "class collision problem" inherent in contrastive learning, thus improving the quality of the resulting representations. To generate more plausible positive views for contrastive learning, we employ a graph attention network-based technique that produces denoised images as augmented data. As such, our framework offers a comprehensive approach that improves the learning of representations by enhancing their local perceptibility, distinctiveness, and the understanding of relational semantics. Furthermore, we utilize a Student's t mixture model to achieve more robust and adaptable clustering of SNIs. Extensive experiments, conducted across 12 different types of datasets consisting of SNIs, demonstrate that DARLC surpasses the state-of-the-art methods in both image clustering and generating image representations that accurately capture gene interactions. Code is available at <a class="link-external link-https" href="https://github.com/zipging/DARLC" rel="external noopener nofollow">this https URL</a>.

Contrastive self-representation learning for data clustering

Point Contrastive Prediction with Semantic Clustering for Self-Supervised Learning on Point Cloud Videos

GRESS: Grouping Belief-Based Deep Contrastive Subspace Clustering

Contrastive Learning Subspace for Text Clustering

Learning a Self-Expressive Network for Subspace Clustering

Comprehensive multi-view self-representations for clustering

Towards Very Deep Representation Learning for Subspace Clustering

Multi-Scale Deep Subspace Clustering With Discriminative Learning

Learnable low-rank latent dictionary for subspace clustering

Deep subspace clustering to achieve jointly latent feature extraction and discriminative learning

Deep Subspace Image Clustering Network with Self-Expression and Self-Supervision

MHCCL: Masked Hierarchical Cluster-Wise Contrastive Learning for Multivariate Time Series

Unsupervised Cross-view Subspace Clustering via Adaptive Contrastive Learning

Deep Double Self-Expressive Subspace Clustering

Dual Advancement of Representation Learning and Clustering for Sparse and Noisy Images

Exploring Non-Contrastive Representation Learning for Deep Clustering

Scaled Simplex Representation for Subspace Clustering

Elastic Deep Sparse Self-Representation Subspace Clustering Network

Segmentary group-sparsity self-representation learning and spectral clustering via double L 21 norm

Deep Robust Clustering by Contrastive Learning

Rank–sparsity Balanced Representation for Subspace Clustering