Abstract:Deep clustering seeks to group data into distinct clusters using deep learning techniques. Existing approaches of deep clustering can be broadly categorized into two groups: offline clustering based on unsupervised representation learning and online clustering based on unsupervised classification. While both groups have demonstrated impressive performance in deep clustering, no study has explored the integration of their respective strengths. To this end, we propose Mutual-Taught Deep Clustering (MTDC), which unifies unsupervised representation learning and unsupervised classification into a framework while realizing mutual promotion using a novel mutual-taught mechanism. Specifically, MTDC alternates between predicting pseudolabels in label space and estimating semantic similarity in feature space during training. Moreover, pseudolabels provide weakly-supervised information to enhance unsupervised representation learning, while semantic similarities function as structural priors that regularize unsupervised classification. Consequently, unsupervised classification and unsupervised representation learning can mutually benefit from one another. MTDC is decoupled from prevailing deep clustering methods. For the sake of clarity, we build upon a straightforward baseline in this paper. Despite its simplicity, we demonstrate that MTDC is exceedingly efficacious and consistently enhances the baseline results by substantial margins. For example, MTDC achieves 2.5%∼7.9% (NMI), 3.0%∼13.9% (ACC), and 3.1%∼16.7% (ARI) gains over the baseline on six widely used image datasets. Source code is available at:https://github.com/yichenwang231/MTDC.

A Multi-Task Learning Strategy for Unsupervised Clustering Via Explicitly Separating the Commonality

Multi-View Clustering Via Simultaneously Learning Shared Subspace And Affinity Matrix

Multi-Task Co-Clustering Via Nonnegative Matrix Factorization

Co-Clustering for Multitask Learning

Elaborate Multi-Task Subspace Learning with Discrete Group Constraint

Learning the Shared Subspace for Multi-task Clustering and Transductive Transfer Classification.

Multi-task Subspace Clustering

Network Clustering for Multi-task Learning

Unsupervised Multi-task Learning with Hierarchical Data Structure.

Multi-task self-supervised learning based fusion representation for Multi-view clustering

Semisoft Task Clustering for Multi-Task Learning

Multi-Modal Deep Clustering: Unsupervised Partitioning of Images

Exploiting Task-Feature Co-Clusters In Multi-Task Learning

Multi-Task Learning with Group-Specific Feature Space Sharing

Unsupervised feature selection for multi-cluster data

Robust Task Grouping with Representative Tasks for Clustered Multi-Task Learning

Mutual-Taught Deep Clustering

Adaptive dual graph regularization for clustered multi-task learning

Multi-task Clustering Through Instances Transfer

Calibrated Multi-Task Subspace Learning Via Binary Group Structure Constraint.

Multiple Kernel Subspace Learning for Clustering and Classification