Abstract: Deep subspace clustering has attracted increasing attention in recent years. Almost all the existing works are required to load the whole training data into one batch for learning the self-expressive coefficients in the framework of deep learning. Although these methods achieve promising results, such a learning fashion severely prevents from the usage of deeper neural network architectures (e.g., ResNet), leading to the limited representation abilities of the models. In this paper, we propose a new deep subspace clustering framework, motivated by the energy-based models. In contrast to previous approaches taking the weights of a fully connected layer as the self-expressive coefficients, we propose to learn an energy-based network to obtain the self-expressive coefficients by mini-batch training. By this means, it is no longer necessary to load all data into one batch for learning, and it thus becomes a reality that we can utilize deeper neural network models for subspace clustering. Considering the powerful representation ability of the recently popular self-supervised learning, we attempt to leverage self-supervised representation learning to learn the dictionary. Finally, we propose a joint framework to learn both the self-expressive coefficients and dictionary simultaneously, and train the model in an end-to-end manner. The experiments are performed on three publicly available datasets, and extensive experimental results demonstrate our method can significantly outperform the other related approaches. For instance, on the three datasets, our method can averagely achieve $13.8\%$, $15.4\%$, $20.8\%$ improvements in terms of Accuracy, NMI, and ARI over SENet which is proposed very recently and obtains the second best results in the experiments.

Deep Subspace Image Clustering Network with Self-Expression and Self-Supervision

Learning a Self-Expressive Network for Subspace Clustering

Self-Guided Deep Multi-View Subspace Clustering Network.

Triplet Deep Subspace Clustering Via Self-Supervised Data Augmentation.

Superpixel Contracted Neighborhood Contrastive Subspace Clustering Network for Hyperspectral Images

Self-Supervised Deep Subspace Clustering with Entropy-norm

Deep Convolutional Self-Paced Clustering

Deep subspace clustering to achieve jointly latent feature extraction and discriminative learning

Pseudo-supervised Deep Subspace Clustering

Multi-Scale Deep Subspace Clustering With Discriminative Learning

An end-to-end graph convolutional network for semi-supervised subspace clustering via label self-expressiveness

Subspace Clustering Via Independent Subspace Analysis Network

Dual Alignment Self-Supervised Incomplete Multi-View Subspace Clustering Network

Self-Supervised Deep Subspace Clustering for Hyperspectral Images with Adaptive Self-Expressive Coefficient Matrix Initialization.

Learning Deep Representation with Energy-Based Self-Expressiveness for Subspace Clustering

Self-Supervised Embedding for Subspace Clustering

Overcomplete Deep Subspace Clustering Networks

Elastic Deep Sparse Self-Representation Subspace Clustering Network

Deep Sparse Subspace Clustering.

S2DMSC: A Self-Supervised Deep Multilevel Subspace Clustering Approach for Large Hyperspectral Images

Self-Supervised Self-Organizing Clustering Network: A Novel Unsupervised Representation Learning Method