Abstract:Deep learning-based clustering methods usually regard feature extraction and feature clustering as two independent steps. In this way, the features of all images need to be extracted before feature clustering, which consumes a lot of calculation. Inspired by the self-organizing map network, a self-supervised self-organizing clustering network ( [Formula: see text]OCNet) is proposed to jointly learn feature extraction and feature clustering, thus realizing a single-stage clustering method. In order to achieve joint learning, we propose a self-organizing clustering header (SOCH), which takes the weight of the self-organizing layer as the cluster centers, and the output of the self-organizing layer as the similarities between the feature and the cluster centers. In order to optimize our network, we first convert the similarities into probabilities which represents a soft cluster assignment, and then we obtain a target for self-supervised learning by transforming the soft cluster assignment into a hard cluster assignment, and finally we jointly optimize backbone and SOCH. By setting different feature dimensions, a Multilayer SOCHs strategy is further proposed by cascading SOCHs. This strategy achieves clustering features in multiple clustering spaces. [Formula: see text]OCNet is evaluated on widely used image classification benchmarks such as Canadian Institute For Advanced Research (CIFAR)-10, CIFAR-100, Self-Taught Learning (STL)-10, and Tiny ImageNet. Experimental results show that our method significant improvement over other related methods. The visualization of features and images shows that our method can achieve good clustering results.

A Self-Organized Growing Network For On-Line Unsupervised Learning

A Self-organized Growing Network for On-line Unsupervised Learning

A Self-Structurizing Neural Network for Online Incremental Learning

A Growing Neural Network for Online Unsupervised Learning.

An Incremental Network for On-Line Unsupervised Classification and Topology Learning.

An On-Line Learning Mechanism for Unsupervised Classification and Topology Representation

An Incremental Neural Network for Non-stationary Unsupervised Learning

An Incremental Neural Network for Online Supervised Learning and Topology Learning

An Online Incremental Semi-Supervised Learning Method

An Online Semi-Supervised Clustering Algorithm Based on a Self-organizing Incremental Neural Network.

An incremental online semi-supervised active learning algorithm based on self-organizing incremental neural network

An enhanced self-organizing incremental neural network for online unsupervised learning.

An on -line self-organizing fuzzy neural network

An Online Semi-supervised Active Learning Algorithm with Self-organiing Incremental Neural Network.

Semi-supervised self-organizing process neural network with self-adaptive structure

A Self-Organizing Incremental Neural Network Based on Local Distribution Learning

Dynamic Growing Self-organizing Neural Network for Clustering

Self-Supervised Self-Organizing Clustering Network: A Novel Unsupervised Representation Learning Method

A Self-organizing Fuzzy Neural Networks

A Dynamic Growing Neural Network For Supervised Or Unsupervised Learning

An Incremental Local Distribution Network for Unsupervised Learning.