Abstract:Deep learning-based clustering methods usually regard feature extraction and feature clustering as two independent steps. In this way, the features of all images need to be extracted before feature clustering, which consumes a lot of calculation. Inspired by the self-organizing map network, a self-supervised self-organizing clustering network ( [Formula: see text]OCNet) is proposed to jointly learn feature extraction and feature clustering, thus realizing a single-stage clustering method. In order to achieve joint learning, we propose a self-organizing clustering header (SOCH), which takes the weight of the self-organizing layer as the cluster centers, and the output of the self-organizing layer as the similarities between the feature and the cluster centers. In order to optimize our network, we first convert the similarities into probabilities which represents a soft cluster assignment, and then we obtain a target for self-supervised learning by transforming the soft cluster assignment into a hard cluster assignment, and finally we jointly optimize backbone and SOCH. By setting different feature dimensions, a Multilayer SOCHs strategy is further proposed by cascading SOCHs. This strategy achieves clustering features in multiple clustering spaces. [Formula: see text]OCNet is evaluated on widely used image classification benchmarks such as Canadian Institute For Advanced Research (CIFAR)-10, CIFAR-100, Self-Taught Learning (STL)-10, and Tiny ImageNet. Experimental results show that our method significant improvement over other related methods. The visualization of features and images shows that our method can achieve good clustering results.

Research of Clustering Algorithm of Self-Organizing Maps Neural Networks

Clustering Analysis Based on SOFM Network

Visualizing Clusters Based on the Serf- Organizing Map

Approach of Clustering Based on Self-Organizing Feature Map

Self-Supervised Self-Organizing Clustering Network: A Novel Unsupervised Representation Learning Method

A Fast Clustering Algorithm for Large-scale and High Dimensional Data

An Self-Organizing Network with Clustering Number Fixed

Dynamic and Adaptive Self Organizing Maps Applied to High Dimensional Large Scale Text Clustering

Research on Neural Network Clustering Algorithm for Short Text

Learning a Self-Expressive Network for Subspace Clustering

Self-organizing Map As a New Method for Clustering and Data Analysis

Kernel-Based Self-Organizing Map Clustering

A Self-organizing Fuzzy Neural Networks

IGSOM: Incremental Clustering Based on Self-Organizing-Mapping

A DATA ANALYZER IN NETWORK ANOMALY DETECTION SYSTEM BASED ON HIERARCHICAL SELF-ORGANIZING MAP

An Online Semi-Supervised Clustering Algorithm Based on a Self-organizing Incremental Neural Network.

Non-Euclidean Self-Organizing Maps

Performance Analysis and Comparison of Neural Networks and Support Vector Machines Classifier

Semi-supervised self-organizing process neural network with self-adaptive structure

Clustering and Observation on Neuron Tuning Property for Brain Machine Interfaces

Deep embedded self-organizing maps for joint representation learning and topology-preserving clustering