Abstract:A recent research area in unsupervised learning is the combination of representation learning with deep neural networks and data clustering. The success of deep learning for supervised tasks is widely established. However, recent research has demonstrated how neural networks are able to learn representations to improve clustering in their intermediate feature space, using specific regularizations. By considering representation learning and clustering as a joint task, models learn clustering-friendly spaces and outperform two-stage approaches where dimensionality reduction and clustering are performed separately. Recently, this idea has been extended to topology-preserving clustering models, known as self-organizing maps (SOM). This work is a thorough study on the deep embedded self-organizing map (DESOM), a model composed of an autoencoder and a SOM layer, training jointly the code vectors and network weights to learn SOM-friendly representations. In other words, SOM induces a form a regularization to improve the quality of quantization and topology in latent space. After detailing the architecture, loss and training algorithm, we study hyperparameters with a series of experiments. Different SOM-based models are evaluated in terms of clustering, visualization and classification on benchmark datasets. We study benefits and trade-offs of joint representation learning and self-organization. DESOM achieves competitive results, requires no pretraining and produces topologically organized visualizations.

qu an tph / 9 80 80 25 v 2 2 0 A ug 1 99 8 A Study of Parallel Self-Organizing Map

A Study of Parallel Self-Organizing Map

A New Adaptive Self-Organizing Map.

Deep Self-Organizing Map for visual classification

Self-Organizing Maps Computing on Graphic Process Unit

Non-Euclidean Self-Organizing Maps

Neuro-mimetic Task-free Unsupervised Online Learning with Continual Self-Organizing Maps

Implementing in-situ self-organizing maps with memristor crossbar arrays for data mining and optimization

Kernel-Based Self-Organizing Map Clustering

Self-Organising Neural Discrete Representation Learning à la Kohonen

An Efficient Self-Organizing Map Designed by Genetic Algorithms for the Traveling Salesman Problem

GROWING HIERARCHICAL SELF-ORGANIZING MAP MODELS FOR MENTAL TASK CLASSIFICATION

HLS-Based Large Scale Self-Organizing Feature Maps

Deep embedded self-organizing maps for joint representation learning and topology-preserving clustering

A Columnar Competitive Model with Simulated Annealing for Solving Combinatorial Optimization Problems

Improving Self-Organizing Maps with Unsupervised Feature Extraction

Using self-organizing map for mental tasks classification in brain-computer interface

ConSOM: A conceptional self-organizing map model for text clustering

Somoclu: an Efficient Parallel Library for Self-Organizing Maps

Clustering High-Dimensional Data Using Growing Som

An Expanding Self-Organizing Neural Network for the Traveling Salesman Problem