Abstract:The demand of fast clustering increases rapidly as we keep collecting tremendously large amount of data in the last decade. In this paper, we propose a nonparametric and representative-based Sparse Self-Represented Network Map for fast clustering on large dataset. Each node in the network generates a heat map for the dataset by receiving stimulations from data within its Accepting Field. We developed a weight adjusting method to learn and summarize the clustering pattern of the data. Such learned map is used for computing clustering results, by breaking weak links and finding connected components Rather than employing an iterative process to find local minima, our network passes the dataset only once and is able to capture the global pattern of the dataset as well as detecting natural number of clusters. As a nonparametric method, we propose Sparse Dynamic Instantiation to avoid the curse of dimensionality, namely a node or a link is instantiated only when stimulated by input data. As a result, the overall complexity is linear to the data dimension. Our algorithm is tested on synthetic and real datasets and compare with popular clustering algorithms (K-means++, Expectation–Maximization, Mean-Shift and StreamKM++) as well as state-of-art clustering algorithm (Affinity Propagation and Density Peak). We also applied our clustering algorithm to mobile location clustering, building a Visual Dictionary for image recognition, and clustering data streams. Our experiments indicate that our algorithm can be a better alternative for all compared popular clustering algorithms especially when efficiency is the primary consideration, namely we drastically improve time and space complexity but retain equal level of accuracy.

Sparse Self-Represented Network Map: A Fast Representative-Based Clustering Method for Large Dataset and Data Stream

Distributed Affinity Propagation Clustering Based on MapReduce

Self-Adaptive Clustering of Dynamic Multi-Graph Learning

Hierarchical Spatial Clustering in Multi-Hop Wireless Sensor Networks

Online Sparse Representation Clustering for Evolving Data Streams

A Fast Clustering Algorithm for Large-scale and High Dimensional Data

A Unified Framework for Representation-Based Subspace Clustering of Out-of-Sample and Large-Scale Data.

A Density-Based Competitive Data Stream Clustering Network with Self-Adaptive Distance Metric

Learning a Self-Expressive Network for Subspace Clustering

Matrix Factorization and Deep Autoencoder based Clustering Scheme for Large-scale UAV Networks

StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Construction

Distributed Data Stream Clustering: A Fast EM-based Approach

HiSpatialCluster: A Novel High-Performance Software Tool for Clustering Massive Spatial Points.

LSROM: Learning Self-Refined Organizing Map for Fast Imbalanced Streaming Data Clustering

Density Based Self Organizing Incremental Neural Network For Data Stream Clustering

Approach of Clustering Based on Self-Organizing Feature Map

Distributed structural clustering on large graph

Scalable Density-Based Distributed Clustering

IT-map: an Effective Nonlinear Dimensionality Reduction Method for Interactive Clustering.

A Stepwise Spatio-Temporal Flow Clustering Method for Discovering Mobility Trends

Fast LDP-MST: an Efficient Density-Peak-Based Clustering Method for Large-Size Datasets