Abstract:The demand of fast clustering increases rapidly as we keep collecting tremendously large amount of data in the last decade. In this paper, we propose a nonparametric and representative-based Sparse Self-Represented Network Map for fast clustering on large dataset. Each node in the network generates a heat map for the dataset by receiving stimulations from data within its Accepting Field. We developed a weight adjusting method to learn and summarize the clustering pattern of the data. Such learned map is used for computing clustering results, by breaking weak links and finding connected components Rather than employing an iterative process to find local minima, our network passes the dataset only once and is able to capture the global pattern of the dataset as well as detecting natural number of clusters. As a nonparametric method, we propose Sparse Dynamic Instantiation to avoid the curse of dimensionality, namely a node or a link is instantiated only when stimulated by input data. As a result, the overall complexity is linear to the data dimension. Our algorithm is tested on synthetic and real datasets and compare with popular clustering algorithms (K-means++, Expectation–Maximization, Mean-Shift and StreamKM++) as well as state-of-art clustering algorithm (Affinity Propagation and Density Peak). We also applied our clustering algorithm to mobile location clustering, building a Visual Dictionary for image recognition, and clustering data streams. Our experiments indicate that our algorithm can be a better alternative for all compared popular clustering algorithms especially when efficiency is the primary consideration, namely we drastically improve time and space complexity but retain equal level of accuracy.

A Density-Based Competitive Data Stream Clustering Network with Self-Adaptive Distance Metric

Density Based Self Organizing Incremental Neural Network For Data Stream Clustering

Density-Based Clustering over an Evolving Data Stream with Noise

An Adaptive Density Data Stream Clustering Algorithm

Online Sparse Representation Clustering for Evolving Data Streams

Evolving data stream clustering algorithm based on the shared nearest neighbor density

An Online Semi-Supervised Clustering Algorithm Based on a Self-organizing Incremental Neural Network.

Online Stream Clustering Using Density and Affinity Propagation Algorithm

Density-based clustering of data streams at multiple resolutions

Clustering Stream Data by Exploring the Evolution of Density Mountain

Self-adaption Neighborhood Density Clustering Method for Mixed Data Stream with Concept Drift

ESA-Stream: Efficient Self-Adaptive Online Data Stream Clustering

DRSCDM: A Novel Density-Related Clustering for Complex High-Dimensional Data Streams

Density-based hierarchical clustering for streaming data

GeoDenStream: an Improved DenStream Clustering Method for Managing Entity Data Within Geographical Data Streams.

Sparse Self-Represented Network Map: A Fast Representative-Based Clustering Method for Large Dataset and Data Stream

Improved Data Stream Clustering Algorithm Based on Temporal Density Features

Efficient Data Stream Clustering Algorithm Based on k-Means Partitioning and Density

Clustering-Induced Adaptive Structure Enhancing Network for Incomplete Multi-View Data

A Density-Based Clustering Structure Mining Algorithm for Data Streams

Distributed Data Stream Clustering Algorithm Based on Density Grid