Abstract:Many important applications continuously generate data, such as financial transaction administration, satellite monitoring, network flow monitoring, and web information processing. The data mining results are always evolving with the newly generated data. Obviously, for the clustering task, it is better to incrementally update the new clustering results based on the old data rather than to recluster all of the data from scratch. The incremental clustering approach is an essential way to solve the problem of clustering with growing Big Data. This paper proposes a boundary-profile-based incremental clustering (BPIC) method to find arbitrarily shaped clusters with dynamically growing datasets. This method represents the existing clustering results with a collection of boundary profiles and discards the inner points of clusters rather than keep all data. It greatly saves both time and space storage costs. To identify the boundary profile, this paper presents a boundary-vector-based boundary point detection (BV-BPD) algorithm that summarizes the structure of the existing clusters. The BPIC method processes each new point in an online fashion and updates the clustering results in a batch mode. When a new point arrives, the BPIC method either immediately labels it or temporarily puts it into a bucket according to the relationship between the new data and the boundary profiles. A bucket is employed to distinguish the noise from the potential seeds of new clusters and alleviate the effects of data order. When the bucket is full, the BPIC method will cluster the data within it and update the clustering results. Thus, the BPIC method is insensitive to noise and the order of new data, which is critical for the robustness of the incremental clustering process. In the experiments, the performance of the boundary point detection algorithm BV-BPD is compared with the state-of-the-art method. The results show that the BV-BPD is better than the state-of-the-art method. Additionally, the performance of BPIC and other two incremental clustering methods are investigated in terms of clustering quality, time and space efficiency. The experimental results indicate that the BPIC method is able to get a qualified clustering result on a large dataset with higher time and space efficiency.

An Incremental Clustering Algorithm Based on CFS

Incremental CFS Clustering on Large Data.

ICFS Clustering with Multiple Representatives for Large Data.

An Incremental Cfs Algorithm for Clustering Large Data in Industrial Internet of Things

Icfs: An Improved Fast Search And Find Of Density Peaks Clustering Algorithm

An Incremental Algorithm for Clustering Search Results

An Efficient Incremental Algorithm for Clustering Based on Density

Incremental Fuzzy Clustering of Time Series

Survey of Incremental Clustering Algorithms

Incremental Structural Clustering for Dynamic Networks

Research and Design of Incremental Cluster Algorithm

Key Grids based Batch-Incremental CLIQUE Clustering Algorithm Considering Cluster Structure Changes

An Incremental Clustering Algorithm Based On Swarm Intelligence Theory

An Incremental Clustering Method Based On The Boundary Profile

An Incremental Clustering Algorithm Based On Sample Selection

Incremental Subspace Clustering over Multiple Data Streams

KIHCDP: An Incremental Hierarchical Clustering Approach for IoT Data Using Dirichlet Process

A Hierarchical Clustering Algorithm Based on Fuzzy Graph Connectedness.

Parameter-Free Incremental Co-Clustering for Multi-Modal Data in Cyber-Physical-Social Systems

Incremental Interval Type-2 Fuzzy Clustering of Data Streams using Single Pass Method

Incremental Clustering Algorithm Based on Representative Points