Abstract:Many important applications continuously generate data, such as financial transaction administration, satellite monitoring, network flow monitoring, and web information processing. The data mining results are always evolving with the newly generated data. Obviously, for the clustering task, it is better to incrementally update the new clustering results based on the old data rather than to recluster all of the data from scratch. The incremental clustering approach is an essential way to solve the problem of clustering with growing Big Data. This paper proposes a boundary-profile-based incremental clustering (BPIC) method to find arbitrarily shaped clusters with dynamically growing datasets. This method represents the existing clustering results with a collection of boundary profiles and discards the inner points of clusters rather than keep all data. It greatly saves both time and space storage costs. To identify the boundary profile, this paper presents a boundary-vector-based boundary point detection (BV-BPD) algorithm that summarizes the structure of the existing clusters. The BPIC method processes each new point in an online fashion and updates the clustering results in a batch mode. When a new point arrives, the BPIC method either immediately labels it or temporarily puts it into a bucket according to the relationship between the new data and the boundary profiles. A bucket is employed to distinguish the noise from the potential seeds of new clusters and alleviate the effects of data order. When the bucket is full, the BPIC method will cluster the data within it and update the clustering results. Thus, the BPIC method is insensitive to noise and the order of new data, which is critical for the robustness of the incremental clustering process. In the experiments, the performance of the boundary point detection algorithm BV-BPD is compared with the state-of-the-art method. The results show that the BV-BPD is better than the state-of-the-art method. Additionally, the performance of BPIC and other two incremental clustering methods are investigated in terms of clustering quality, time and space efficiency. The experimental results indicate that the BPIC method is able to get a qualified clustering result on a large dataset with higher time and space efficiency.

KIHCDP: An Incremental Hierarchical Clustering Approach for IoT Data Using Dirichlet Process

An Incremental Cfs Algorithm for Clustering Large Data in Industrial Internet of Things

An Incremental Clustering Algorithm Based on CFS

Efficient Finer-Grained Incremental Processing with MapReduce for Big Data

A Density-Center-Based Automatic Clustering Algorithm for IoT Data Analysis

Hierarchical Federated Edge Learning with Adaptive Clustering in Internet of Things

Computational analysis of incremental clustering approaches for Large Data

Incremental Interval Type-2 Fuzzy Clustering of Data Streams using Single Pass Method

ICFS Clustering with Multiple Representatives for Large Data.

Incremental Clustering: The Case for Extra Clusters

A Distributed Processing Framework of Incremental Text Clustering under the Background of Big Data

Consensus-Based Distributed Clustering for IoT

ClusFC‐IoT: A clustering‐based approach for data reduction in fog‐cloud‐enabled IoT

A Cloud-Edge-Aided Incremental High-Order Possibilistic C-Means Algorithm for Medical Data Clustering.

A clustering algorithm for detecting differential deviations in the multivariate time-series IoT data based on sensor relationship

An Improved Energy-Aware Clustering Method for the Regional Queries in the Internet of Things

A Class of Differential Data Processing-Based Data Gathering Schemes in Internet of Things

Two-Level Dynamic Programming-Enabled Non-Metric Data Aggregation Technique for the Internet of Things

An Incremental Clustering Algorithm Based On Swarm Intelligence Theory

Decentralized multiple hypothesis testing in Cognitive IOT using massive heterogeneous data

An Incremental Clustering Method Based On The Boundary Profile