Abstract:Internet of Things (IoT) devices are constantly producing vast amounts of data, necessitating efficient storage and processing to extract useful information. However, the models used to extract relevant information from IoT data are often hindered by the lack of useful data and the ever-changing distribution of this data. This paper introduces an incremental data clustering technique on a continuous stream of data through a Dirichlet process-based approach that is adept at handling the formation of clusters in streaming data. The complete approach is twofold; firstly, it starts with an estimated distribution of data and allocates an incoming data point to the estimated data distribution. Secondly, it refines the estimated data distribution after the allocation of the current point and over the subsequent arrival of data points. The influx of data leads to greater challenges in determining clusters for incoming points and preserving the current clusters for improved decision-making. In this context, our proposed approach deals with the increasing amount of data using a selective elimination technique on both existing and incoming data. To assess the performance of the proposed approach, benchmark experiments have been performed using benchmark datasets. The results of the experiments demonstrate that the proposed model has a gain ranging from 2% to 4% as compared to the existing state-of-the-art and recent adaptive clustering approaches in terms of clustering accuracy with incremental data addition and variable clustering parameters. The proposed method shows a high gain in terms of running time ranging from 2% to 20% as compared to the existing approaches depending on the data reduction parameter. Furthermore, research findings through this work indicate that it is possible to set a trade-off between accuracy and running time by adjusting the elimination parameter depending on the requirements of the considered application.

Incremental Hierarchical Clustering of Stochastic Pattern-Based Symbolic Data.

Hierarchical Clustering of Complex Symbolic Data and Application for Emitter Identification

Hybrid Hierarchical Clustering - Piecewise Aggregate Approximation, with Applications

Fuzzy Rough Sets-Based Incremental Feature Selection for Hierarchical Classification

Semi-supervised Hierarchical Clustering Analysis for High Dimensional Data

A Hierarchical Clustering Algorithm Based on Fuzzy Graph Connectedness.

Incremental Subspace Clustering over Multiple Data Streams

Incremental Clustering: The Case for Extra Clusters

Efficient Forecasting of Large Scale Hierarchical Time Series via Multilevel Clustering

A New Representation of Interval Symbolic Data and Its Application in Dynamic Clustering

An Hierarchical Clustering Method Based on Data Fields

An Incremental Clustering Algorithm Based on CFS

Incremental CFS Clustering on Large Data.

Uncertainty Measure-Based Incremental Feature Selection For Hierarchical Classification

Supervised Adaptive Incremental Clustering for Data Stream of Chunks

An Incremental Clustering Algorithm Based On Swarm Intelligence Theory

Incremental Semi-Supervised Clustering Ensemble for High Dimensional Data Clustering.

KIHCDP: An Incremental Hierarchical Clustering Approach for IoT Data Using Dirichlet Process

Cluster-Computer Based Incremental and Distributed RSOM Data-Clustering

A Spectral Clustering Algorithm Based on Hierarchical Method

Robust and Stochastic Sparse Subspace Clustering