Abstract:Clustering is a fundamental operation that plays an essential role in data management and analysis. Clustering algorithms have been well studied over the past two decades, but the real-time clustering has yet to be maturely applied. For applications based on clustering calculations, capturing the dynamic changes of clusters and trends of moving objects in a real-time manner can maximize the value of the data. Although the DSPE ( D istributed S tream P rocessing E ngine) is capable of such workloads, it still faces the problems of fixed window size and computational resources waste. In this paper, we introduce a new C ost- e ffective and A daptive C lustering method ( CeAC ), which can improve computational efficiency while ensuring the accuracy of the clustering result. Specifically, we design a composite window model which contains the latest data records and maintains historical states. To achieve a lightweight clustering, we propose a fully online clustering algorithm based on grid density, which can capture clusters with arbitrary shape and effectively handle outliers in parallel. We further introduce an adaptive calculation model to accelerate the clustering operation by shedding workload according to the incoming data characteristic. Experimental results show that the proposed method is accurate and efficient in real-time data stream clustering.

Dynamic grid-based clustering over data stream

Clustering over an evolving data stream based on grid density and correlation

Data Stream Clustering Algorithm Based on Active Grid Density

A Clustering Algorithm Based on Density-Grid for Stream Data

Distributed Data Stream Clustering Algorithm Based on Density Grid

Irregular Grid-Based Clustering over High-Dimensional Data Streams

A Grid-Based Density Peaks Clustering Algorithm

Grid-based Data Stream Clustering for Intrusion Detection

Research on Clustering Algorithm Based on Grid Density on Uncertain Data Stream

A Density Granularity Grid Clustering Algorithm Based on Data Stream.

An Enhanced Version of MDDB-GC Algorithm: Multi-Density DBSCAN Based on Grid and Contribution for Data Stream

An Incremental Irregular Grid Algorithm for Clustering Data Streams

An Incremental Algorithm Based on Irregular Grid for Clustering Data Stream

Dynamic Density-Based Clustering Algorithm over Uncertain Data Streams

Online Clustering Algorithm Based on Grid Structure

Clustering Algorithm for Spatial Data Streams Based on A Grid and Distance Threshold

Grid Probability Density-based clustering for uncertain data streams over sliding windows

Grid-based Clustering Algorithm for Multi-Density

Clustering Algorithm Based on Grid Density and Distance Information Characteristics

Incremental Subspace Clustering over Multiple Data Streams

Cost-effective and adaptive clustering algorithm for stream processing on cloud system