Performance Comparison of Two Streaming Data Clustering Algorithms

Chandrakant Mahobiya,M. Kumar

DOI: https://doi.org/10.48550/arXiv.1406.6778

2014-06-26

Databases

Abstract:The weighted fuzzy c-mean clustering algorithm and weighted fuzzy c-mean-adaptive cluster number are extension of traditional fuzzy c-mean Algorithm to stream data clustering algorithm.

What problem does this paper attempt to address?

Mining Fuzzy Association Rules in Data Streams

Peng Chen,Hongye Su,Lichao Guo,Yu Qu

DOI: https://doi.org/10.1109/iccet.2010.5485665

2010-01-01

Abstract:Many algorithms have been proposed for mining fuzzy association rules in static datasets with quantitative attributes. However, there is few study on mining fuzzy association rules in data streams. This paper presents an algorithm FFI_Stream for fuzzy association rules mining in data streams. Efficient techniques are presented to find fuzzy association rules in data streams using time based sliding window model. The clustering technique is used to find the fuzzy sets. Membership Function Bias measure (MFB_measure) is introduced to evaluate the membership function in each sliding window. Selectively Updating Mechanism (SUM) and Projected Summaries (PS) are proposed to update the fuzzy sets dynamically. Then, experiments are carried out on both synthetic and real life datasets. The results show that the algorithm is effective and efficient.
Fuzzy C-mean Clustering Based on Ant Algorithm

Xin-hua ZHOU,Dao HUANG

DOI: https://doi.org/10.3969/j.issn.1671-7848.2005.02.012

2005-01-01

Abstract:To the mistake of local optimization in iterative process of fuzzy C-mean(FCM) clustering algorithm,a fuzzy C-mean clustering based on ant algorithm is presented to identify fuzzy clustering numbers and initial clustering center of FCM. Ant algorithm with global search and collateral calculation avoids local optimization.The simulation result shows the effectiveness of the method.
A New Parallel Adaptive Clustering and its Application to Streaming Data

Benjamin McLaughlin,Sung Ha Kang

DOI: https://doi.org/10.48550/arXiv.2104.02680

2021-04-07

Abstract:This paper presents a parallel adaptive clustering (PAC) algorithm to automatically classify data while simultaneously choosing a suitable number of classes. Clustering is an important tool for data analysis and understanding in a broad set of areas including data reduction, pattern analysis, and classification. However, the requirement to specify the number of clusters in advance and the computational burden associated with clustering large sets of data persist as challenges in clustering. We propose a new parallel adaptive clustering (PAC) algorithm that addresses these challenges by adaptively computing the number of clusters and leveraging the power of parallel computing. The algorithm clusters disjoint subsets of the data on parallel computation threads. We develop regularized set \mi{k}-means to efficiently cluster the results from the parallel threads. A refinement step further improves the clusters. The PAC algorithm offers the capability to adaptively cluster data sets which change over time by reusing the information from previous time steps to decrease computation. We provide theoretical analysis and numerical experiments to characterize the performance of the method, validate its properties, and demonstrate the computational efficiency of the method.

Machine Learning,Computer Vision and Pattern Recognition
A clustering algorithm for distributed time-series data

Chengan Li,Tiejun Wu

2007-01-01

WSEAS TRANSACTIONS ON SYSTEMS

Abstract:In this paper a distributed clustering algorithms is proposed to cluster time series in a distributed environment. Based on fuzzy clustering, the proposed algorithm is performed in multiple sites without transferring all data to a single site. The experimental results demonstrate that the proposed algorithm is effective, efficient and scalable and provides the same clustering quality as the single centralized data set.
Adaptive Approach to Fuzzy Clustering

岳士弘,李平,宋执环,谷应鲲

DOI: https://doi.org/10.3785/j.issn.1008-973x.2004.10.010

2004-01-01

Abstract:Fuzzy c-means (FCM) algorithm has noise-sensitivity and lacks the typicality of membership of point to cluster. An adaptive approach to fuzzy clustering was presented to overcome these problems. The approach could automatically distinguish these important points by multiplying a suitable weight number and these important clusters in dataset. Also, the approach can work well in noisy circumstances and its convergence is proven theoretically. Two experiments were used to verify the effectiveness and efficiency of the proposed approach in this paper.
Alternate Data Clustering for Fast Pattern Matching in Stream Time Series Data

Vishwanath R.H.,Thanagamani M.,Venugopal K.R.,Iyengar S.S.,L. M. Patnaik

DOI: https://doi.org/10.1007/978-3-642-35615-5_22

2012-01-01

Abstract:Stream time series retrieval has been a major area of study due to its vast application in various fields like weather forecasting, multimedia data retrieval and huge data analysis. Presently, there is a demand for stream data processing, high speed searching and quick response. In this paper, we use a alternate data cluster or segment mean method for stream time series data, where the data is pruned with a computational cost of O(log w). This approach can be used for both static and dynamic stream data processing. The results obtained are the better than the existing algorithms.
Incremental Interval Type-2 Fuzzy Clustering of Data Streams using Single Pass Method

Sana Qaiyum,Izzatdin Aziz,Mohd Hilmi Hasan,Asif Irshad Khan,Abdulmohsen Almalawi

DOI: https://doi.org/10.3390/s20113210

2020-06-05

Abstract:Data Streams create new challenges for fuzzy clustering algorithms, specifically Interval Type-2 Fuzzy C-Means (IT2FCM). One problem associated with IT2FCM is that it tends to be sensitive to initialization conditions and therefore, fails to return global optima. This problem has been addressed by optimizing IT2FCM using Ant Colony Optimization approach. However, IT2FCM-ACO obtain clusters for the whole dataset which is not suitable for clustering large streaming datasets that may be coming continuously and evolves with time. Thus, the clusters generated will also evolve with time. Additionally, the incoming data may not be available in memory all at once because of its size. Therefore, to encounter the challenges of a large data stream environment we propose improvising IT2FCM-ACO to generate clusters incrementally. The proposed algorithm produces clusters by determining appropriate cluster centers on a certain percentage of available datasets and then the obtained cluster centroids are combined with new incoming data points to generate another set of cluster centers. The process continues until all the data are scanned. The previous data points are released from memory which reduces time and space complexity. Thus, the proposed incremental method produces data partitions comparable to IT2FCM-ACO. The performance of the proposed method is evaluated on large real-life datasets. The results obtained from several fuzzy cluster validity index measures show the enhanced performance of the proposed method over other clustering algorithms. The proposed algorithm also improves upon the run time and produces excellent speed-ups for all datasets.
MOStream: A Modular and Self-Optimizing Data Stream Clustering Algorithm

Zhengru Wang,Xin Wang,Shuhao Zhang

2024-06-17

Abstract:Data stream clustering is a critical operation in various real-world applications, ranging from the Internet of Things (IoT) to social media and financial systems. Existing data stream clustering algorithms, while effective to varying extents, often lack the flexibility and self-optimization capabilities needed to adapt to diverse workload characteristics such as outlier, cluster evolution and changing dimensions in data points. These limitations manifest in suboptimal clustering accuracy and computational inefficiency. In this paper, we introduce MOStream, a modular and self-optimizing data stream clustering algorithm designed to dynamically balance clustering accuracy and computational efficiency at runtime. MOStream distinguishes itself by its adaptivity, clearly demarcating four pivotal design dimensions: the summarizing data structure, the window model for handling data temporality, the outlier detection mechanism, and the refinement strategy for improving cluster quality. This clear separation facilitates flexible adaptation to varying design choices and enhances its adaptability to a wide array of application contexts. We conduct a rigorous performance evaluation of MOStream, employing diverse configurations and benchmarking it against 9 representative data stream clustering algorithms on 4 real-world datasets and 3 synthetic datasets. Our empirical results demonstrate that MOStream consistently surpasses competing algorithms in terms of clustering accuracy, processing throughput, and adaptability to varying data stream characteristics.

Databases
Dynamic Micro-cluster-Based Streaming Data Clustering Method for Anomaly Detection.

Xiaolan Wang,Md. Manjur Ahmed,Mohd Nizam Husen,Hai Tao,Qian Zhao

DOI: https://doi.org/10.1007/978-981-99-0405-1_5

2023-01-01

Abstract:The identification of anomalies in a data stream is a difficulty for decision-making in real time. A memory-constrained online detection system that is able to quickly detect the concept drift of streaming data is required because the constant arrival of massive amounts of streaming data with changing characteristics makes real-time and efficient anomaly detection a difficult task. This is because of the nature of the data itself, which is constantly changing. In this study, a novel model for detecting anomalies using dynamic micro-clusters scheme is developed. The macro-clusters are generated from a network of connected micro-clusters. When new data items are added, the normal patterns that are formed in macro-clusters will update in tandem with the dynamic micro-clusters in an incremental fashion. An outlier may be understood from both a global and a local perspective by examining the global and local densities respectively. The effectiveness of the suggested approach was evaluated with the use of three different datasets. The findings of the experiment demonstrate that the suggested method is superior to earlier algorithms in terms of both the accuracy of detection and the level of computing complexity it requires.
Density-based hierarchical clustering for streaming data

Tu Q.,Lu J.F.,Yuan B.,Tang J.B.,Yang J.Y.

DOI: https://doi.org/10.1016/j.patrec.2011.11.022

IF: 4.757

2012-01-01

Pattern Recognition Letters

Abstract:For streaming data that arrive continuously such as multimedia data and financial transactions, clustering algorithms are typically allowed to scan the data set only once. Existing research in this domain mainly focuses on improving the accuracy of clustering. In this paper, a novel density-based hierarchical clustering scheme for streaming data is proposed in order to improve both accuracy and effectiveness; it is based on the agglomerative clustering framework. Traditionally, clustering algorithms for streaming data often use the cluster center to represent the whole cluster when conducting cluster merging, which may lead to unsatisfactory results. We argue that even if the data set is accessed only once, some parameters, such as the variance within cluster, the intra-cluster density and the inter-cluster distance, can be calculated accurately. This may bring measurable benefits to the process of cluster merging. Furthermore, we employ a general framework that can incorporate different criteria and, given the same criteria, will produce similar clustering results for both streaming and non-streaming data. In experimental studies, the proposed method demonstrates promising results with reduced time and space complexity.
Entropy Based Clustering of Data Streams with Mixed Numeric and Categorical Values

Shuyun Wang,Yingjie Fan,Chenghong Zhang,HeXiang Xu,Xiulan Hao,Yunfa Hu

DOI: https://doi.org/10.1109/ICIS.2008.57

2008-01-01

Abstract:In is paper, a novel algorithm for clustering data streams with mixed numeric and categorical attributes (CNC-Stream)is proposed. A new similarity measure based on entropy determining the similarity between the objects (data points in the stream or the micro-clusters in memory) is also presented here, which makes CNC-Stream work. The experiments conducted on the real data sets and synthetic data sets show that the proposed method is of high quality.
Data Stream Clustering: A Review

Alaettin Zubaroğlu,Volkan Atalay

DOI: https://doi.org/10.1007/s10462-020-09874-x

2020-07-17

Abstract:Number of connected devices is steadily increasing and these devices continuously generate data streams. Real-time processing of data streams is arousing interest despite many challenges. Clustering is one of the most suitable methods for real-time data stream processing, because it can be applied with less prior information about the data and it does not need labeled instances. However, data stream clustering differs from traditional clustering in many aspects and it has several challenging issues. Here, we provide information regarding the concepts and common characteristics of data streams, such as concept drift, data structures for data streams, time window models and outlier detection. We comprehensively review recent data stream clustering algorithms and analyze them in terms of the base clustering technique, computational complexity and clustering accuracy. A comparison of these algorithms is given along with still open problems. We indicate popular data stream repositories and datasets, stream processing tools and platforms. Open problems about data stream clustering are also discussed.

Machine Learning,Artificial Intelligence,Databases
Research of Data Stream Clustering Algorithms Based on Artificial Immune Principle

HU Wei,XU Fu-yuan,MA Qing-guo

DOI: https://doi.org/10.3969/j.issn.1002-137X.2012.02.045

2012-01-01

Computer Science

Abstract:In traditional data stream clustering algorithm,adaptive problem is not strong,the dependence is too high and clustering quality is not ideal,clustering efficiency is low,this paper presented a data stream clustering algorithms based on artificial immune principle-IMStream.This algorithm introduces attenuation function and moment weight to reflect the past data weights with the current data in the data stream of position,through calculating antibody expect cloning rate E(xi) to limit the antibody cloning number and keep the diversity of antibodies,take out eliminated strategy to made the final network structure more to accord with the original data stream inherent characteristics.The experiments based on the real data set and artificial data set show that the algorithm IMStream has better clustering performance.
Efficient Principal Subspace Projection of Streaming Data Through Fast Similarity Matching

Andrea Giovannucci,Victor Minden,Cengiz Pehlevan,Dmitri B. Chklovskii

DOI: https://doi.org/10.48550/arXiv.1808.02083

2018-08-07

Abstract:Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a time and must be processed online. Here, we introduce a computationally efficient version of similarity matching, a framework for online dimensionality reduction that incrementally estimates the top K-dimensional principal subspace of streamed data while keeping in memory only the last sample and the current iterate. To assess the performance of our approach, we construct and make public a test suite containing both a synthetic data generator and the infrastructure to test online dimensionality reduction algorithms on real datasets, as well as performant implementations of our algorithm and competing algorithms with similar aims. Among the algorithms considered we find our approach to be competitive, performing among the best on both synthetic and real data.

Computation,Machine Learning
FGCH: a Fast and Grid Based Clustering Algorithm for Hybrid Data Stream

Jinyin Chen,Xiang Lin,Qi Xuan,Yun Xiang

DOI: https://doi.org/10.1007/s10489-018-1324-x

IF: 5.3

2018-01-01

Applied Intelligence

Abstract:Streaming large volumes of data has a wide range of real-world applications, e.g., video flows, internet calls, and online games etc. Thus, fast and real-time data stream processing is important. Traditionally, data clustering algorithms are efficient and effective to mine information from large data. However, they are mostly not suitable for online data stream clustering. Therefore, in this work, we propose a novel fast and grid based clustering algorithm for hybrid data stream (FGCH). Specifically, we have made the following main contributions: 1), we develop a non-uniform attenuation model to enhance the resistance to noise; 2), we propose a similarity calculation method for hybrid data, which can calculate the similarity more efficiently and accurately; and 3), we present a novel clustering center fast determination algorithm (CCFD), which can automatically determine the number, center, and radius of clusters. Our technique is compared with several state-of-art clustering algorithms. The experimental results show that our technique can achieve more than better clustering accuracy on average. Meanwhile, the running time is shorter compared with the closest algorithm.
TSF-DBSCAN: A Novel Fuzzy Density-Based Approach for Clustering Unbounded Data Streams

Alessio Bechini,Francesco Marcelloni,Alessandro Renda

DOI: https://doi.org/10.1109/tfuzz.2020.3042645

IF: 12.253

2022-03-01

IEEE Transactions on Fuzzy Systems

Abstract:In recent years, several clustering algorithms have been proposed with the aim of mining knowledge from streams of data generated at a high speed by a variety of hardware platforms and software applications. Among these algorithms, density-based approaches have proved to be particularly attractive, thanks to their capability of handling outliers and capturing clusters with arbitrary shapes. The streaming setting poses additional challenges that need to be addressed as well: data streams are potentially unbounded and affected by concept drift, i.e., a modification over time in the underlying data generation process. In this article, we propose temporal streaming fuzzy density-based spatial clustering of applications with noise (TSF-DBSCAN), a novel fuzzy clustering algorithm for streaming data. TSF-DBSCAN is an extension of the well-known DBSCAN algorithm, one of the most popular density-based clustering approaches. Fuzziness is introduced in TSF-DBSCAN to model the uncertainty about the distance threshold that defines the neighborhood of an object. As a consequence, TSF-DBSCAN identifies clusters with fuzzy overlapping borders. A fading model, which makes objects less relevant as they become more remote in time, endows TSF-DBSCAN with the capability of adapting to evolving data streams. The integration of the model in a two-stage approach ensures computational and memory efficiency: during the online stage, continuously arriving objects are organized in proper data structures that are later exploited in the offline stage to determine a fine-grained partition. An extensive experimental analysis on synthetic and real-world datasets shows that TSF-DBSCAN yields competitive performance when compared to other clustering algorithms recently proposed for streaming data.

computer science, artificial intelligence,engineering, electrical & electronic
HClustream: A Novel Approach for Clustering Evolving Heterogeneous Data Stream

Chunyu Yang,Jie Zhou

DOI: https://doi.org/10.1109/ICDMW.2006.89

2006-01-01

Abstract:Recently, the continuously arriving and evolving data stream has become a common phenomenon in many fields, such as sensor networks, Web click stream and Internet traffic flow. One of the most important mining tasks is clustering. Clustering has attracted extensive research by both the community of machine learning and data mining. Many stream clustering methods have been proposed. These methods have proven to be efficient on specific problems. However, most of these methods are on continuous clustering and few of them are about to solve the heterogeneous clustering problems. In this paper, we propose a novel approach based on the CluStream framework for clustering data stream with heterogeneous features. The centroid of continuous attributes and the histogram of the discrete attributes are used to represent the micro clusters, and k-prototype clustering algorithm is used to create the micro clusters and macro clusters. Experimental results on both synthetic and real data sets show its efficiency
ESA-Stream: Efficient Self-Adaptive Online Data Stream Clustering

Yanni Li,Hui Li,Zhi Wang,Bing Liu,Jiangtao Cui,Hang Fei

DOI: https://doi.org/10.1109/tkde.2020.2990196

IF: 9.235

2022-02-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Many big data applications produce a massive amount of high-dimensional, real-time, and evolving streaming data. Clustering such data streams with both effectiveness and efficiency are critical for these applications. Although there are well-known data stream clustering algorithms that are based on the popular online-offline framework, these algorithms still face some major challenges. Several critical questions are still not answer satisfactorily: How to perform dimensionality reduction effectively and efficiently in the online dynamic environment? How to enable the clustering algorithm to achieve complete real-time online processing? How to make algorithm parameters learn in a self-supervised or self-adaptive manner to cope with high-speed evolving streams? In this paper, we focus on tackling these challenges by proposing a fully online data stream clustering algorithm (called ESA-Stream) that can learn parameters online dynamically in a self-adaptive manner, speedup dimensionality reduction, and cluster data streams effectively and efficiently in an online and dynamic environment. Experiments on a wide range of synthetic and real-world data streams show that ESA-Stream outperforms state-of-the-art baselines considerably in both effectiveness and efficiency.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
Clustering Stream Data by Exploring the Evolution of Density Mountain

Shufeng Gong,Yanfeng Zhang,Ge Yu

DOI: https://doi.org/10.48550/arXiv.1710.00867

2017-10-03

Abstract:Stream clustering is a fundamental problem in many streaming data analysis applications. Comparing to classical batch-mode clustering, there are two key challenges in stream clustering: (i) Given that input data are changing continuously, how to incrementally update clustering results efficiently? (ii) Given that clusters continuously evolve with the evolution of data, how to capture the cluster evolution activities? Unfortunately, most of existing stream clustering algorithms can neither update the cluster result in real time nor track the evolution of clusters. In this paper, we propose an stream clustering algorithm EDMStream by exploring the Evolution of Density Mountain. The density mountain is used to abstract the data distribution, the changes of which indicate data distribution evolution. We track the evolution of clusters by monitoring the changes of density mountains. We further provide efficient data structures and filtering schemes to ensure the update of density mountains in real time, which makes online clustering possible. The experimental results on synthetic and real datasets show that, comparing to the state-of-the-art stream clustering algorithms, e.g., D-Stream, DenStream, DBSTREAM and MR-Stream, our algorithm can response to a cluster update much faster (say 7-15x faster than the best of the competitors) and at the same time achieve comparable cluster quality. Furthermore, EDMStream can successfully capture the cluster evolution activities.

Databases,Information Retrieval
Fuzzy c-Shape: A new algorithm for clustering finite time series waveforms

Fateme Fahiman,Jame C.Bezdek,Sarah M.Erfani,Christopher Leckie,Marimuthu Palaniswami

DOI: https://doi.org/10.48550/arXiv.1608.01072

2016-08-03

Abstract:The existence of large volumes of time series data in many applications has motivated data miners to investigate specialized methods for mining time series data. Clustering is a popular data mining method due to its powerful exploratory nature and its usefulness as a preprocessing step for other data mining techniques. This article develops two novel clustering algorithms for time series data that are extensions of a crisp c-shapes algorithm. The two new algorithms are heuristic derivatives of fuzzy c-means (FCM). Fuzzy c-Shapes plus (FCS+) replaces the inner product norm in the FCM model with a shape-based distance function. Fuzzy c-Shapes double plus (FCS++) uses the shape-based distance, and also replaces the FCM cluster centers with shape-extracted prototypes. Numerical experiments on 48 real time series data sets show that the two new algorithms outperform state-of-the-art shape-based clustering algorithms in terms of accuracy and efficiency. Four external cluster validity indices (the Rand index, Adjusted Rand Index, Variation of Information, and Normalized Mutual Information) are used to match candidate partitions generated by each of the studied algorithms. All four indices agree that for these finite waveform data sets, FCS++ gives a small improvement over FCS+, and in turn, FCS+ is better than the original crisp c-shapes method. Finally, we apply two tests of statistical significance to the three algorithms. The Wilcoxon and Friedman statistics both rank the three algorithms in exactly the same way as the four cluster validity indices.

Machine Learning

Performance Comparison of Two Streaming Data Clustering Algorithms

Mining Fuzzy Association Rules in Data Streams

Fuzzy C-mean Clustering Based on Ant Algorithm

A New Parallel Adaptive Clustering and its Application to Streaming Data

A clustering algorithm for distributed time-series data

Adaptive Approach to Fuzzy Clustering

Alternate Data Clustering for Fast Pattern Matching in Stream Time Series Data

Incremental Interval Type-2 Fuzzy Clustering of Data Streams using Single Pass Method

MOStream: A Modular and Self-Optimizing Data Stream Clustering Algorithm

Dynamic Micro-cluster-Based Streaming Data Clustering Method for Anomaly Detection.

Density-based hierarchical clustering for streaming data

Entropy Based Clustering of Data Streams with Mixed Numeric and Categorical Values

Data Stream Clustering: A Review

Research of Data Stream Clustering Algorithms Based on Artificial Immune Principle

Efficient Principal Subspace Projection of Streaming Data Through Fast Similarity Matching

FGCH: a Fast and Grid Based Clustering Algorithm for Hybrid Data Stream

TSF-DBSCAN: A Novel Fuzzy Density-Based Approach for Clustering Unbounded Data Streams

HClustream: A Novel Approach for Clustering Evolving Heterogeneous Data Stream

ESA-Stream: Efficient Self-Adaptive Online Data Stream Clustering

Clustering Stream Data by Exploring the Evolution of Density Mountain

Fuzzy c-Shape: A new algorithm for clustering finite time series waveforms