Abstract:In the era of big data, it is increasingly common that large amount of data is generated across multiple distributed sites and cannot be gathered into a centralized site for further analysis, which invalidates the assumption of traditional clustering techniques based on centralized models. The major challenge is that these distributed datasets cannot be trivially merged due to issues such as privacy concerns, limited network bandwidth among sites and limited computational capacity of a single site. To tackle this challenge, we propose an efficient distributed clustering scheme using boundary information (DCUBI), which features good flexibility and scalability. The main procedure of DCUBI consists of three steps: local-global-local. Firstly, each local site extracts the boundary points from its own local data and applies traditional clustering on boundary points only. Secondly, labeled boundary points from each site are sent to the central site as local representatives where boundary and cluster fusion is conducted to form the global clustering model. Finally, the global boundary and cluster information is sent back to each local site for refined local clustering. To demonstrate the effectiveness of DCUBI, we plug the well-known DBSCAN algorithm into DCUBI and comprehensive experiments are conducted using datasets with different properties. Experiment results clearly verify the quality of clustering by DCUBI as well as its superior time efficiency when the volume of data in each site is large. Furthermore, other popular clustering techniques especially those with high time complexity such as spectral clustering and affinity propagation clustering are also plugged into DCUBI to demonstrate the flexibility of the proposed scheme.

Large-scale Data Clustering Algorithm Based on Quantum Immune Regulation Network

Manifold distance based artificial immune incremental data clustering algorithm

A novel clustering algorithm based on quantum games

A Kernel-Based Intuitionistic Fuzzy C-Means Clustering Using Improved Multi-Objective Immune Algorithm

Regulation of amylase activity in Drosophila melanogaster: Effects of dietary carbohydrate

Research of Data Stream Clustering Algorithms Based on Artificial Immune Principle

Hybrid quantum-classical unsupervised data clustering based on the Self-Organizing Feature Map

A two-phase clustering algorithm based on artificial immune network

A Quorum Sensing Inspired Algorithm for Dynamic Clustering

A Hybrid Classical-Quantum Clustering Algorithm Based on Quantum Walks.

A Novel Clustering Algorithm Based on Quantum Random Walk

Data Stream Clustering Based on Immune Principle

Variational shadow quantum neural network based on immune optimisation algorithm

An Energy Balance and Mobility Prediction Clustering Algrithm for Large-Scale UAV Ad Hoc Networks

Adaptive Neuro Fuzzy Networks based on Quantum Subtractive Clustering

Quantum Vision Clustering

Solving Multiobjective Clustering Using An Immune-Inspired Algorithm

Clustering Analysis of Unlabeled Data and Weak-Label Detection Analysis Method Integrating Soft Computing Technology

Design study of a guided-wave optical microphone with a diaphragm

Hybrid raven roosting intelligence framework for enhancing efficiency in data clustering

Efficient Distributed Clustering Using Boundary Information