Abstract:In the era of big data, it is increasingly common that large amount of data is generated across multiple distributed sites and cannot be gathered into a centralized site for further analysis, which invalidates the assumption of traditional clustering techniques based on centralized models. The major challenge is that these distributed datasets cannot be trivially merged due to issues such as privacy concerns, limited network bandwidth among sites and limited computational capacity of a single site. To tackle this challenge, we propose an efficient distributed clustering scheme using boundary information (DCUBI), which features good flexibility and scalability. The main procedure of DCUBI consists of three steps: local-global-local. Firstly, each local site extracts the boundary points from its own local data and applies traditional clustering on boundary points only. Secondly, labeled boundary points from each site are sent to the central site as local representatives where boundary and cluster fusion is conducted to form the global clustering model. Finally, the global boundary and cluster information is sent back to each local site for refined local clustering. To demonstrate the effectiveness of DCUBI, we plug the well-known DBSCAN algorithm into DCUBI and comprehensive experiments are conducted using datasets with different properties. Experiment results clearly verify the quality of clustering by DCUBI as well as its superior time efficiency when the volume of data in each site is large. Furthermore, other popular clustering techniques especially those with high time complexity such as spectral clustering and affinity propagation clustering are also plugged into DCUBI to demonstrate the flexibility of the proposed scheme.

A Highly Scalable Clustering Scheme Using Boundary Information

Efficient Distributed Clustering Using Boundary Information

Privacy Preserving Distributed DBSCAN Clustering

A Statistical Information-Based Clustering Approach in Distance Space

Towards a Compact and Effective Representation for Datasets with Inhomogeneous Clusters.

Using Greedy Algorithm: DBSCAN Revisited II

Discrete and Balanced Spectral Clustering with Scalability

Approaches for Scaling Dbscan Algorithm to Large Spatial Databases

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

Surface Extraction and Boundary Detection Based on DBSCAN Clustering in 3D Point Clouds

Scaling Up the DBSCAN Algorithm for Clustering Large Spatial Databases Based on Sampling Technique

GriT-DBSCAN: A spatial clustering algorithm for very large databases

An Efficient Class-Constrained DBSCAN Approach for Large-Scale Point Cloud Clustering

CURE-NS: a hierarchical clustering algorithm with new shrinking scheme

3D Surface Segmentation from Point Clouds Via Quadric Fits Based on DBSCAN Clustering

DBSTC: an Effective Method for Discovering Cluster Features with Different Spatiotemporal Densities

AutoSCAN: automatic detection of DBSCAN parameters and efficient clustering of data in overlapping density regions

Non-iterative Border-Peeling Clustering Algorithm based on Swap Strategy

A Distance Scaling Method to Improve Density-Based Clustering.

DBSC: A Dependency-Based Subspace Clustering Algorithm for High Dimensional Numerical Datasets

A Hybrid Approach to Clustering in Very Large Databases