Abstract:The existing parallel DBSCAN (density based spatial clustering of applications with noise) algorithm needs to determine the parameter settings manually, and the datasets will be repeatedly accessed in the process of data partitioning and data merging, which reduces the efficiency of the algorithm excuting. Therefore, this paper proposes a parallel adaptive DBSCAN algorithm based on k-dimensional tree partition. It divides the dataset into several balanced data partitions by using k-dimensional tree, and carries out parallel computing in spark distributed computing framework, thus increasing the concurrent processing ability of the algorithm program and improving the I/O access speed. In addition, the improved adaptive DBSCAN parameter method is applied to each data partition for clustering analysis to obtain local clusters, which solves the random problem of manual setting parameters in the clustering process, and ensures the data quality of clustering mining. At the same time of creating local clusters, this algorithm also puts the mapping relationship between data points and adjacent points into the HashMap data structure of the master node, and uses it to merge local clusters into whole clusters, which can reduce the time cost of data merging. The experimental results show that the proposed algorithm can save about 18% running time compared with RDD-DBSCAN algorithm without reducing the clustering quality. With the increase of the number of cluster nodes, the running efficiency of the algorithm can be further improved, so it is suitable for processing massive data clustering analysis.

DBSCAN Optimization Algorithm Based on KD-tree Partitioning inCloud Computing

An Improvement Method of DBSCAN Algorithm on Cloud Computing

A Parallel Adaptive DBSCAN Algorithm Based on k-Dimensional Tree Partition

DBSCAN-PSM: an Improvement Method of DBSCAN Algorithm on Spark

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

A Parallel DBSCAN Algorithm Based on Spark

Design and Implementation of Parallel DBSCAN Algorithm Based on Spark

PS-DBSCAN: An Efficient Parallel DBSCAN Algorithm Based on Platform Of AI (PAI)

Research On The Parallelization Of The Dbscan Clustering Algorithm For Spatial Data Mining Based On The Spark Platform

A MapReduce-based improvement algorithm for DBSCAN:

Application of Improved DBSCAN Clustering Algorithm in Task Scheduling of Cloud Computing

An Optimized Load Algorithm of Parallel Data Warehouse Based on the Cloud Computing Platform

New method to improve DBSCAN clustering algorithm quality

MRG-DBSCAN: an Improved DBSCAN Clustering Method Based on Map Reduce and Grid

Research and Improvement of DBSCAN Cluster Algorithm

A Data Partitioning Method for Parallel Digital Terrain Analysis

A Parallel K‐means Clustering Algorithm Based on Redundance Elimination and Extreme Points Optimization Employing MapReduce

An Improved DBSCAN Clustering Algorithm

An Improved Parallel K-means Clustering Algorithm with MapReduce

Study of Fast Parallel Clustering Partition Algorithm for Large Data Sets

Parallel Outlier Detection Using KD-Tree Based on MapReduce