Abstract:Finding meaningful clustering patterns in data can be very challenging when the clusters are of arbitrary shapes, different sizes, or densities, and especially when the data set contains high percentage (e.g., 80%) of noise. Unfortunately, most existing clustering techniques cannot properly handle this tough situation and often result in dramatically deteriorating performance. In this paper, a purposefully designed clustering algorithm called Density-Based Multiscale Analysis for Clustering (DBMAC)-II is proposed, which is an improved version of the latest strong-noise clustering algorithm DBMAC. DBMAC is proposed under the assumption that all clusters are homogeneous and cannot work well when the data set contains clusters of varying densities. DBMAC-II overcomes the limitation of DBMAC by executing the multiscale analysis iteratively and can conduct strong noise-robust clustering without any strict assumption on the shapes and densities of clusters. In DBMAC-II, each data point or object is mapped into a feature space using its r-neighborhood statistics with different r (radius) values, which is similar to DBMAC. In general, the higher the value of r-neighborhood statistics, the more likely the object is considered as a “clustered”object. Instead of trying to find a single optimal r value, a set of radius values appropriate for separating “clustered”objects and “noisy”objects is identified, using a formal statistical method for multimodality test, referred to as multiscale analysis. For clusters with varying densities, multiscale analysis is applied to extract the clusters with the highest density from the current data set iteratively. Moreover, a statistical uniformity test for measuring clustering tendency is used as the self-adaptive stopping criterion of the iteration. Comprehensive experimental studies on a series of challenging benchmark data sets demonstrate that DBMAC-II is not only superior to classical density-based clustering approaches, including DBSCAN, OPTICS, and HDBSCAN, but also can consistently outperform the latest strong-noise robust clustering techniques, such as Skinny-dip.

Density-based multiscale analysis for clustering in strong noise settings

Density-Based Multiscale Analysis for Clustering in Strong Noise Settings with Varying Densities

MDBSCAN: A multi-density DBSCAN based on relative density

A Fast Algorithm for Density-Based Clustering in Large Database

Comparative Density Peaks Clustering

A Statistical Information-Based Clustering Approach in Distance Space

Density-ratio Based Clustering for Discovering Clusters with Varying Densities.

A Distance Scaling Method to Improve Density-Based Clustering.

A Method of Two-Stage Clustering Learning Based on Improved DBSCAN and Density Peak Algorithm

A dynamic density-based clustering method based on K-nearest neighbor

AutoSCAN: automatic detection of DBSCAN parameters and efficient clustering of data in overlapping density regions

Using Greedy Algorithm: DBSCAN Revisited II

DBSCAN-MS: Distributed Density-Based Clustering in Metric Spaces

A novel density-based clustering algorithm using nearest neighbor graph

AMD-DBSCAN: An Adaptive Multi-density DBSCAN for datasets of extremely variable density

A novel clustering algorithm based on the gravity-mass-square ratio and density core with a dynamic denoising radius

A Novel Density Deviation Multi-Peaks Automatic Clustering Algorithm

DPC-DNG: Graph-based Label Propagation of K-Nearest Higher-Density Neighbors for Density Peaks Clustering

A Novel Adaptive Density-Based Spatial Clustering of Application with Noise Based on Bird Swarm Optimization Algorithm.

An Improved Method For Density-Based Clustering

Dboost: A Fast Algorithm for Dbscan-Based Clustering on High Dimensional Data