Abstract:Clustering is an important data processing tool, which can be used to reveal the distribution structure of unfamiliar domain data, or as preprocess methods to magnify data object to accelerate subsequent processing or simplify models. However, the distribution of many real-world data in feature space is very complex or uneven. Besides, the similarity/distance is not easy to be properly defined in feature space with different dimensional quantity. Therefore, many existing clustering algorithms are not stable in real datasets, and better performance of different datasets relies on artificial special design, such as scale normalization. In this paper, we propose a bidirectional hierarchical clustering (BHC) algorithm with two phases. In the first phase (Top-down), based on the probability density function of data in different dimensions, the feature space is divided into over-segmented grids to adapt to the complex distribution of data. In the second phase (Bottom-up), based on statistical information, a robust distance instead of geometrical distance is defined to agglomerate the grids into a dendrogram. Compared with the individual data points, grids created in the first phase can carry more statistical information, and the magnified processing objects can accelerate the clustering process. The second phase enhances the algorithm’s ability by the ability of recognize arbitrary shape data clusters. The effectiveness of BHC is compared with 20 popular or recent clustering algorithms on 8 artificial datasets and 6 real-world datasets. And the results show that our algorithm can achieve good results on most datasets. In particular, BHC surpasses all the comparison algorithms involved in the experiment on all real-world datasets. In addition, in order to test the efficiency of the algorithm, we design an experiment which can test the influence of dimension and data size on the operation time.

A Hierarchical Clustering Algorithm Based on Grid Partition

A Grid-Based Density Peaks Clustering Algorithm

Clustering in Scientific Data Mining Based on Grid and Iterative Method

GK-means: an Efficient K-means Clustering Algorithm Based on Grid

Grid Partition and Agglomeration for Bidirectional Hierarchical Clustering

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

Application of a grid - based spatial clustering method on regional division

Using Cluster Similarity to Detect Natural Cluster Hierarchies

HGCUDF: Hierarchical Grid Clustering Using Data Field

A Hybrid Clustering Algorithm and It's Application

A Novel Grid-Based Clustering Algorithm

Spatial data partitioning based on the clustering of minimum distance criterion

HCFS: A Density Peak Based Clustering Algorithm Employing A Hierarchical Strategy.

A Novel Clustering Algorithm Based On Hierarchical And K-Means Clusteringz

Grid-Based Clustering Algorithm Based On Intersecting Partition And Density Estimation

An Improved K-means Algorithm Based on Mapreduce and Grid

HASTA: A Hierarchical-Grid Clustering Algorithm with Data Field

A Fast K-Means Clustering Algorithm Based on Grid Data Reduction

A grid-growing clustering algorithm for geo-spatial data

A Hierarchical Clustering Algorithm Based on K-Means with Constraints

A Spectral Clustering Algorithm Based on Hierarchical Method