Abstract:Clustering is an important data processing tool, which can be used to reveal the distribution structure of unfamiliar domain data, or as preprocess methods to magnify data object to accelerate subsequent processing or simplify models. However, the distribution of many real-world data in feature space is very complex or uneven. Besides, the similarity/distance is not easy to be properly defined in feature space with different dimensional quantity. Therefore, many existing clustering algorithms are not stable in real datasets, and better performance of different datasets relies on artificial special design, such as scale normalization. In this paper, we propose a bidirectional hierarchical clustering (BHC) algorithm with two phases. In the first phase (Top-down), based on the probability density function of data in different dimensions, the feature space is divided into over-segmented grids to adapt to the complex distribution of data. In the second phase (Bottom-up), based on statistical information, a robust distance instead of geometrical distance is defined to agglomerate the grids into a dendrogram. Compared with the individual data points, grids created in the first phase can carry more statistical information, and the magnified processing objects can accelerate the clustering process. The second phase enhances the algorithm’s ability by the ability of recognize arbitrary shape data clusters. The effectiveness of BHC is compared with 20 popular or recent clustering algorithms on 8 artificial datasets and 6 real-world datasets. And the results show that our algorithm can achieve good results on most datasets. In particular, BHC surpasses all the comparison algorithms involved in the experiment on all real-world datasets. In addition, in order to test the efficiency of the algorithm, we design an experiment which can test the influence of dimension and data size on the operation time.

A general grid-clustering approach

An unsupervised grid-based approach for clustering analysis

Agglomerative Clustering Algorithm Based on Grid Distance

Grid Partition and Agglomeration for Bidirectional Hierarchical Clustering

Using Two-Stage Approach To Clustering

Using Cluster Similarity to Detect Natural Cluster Hierarchies

Clustering Algorithm Based on Grid Density and Distance Information Characteristics

GCA: A Real-Time Grid-Based Clustering Algorithm for Large Data Set

A Novel Clustering Method Based on Adjacent Grids Searching

A Grid-Based Clustering Algorithm With Referential Value Of Parameters

Grid-Based Hierarchical Spatial Clustering Algorithm in Presence of Obstacle and Constraints

Incremental Clustering Algorithm Based on Grid

Parallel Gravitational Clustering Based on Grid Partitioning for Large-Scale Data

Application of a grid - based spatial clustering method on regional division

Research on a Clustering Algorithm Based on Adaptive Grid Partition and Decision Graph

SSCG: Spatial Subcluster Clustering Method by Grid-Connection.

Scalable Hierarchical Agglomerative Clustering

CABGD: an Improved Clustering Algorithm Based on Grid-Density

Clustering in Scientific Data Mining Based on Grid and Iterative Method

A Novel Hierarchical Clustering Approach Based on Universal Gravitation

A Hierarchical Clustering Algorithm Based on Grid Partition