Abstract:Hierarchical clustering allows better performance in grouping heterogeneous and non-spherical datasets than the center-based clustering, at the expense of increased time complexity. Meanwhile, the bottom-up approach of hierarchical clustering methods often tend to be sensitive or vulnerable to datasets containing obscure cluster boundaries. This paper presents an effective method for hierarchical clustering, called HCNN, which utilizes two types of structural similarities in nearest neighbor graph of a dataset to group similar data into clusters. In particular, the first metric is used to identify those pairs of data with maximal similarity in their nearest neighborhoods that can serve as local centers of every initial cluster. This can contribute to observing the boundaries and detecting clusters, hubs and outliers, thereby alleviating remarkably the influence of obscure boundaries between clusters. The initial clusters will be merged recursively in accordance with the second similarity metric measured in terms of the connectivity between clusters in the nearest neighbor graph. In this case, rather than combining two clusters with highest similarity during each iteration, we consider the maximum similarity as a transitive and closure relation between clusters, i.e., an equivalence relation, which enables more effective and efficient merging of clusters via application of advanced data structures. Experiments based on synthetic and real datasets demonstrate that the proposed HCNN algorithms can possibly outperform the state-of-the-art clustering methods evaluated in terms of the clustering accuracy, normalized mutual information and adjust rand index. Moreover, experiments on unlabeled real datasets show that our method enables effective identification of the quantity of clusters based on Davies–Bouldin index and average silhouette coefficient.

ON IMPROVEMENT AND ANALYSIS OF HIERARCHICAL CLUSTERING ALGORITHM

How to improve the accuracy of clustering algorithms

Using Visualization to Improve Clustering Analysis on Heterogeneous Information Network.

Fair Algorithms for Hierarchical Agglomerative Clustering

Effective hierarchical clustering based on structural similarities in nearest neighbor graphs

Towards understanding hierarchical clustering

A Coding Hierarchy Computing Based Clustering Algorithm

A rough set based clustering algorithm and the information theoretical approach to refine clusters

Data Aggregation for Hierarchical Clustering

Hierarchical Clustering: Objective Functions and Algorithms

A Hierarchical Clustering Algorithm Based on Fuzzy Graph Connectedness.

The Impact of Isolation Kernel on Agglomerative Hierarchical Clustering Algorithms

Scalable Hierarchical Agglomerative Clustering

A GA-based Divisive Hierarchical Clustering Algorithm

Iterative Optimization and Simplification of Hierarchical Clusterings

Semi-supervised Hierarchical Clustering Analysis for High Dimensional Data

Solutions to General Clustering Algorithmic Issues

Improved Clustering Algorithm Based on Modified Fuzzy C-means Applied to the Traffic

Hierarchical Clustering Supported by Reciprocal Nearest Neighbors

Improving Quality of Hierarchical Clustering for Large Data Series

Sequential Combination Methods for Data Clustering Analysis