Abstract:Hierarchical clustering allows better performance in grouping heterogeneous and non-spherical datasets than the center-based clustering, at the expense of increased time complexity. Meanwhile, the bottom-up approach of hierarchical clustering methods often tend to be sensitive or vulnerable to datasets containing obscure cluster boundaries. This paper presents an effective method for hierarchical clustering, called HCNN, which utilizes two types of structural similarities in nearest neighbor graph of a dataset to group similar data into clusters. In particular, the first metric is used to identify those pairs of data with maximal similarity in their nearest neighborhoods that can serve as local centers of every initial cluster. This can contribute to observing the boundaries and detecting clusters, hubs and outliers, thereby alleviating remarkably the influence of obscure boundaries between clusters. The initial clusters will be merged recursively in accordance with the second similarity metric measured in terms of the connectivity between clusters in the nearest neighbor graph. In this case, rather than combining two clusters with highest similarity during each iteration, we consider the maximum similarity as a transitive and closure relation between clusters, i.e., an equivalence relation, which enables more effective and efficient merging of clusters via application of advanced data structures. Experiments based on synthetic and real datasets demonstrate that the proposed HCNN algorithms can possibly outperform the state-of-the-art clustering methods evaluated in terms of the clustering accuracy, normalized mutual information and adjust rand index. Moreover, experiments on unlabeled real datasets show that our method enables effective identification of the quantity of clusters based on Davies–Bouldin index and average silhouette coefficient.

An Improved Hierarchical Datastructure for Nearest Neighbor Search

A New Linkless Hierarchical Structure Based on Perfect Hashing

A Unified Approximate Nearest Neighbor Search Scheme by Combining Data Structure and Hashing.

Discovering Data Structures: Nearest Neighbor Search and Beyond

Graph Based Nearest Neighbor Search: Promises and Failures

Effective optimizations of cluster-based nearest neighbor search in high-dimensional space

Efficient and Robust Approximate Nearest Neighbor Search Using Hierarchical Navigable Small World Graphs

Tree and Graph Based Two-Stages Routing for Approximate Nearest Neighbor Search

Scalable Nearest Neighbor Search based on kNN Graph

Approximate Nearest Neighbor Search on High Dimensional Data — Experiments, Analyses, and Improvement

Effective hierarchical clustering based on structural similarities in nearest neighbor graphs

Hierarchical Nearest Neighbor Descent, In-Tree, and Clustering

Contorting High Dimensional Data for Efficient Main Memory KNN Processing

Binary Hashing for Approximate Nearest Neighbor Search on Big Data: A Survey.

Z Tree: an Index Structure for High-dimensional Data

Lightweight-Yet-Efficient: Revitalizing Ball-Tree for Point-to-Hyperplane Nearest Neighbor Search

Efficient Nearest Neighbor Search Using Dynamic Programming

Efficient Nearest Neighbor Search in High Dimensional Hamming Space

Subspace Collision: An Efficient and Accurate Framework for High-dimensional Approximate Nearest Neighbor Search

A scalable solution to the nearest neighbor search problem through local-search methods on neighbor graphs

A Comparative Study on Hierarchical Navigable Small World Graphs.