Abstract:Hierarchical clustering is a stronger extension of one of today's most influential unsupervised learning methods: clustering. The goal of this method is to create a hierarchy of clusters, thus constructing cluster evolutionary history and simultaneously finding clusterings at all resolutions. We propose four traits of interest for hierarchical clustering algorithms: (1) empirical performance, (2) theoretical guarantees, (3) cluster balance, and (4) scalability. While a number of algorithms are designed to achieve one to two of these traits at a time, there exist none that achieve all four. Inspired by Bateni et al.'s scalable and empirically successful Affinity Clustering [NeurIPs 2017], we introduce Affinity Clustering's successor, Matching Affinity Clustering. Like its predecessor, Matching Affinity Clustering maintains strong empirical performance and uses Massively Parallel Communication as its distributed model. Designed to maintain provably balanced clusters, we show that our algorithm achieves good, constant factor approximations for Moseley and Wang's revenue and Cohen-Addad et al.'s value. We show Affinity Clustering cannot approximate either function. Along the way, we also introduce an efficient $k$-sized maximum matching algorithm in the MPC model.

What problem does this paper attempt to address?

### Problems the paper attempts to solve This paper aims to solve the hierarchical clustering problem on large - scale data sets and proposes a new algorithm - **Matching Affinity Clustering**. The paper mainly focuses on four performance indicators: 1. **Empirical Performance**: How the algorithm performs on actual data sets. 2. **Theoretical Guarantees**: Whether the algorithm can theoretically provide good approximate results. 3. **Balance**: Whether the generated clusters remain balanced, that is, whether the sizes of each cluster are close. 4. **Scalability**: Whether the algorithm can run efficiently on large - scale data sets. Existing hierarchical clustering algorithms can usually only meet one or two of these indicators simultaneously, while the goal of this paper is to design an algorithm that can meet all four of the above indicators simultaneously. ### Main contributions 1. **Algorithm design**: - A new hierarchical clustering algorithm, **Matching Affinity Clustering**, is proposed, which performs cluster merging based on iterative matchings. - The algorithm is applicable not only to edges with similarity weights but also to edges with distance weights. 2. **Theoretical analysis**: - It is proved that **Matching Affinity Clustering** can achieve good approximate results on both the revenue and value optimization functions. - Specifically, in the revenue context, for a graph with $n = 2^N$, the algorithm can achieve an approximation ratio of $(1/3-\epsilon)$; for a general graph, it can achieve an approximation ratio of $(1/9 - \epsilon)$. - In the value context, assuming there is an MPC algorithm for the minimum weighted k - matching, for a graph with $n = 2^N$, the algorithm can achieve an approximation ratio of $2/3\alpha$; for a general graph, it can achieve an approximation ratio of $1/3\alpha$. 3. **Experimental verification**: - Through experiments on small - scale data sets, it is verified that the performance of **Matching Affinity Clustering** on actual data sets is comparable to or better than that of the existing best algorithms. - Especially on balanced data sets, **Matching Affinity Clustering** performs even better. 4. **Balance guarantee**: - It is proved that **Matching Affinity Clustering** can generate completely balanced clusters when $n = 2^N$, and can also ensure the relative balance of clusters in other cases. 5. **Scalability**: - By implementing it in the Massively Parallel Communication (MPC) model, the efficiency of the algorithm on large - scale data sets is ensured. ### Conclusion **Matching Affinity Clustering** is a new hierarchical clustering algorithm that can perform well in terms of empirical performance, theoretical guarantees, balance, and scalability, filling the gap where existing algorithms cannot meet these four aspects simultaneously.

Improved Hierarchical Clustering on Massive Datasets with Broad Guarantees

Scalable Hierarchical Agglomerative Clustering

Data Structures & Algorithms for Exact Inference in Hierarchical Clustering

DHC: A Distributed Hierarchical Clustering Algorithm for Large Datasets

Efficient hierarchical clustering of large high dimensional datasets.

Hybrid Hierarchical Clustering - Piecewise Aggregate Approximation, with Applications

Cost-effective Hierarchical Clustering with Local Density Peak Detection

Online Hierarchical Clustering Approximations

A Novel Hierarchical Clustering Algorithm with Merging Strategy Based on Shared Subordinates

A New Efficient Medoid Based Divisive Hierarchical Clustering Method for Large-Scale Data

Effective hierarchical clustering based on structural similarities in nearest neighbor graphs

Generalized Reductions: Making any Hierarchical Clustering Fair and Balanced with Low Cost

Order preserving hierarchical agglomerative clustering

Objective-Based Hierarchical Clustering of Deep Embedding Vectors

Scalable Hierarchical Clustering by Composition Rank Vector Encoding and Tree Structure

Cluster Aggregate Inequality And Multi-Level Hierarchical Clustering

Cluster Merging and Splitting in Hierarchical Clustering Algorithms

Scalable Co-Clustering for Large-Scale Data through Dynamic Partitioning and Hierarchical Merging

Semi-supervised Hierarchical Ensemble Clustering Based on an Innovative Distance Metric and Constraint Information

Active Clustering: Robust and Efficient Hierarchical Clustering using Adaptively Selected Similarities

Private Hierarchical Clustering and Efficient Approximation