Abstract:This paper introduces a novel formulation of the clustering problem, namely the Minimum Sum-of-Squares Clustering of Infinitely Tall Data (MSSC-ITD), and presents HPClust, an innovative set of hybrid parallel approaches for its effective solution. By utilizing modern high-performance computing techniques, HPClust enhances key clustering metrics: effectiveness, computational efficiency, and scalability. In contrast to vanilla data parallelism, which only accelerates processing time through the MapReduce framework, our approach unlocks superior performance by leveraging the multi-strategy competitive-cooperative parallelism and intricate properties of the objective function landscape. Unlike other available algorithms that struggle to scale, our algorithm is inherently parallel in nature, improving solution quality through increased scalability and parallelism, and outperforming even advanced algorithms designed for small and medium-sized datasets. Our evaluation of HPClust, featuring four parallel strategies, demonstrates its superiority over traditional and cutting-edge methods by offering better performance in the key metrics. These results also show that parallel processing not only enhances the clustering efficiency, but the accuracy as well. Additionally, we explore the balance between computational efficiency and clustering quality, providing insights into optimal parallel strategies based on dataset specifics and resource availability. This research advances our understanding of parallelism in clustering algorithms, demonstrating that a judicious hybridization of advanced parallel approaches yields optimal results for MSSC-ITD. Experiments on synthetic data further confirm HPClust's exceptional scalability and robustness to noise.

Maximin Separation Probability Clustering.

Discriminative Dimension Reduction Via Maximin Separation Probability Analysis

MPC: Multi-view Probabilistic Clustering

Efficient Maximum Margin Clustering Via Cutting Plane Algorithm.

Maximum Volume Clustering: a New Discriminative Clustering Approach.

Linear Time Maximum Margin Clustering

An Efficient Algorithm for Maximal Margin Clustering

Subspace maximum margin clustering.

Multi-view Maximum Margin Clustering with Privileged Information Learning

Maximum Margin Clustering with Multivariate Loss Function.

Maximum Margin Clustering with Pairwise Constraints

Tighter and Convex Maximum Margin Clustering

Nonparametric Dimension Reduction Via Maximizing Pairwise Separation Probability.

An Effective Maximal Subspace Clustering Algorithm Based on Enumeration Tree

From Penalized Maximum Likelihood to Cluster Analysis: a Unified Probabilistic Framework of Clustering.

Efficient Multiclass Maximum Margin Clustering

SPARSE KERNEL MAXIMUM MARGIN CLUSTERING

Clustering with minimum spanning trees: How good can it be?

Minimax and Minimax Projection Designs Using Clustering

High-Performance Hybrid Algorithm for Minimum Sum-of-Squares Clustering of Infinitely Tall Data