Abstract:Convex clustering is a promising new approach to the classical problem of clustering, combining strong performance in empirical studies with rigorous theoretical foundations. Despite these advantages, convex clustering has not been widely adopted, due to its computationally intensive nature and its lack of compelling visualizations. To address these impediments, we introduce <i>Algorithmic Regularization</i>, an innovative technique for obtaining high-quality estimates of regularization paths using an iterative one-step approximation scheme. We justify our approach with a novel theoretical result, guaranteeing global convergence of the approximate path to the exact solution under easily checked non-data-dependent assumptions. The application of algorithmic regularization to convex clustering yields the Convex Clustering via Algorithmic Regularization Paths (CARP) algorithm for computing the clustering solution path. On example datasets from genomics and text analysis, CARP delivers over a 100-fold speed-up over existing methods, while attaining a finer approximation grid than standard methods. Furthermore, CARP enables improved visualization of clustering solutions: the fine solution grid returned by CARP can be used to construct a convex clustering-based dendrogram, as well as forming the basis of a dynamic path-wise visualization based on modern web technologies. Our methods are implemented in the open-source R package clustRviz, available at <a class="ext-link" href="https://github.com/DataSlingers/clustRviz">https://github.com/DataSlingers/clustRviz</a>. <a class="ext-link" href="https://doi.org/10.1080/10618600.2019.1629943">Supplementary materials</a> for this article are available online.

Data Clustering and Visualization with Recursive Goemans-Williamson MaxCut Algorithm

Data Clustering and Visualization with Recursive Max k-Cut Algorithm

Using Visualization to Improve Clustering Analysis on Heterogeneous Information Network.

Deep Clustering and Visualization for End-to-End High-Dimensional Data Analysis.

Maximizing Agreements for Ranking, Clustering and Hierarchical Clustering via MAX-CUT

Dynamic Visualization and Fast Computation for Convex Clustering via Algorithmic Regularization

MeanCut: A Greedy-Optimized Graph Clustering via Path-based Similarity and Degree Descent Criterion

Constrained Hierarchical Clustering via Graph Coarsening and Optimal Cuts

An Efficient Algorithm for Maximal Margin Clustering

Clustering and Community Detection with Imbalanced Clusters

Harmonic cut: An efficient and directly solved balanced graph clustering

A scalable clustering algorithm to approximate graph cuts

ClusterGraph: a new tool for visualization and compression of multidimensional data

Exploiting the Structure: Stochastic Gradient Methods Using Raw Clusters

Hierarchical Clustering Algorithms for Document Datasets

Effective algorithm for maximal pattern-based subspace clustering

Data Structures & Algorithms for Exact Inference in Hierarchical Clustering

ClusterFuG: Clustering Fully connected Graphs by Multicut

A Graph-Based Biomedical Literature Clustering Approach Utilizing Term's Global and Local Importance Information

Hierarchical Overlapping Clustering of Network Data Using Cut Metrics

Streaming Euclidean Max-Cut: Dimension Vs Data Reduction