Abstract:The Johnson-Lindenstrauss (JL) Lemma introduced the concept of dimension reduction via a random linear map, which has become a fundamental technique in many computational settings. For a set of $n$ points in $\mathbb{R}^d$ and any fixed $\epsilon>0$, it reduces the dimension $d$ to $O(\log n)$ while preserving, with high probability, all the pairwise Euclidean distances within factor $1+\epsilon$. Perhaps surprisingly, the target dimension can be lower if one only wishes to preserve the optimal value of a certain problem on the pointset, e.g., Euclidean max-cut or $k$-means. However, for some notorious problems, like diameter (aka furthest pair), dimension reduction via the JL map to below $O(\log n)$ does not preserve the optimal value within factor $1+\epsilon$. We propose to focus on another regime, of \emph{moderate dimension reduction}, where a problem's value is preserved within factor $\alpha>1$ using target dimension $\tfrac{\log n}{poly(\alpha)}$. We establish the viability of this approach and show that the famous $k$-center problem is $\alpha$-approximated when reducing to dimension $O(\tfrac{\log n}{\alpha^2}+\log k)$. Along the way, we address the diameter problem via the special case $k=1$. Our result extends to several important variants of $k$-center (with outliers, capacities, or fairness constraints), and the bound improves further with the input's doubling dimension. While our $poly(\alpha)$-factor improvement in the dimension may seem small, it actually has significant implications for streaming algorithms, and easily yields an algorithm for $k$-center in dynamic geometric streams, that achieves $O(\alpha)$-approximation using space $poly(kdn^{1/\alpha^2})$. This is the first algorithm to beat $O(n)$ space in high dimension $d$, as all previous algorithms require space at least $\exp(d)$. Furthermore, it extends to the $k$-center variants mentioned above.

Chromatic Clustering in High Dimensional Space

Moderate Dimension Reduction for $k$-Center Clustering

A Unified Framework for Clustering Constrained Data without Locality Property

Subspace Clustering by Directly Solving Discriminative K-means

Inapproximability of Maximum Diameter Clustering for Few Clusters

Deterministic Clustering in High Dimensional Spaces: Sketches and Approximation

A Parameterized Approximation Algorithm for the Chromatic k-Median Problem

Hybrid k-Clustering: Blending k-Median and k-Center

Techniques for Generalized Colorful $k$-Center Problems

Enhanced Locality Sensitive Clustering in High Dimensional Space

Efficient Approximate Algorithms for the Closest Pair Problem in High Dimensional Spaces.

Parameterized Approximation for Robust Clustering in Discrete Geometric Spaces

Constraint Based Dimension Correlation and Distance Divergence for Clustering High-Dimensional Data

The Johnson-Lindenstrauss Lemma for Clustering and Subspace Approximation: From Coresets to Dimension Reduction

Clustering with Diversity

Adaptive Dimension Reduction for Clustering High Dimensional Data

Explainable $k$-Means and $k$-Medians Clustering

Approximating Fair $k$-Min-Sum-Radii in Euclidean Space

Randomized Dimensionality Reduction for k-means Clustering

Non-Redundant Subspace Clusterings with Nr-Kmeans and Nr-DipMeans

Near-Optimal Algorithms for Constrained k-Center Clustering with Instance-level Background Knowledge