Abstract:In this paper, we consider the problem of partitioning a small data sample of size $n$ drawn from a mixture of $2$ sub-gaussian distributions. Our work is motivated by the application of clustering individuals according to their population of origin using markers, when the divergence between the two populations is small. We are interested in the case that individual features are of low average quality $\gamma$, and we want to use as few of them as possible to correctly partition the sample. We consider semidefinite relaxation of an integer quadratic program which is formulated essentially as finding the maximum cut on a graph where edge weights in the cut represent dissimilarity scores between two nodes based on their features. A small simulation result in Blum, Coja-Oghlan, Frieze and Zhou (2007, 2009) shows that even when the sample size $n$ is small, by increasing $p$ so that $np= \Omega(1/\gamma^2)$, one can classify a mixture of two product populations using the spectral method therein with success rate reaching an ``oracle'' curve. There the ``oracle'' was computed assuming that distributions were known, where success rate means the ratio between correctly classified individuals and the sample size $n$. In this work, we show the theoretical underpinning of this observed concentration of measure phenomenon in high dimensions, simultaneously for the semidefinite optimization goal and the spectral method, where the input is based on the gram matrix computed from centered data. We allow a full range of tradeoffs between the sample size and the number of features such that the product of these two is lower bounded by $1/{\gamma^2}$ so long as the number of features $p$ is lower bounded by $1/\gamma$.

From graph cuts to isoperimetric inequalities: Convergence rates of Cheeger cuts on data clouds

Consistency of Cheeger and Ratio Graph Cuts

Data Clustering Based on the Modified Relaxation Cheeger Cut Model

Distributional limits of graph cuts on discretized grids

Weighted Cheeger and Buser Inequalities, with Applications to Clustering and Cutting Probability Densities

Continuum Limits of Ollivier's Ricci Curvature on data clouds: pointwise consistency and global lower bounds

A scalable clustering algorithm to approximate graph cuts

Isoperimetric Cut on a Directed Graph

Certifying Global Optimality of Graph Cuts via Semidefinite Relaxation: A Performance Guarantee for Spectral Clustering

Local Guarantees in Graph Cuts and Clustering

Spectral Clustering on Large Datasets: When Does it Work? Theory from Continuous Clustering and Density Cheeger-Buser

MeanCut: A Greedy-Optimized Graph Clustering via Path-based Similarity and Degree Descent Criterion

Graph Cuts with Arbitrary Size Constraints Through Optimal Transport

On Generalization Bounds for Projective Clustering

Balanced Graph Cut with Exponential Inter-Cluster Compactness

When Do Birds of a Feather Flock Together? K-Means, Proximity, and Conic Programming.

Efficient Graph Field Integrators Meet Point Clouds

Compressive Sensing for cut improvement and local clustering

Semidefinite programming on population clustering: a global analysis

Geometric structure of graph Laplacian embeddings

When do birds of a feather flock together?