Abstract:The Separating Hyperplane theorem is a fundamental result in Convex Geometry with myriad applications. Our first result, Random Separating Hyperplane Theorem (RSH), is a strengthening of this for polytopes. $\rsh$ asserts that if the distance between $a$ and a polytope $K$ with $k$ vertices and unit diameter in $\Re^d$ is at least $\delta$, where $\delta$ is a fixed constant in $(0,1)$, then a randomly chosen hyperplane separates $a$ and $K$ with probability at least $1/poly(k)$ and margin at least $\Omega \left(\delta/\sqrt{d} \right)$. An immediate consequence of our result is the first near optimal bound on the error increase in the reduction from a Separation oracle to an Optimization oracle over a polytope. RSH has algorithmic applications in learning polytopes. We consider a fundamental problem, denoted the ``Hausdorff problem'', of learning a unit diameter polytope $K$ within Hausdorff distance $\delta$, given an optimization oracle for $K$. Using RSH, we show that with polynomially many random queries to the optimization oracle, $K$ can be approximated within error $O(\delta)$. To our knowledge this is the first provable algorithm for the Hausdorff Problem. Building on this result, we show that if the vertices of $K$ are well-separated, then an optimization oracle can be used to generate a list of points, each within Hausdorff distance $O(\delta)$ of $K$, with the property that the list contains a point close to each vertex of $K$. Further, we show how to prune this list to generate a (unique) approximation to each vertex of the polytope. We prove that in many latent variable settings, e.g., topic modeling, LDA, optimization oracles do exist provided we project to a suitable SVD subspace. Thus, our work yields the first efficient algorithm for finding approximations to the vertices of the latent polytope under the well-separatedness assumption.

Counting faces of randomly-projected polytopes when the projection radically lowers dimension

Random projections of random manifolds

Facets of High-Dimensional Gaussian Polytopes

Random inscribed polytopes in projective geometries

Random polytopes in convex bodies: Bridging the gap between extremal containers

Random Shadows of Fixed Polytopes

Enumerating integer points in polytopes with bounded subdeterminants

Which exceptional low-dimensional projections of a Gaussian point cloud can be found in polynomial time?

Random projections beyond zero overlap

Lower Bounds on Face Numbers of Polytopes with $m$ Facets

Estranged facets and $k$-facets of Gaussian random point sets

Construction and Analysis of Projected Deformed Products

Asymptotic expected $T$-functionals of random polytopes with applications to $L_p$ surface areas

Integer Feasibility of Random Polytopes

Optimal Bound on the Combinatorial Complexity of Approximating Polytopes

Facets of Random Symmetric Edge Polytopes, Degree Sequences, and Clustering

Random Separating Hyperplane Theorem and Learning Polytopes

On the Dimension of Exceptional Parameters for Nonlinear Projections, and the Discretized Elekes-Rónyai Theorem

On the Combinatorial Complexity of Approximating Polytopes

Random weighted projections, random quadratic forms and random eigenvectors