Abstract:SIAM Journal on Computing, Ahead of Print. The random geometric graph model [math] is a distribution over graphs in which the edges capture a latent geometry. To sample [math], we identify each of our [math] vertices with an independently and uniformly sampled vector from the [math]-dimensional unit sphere [math], and we connect pairs of vertices whose vectors are "sufficiently close," such that the marginal probability of an edge is [math]. Because of the underlying geometry, this model is natural for applications in data science and beyond. We investigate the problem of testing for this latent geometry, or, in other words, distinguishing an Erdős–Rényi graph [math] from a random geometric graph [math]. It is not too difficult to show that if [math] while [math] is held fixed, the two distributions become indistinguishable; we wish to understand how fast [math] must grow as a function of [math] for indistinguishability to occur. When [math] for constant [math], we prove that if [math], the total variation distance between the two distributions is close to 0; this improves upon the best previous bound of Brennan, Bresler, and Nagaraj (2020), which required [math], and further our result is nearly tight, resolving a conjecture of Bubeck, Ding, Eldan, and Rácz (2016) up to logarithmic factors. We also obtain improved upper bounds on the statistical indistinguishability thresholds in [math] for the full range of [math] satisfying [math], improving upon the previous bounds by polynomial factors. Our analysis uses the belief propagation algorithm to characterize the distributions of (subsets of) the random vectors conditioned on producing a particular graph. In this sense, our analysis is connected to the "cavity method" from statistical physics. To analyze this process, we rely on novel sharp estimates for the area of the intersection of a random sphere cap with an arbitrary subset of [math], which we prove using optimal transport maps and entropy-transport inequalities on the unit sphere. We believe these techniques may be of independent interest.

Consistent Recovery Threshold of Hidden Nearest Neighbor Graphs

Matching Recovery Threshold for Correlated Random Graphs

Optimal and exact recovery on general non-uniform Hypergraph Stochastic Block Model

On Locally Most Reliable Three-Terminal Graphs of Sparse Graphs

Recovering a Hidden Community Beyond the Kesten-Stigum Threshold in O(|E| Log^*|v|) Time

k -Nearest-Neighbor Clustering and Percolation Theory

Testing Thresholds for High-Dimensional Sparse Random Geometric Graphs

Exact recovery in Gaussian weighted stochastic block model and planted dense subgraphs: Statistical and algorithmic thresholds

Exact Recovery of Community Detection in k-partite Graph Models

Fast Approximate K NN Graph Construction for High Dimensional Data Via Recursive Lanczos Bisection

Optimal construction of k-nearest neighbor graphs for identifying noisy clusters

On Efficiently Finding Reverse K-Nearest Neighbors over Uncertain Graphs

A Theory-Based Evaluation of Nearest Neighbor Models Put Into Practice

Efficient kNN Algorithm Based on Graph Sparse Reconstruction.

Evaluating Probability Threshold K-Nearest-neighbor Queries over Uncertain Data.

Fluctuations of the connectivity threshold and largest nearest-neighbour link

Approximating sparse graphs: The random overlapping communities model

Recovering a Single Community with Side Information

Optimal Nonparametric Inference with Two-Scale Distributional Nearest Neighbors

Improved convergence rate of kNN graph Laplacians

Information-Theoretic Thresholds for the Alignments of Partially Correlated Graphs