Abstract:Learning the community structure of a large-scale graph is a fundamental problem in machine learning, computer science and statistics. We study the problem of exactly recovering the communities in a graph generated from the Stochastic Block Model (SBM) in the Massively Parallel Computation (MPC) model. Specifically, given $kn$ vertices that are partitioned into $k$ equal-sized clusters (i.e., each has size $n$), a graph on these $kn$ vertices is randomly generated such that each pair of vertices is connected with probability~$p$ if they are in the same cluster and with probability $q$ if not, where $p > q > 0$. We give MPC algorithms for the SBM in the (very general) \emph{$s$-space MPC model}, where each machine has memory $s=\Omega(\log n)$. Under the condition that $\frac{p-q}{\sqrt{p}}\geq \tilde{\Omega}(k^{\frac12}n^{-\frac12+\frac{1}{2(r-1)}})$ for any integer $r\in [3,O(\log n)]$, our first algorithm exactly recovers all the $k$ clusters in $O(kr\log_s n)$ rounds using $\tilde{O}(m)$ total space, or in $O(r\log_s n)$ rounds using $\tilde{O}(km)$ total space. If $\frac{p-q}{\sqrt{p}}\geq \tilde{\Omega}(k^{\frac34}n^{-\frac14})$, our second algorithm achieves $O(\log_s n)$ rounds and $\tilde{O}(m)$ total space complexity. Both algorithms significantly improve upon a recent result of Cohen-Addad et al. [PODC'22], who gave algorithms that only work in the \emph{sublinear space MPC model}, where each machine has local memory~$s=O(n^{\delta})$ for some constant $\delta>0$, with a much stronger condition on $p,q,k$. Our algorithms are based on collecting the $r$-step neighborhood of each vertex and comparing the difference of some statistical information generated from the local neighborhoods for each pair of vertices. To implement the clustering algorithms in parallel, we present efficient approaches for implementing some basic graph operations in the $s$-space MPC model.

Stochastic Block Model and Community Detection in the Sparse Graphs: A spectral algorithm with optimal rate of recovery

Robust recovery for stochastic block models, simplified and generalized

Optimal reconstruction of general sparse stochastic block models

A Scalable Community Detection Algorithm for Large Graphs Using Stochastic Block Models.

Subsampling Spectral Clustering for Stochastic Block Models in Large-Scale Networks

Scalable inference for stochastic block models

Partial Recovery Bounds for the Sparse Stochastic Block Model

Weak recovery, hypothesis testing, and mutual information in stochastic block models and planted factor graphs

Fundamental Limits of Spectral Clustering in Stochastic Block Models

Optimal Non-Convex Exact Recovery in Stochastic Block Model Via Projected Power Method

Spectral Properties and Weak Detection in Stochastic Block Models

Sparse random hypergraphs: Non-backtracking spectra and community detection

Randomized Spectral Clustering in Large-Scale Stochastic Block Models

Percolated stochastic block model via EM algorithm and belief propagation with non-backtracking spectra

Community Detection in the Hypergraph SBM: Exact Recovery Given the Similarity Matrix

Recovering communities in the general stochastic block model without knowing the parameters

PageRank Nibble on the sparse directed stochastic block model

Massively Parallel Algorithms for the Stochastic Block Model

Efficient Distributed Community Detection in the Stochastic Block Model

A spectral based goodness-of-fit test for stochastic block models

Computational and Statistical Thresholds in Multi-layer Stochastic Block Models