Abstract:Learning the community structure of a large-scale graph is a fundamental problem in machine learning, computer science and statistics. We study the problem of exactly recovering the communities in a graph generated from the Stochastic Block Model (SBM) in the Massively Parallel Computation (MPC) model. Specifically, given $kn$ vertices that are partitioned into $k$ equal-sized clusters (i.e., each has size $n$), a graph on these $kn$ vertices is randomly generated such that each pair of vertices is connected with probability~$p$ if they are in the same cluster and with probability $q$ if not, where $p > q > 0$. We give MPC algorithms for the SBM in the (very general) \emph{$s$-space MPC model}, where each machine has memory $s=\Omega(\log n)$. Under the condition that $\frac{p-q}{\sqrt{p}}\geq \tilde{\Omega}(k^{\frac12}n^{-\frac12+\frac{1}{2(r-1)}})$ for any integer $r\in [3,O(\log n)]$, our first algorithm exactly recovers all the $k$ clusters in $O(kr\log_s n)$ rounds using $\tilde{O}(m)$ total space, or in $O(r\log_s n)$ rounds using $\tilde{O}(km)$ total space. If $\frac{p-q}{\sqrt{p}}\geq \tilde{\Omega}(k^{\frac34}n^{-\frac14})$, our second algorithm achieves $O(\log_s n)$ rounds and $\tilde{O}(m)$ total space complexity. Both algorithms significantly improve upon a recent result of Cohen-Addad et al. [PODC'22], who gave algorithms that only work in the \emph{sublinear space MPC model}, where each machine has local memory~$s=O(n^{\delta})$ for some constant $\delta>0$, with a much stronger condition on $p,q,k$. Our algorithms are based on collecting the $r$-step neighborhood of each vertex and comparing the difference of some statistical information generated from the local neighborhoods for each pair of vertices. To implement the clustering algorithms in parallel, we present efficient approaches for implementing some basic graph operations in the $s$-space MPC model.

On the Scalable Learning of Stochastic Blockmodel.

A Scalable Redefined Stochastic Blockmodel

SSBM: A Signed Stochastic Block Model for Multiple Structure Discovery in Large-Scale Exploratory Signed Networks

Improved Community Detection using Stochastic Block Models

Stochastic Blockmodels meet Graph Neural Networks

Massively Parallel Algorithms for the Stochastic Block Model

Scalable inference for stochastic block models

Bayesian model selection of stochastic block models

Empirical Bayes estimation for the stochastic blockmodel

Inference for a generalised stochastic block model with unknown number of blocks and non-conjugate edge models

Restricted Tweedie Stochastic Block Models

Recovering communities in the general stochastic block model without knowing the parameters

Beyond Asymptotics: Practical Insights into Community Detection in Complex Networks

Systematic assessment of the quality of fit of the stochastic block model for empirical networks

Stochastic Block Models with Multiple Continuous Attributes

Neural-prior stochastic block model

Improving Stochastic Block Models by Incorporating Power-Law Degree Characteristic.

Stochastic Block Models are a Discrete Surface Tension

LSBN: A Large-Scale Bayesian Structure Learning Framework for Model Averaging

A Scalable Community Detection Algorithm for Large Graphs Using Stochastic Block Models.

Struct-MMSB: Mixed Membership Stochastic Blockmodels with Interpretable Structured Priors