Abstract:Learning the community structure of a large-scale graph is a fundamental problem in machine learning, computer science and statistics. We study the problem of exactly recovering the communities in a graph generated from the Stochastic Block Model (SBM) in the Massively Parallel Computation (MPC) model. Specifically, given $kn$ vertices that are partitioned into $k$ equal-sized clusters (i.e., each has size $n$), a graph on these $kn$ vertices is randomly generated such that each pair of vertices is connected with probability~$p$ if they are in the same cluster and with probability $q$ if not, where $p > q > 0$. We give MPC algorithms for the SBM in the (very general) \emph{$s$-space MPC model}, where each machine has memory $s=\Omega(\log n)$. Under the condition that $\frac{p-q}{\sqrt{p}}\geq \tilde{\Omega}(k^{\frac12}n^{-\frac12+\frac{1}{2(r-1)}})$ for any integer $r\in [3,O(\log n)]$, our first algorithm exactly recovers all the $k$ clusters in $O(kr\log_s n)$ rounds using $\tilde{O}(m)$ total space, or in $O(r\log_s n)$ rounds using $\tilde{O}(km)$ total space. If $\frac{p-q}{\sqrt{p}}\geq \tilde{\Omega}(k^{\frac34}n^{-\frac14})$, our second algorithm achieves $O(\log_s n)$ rounds and $\tilde{O}(m)$ total space complexity. Both algorithms significantly improve upon a recent result of Cohen-Addad et al. [PODC'22], who gave algorithms that only work in the \emph{sublinear space MPC model}, where each machine has local memory~$s=O(n^{\delta})$ for some constant $\delta>0$, with a much stronger condition on $p,q,k$. Our algorithms are based on collecting the $r$-step neighborhood of each vertex and comparing the difference of some statistical information generated from the local neighborhoods for each pair of vertices. To implement the clustering algorithms in parallel, we present efficient approaches for implementing some basic graph operations in the $s$-space MPC model.

Efficiently and Fast Learning a Fine-grained Stochastic Blockmodel from Large Networks.

A Scalable Redefined Stochastic Blockmodel

Sparse Bayesian Approach to Fast Learning Network for Multiclassification.

SSBM: A Signed Stochastic Block Model for Multiple Structure Discovery in Large-Scale Exploratory Signed Networks

Improved Community Detection using Stochastic Block Models

Scalable inference for stochastic block models

Massively Parallel Algorithms for the Stochastic Block Model

Stochastic Blockmodels meet Graph Neural Networks

Improving Community Detection in Blockmodel by Distance-Based Observation Selection

Beyond Asymptotics: Practical Insights into Community Detection in Complex Networks

Model-based clustering in networks with Stochastic Community Finding

A Scalable Community Detection Algorithm for Large Graphs Using Stochastic Block Models.

Improving Stochastic Block Models by Incorporating Power-Law Degree Characteristic.

Systematic assessment of the quality of fit of the stochastic block model for empirical networks

Neural-prior stochastic block model

Struct-MMSB: Mixed Membership Stochastic Blockmodels with Interpretable Structured Priors

Network sampling based inference for subgraph counts and clustering coefficient in a Stochastic Block Model framework with some extensions to a sparse case

Embedded topics in the stochastic block model

LSBN: A Large-Scale Bayesian Structure Learning Framework for Model Averaging

Restricted Tweedie Stochastic Block Models

Scalable Community Detection in Massive Networks Using Aggregated Relational Data