Abstract:The mixed membership stochastic blockmodel (MMSB) is a popular framework for community detection and network generation. It learns a low-rank mixed membership representation for each node across communities by exploiting the underlying graph structure. MMSB assumes that the membership distributions of the nodes are independently drawn from a Dirichlet distribution, which limits its capability to model highly correlated graph structures that exist in real-world networks. In this paper, we present a flexible richly structured MMSB model, \textit{Struct-MMSB}, that uses a recently developed statistical relational learning model, hinge-loss Markov random fields (HL-MRFs), as a structured prior to model complex dependencies among node attributes, multi-relational links, and their relationship with mixed-membership distributions. Our model is specified using a probabilistic programming templating language that uses weighted first-order logic rules, which enhances the model's interpretability. Further, our model is capable of learning latent characteristics in real-world networks via meaningful latent variables encoded as a complex combination of observed features and membership distributions. We present an expectation-maximization based inference algorithm that learns latent variables and parameters iteratively, a scalable stochastic variation of the inference algorithm, and a method to learn the weights of HL-MRF structured priors. We evaluate our model on six datasets across three different types of networks and corresponding modeling scenarios and demonstrate that our models are able to achieve an improvement of 15\% on average in test log-likelihood and faster convergence when compared to state-of-the-art network models.

Estimating Mixed Memberships With Sharp Eigenvector Deviations

Estimating mixed memberships in multi-layer networks

Consistent Estimation of Mixed Memberships with Successive Projections

PriME: Privacy-aware Membership profile Estimation in networks

Optimal Network Membership Estimation Under Severe Degree Heterogeneity

Inferences on Mixing Probabilities and Ranking in Mixed-Membership Models

Regularized spectral clustering under the mixed membership stochastic block model

Discovering overlapping communities in multi-layer directed networks

Improving Community Detection in Blockmodel by Distance-Based Observation Selection

Optimal Estimation of Parameters in Degree Corrected Mixed Membership Models

Estimating Higher-Order Mixed Memberships via the $\ell_{2,\infty}$ Tensor Perturbation Bound

Estimating Mixed-Memberships Using the Symmetric Laplacian Inverse Matrix

Mixed Membership Estimation for Weighted Networks

Struct-MMSB: Mixed Membership Stochastic Blockmodels with Interpretable Structured Priors

Bias-Corrected Joint Spectral Embedding for Multilayer Networks with Invariant Subspace: Entrywise Eigenvector Perturbation and Inference

Pseudo-likelihood-based $M$-estimation of random graphs with dependent edges and parameter vectors of increasing dimension

SIMPLE-RC: Group Network Inference with Non-Sharp Nulls and Weak Signals

Directed mixed membership stochastic blockmodel

Simultaneous Identification of Sparse Structures and Communities in Heterogeneous Graphical Models

Community Detection in High-Dimensional Graph Ensembles