Abstract:The mixed membership stochastic blockmodel (MMSB) is a popular framework for community detection and network generation. It learns a low-rank mixed membership representation for each node across communities by exploiting the underlying graph structure. MMSB assumes that the membership distributions of the nodes are independently drawn from a Dirichlet distribution, which limits its capability to model highly correlated graph structures that exist in real-world networks. In this paper, we present a flexible richly structured MMSB model, \textit{Struct-MMSB}, that uses a recently developed statistical relational learning model, hinge-loss Markov random fields (HL-MRFs), as a structured prior to model complex dependencies among node attributes, multi-relational links, and their relationship with mixed-membership distributions. Our model is specified using a probabilistic programming templating language that uses weighted first-order logic rules, which enhances the model's interpretability. Further, our model is capable of learning latent characteristics in real-world networks via meaningful latent variables encoded as a complex combination of observed features and membership distributions. We present an expectation-maximization based inference algorithm that learns latent variables and parameters iteratively, a scalable stochastic variation of the inference algorithm, and a method to learn the weights of HL-MRF structured priors. We evaluate our model on six datasets across three different types of networks and corresponding modeling scenarios and demonstrate that our models are able to achieve an improvement of 15\% on average in test log-likelihood and faster convergence when compared to state-of-the-art network models.

Modeling hierarchical structures - Hierarchical Linear Modeling using MPlus

Multiple membership multilevel models

Modernizing use of regression models in physics education research: a review of hierarchical linear modeling

Hierarchical Causal Models

Inequality Constrained Multilevel Models

Multilevel analysis : an introduction to basic and advanced multilevel modeling

Multilevel modeling for longitudinal data: concepts and applications

Hierarchical generalized additive models in ecology: an introduction with mgcv

Studying Hierarchical Latent Structures in Heterogeneous Populations with Missing Information

Variational Bayesian hierarchical regression for data analysis

Struct-MMSB: Mixed Membership Stochastic Blockmodels with Interpretable Structured Priors

Estimating nonlinear effects of random slopes: A comparison of multilevel structural equation modeling with a two-step, a single-indicator, and a plausible values approach

Fitting Multilevel Vector Autoregressive Models in Stan, JAGS, and Mplus

Software Packages for Bayesian Multilevel Modeling

Insurance pricing with hierarchically structured data: An illustration with a workers' compensation insurance portfolio

Cross-classified multilevel models

Understanding Variation in Longitudinal Data Using Latent Growth Mixture Modeling

Data Analysis Using Regression and Multilevel/Hierarchical Models

Mediation from Multilevel to Structural Equation Modeling

Fast maximum likelihood estimation for general hierarchical models

Methods and Software for the Multilevel Social Relations Model: A Tutorial