Abstract:The mixed membership stochastic blockmodel (MMSB) is a popular framework for community detection and network generation. It learns a low-rank mixed membership representation for each node across communities by exploiting the underlying graph structure. MMSB assumes that the membership distributions of the nodes are independently drawn from a Dirichlet distribution, which limits its capability to model highly correlated graph structures that exist in real-world networks. In this paper, we present a flexible richly structured MMSB model, \textit{Struct-MMSB}, that uses a recently developed statistical relational learning model, hinge-loss Markov random fields (HL-MRFs), as a structured prior to model complex dependencies among node attributes, multi-relational links, and their relationship with mixed-membership distributions. Our model is specified using a probabilistic programming templating language that uses weighted first-order logic rules, which enhances the model's interpretability. Further, our model is capable of learning latent characteristics in real-world networks via meaningful latent variables encoded as a complex combination of observed features and membership distributions. We present an expectation-maximization based inference algorithm that learns latent variables and parameters iteratively, a scalable stochastic variation of the inference algorithm, and a method to learn the weights of HL-MRF structured priors. We evaluate our model on six datasets across three different types of networks and corresponding modeling scenarios and demonstrate that our models are able to achieve an improvement of 15\% on average in test log-likelihood and faster convergence when compared to state-of-the-art network models.

A Joint MLE Approach to Large-Scale Structured Latent Attribute Analysis

Learning Attribute Patterns in High-Dimensional Structured Latent Attribute Models

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Structured Latent Factor Analysis for Large-scale Data: Identifiability, Estimability, and Their Implications

Generalized Linear Latent Variable Modeling for Multi-Group Studies

Learning Latent and Hierarchical Structures in Cognitive Diagnosis Models

Latent class analysis for multi-layer categorical data

From Complexity to Parsimony: Integrating Latent Class Analysis to Uncover Multimodal Learning Patterns in Collaborative Learning

Joint Latent Space Model for Social Networks with Multivariate Attributes

Enhancing health assessments with large language models: A methodological approach

Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models

Sparse high-dimensional linear mixed modeling with a partitioned empirical Bayes ECM algorithm

LSMM: A statistical approach to integrating functional annotations with genome-wide association studies

Supervised Latent Dirichlet Allocation with Covariates: A Bayesian Structural and Measurement Model of Text and Covariates.

Regularized Latent Class Analysis with Application in Cognitive Diagnosis

Linear Latent Structure Analysis: from Foundations to Algorithms and Applications

Latent Conjunctive Bayesian Network: Unify Attribute Hierarchy and Bayesian Network for Cognitive Diagnosis

Maximum Ideal Likelihood Estimator: An New Estimation and Inference Framework for Latent Variable Models

Struct-MMSB: Mixed Membership Stochastic Blockmodels with Interpretable Structured Priors

Model-free Estimation of Latent Structure via Multiscale Nonparametric Maximum Likelihood

Multivariate Shared-Parameter Mixed-Effects Location Scale Model for Analysis of Intensive Longitudinal Data