Abstract:We consider a latent space model for dynamic networks, where our objective is to estimate the pairwise inner products plus the intercept of the latent positions. To balance posterior inference and computational scalability, we consider a structured mean-field variational inference framework, where the time-dependent properties of the dynamic networks are exploited to facilitate computation and inference. Additionally, an easy-to-implement block coordinate ascent algorithm is developed with message-passing type updates in each block, whereas the complexity per iteration is linear with the number of nodes and time points. To certify the optimality, we demonstrate that the variational risk of the proposed variational inference approach attains the minimax optimal rate with only a logarithm factor under certain conditions. To this end, we first derive the minimax lower bound, which might be of independent interest. In addition, we show that the posterior under commonly adopted Gaussian random walk priors can achieve the minimax lower bound with only a logarithm factor. To the best of our knowledge, this is the first such a throughout theoretical analysis of Bayesian dynamic latent space models. Simulations and real data analysis demonstrate the efficacy of our methodology and the efficiency of our algorithm.

Asymptotic Normality of Maximum Likelihood and Its Variational Approximation for Stochastic Blockmodels

An Overview of Asymptotic Normality in Stochastic Blockmodels: Cluster Analysis and Inference

Consistency of maximum-likelihood and variational estimators in the Stochastic Block Model

Stochastic Blockmodeling and Variational Bayes Learning for Signed Network Analysis.

Consistency and asymptotic normality of Latent Block Model estimators

Variational Bayesian Inference and Complexity Control for Stochastic Block Models

Asymptotic Properties of the Maximum Likelihood Estimator for Markov-switching Observation-driven Models

Theoretical and Computational Guarantees of Mean Field Variational Inference for Community Detection

Convergence and asymptotic normality of variational Bayesian approximations for exponential family models with missing values

Asymptotic Behavior of the Maximum Likelihood Estimator for General Markov Switching Models

Community detection in stochastic block models via penalized variational estimation

Empirical Bayes estimation for the stochastic blockmodel

Rates of convergence and normal approximations for estimators of local dependence random graph models

Estimating Stochastic Block Models in the Presence of Covariates

Maximum likelihood degree of the $β$-stochastic blockmodel

A Note on Spatial-Temporal Lattice Modeling and Maximum Likelihood Estimation

On Equivalence of Likelihood Maximization of Stochastic Block Model and Constrained Nonnegative Matrix Factorization

High Dimensional Expectation-Maximization Algorithm: Statistical Optimization and Asymptotic Normality

Bayesian model selection of stochastic block models

On the Disjoint and Sliding Block Maxima method for piecewise stationary time series

Structured Optimal Variational Inference for Dynamic Latent Space Models