Abstract:Estimating a sequence of dynamic undirected graphical models, in which adjacent graphs share similar structures, is of paramount importance in various social, financial, biological, and engineering systems, since the evolution of such networks can be utilized for example to spot trends, detect anomalies, predict vulnerability, and evaluate the impact of interventions. Existing methods for learning dynamic graphical models require the tuning parameters that control the graph sparsity and the temporal smoothness to be selected via brute-force grid search. Furthermore, these methods are computationally burdensome with time complexity O(NP3) for P variables and N time points. As a remedy, we propose a low-complexity tuning-free Bayesian approach, named BASS. Specifically, we impose temporally dependent spike and slab priors on the graphs such that they are sparse and varying smoothly across time. An efficient variational inference algorithm based on natural gradients is then derived to learn the graph structures from the data in an automatic manner. Owing to the pseudo-likelihood and the mean-field approximation, the time complexity of BASS is only O(NP2). To cope with the local maxima problem of variational inference, we resort to simulated annealing and propose a method based on bootstrapping of the observations to generate the annealing noise. We provide numerical evidence that BASS outperforms existing methods on synthetic data in terms of structure estimation, while being more efficient especially when the dimension P becomes high. We further apply the approach to the stock return data of 78 banks from 2005 to 2013 and find that the number of edges in the financial network as a function of time contains three peaks, in coincidence with the 2008 global financial crisis and the two subsequent European debt crisis. On the other hand, by identifying the frequency-domain resemblance to the time-varying graphical models, we show that BASS can be extended to learning frequency-varying inverse spectral density matrices, and further yields graphical models for multivariate stationary time series. As an illustration, we analyze scalp EEG signals of patients at the early stages of Alzheimer's disease (AD) and show that the brain networks extracted by BASS can better distinguish between the patients and the healthy controls.

Exploiting Spike-and-Slab Prior for Variational Estimation of Nonlinear Systems

Variational Identification of Linearly Parameterized Nonlinear State-Space Systems

Process Monitoring with Sparse Bayesian Model for Industrial Methanol Distillation

Bayesian Nonnegative Matrix Factorization with a Truncated Spike-and-Slab Prior

Stochastic Variational Bayesian Inference for a Nonlinear Forward Model

Towards Robust Bayesian Estimation for Linear Dynamical Systems

Dynamic sparsity on dynamic regression models

A Sparse Bayesian Approach to the Identification of Nonlinear State-Space Systems.

Identification of Nonlinear Sparse Networks Using Sparse Bayesian Learning

Robust RVM Based on Spike-Slab Prior

Nonlinear Variational Bayesian Factor Regression for Inferential Sensor Modeling

Em-Based Global Identification Of Lpv Arx Models With A Noisy Scheduling Variable

Spike and slab Bayesian sparse principal component analysis

Bayesian Sparse Estimation Using Double Lomax Priors

Variance State Propagation for Structured Sparse Bayesian Learning

A Variational Bayesian EM Approach to Structured Sparse Signal Reconstruction

Efficient Variational Bayes Learning of Graphical Models With Smooth Structural Changes

On Identification of Sparse Multivariable ARX Model: A Sparse Bayesian Learning Approach

Surrogate modelling for stochastic dynamical systems by combining NARX models and polynomial chaos expansions

Sparse estimation of linear model via Bayesian method

Robust Adaptive Algorithm for Nonlinear Systems with Unknown Measurement Noise and Uncertain Parameters by Variational Bayesian Inference