Abstract:Estimating a sequence of dynamic undirected graphical models, in which adjacent graphs share similar structures, is of paramount importance in various social, financial, biological, and engineering systems, since the evolution of such networks can be utilized for example to spot trends, detect anomalies, predict vulnerability, and evaluate the impact of interventions. Existing methods for learning dynamic graphical models require the tuning parameters that control the graph sparsity and the temporal smoothness to be selected via brute-force grid search. Furthermore, these methods are computationally burdensome with time complexity O(NP3) for P variables and N time points. As a remedy, we propose a low-complexity tuning-free Bayesian approach, named BASS. Specifically, we impose temporally dependent spike and slab priors on the graphs such that they are sparse and varying smoothly across time. An efficient variational inference algorithm based on natural gradients is then derived to learn the graph structures from the data in an automatic manner. Owing to the pseudo-likelihood and the mean-field approximation, the time complexity of BASS is only O(NP2). To cope with the local maxima problem of variational inference, we resort to simulated annealing and propose a method based on bootstrapping of the observations to generate the annealing noise. We provide numerical evidence that BASS outperforms existing methods on synthetic data in terms of structure estimation, while being more efficient especially when the dimension P becomes high. We further apply the approach to the stock return data of 78 banks from 2005 to 2013 and find that the number of edges in the financial network as a function of time contains three peaks, in coincidence with the 2008 global financial crisis and the two subsequent European debt crisis. On the other hand, by identifying the frequency-domain resemblance to the time-varying graphical models, we show that BASS can be extended to learning frequency-varying inverse spectral density matrices, and further yields graphical models for multivariate stationary time series. As an illustration, we analyze scalp EEG signals of patients at the early stages of Alzheimer's disease (AD) and show that the brain networks extracted by BASS can better distinguish between the patients and the healthy controls.

Incremental Learning Bayesian Networks for Financial Data Modeling

Financial Data Modeling using a Hybrid Bayesian Network Structured Learning Algorithm

Incremental Learning Bayesian Networks for the Stock Return Prediction

Incremental learning Bayesian network structures efficiently

Hybrid Incremental Learning Algorithms for Bayesian Network Structures

Incremental Learning Of Bayesian Networks With Hidden Variables

An Incremental Approach for Sparse Bayesian Network Structure Learning

Adaptive Learning of Dynamic Bayesian Networks with Changing Structures by Detecting Geometric Structures of Time Series

Deep incremental learning models for financial temporal tabular datasets with distribution shifts

Improved Population-Based Incremental Learning of Bayesian Networks with partly known structure and parallel computing

Continuous Variable Based Bayesian Network Structure Learning from Financial Factors

Additive Dynamic Bayesian Networks for Enhanced Feature Learning in Soft Sensor Modeling

Augmented Bilinear Network for Incremental Multi-Stock Time-Series Classification

Incremental Attribute Learning by Knowledge distillation method

Incremental Feature Learning For Infinite Data

Incremental Learning for Interaction Dynamics with the Influence Model

Incremental 3D reconstruction using Bayesian learning

Incremental Spatiotemporal Learning for Online Modeling of Distributed Parameter Systems

Causal inference from financial factors: Continuous variable based local structure learning algorithm

Incremental Bayesian broad learning system and its industrial application

Efficient Variational Bayes Learning of Graphical Models With Smooth Structural Changes