Abstract:Time-series datasets are central in machine learning with applications in numerous fields of science and engineering, such as biomedicine, Earth observation, and network analysis. Extensive research exists on state-space models (SSMs), which are powerful mathematical tools that allow for probabilistic and interpretable learning on time series. Learning the model parameters in SSMs is arguably one of the most complicated tasks, and the inclusion of prior knowledge is known to both ease the interpretation but also to complicate the inferential tasks. Very recent works have attempted to incorporate a graphical perspective on some of those model parameters, but they present notable limitations that this work addresses. More generally, existing graphical modeling tools are designed to incorporate either static information, focusing on statistical dependencies among independent random variables (e.g., graphical Lasso approach), or dynamic information, emphasizing causal relationships among time series samples (e.g., graphical Granger approaches). However, there are no joint approaches combining static and dynamic graphical modeling within the context of SSMs. This work proposes a novel approach to fill this gap by introducing a joint graphical modeling framework that bridges the graphical Lasso model and a causal-based graphical approach for the linear-Gaussian SSM. We present DGLASSO (Dynamic Graphical Lasso), a new inference method within this framework that implements an efficient block alternating majorization-minimization algorithm. The algorithm's convergence is established by departing from modern tools from nonlinear analysis. Experimental validation on various synthetic data showcases the effectiveness of the proposed model and inference algorithm.

Mixed LICORS: A Nonparametric Algorithm for Predictive State Reconstruction

The LICORS Cabinet: Nonparametric Algorithms for Spatio-temporal Prediction

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Sparse covariance estimation in logit mixture models

Sparsity enabled cluster reduced-order models for control

Learning Mixtures of Sparse Linear Regressions Using Sparse Graph Codes

Identifying latent state transition in non-linear dynamical systems

Prediction under Latent Subgroup Shifts with High-Dimensional Observations

Tensor Decompositions Meet Control Theory: Learning General Mixtures of Linear Dynamical Systems

CARlasso: An R package for the estimation of sparse microbial networks with predictors

Sparse dynamic network reconstruction through L1-regularization of a Lyapunov equation

Unsupervised Classification with a Family of Parsimonious Contaminated Shifted Asymmetric Laplace Mixtures

Disentanglement via Mechanism Sparsity Regularization: A New Principle for Nonlinear ICA

Discriminative learning for dynamic state prediction

Offline Imitation from Observation via Primal Wasserstein State Occupancy Matching

Latent Space Score-based Diffusion Model for Probabilistic Multivariate Time Series Imputation

Toeplitz Inverse Covariance-Based Clustering of Multivariate Time Series Data

Sparse Graphical Linear Dynamical Systems

BELMM: Bayesian model selection and random walk smoothing in time-series clustering

Likelihood-Free Overcomplete ICA and Applications in Causal Discovery

RICASSO: Reinforced Imbalance Learning with Class-Aware Self-Supervised Outliers Exposure