Abstract:We seek a computationally efficient model for a collection of time series arising from multiple interacting entities (a.k.a. "agents"). Recent models of spatiotemporal patterns across individuals fail to incorporate explicit system-level collective behavior that can influence the trajectories of individual entities. To address this gap in the literature, we present a new hierarchical switching-state model that can be trained in an unsupervised fashion to simultaneously learn both system-level and individual-level dynamics. We employ a latent system-level discrete state Markov chain that provides top-down influence on latent entity-level chains which in turn govern the emission of each observed time series. Recurrent feedback from the observations to the latent chains at both entity and system levels allows recent situational context to inform how dynamics unfold at all levels in bottom-up fashion. We hypothesize that including both top-down and bottom-up influences on group dynamics will improve interpretability of the learned dynamics and reduce error when forecasting. Our hierarchical switching recurrent dynamical model can be learned via closed-form variational coordinate ascent updates to all latent chains that scale linearly in the number of entities. This is asymptotically no more costly than fitting a separate model for each entity. Analysis of both synthetic data and real basketball team movements suggests our lean parametric model can achieve competitive forecasts compared to larger neural network models that require far more computational resources. Further experiments on soldier data as well as a synthetic task with 64 cooperating entities show how our approach can yield interpretable insights about team dynamics over time.

Switching Poisson Gamma Dynamical Systems

Infinite Switching Dynamic Probabilistic Network with Bayesian Nonparametric Learning

A Poisson-Gamma Dynamic Factor Model with Time-Varying Transition Dynamics

Negative-Binomial Randomized Gamma Markov Processes for Heterogeneous Overdispersed Count Time Series

Bayesian Inference of Recurrent Switching Linear Dynamical Systems with Higher-Order Dependence

Recurrent switching linear dynamical systems

Markov Chain Monte Carlo for Continuous-Time Switching Dynamical Systems

Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systems

Graph Switching Dynamical Systems

Discovering group dynamics in coordinated time series via hierarchical recurrent switching-state models

Recursive Gaussian Mixture Models for Adaptive Process Monitoring

Bayesian Inference in Recurrent Explicit Duration Switching Linear Dynamical Systems

Variational Inference for Continuous-Time Switching Dynamical Systems

Tree-Structured Recurrent Switching Linear Dynamical Systems for Multi-Scale Modeling

Dynamic Modeling of Spike Count Data With Conway-Maxwell Poisson Variability

Scalable Hybrid HMM with Gaussian Process Emission for Sequential Time-series Data Clustering

Stochastic Gradient MCMC for Nonlinear State Space Models

On the Identifiability of Switching Dynamical Systems

Generalized Glauber dynamics for inference in biology

A sticky Poisson Hidden Markov Model for spike data

Dynamic sparsity on dynamic regression models