Abstract:To model sequentially observed multivariate nonstationary count data, we propose a switching Poisson-gamma dynamical systems (SPGDS), a dynamic probabilistic network with switching mechanism. Different from previous models, SPGDS assigns its latent variables into mixture of gamma distributed parameters to model complex sequences and describe the nonlinear dynamics, meanwhile, capture various temporal dependencies. Moreover, SPGDS can model all discrete and nonnegative real data by linking them to latent counts. To take advantage of Bayesian nonparametrics in handling the unknown number of mixture components, we integrate Dirichlet process (DP) mixture into SPGDS and develop an infinite switching Poisson-gamma dynamical systems (iSPGDS). For efficient and nonparametric inference, we develop a infinite switching recurrent variational inference network, combined with a scalable hybrid stochastic gradient-MCMC and variational inference method, which is scalable to large scale sequences and fast in out-of-sample prediction. Besides, to handle the time-series categorization task, we further propose an supervised attention iSPGDS (attn-iSPGDS), which combines the representation power of iSPGDS, discriminative power of deep neural networks, and selection power of the attention mechanism under a principled probabilistic framework. Experiments on both unsupervised and supervised tasks demonstrate that the proposed model not only has excellent fitting and prediction performance on complex sequences, but also separates different dynamical patterns within them.

Probabilistic Classifier Chain Inference via Gibbs Sampling.

A Bayesian Network nearest k-labels method for Multi-label classification

Max-margin Based Bayesian Classifier.

Classifier Chain Networks for Multi-Label Classification

Infinite Switching Dynamic Probabilistic Network with Bayesian Nonparametric Learning

A Three-phase Augmented Classifiers Chain Approach Based on Co-occurrence Analysis for Multi-Label Classification

Partial Classifier Chains with Feature Selection by Exploiting Label Correlation in Multi-Label Classification

Bayesian Prediction-Powered Inference

Classification with Label Noise: a Markov Chain Sampling Framework.

Learning A Flexible K-Dependence Bayesian Classifier from the Chain Rule of Joint Probability Distribution

A Generative Probabilistic Model for Multi-label Classification

Classifier chains for multi-label classification

Inference and Learning in Hybrid Probabilistic Network.

Learning Moral Graphs in Construction of High-Dimensional Bayesian Networks for Mixed Data

LCBM: A Multi-View Probabilistic Model for Multi-Label Classification

Exploring Complex Multivariate Probability Distributions with Simple and Robust Bayesian Network Topology for Classification

Scalable Multi-Output Label Prediction: From Classifier Chains to Classifier Trellises

Group sensitive Classifier Chains for multi-label classification

Causal structure learning with momentum: Sampling distributions over Markov Equivalence Classes of DAGs

Deep Dependency Networks and Advanced Inference Schemes for Multi-Label Classification

Nonparametric Bayesian Multi-Task Large-margin Classification.