Abstract:Time-varying mixture densities occur in many scenarios, for example, the distributions of keywords that appear in publications may evolve from year to year, video frame features associated with multiple targets may evolve in a sequence. Any models that realistically cater to this phenomenon must exhibit two important properties: the underlying mixture densities must have an unknown number of mixtures, and there must be some smoothness constraints in place for the adjacent mixture densities. The traditional Hierarchical Dirichlet Process (HDP) may be suited to the first property, but certainly not the second. This is due to how each random measure in the lower hierarchies is sampled independent of each other and hence does not facilitate any temporal correlations. To overcome such shortcomings, we proposed a new Smoothed Hierarchical Dirichlet Process (sHDP). The key novelty of this model is that we place a temporal constraint amongst the nearby discrete measures ${G_j}$ in the form of symmetric Kullback-Leibler (KL) Divergence with a fixed bound $B$. Although the constraint we place only involves a single scalar value, it nonetheless allows for flexibility in the corresponding successive measures. Remarkably, it also led us to infer the model within the stick-breaking process where the traditional Beta distribution used in stick-breaking is now replaced by a new constraint calculated from $B$. We present the inference algorithm and elaborate on its solutions. Our experiment using NIPS keywords has shown the desirable effect of the model.

An Improved Hierarchical Dirichlet Process-Hidden Markov Model and Its Application to Trajectory Modeling and Retrieval

Hierarchical Topic Modeling with Nested Hierarchical Dirichlet Process

Interactive Topic Modeling Based on Hierarchical Dirichlet Process

An Incremental DPMM-Based Method for Trajectory Clustering, Modeling, and Retrieval

Trajectory-Based Video Retrieval Using Dirichlet Process Mixture Models

Measuring and Enhancing the Transferability of Hidden Markov Models for Dynamic Travel Behavioral Analysis

Hierarchical Vehicle Trajectory Prediction with Interactive Multiple Models

Tracking and Connecting Topics Via Incremental Hierarchical Dirichlet Processes

Inferring Hierarchical Mixture Structures: A Bayesian Nonparametric Approach

Multiple Maneuvering Target Tracking Based on Hierarchical Dirichlet Process and Hidden Markov Model

Multi-perspective Hierarchical Dirichlet Process for Geographical Topic Modeling.

Modeling and recognizing human trajectories with beta process hidden Markov models

Online Topic Evolution Modeling Based on Hierarchical Dirichlet Process.

Hierarchical Dirichlet Processes with Social Influence

BAT-Chain: Bayesian-Aware Transport Chain for Topic Hierarchies Discovery

Automatic Identification of Driving Maneuver Patterns using a Robust Hidden Semi-Markov Models

Phrase-based Topic and Sentiment Detection and Tracking Model Using Incremental HDP.

Disentangled Sticky Hierarchical Dirichlet Process Hidden Markov Model

Smoothed Hierarchical Dirichlet Process: A Non-Parametric Approach to Constraint Measures

Deep Dirichlet Process Mixture Model for Non-parametric Trajectory Clustering

Visual Analysis Method for Traffic Trajectory with Dynamic Topic Movement Patterns Based on the Improved Markov Decision Process