Abstract:Most topic models are constructed under the assumption that documents follow a multinomial distribution. The Poisson distribution is an alternative distribution to describe the probability of count data. For topic modelling, the Poisson distribution describes the number of occurrences of a word in documents of fixed length. The Poisson distribution has been successfully applied in text classification, but its application to topic modelling is not well documented, specifically in the context of a generative probabilistic model. Furthermore, the few Poisson topic models in literature are admixture models, making the assumption that a document is generated from a mixture of topics. In this study, we focus on short text. Many studies have shown that the simpler assumption of a mixture model fits short text better. With mixture models, as opposed to admixture models, the generative assumption is that a document is generated from a single topic. One topic model, which makes this one-topic-per-document assumption, is the Dirichlet-multinomial mixture model. The main contributions of this work are a new Gamma-Poisson mixture model, as well as a collapsed Gibbs sampler for the model. The benefit of the collapsed Gibbs sampler derivation is that the model is able to automatically select the number of topics contained in the corpus. The results show that the Gamma-Poisson mixture model performs better than the Dirichlet-multinomial mixture model at selecting the number of topics in labelled corpora. Furthermore, the Gamma-Poisson mixture produces better topic coherence scores than the Dirichlet-multinomial mixture model, thus making it a viable option for the challenging task of topic modelling of short text.

A Topic Tracking Oriented Dirichlet Process Mixture Model

Hierarchical Topic Modeling with Nested Hierarchical Dirichlet Process

Incorporating Probabilistic Knowledge into Topic Models.

TSDPMM: Incorporating Prior Topic Knowledge into Dirichlet Process Mixture Models for Text Clustering.

Incorporating Knowledge Graph Embeddings into Topic Modeling

Nonparametric Bayesian Methods (Dirichlet Process Mixtures)

Novel mixture allocation models for topic learning

Tracking and Connecting Topics Via Incremental Hierarchical Dirichlet Processes

Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings

Interactive Topic Modeling Based on Hierarchical Dirichlet Process

Functional Dirichlet Process.

Dirichlet Process Mixture Model, Extensions and Applications

Deep Dirichlet process mixture models.

Incorporating Hierarchical Dirichlet Process into Tag Topic Model.

The Infinite Student'S T-Mixture For Robust Modeling

Trajectory-Based Video Retrieval Using Dirichlet Process Mixture Models

A Gamma-Poisson Mixture Topic Model for Short Text

Dirichlet Mixture Allocation for Multiclass Document Collections Modeling

A CWTM Model of Topic Extraction for Short Text.

A unified model for stable and temporal topic detection from social media data

Research on Mining Common Concern Via Infinite Topic Modelling