Abstract:Text clustering is a widely studied problem in the text mining domain. The Dirichlet Multinomial Mixture (DMM) model based clustering algorithms have shown good performance to cope with high dimensional sparse text data, obtaining reasonable results in both clustering accuracy and computational efficiency. However, the time complexity of DMM model training is proportional to the average document length and the number of clusters, making it inefficient for scaling up to long text and large corpora, which is common in realworld applications such as documents organization, retrieval and recommendation. In this paper, we leverage a symmetric prior setting for Dirichlet distribution, and build indices to decrease the time complexity of the sampling-based training for DMM from O(K∗L) to O(K∗U), where K is the number of clusters, L the average length of document, and U the average number of unique words in each document. We introduce a Metropolis-Hastings sampling algorithm, which further reduces the sampling time complexity from O(K∗U) to O(U) in the nearly-to-convergence training stages. Moreover, we also parallelize the DMM model training to obtain a further acceleration by using an uncollapsed Gibbs sampler. We combine all these optimizations into a highly efficient implementation, called X-DMM, which enables the DMM model to scale up for long and large-scale text clustering. We evaluate the performance of X-DMM on several real world datasets, and the experimental results show that XDMM achieves substantial speed up compared with existing state-of-the-art algorithms without clustering accuracy degradation.

TSDPMM: Incorporating Prior Topic Knowledge into Dirichlet Process Mixture Models for Text Clustering.

Hierarchical Topic Modeling with Nested Hierarchical Dirichlet Process

Document Clustering Based on Probabilistic Topic Model

Incorporating Probabilistic Knowledge into Topic Models.

Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding

A Knowledge-Based Semisupervised Hierarchical Online Topic Detection Framework.

Deep Dirichlet process mixture models.

Interactive Topic Modeling Based on Hierarchical Dirichlet Process

An Adaptive Dirichlet Multinomial Mixture Model for Short Text Streaming Clustering

Incorporating Hierarchical Dirichlet Process into Tag Topic Model.

Tracking and Connecting Topics Via Incremental Hierarchical Dirichlet Processes

A Bayesian Mixture Model of Temporal Point Processes with Determinantal Point Process Prior

CDP Mixture Models for Data Clustering

A topic-enhanced dirichlet model for short text stream clustering

X-DMM: Fast and Scalable Model Based Text Clustering

Dirichlet Mixture Allocation for Multiclass Document Collections Modeling

An Incremental DPMM-Based Method for Trajectory Clustering, Modeling, and Retrieval

Hierarchical Dirichlet Processes with Social Influence

Unsupervised Learning of Dirichlet Process Mixture Models with Missing Data

Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings

Sequential Embedding Induced Text Clustering, a Non-parametric Bayesian Approach