Abstract:Deep probabilistic aspect models are widely utilized in document analysis to extract the semantic information and obtain descriptive topics. However, there are two problems that may affect their applications. One is that common words shared among all documents with low representational meaning may reduce the representation ability of learned topics. The other is introducing supervision information to hierarchical topic models to fully utilize the side information of documents that is difficult. To address these problems, in this article, we first propose deep diverse latent Dirichlet allocation (DDLDA), a deep hierarchical topic model that can yield more meaningful semantic topics with less common and meaningless words by introducing shared topics. Moreover, we develop a variational inference network for DDLDA, which helps us to further generalize DDLDA to a supervised deep topic model called max-margin DDLDA (mmDDLDA) by employing max-margin principle as the classification criterion. Compared to DDLDA, mmDDLDA can discover more discriminative topical representations. In addition, a continual hybrid method with stochastic-gradient MCMC and variational inference is put forward for deep latent Dirichlet allocation (DLDA)-based models to make them more practical in real-world applications. The experimental results demonstrate that DDLDA and mmDDLDA are more efficient than existing unsupervised and supervised topic models in discovering highly discriminative topic representations and achieving higher classification accuracy. Meanwhile, DLDA and our proposed models trained by the proposed continual learning approach cannot only show good performance on preventing catastrophic forgetting but also fit the evolving new tasks well.

An Improved Latent Dirichlet Allocation Method For Service Topic Detection

Topic Discovery Based on LDA_col Model and Topic Significance Re-ranking.

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

A LDA Topic Model Based Collection Selection Method for Distributed Information Retrieval

News Topic Discovery Through Community Detection

Web Service Clustering Method Based on Word Vector and Biterm Topic Model

Cloud Service Recommendation with Bi-LSTM and GLDA Based Approach

Topic2Vec: Learning distributed representations of topics

A density-based method for adaptive LDA model selection

SeCo-LDA: Mining Service Co-Occurrence Topics for Composition Recommendation.

A Spectral Algorithm for Latent Dirichlet Allocation

Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey

Constrained-hLDA for Topic Discovery in Chinese Microblogs.

Contextual-LDA: A Context Coherent Latent Topic Model for Mining Large Corpora.

Group-based Latent Dirichlet Allocation (Group-LDA)

Latent Dirichlet classification:A new method for object detection

Max-Margin Deep Diverse Latent Dirichlet Allocation With Continual Learning

Sentiment word co-occurrence and knowledge pair feature extraction based LDA short text clustering algorithm

Wt-Lda: User Tagging Augmented Lda For Web Service Clustering

Topic-weak-correlated Latent Dirichlet Allocation

A Web service clustering method based on topic enhanced Gibbs sampling algorithm for the Dirichlet Multinomial Mixture model and service collaboration graph