Abstract:Deep probabilistic aspect models are widely utilized in document analysis to extract the semantic information and obtain descriptive topics. However, there are two problems that may affect their applications. One is that common words shared among all documents with low representational meaning may reduce the representation ability of learned topics. The other is introducing supervision information to hierarchical topic models to fully utilize the side information of documents that is difficult. To address these problems, in this article, we first propose deep diverse latent Dirichlet allocation (DDLDA), a deep hierarchical topic model that can yield more meaningful semantic topics with less common and meaningless words by introducing shared topics. Moreover, we develop a variational inference network for DDLDA, which helps us to further generalize DDLDA to a supervised deep topic model called max-margin DDLDA (mmDDLDA) by employing max-margin principle as the classification criterion. Compared to DDLDA, mmDDLDA can discover more discriminative topical representations. In addition, a continual hybrid method with stochastic-gradient MCMC and variational inference is put forward for deep latent Dirichlet allocation (DLDA)-based models to make them more practical in real-world applications. The experimental results demonstrate that DDLDA and mmDDLDA are more efficient than existing unsupervised and supervised topic models in discovering highly discriminative topic representations and achieving higher classification accuracy. Meanwhile, DLDA and our proposed models trained by the proposed continual learning approach cannot only show good performance on preventing catastrophic forgetting but also fit the evolving new tasks well.

Discriminative infinite latent feature models

Using latent class models for neighbors selection in collaborative filtering

Discriminative Nonparametric Latent Feature Relational Models with Data Augmentation

Max-Margin Nonparametric Latent Feature Models for Link Prediction.

MedLDA: maximum margin supervised topic models

Learning Harmonium Models with Infinite Latent Features

Latent Feature Models for Large-Scale Link Prediction

Latent Fisher Discriminant Analysis

Latent Factor Interpretations for Collaborative Filtering

Locally Linear Factorization Machines.

Max-margin Latent Feature Relational Models for Entity-Attribute Networks

Local Feature Discriminant Projection

An L1-and-L2-Norm-Oriented Latent Factor Model for Recommender Systems

Max-Margin Deep Diverse Latent Dirichlet Allocation With Continual Learning

An Infinite Latent Attribute Model for Network Data

MedLDA: A General Framework of Maximum Margin Supervised Topic Models

MedLDA: maximum margin supervised topic models for regression and classification.

Explaining Latent Factor Models for Recommendation with Influence Functions

Latent Space Regularization for Recommender Systems.

Latent Feature Mining for Predictive Model Enhancement with Large Language Models

A Multilayered-and-Randomized Latent Factor Model for High-Dimensional and Sparse Matrices