Abstract:Deep probabilistic aspect models are widely utilized in document analysis to extract the semantic information and obtain descriptive topics. However, there are two problems that may affect their applications. One is that common words shared among all documents with low representational meaning may reduce the representation ability of learned topics. The other is introducing supervision information to hierarchical topic models to fully utilize the side information of documents that is difficult. To address these problems, in this article, we first propose deep diverse latent Dirichlet allocation (DDLDA), a deep hierarchical topic model that can yield more meaningful semantic topics with less common and meaningless words by introducing shared topics. Moreover, we develop a variational inference network for DDLDA, which helps us to further generalize DDLDA to a supervised deep topic model called max-margin DDLDA (mmDDLDA) by employing max-margin principle as the classification criterion. Compared to DDLDA, mmDDLDA can discover more discriminative topical representations. In addition, a continual hybrid method with stochastic-gradient MCMC and variational inference is put forward for deep latent Dirichlet allocation (DLDA)-based models to make them more practical in real-world applications. The experimental results demonstrate that DDLDA and mmDDLDA are more efficient than existing unsupervised and supervised topic models in discovering highly discriminative topic representations and achieving higher classification accuracy. Meanwhile, DLDA and our proposed models trained by the proposed continual learning approach cannot only show good performance on preventing catastrophic forgetting but also fit the evolving new tasks well.

A UMDA-Based Discretization Method for Continuous Attributes

An ICA-Based multivariate discretization algorithm

A New Supervised Discretization Method Based on Bayes Measure

The Discretization of Continuous Attributes Based on Compatibility Rough Set and Genetic Algorithm

A New Discretization Approach of Continuous Attributes

A novel discretization algorithm based on multi-scale and information entropy

A New Discretization Algorithm for Continuous Interval-valued Attributes

Discretization of Continuous-Valued Attributes and Instance-Based Learning

Discretizing Numerical Attributes: An Analysis of Human Perceptions

Multi-relational Discretization Methods

A Survey of Discretization Techniques: Taxonomy and Empirical Analysis in Supervised Learning

Method of Discretization of Continuous Attributes of Decision Table

A New Algorithm for the Discretization of Continuous Attributes based on Rough Set

Decoupled Mixup for Data-efficient Learning

Convergence analysis of UMDAC with finite populations: a case study on flat landscapes

Max-Margin Deep Diverse Latent Dirichlet Allocation With Continual Learning

Unified Discrete Diffusion for Categorical Data

Combining data discretization and missing value imputation for incomplete medical datasets

Discretisation in Lazy Learning Algorithms

Optimizing continuous problems using estimation of distribution algorithm based on histogram model

centroIDA: Cross-Domain Class Discrepancy Minimization Based on Accumulative Class-Centroids for Imbalanced Domain Adaptation