Abstract:A popular approach to topic modeling involves extracting co-occurring n-grams of a corpus into semantic themes. The set of n-grams in a theme represents an underlying topic, but most topic modeling approaches are not able to label these sets of words with a single n-gram. Such labels are useful for topic identification in summarization systems. This paper introduces a novel approach to labeling a group of n-grams comprising an individual topic. The approach taken is to complement the existing topic distributions over words with a known distribution based on a predefined set of topics. This is done by integrating existing labeled knowledge sources representing known potential topics into the probabilistic topic model. These knowledge sources are translated into a distribution and used to set the hyperparameters of the Dirichlet generated distribution over words. In the inference these modified distributions guide the convergence of the latent topics to conform with the complementary distributions. This approach ensures that the topic inference process is consistent with existing knowledge. The label assignment from the complementary knowledge sources are then transferred to the latent topics of the corpus. The results show both accurate label assignment to topics as well as improved topic generation than those obtained using various labeling approaches based off Latent Dirichlet allocation (LDA).

Efficient Methods for Incorporating Knowledge into Topic Models

Incorporating Probabilistic Knowledge into Topic Models.

Incorporating Knowledge Graph Embeddings into Topic Modeling

Source-LDA: Enhancing probabilistic topic models using prior knowledge sources

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Incorporating Entity Correlation Knowledge into Topic Modeling

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Parsimonious Topic Models with Salient Word Discovery

A Spectral Algorithm for Latent Dirichlet Allocation

Latent Dirichlet Allocation - An approach for topic discovery

A Novel Topic Model for Documents by Incorporating Semantic Relations Between Words

Incorporating Biterm Correlation Knowledge into Topic Modeling for Short Texts

Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey

A New Approach to Speeding Up Topic Modeling

A density-based method for adaptive LDA model selection

Topic-weak-correlated Latent Dirichlet Allocation

LITA: An Efficient LLM-assisted Iterative Topic Augmentation Framework

A Word Position-Related Lda Model

Plink-LDA: Using Link As Prior Information in Topic Modeling

Sparse Hybrid Variational-Gibbs Algorithm for Latent Dirichlet Allocation.

Topic-Aware Knowledge Graph with Large Language Models for Interoperability in Recommender Systems