Abstract:Topic modelling is a beneficial technique used to discover latent topics in text collections. But to correctly understand the text content and generate a meaningful topic list, semantics are important. By ignoring semantics, that is, not attempting to grasp the meaning of the words, most of the existing topic modelling approaches can generate some meaningless topic words. Even existing semantic-based approaches usually interpret the meanings of words without considering the context and related words. In this article, we introduce a semantic-based topic model called semantic-LDA that captures the semantics of words in a text collection using concepts from an external ontology. A new method is introduced to identify and quantify the concept–word relationships based on matching words from the input text collection with concepts from an ontology without using pre-calculated values from the ontology that quantify the relationships between the words and concepts. These pre-calculated values may not reflect the actual relationships between words and concepts for the input collection, because they are derived from datasets used to build the ontology rather than from the input collection itself. Instead, quantifying the relationship based on the word distribution in the input collection is more realistic and beneficial in the semantic capture process. Furthermore, an ambiguity handling mechanism is introduced to interpret the unmatched words, that is, words for which there are no matching concepts in the ontology. Thus, this article makes a significant contribution by introducing a semantic-based topic model that calculates the word–concept relationships directly from the input text collection. The proposed semantic-based topic model and an enhanced version with the disambiguation mechanism were evaluated against a set of state-of-the-art systems, and our approaches outperformed the baseline systems in both topic quality and information filtering evaluations.

A Weighted Topic Modeling Approach Based on Word Embedding

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Topic Discovery Based on LDA_col Model and Topic Significance Re-ranking.

Topic Modeling over Short Texts by Incorporating Word Embeddings

Incorporating Knowledge Graph Embeddings into Topic Modeling

A Novel Topic Model for Automatic Term Extraction

Topic Modeling in Embedding Spaces

Topic Modeling Using Distributed Word Embeddings

Hierarchical Topic Modeling with Nested Hierarchical Dirichlet Process

A Correlated Topic Model Using Word Embeddings

Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings

Topic2Vec: Learning distributed representations of topics

Financial Topic Modeling Based on the BERT-LDA Embedding

Topic-weak-correlated Latent Dirichlet Allocation

Statistical Word Sense Aware Topic Models

A Novel Topic Model for Documents by Incorporating Semantic Relations Between Words

Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey

Improving the term weighting log entropy of latent dirichlet allocation

Using Word Sense As a Latent Variable in LDA Can Improve Topic Modeling.

A Semantics-enhanced Topic Modelling Technique: Semantic-LDA

Locally discriminative topic modeling