Abstract:Topic modelling is a beneficial technique used to discover latent topics in text collections. But to correctly understand the text content and generate a meaningful topic list, semantics are important. By ignoring semantics, that is, not attempting to grasp the meaning of the words, most of the existing topic modelling approaches can generate some meaningless topic words. Even existing semantic-based approaches usually interpret the meanings of words without considering the context and related words. In this article, we introduce a semantic-based topic model called semantic-LDA that captures the semantics of words in a text collection using concepts from an external ontology. A new method is introduced to identify and quantify the concept–word relationships based on matching words from the input text collection with concepts from an ontology without using pre-calculated values from the ontology that quantify the relationships between the words and concepts. These pre-calculated values may not reflect the actual relationships between words and concepts for the input collection, because they are derived from datasets used to build the ontology rather than from the input collection itself. Instead, quantifying the relationship based on the word distribution in the input collection is more realistic and beneficial in the semantic capture process. Furthermore, an ambiguity handling mechanism is introduced to interpret the unmatched words, that is, words for which there are no matching concepts in the ontology. Thus, this article makes a significant contribution by introducing a semantic-based topic model that calculates the word–concept relationships directly from the input text collection. The proposed semantic-based topic model and an enhanced version with the disambiguation mechanism were evaluated against a set of state-of-the-art systems, and our approaches outperformed the baseline systems in both topic quality and information filtering evaluations.

Semantic Analysis of Entity Contexts towards Open Named Entity Classification on the Web

Leveraging Contextual Information for Effective Entity Salience Detection

A Web Semantic-Based Text Analysis Approach for Enhancing Named Entity Recognition Using PU-Learning and Negative Sampling

Search-Based Automatic Web Image Annotation Using Latent Visual and Semantic Analysis

Multi-Context Attention for Entity Matching.

Entity Synonym Discovery via Multipiece Bilateral Context Matching

Named Entity Recognition in Multi-level Contexts

ES-LDA: Entity Summarization Using Knowledge-based Topic Modeling.

An Ontology-Based Latent Semantic Indexing Approach Using Long Short-Term Memory Networks.

Web-Scale Visual Entity Recognition: An LLM-Driven Data Approach

On the connections between explicit semantic analysis and latent semantic analysis.

Improving Entity Linking by Modeling Latent Entity Type Information

Learning Cross-Context Entity Representations from Text

Webel: Improving Entity Linking With Extra Web Contexts

Read Extensively, Focus Smartly: A Cross-document Semantic Enhancement Method for Visual Documents NER.

Multi-Distribution Characteristics Based Chinese Entity Synonym Extraction from The Web

A Neural Network-Powered Cognitive Method of Identifying Semantic Entities in Earth Science Papers

The Theory and Application of Latent Semantic Analysis

Text Information Retrieval Based on Latent Semantic Analysis

Named Entity Recognition with Bidirectional LSTM-CNNs

A Semantics-enhanced Topic Modelling Technique: Semantic-LDA