Abstract:With the widespread use of online social networks, billions of pieces of information are generated every day. How to detect new topics quickly and accurately at such data scale plays a vital role in information recommendation and public opinion control. One of the basic research tasks of topic detection is how to represent a topic. The existing topic representation models do not focus on how to select better differentiated words to represent topics, are still computer-centered, and do not effectively combine human intelligence and artificial intelligence (AI). To solve these problems, this article proposes a word-distributed sensitive topic representation model (WDS-LDA) based on hybrid human-AI (H-AI). The basic idea is that the distribution of words within a topic or among different topics has a great influence on the selection of topic expression words. If a word is evenly distributed among all documents of a certain topic, it indicates that the word is the common word of all documents in the topic, and it is more suitable to represent this topic. If a word is more evenly distributed among various topics, it indicates that the word is a common word of all topics, and cannot be used for the purpose of distinguishing among topics, becoming less suitable to represent any topic. At the same time, the human cognitive ability and cognitive models are introduced into topic representation based on H-AI. We introduce the user's modification of topic expression words into the topic model representation so that the topic model can learn human wisdom and become more and more accurate. Therefore, three different weights are introduced: inside weight; outside weight; and manual adjustment weight. The inside weight describes the uniform distribution of a word in the given topic, the outside weight describes the uniform distribution of a word in all topics, and the manual adjustment weight reflects whether a word is suitable as a representative vocabulary in the past manual adjustment. Tests using Sina microblog's actual data sets show that the WDS-LDA algorithm makes the representative words more important, the distinction among different topic words higher, and effectively improves the precision of subsequent algorithms, such as topic detection and topic evolutionary analysis using the topic model.

A Novel Topic Model for Automatic Term Extraction

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

SBTM: A Joint Sentiment and Behaviour Topic Model for Online Course Discussion Forums

Measuring Termhood in Automatic Terminology Extraction

A Novel Topic Model for Documents by Incorporating Semantic Relations Between Words

Tag-Weighted Topic Model for Mining Semi-Structured Documents.

Research on Automatic Chinese Multi-word Term Extraction Based on Term Component

ITWF: A Framework to Apply Term Weighting Schemes in Topic Model

A Weighted Topic Modeling Approach Based on Word Embedding

A Query-Driven Topic Model

Statistical Word Sense Aware Topic Models

A Novel Neural Topic Model and Its Supervised Extension.

Automatic Domain Terminology Extraction Using Graph Mutual Reinforcement

A Novel Parsing-Based Automatic Domain Terminology Extraction Method

Topic Modeling over Short Texts by Incorporating Word Embeddings

Domain-Specific Term Rankings Using Topic Models

A Topic Representation Model for Online Social Networks Based on Hybrid Human–Artificial Intelligence

A biterm topic model for short texts

Topics in the Haystack: Extracting and Evaluating Topics beyond Coherence

Domain-specific Topic Model for Knowledge Discovery in Computational and Data-Intensive Scientific Communities

Automatic Labeling of Topic Models Using Text Summaries