Abstract:Developing text classifiers often requires a large number of labeled documents as training examples. However, manually labeling documents is costly and time-consuming. Recently, a few methods have been proposed to label documents by using a small set of relevant keywords for each category, known as dataless text classification. In this paper, we propose a Seed-Guided Topic Model (named STM) for the dataless text classification task. Given a collection of unlabeled documents, and for each category a small set of seed words that are relevant to the semantic meaning of the category, the STM predicts the category labels of the documents through topic influence. STM models two kinds of topics: category-topics and general-topics. Each category-topic is associated with one specific category, representing its semantic meaning. The general-topics capture the global semantic information underlying the whole document collection. STM assumes that each document is associated with a single category-topic and a mixture of general-topics. A novelty of the model is that STM learns the topics by exploiting the explicit word co-occurrence patterns between the seed words and regular words (i.e., non-seed words) in the document collection. A document is then labeled, or classified, based on its posterior category-topic assignment. Experiments on two widely used datasets show that STM consistently outperforms the state-of-the-art dataless text classifiers. In some tasks, STM can also achieve comparable or even better classification accuracy than the state-of-the-art supervised learning solutions. Our experimental results further show that STM is insensitive to the tuning parameters. Stable performance with little variation can be achieved in a broad range of parameter settings, making it a desired choice for real applications.

Tipster: A Topic-Guided Language Model for Topic-Aware Text Segmentation.

SegFormer: A Topic Segmentation Model with Controllable Range of Attention.

TSSE-DMM: Topic Modeling for Short Texts Based on Topic Subdivision and Semantic Enhancement

GiTS: Gist-driven Text Segmentation

Topic Model over Short Texts Incorporating Word Embedding

A Pseudo-document-based Topical N-grams Model for Short Texts

PSLDA: a Novel Supervised Pseudo Document-Based Topic Model for Short Texts

A Joint Model Of Extended Lda And Ibtm Over Streaming Chinese Short Texts

Targeted Aspects Oriented Topic Modeling for Short Texts

Topic Discovery for Streaming Short Texts with CTM.

G2T: A Simple but Effective Framework for Topic Modeling Based on Pretrained Language Model and Community Detection

Short Text Topic Modeling With Flexible Word Patterns

Textual tag recommendation with multi-tag topical attention

A Topic-Triggered Language Model for Statistical Machine Translation.

Improving Long Document Topic Segmentation Models With Enhanced Coherence Modeling

Effective Document Labeling with Very Few Seed Words: A Topic Model Approach

Topic Sensitive Neural Headline Generation.

Automatic Labeling of Topic Models Using Text Summaries

Language Cognition and Topic Identification

GLTM: A Global and Local Word Embedding-Based Topic Model for Short Texts.

TDAM: a Topic-Dependent Attention Model for Sentiment Analysis