Abstract:Analyzing short texts infers discriminative and coherent latent topics that is a critical and fundamental task since many real-world applications require semantic understanding of short texts. Traditional long text topic modeling algorithms (e.g., PLSA and LDA) based on word co-occurrences cannot solve this problem very well since only very limited word co-occurrence information is available in short texts. Therefore, short text topic modeling has already attracted much attention from the machine learning research community in recent years, which aims at overcoming the problem of sparseness in short texts. In this survey, we conduct a comprehensive review of various short text topic modeling techniques proposed in the literature. We present three categories of methods based on Dirichlet multinomial mixture, global word co-occurrences, and self-aggregation, with example of representative approaches in each category and analysis of their performance on various tasks. We develop the first comprehensive open-source library, called STTM, for use in Java that integrates all surveyed algorithms within a unified interface, benchmark datasets, to facilitate the expansion of new methods in this research field. Finally, we evaluate these state-of-the-art methods on many real-world datasets and compare their performance against one another and versus long text topic modeling algorithm.

Short Text Understanding by Leveraging Knowledge into Topic Model.

Incorporating Knowledge Graph Embeddings into Topic Modeling

Incorporating Knowledge into Neural Network for Text Representation.

Incorporating Probabilistic Knowledge into Topic Models.

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Topic Modeling over Short Texts by Incorporating Word Embeddings

Mitigating Data Sparsity for Short Text Topic Modeling by Topic-Semantic Contrastive Learning

Incorporating Biterm Correlation Knowledge into Topic Modeling for Short Texts

BTM: Topic Modeling over Short Texts

Short Text Topic Modeling Techniques, Applications, and Performance: A Survey

Enhanced Short Text Modeling: Leveraging Large Language Models for Topic Refinement

Short Text Topic Modeling With Flexible Word Patterns

Utilizing Recurrent Neural Network for Topic Discovery in Short Text Scenarios

Research on Improve Topic Representation over Short Text.

Context Reinforced Neural Topic Modeling over Short Texts

Topic model based on co-occurrence word networks for unbalanced short text datasets

TSSE-DMM: Topic Modeling for Short Texts Based on Topic Subdivision and Semantic Enhancement

Modeling over Short Texts

A CWTM Model of Topic Extraction for Short Text.

Let the Pretrained Language Models "Imagine" for Short Texts Topic Modeling

A Self-adaptive Sliding Window Based Topic Model for Non-uniform Texts