Abstract:Topic detection is an information processing technology designed to help people deal with the growing problem of data information on the Internet. In the research literature, topic detection methods are used for topic classification through word embedding, supervised-based and unsupervised-based approaches. However, most methods for topic detection only address the problem of clustering and do not focus on the problem of topic detection accuracy reduction due to the cohesiveness of topics. Also, the sequence of biterm during topic detection can cause substantial deviations in the detected topic content. To solve the above problems, this paper proposes a topic detection method based on KM-LSH fusion algorithm and improved BTM model. KM-LSH fusion algorithm is a fusion algorithm that combines K-means clustering and LSH refinement clustering. The proposed method can solve the problem of cohesiveness of topic detection, and the improved BTM model can solve the influence of the sequence of biterm on topic detection. First, the text vector is constructed by processing the collected set of microblog texts using text preprocessing methods. Secondly, the KM-LSH fusion algorithm is used to calculate text similarity and perform topic clustering and refinement. Finally, the improved BTM model is used to model the texts, which is combined with the word position and the improved TF-IDF weight calculation algorithm to adjust the microblogging texts in clustering. The experiment results indicate that the proposed KM-LSH-IBTM method improves the evaluation indexes compared with the other three topic detection methods. In conclusion, the proposed KM-LSH-IBTM method promotes the processing capability of topic detection in terms of cohesiveness and the sequence of biterm.

CS-BTM: a semantics-based hot topic detection method for social network

SBTM: A Joint Sentiment and Behaviour Topic Model for Online Course Discussion Forums

Topic Discovery for Streaming Short Texts with CTM.

Modeling over Short Texts

A topic detection method based on KM-LSH Fusion algorithm and improved BTM model

A biterm topic model for short texts

Microblog hot topic detection based on positive point mutual informa-tion and probabilistic topic model

Chinese Microblog Topic Detection through POS-Based Semantic Expansion

Topic Detection Based On Semantics, Time And Social Relationship

Detection and Extraction of Hot Topics on Chinese Microblogs

Research Based on the HowNet Semantic Expansion Micro-Blog Hot Topic Detection System

Research on Improved BBTM Model for Microblog Hot Topic Discovery*

An Effective Hot Topic Detection Method for Microblog on Spark

BTM: Topic Modeling over Short Texts

An Intention-Topic Model Based On Verbs Clustering And Short Texts Topic Mining

A Joint Model Of Extended Lda And Ibtm Over Streaming Chinese Short Texts

Improved BTM topic embedding method for Web text data extraction

Relational Biterm Topic Model: Short-Text Topic Modeling Using Word Embeddings

Micro-blog Topic Detection in Frequent Word Networks

Semantic Augmented Topic Model over Short Text

Biterm Pseudo Document Topic Model for Short Text