Abstract:Topic detection is an information processing technology designed to help people deal with the growing problem of data information on the Internet. In the research literature, topic detection methods are used for topic classification through word embedding, supervised-based and unsupervised-based approaches. However, most methods for topic detection only address the problem of clustering and do not focus on the problem of topic detection accuracy reduction due to the cohesiveness of topics. Also, the sequence of biterm during topic detection can cause substantial deviations in the detected topic content. To solve the above problems, this paper proposes a topic detection method based on KM-LSH fusion algorithm and improved BTM model. KM-LSH fusion algorithm is a fusion algorithm that combines K-means clustering and LSH refinement clustering. The proposed method can solve the problem of cohesiveness of topic detection, and the improved BTM model can solve the influence of the sequence of biterm on topic detection. First, the text vector is constructed by processing the collected set of microblog texts using text preprocessing methods. Secondly, the KM-LSH fusion algorithm is used to calculate text similarity and perform topic clustering and refinement. Finally, the improved BTM model is used to model the texts, which is combined with the word position and the improved TF-IDF weight calculation algorithm to adjust the microblogging texts in clustering. The experiment results indicate that the proposed KM-LSH-IBTM method improves the evaluation indexes compared with the other three topic detection methods. In conclusion, the proposed KM-LSH-IBTM method promotes the processing capability of topic detection in terms of cohesiveness and the sequence of biterm.

An Improved Topic Detection Method for Chinese Microblog Based on Incremental Clustering

A Topic Detection Method for Chinese Microblog

A Comparison Study of Clustering Algorithms for Microblog Posts

Novel Topic Detection Method for Microblog Based on SVM Filtration

Detection and Extraction of Hot Topics on Chinese Microblogs

A Microblog Hot Topic Detection Algorithm Based on Discrete Particle Swarm Optimization

Chinese Microblog Topic Detection through POS-Based Semantic Expansion

Research of Automatic Topic Detection Based on Incremental Clustering

A topic detection method based on KM-LSH Fusion algorithm and improved BTM model

Thread Cleaning and Merging for Microblog Topic Detection.

Automatic Topic Detection With An Incremental Clustering Algorithm

An Emotion-Based Method of Topic Detection from Chinese Microblogs

Hot Topic Detection Based on VSM and Improved LDA Hybrid Model

A Fast Hierarchical Topic Detection Method

Research on User Influence-Based Hot Topic Detection Methodin Micro-blog

An Improved Latent Dirichlet Allocation Model for Hot Topic Extraction

A Research of Hot Topic Detection through Microblogging

A Popular Topic Detection Method based on Microblog Images and Short Text Information

Incremental Algorithm for Clustering Texts in Internet-Oriented Topic Detection

Microblog hot topic detection based on positive point mutual informa-tion and probabilistic topic model