Abstract:Currently, with the rapid growth of online media, more people are obtaining information from it. However, traditional hotspot mining algorithms cannot achieve precise and fast control of hot topics. Aiming at the problem of poor accuracy and timeliness in current news media hotspot mining methods, this paper proposes a hotspot mining method based on the co-occurrence word model. First, a new co-occurrence word model based on word weight is proposed. Then, for key phrase extraction, a hotspot mining algorithm based on the co-occurrence word model and improved smooth inverse frequency rank (SIFRANK) is designed. Finally, the Spark computing framework is introduced to improve the computing efficiency. The experimental outcomes expresses that the new word discovery algorithm discovered 16871 and 17921 new words in the Weibo Short News and Weibo Short Text datasets respectively. The heat weight values of the keywords obtained by the improved SIFRANK reaches 0.9356, 0.9991, and 0.6117. In the Covid19 Tweets dataset, the accuracy is 0.6223, the recall is 0.7015, and the F1 value is 0.6605. In the President-elects Tweets dataset, the accuracy is 0.6418, the recall is 0.7162, and the F1 value is 0.6767. After applying the Spark computing framework, the running speed has significantly improved. The text mining news media hotspot mining method based on the co-occurrence word model proposed in this study has improved the accuracy and efficiency of mining hot topics, and has great practical significance.

Online Hot Topic Discovery and Hotness Evaluation

Hot Topic Detection Based on a Refined TF-IDF Algorithm

The Hot Topics Evaluation and Key Issues in Online News about Emergency Events

Research And Implementation Of Hot Topic Detection System Based On Web

Design and Implementation of On-Line Hot Topic Discovery Model

Online Hot Topic Detection from Web News Based on Bursty Term Identification.

On-Line Hot Topic Recommendation Using Tolerance Rough Set Based Topic Clustering

Co-occurrence word model for news media hotspot mining-text mining method design

Towards better understanding of hot topics in online learning communities

Hot topic detection based on combined content and time similarity

Hot topic detection based on a tripartite model

An Improved Latent Dirichlet Allocation Model for Hot Topic Extraction

Efficient Diverse Rank Of Hot-Topics-Discussion On Social Network

ECANP: A Topic Influence Evaluation Model for Hot Topics

A Momentum Theory For Hot Topic Life-Cycle: A Case Study Of Hot Hashtag Emerging In Twitter

Data Mining Method of Social Media Hot Topics Based on Time Series Clustering

An Online Hot Topics Detection Approach Using the Improved Ant Colony Text Clustering Algorithm

Detecting Hot Topics in Technology News Streams

Hotspot Detection in Social Media Based on Improved Strategy Clustering

Research on Internet Public Opinion Recognition Method Based on High Frequency Co-occurrence

A Prerecognition Model for Hot Topic Discovery Based on Microblogging Data