An Improved News Recommendation Algorithm Based on Text Similarity

Yihang Gao,Hui Zhao,Qian Zhou,Meikang Qiu,Meiqin Liu

DOI: https://doi.org/10.1109/smartblock52591.2020.00031

2020-01-01

Abstract:With the advent of the data age, the public has been facing the problem of information overload. Recommendation algorithms are an effective way to solve this problem. At present, a large number of recommended algorithms adopt the following two ideas: content-based text similarity algorithm and user-based collaborative filtering algorithm. Researchers have developed a distributed collaborative recommendation protocol based on blockchain. However, these algorithms ignore the characteristics of the news industry itself. Just adopting the above ideas will inevitably lead to many internet public opinion problems. Therefore, this paper proposes an improved N-TF-IDF algorithm, which is more suitable for the news industry, and can control the outbreak of negative public opinion, and has a positive effect on stabilizing internet public opinion. Through the verification of the experimental data set, the algorithm is superior to the traditional information retrieval and text mining technology TF-IDF in both the time dimension and the emotional dimension, and this algorithm is not affected by citizens' privacy rights.