Abstract:Predicting emerging research topics is important to researchers and policymakers. In this study, we propose a two-step solution to the problem of emerging topic prediction. The first step forecasts the future popularity score, a novel indicator reflecting the impact and growth, of candidate topics in a time-series manner. The second step selects novel topics from the candidates predicted to be popular in the first step. Terms with domain characteristics are used as candidate topics. Deep neural networks, specifically LSTM and NNAR, are applied with nine features of topics to predict popularity score. We evaluated the models and five baselines on two datasets from two perspectives, i.e., the ability to (1) predict the correct indicator value and (2) reconstruct the optimal ranking order. Two types of training strategies were compared, including a global strategy that trains a model with all topics and two local strategies that train separate models with different groups of topics. Our results show that LSTM and NNAR outperform other models in predicting the value of popularity score measured by MAE and RMSE, while LightGBM is a competitive baseline in ranking the topics in terms of NDCG@20. The performance difference of global and local strategies is not significant. Emerging topics predicted by our approach are compared with those by other methods. A qualitative assessment on nominated emerging topics suggests topics nominated by machine learning methods are more alike than those by the rule-based model. Some important topics are nominated according to a preliminary literature analysis. This study exploited the strengths of both machine learning and bibliometric indicator approaches for emerging topic prediction. Deep neural networks are applied where objective optimization target can be defined and measured. Bibliometric indicator offers an efficient way to select novel topics from candidates. The hybrid approach shows promise in considering various characteristics of emerging topics when making predictions.

Forecasting Popularity of News Article by Title Analyzing with BN-LSTM Network

Shallow reading with Deep Learning: Predicting popularity of online content using only its title

Hierarchical Neural Network for Online News Popularity Prediction

Neural Network Based Popularity Prediction by Linking Online Content with Knowledge Bases.

Predicting the Popularity of Online Content with Knowledge-enhanced Neural Networks

Title-Aware Neural News Topic Prediction

Popularity prediction in microblog based on LR-DT

Combining Deep Neural Network and Bibliometric Indicator for Emerging Research Topic Prediction.

A Real-Time Method to Predict Social Media Popularity

To Post or Not to Post: Using Online Trends to Predict Popularity of Offline Content

Hot News Prediction Method Based on Natural Language Processing Technology and Its Application.

Popularity Prediction of Online Contents Via Cascade Graph and Temporal Information.

Anime Popularity Prediction Before Huge Investments: a Multimodal Approach Using Deep Learning

Modeling Popularity in Asynchronous Social Media Streams with Recurrent Neural Networks

Approach to Predicting News -- A Precise Multi-LSTM Network With BERT

Recent Advances on Neural Headline Generation

An Attention-based Neural Model for Popularity Prediction in Social Service

A Named Entity Topic Model for News Popularity Prediction

DNCP: An attention-based deep learning approach enhanced with attractiveness and timeliness of News for online news click prediction

A Two-stage Prediction Method of News Popularity Only Using Content Features

Sentiment and Hashtag-aware Attentive Deep Neural Network for Multimodal Post Popularity Prediction