A novel text-based framework for forecasting agricultural futures using massive online news headlines

Jianping Li,Guowen Li,Mingxi Liu,Xiaoqian Zhu,Lu Wei
DOI: https://doi.org/10.1016/j.ijforecast.2020.02.002
IF: 7.022
2022-01-01
International Journal of Forecasting
Abstract:<p>The agricultural futures prices are generally considered difficult to forecast because the causes of fluctuations are incredibly complicated. We propose a text-based forecasting framework, which can effectively identify and quantify factors affecting agricultural futures based on massive online news headlines. A comprehensive list of influential factors can be formed using a text mining method called topic modeling. A new sentiment-analysis-based way is designed to quantify the factors such as the weather and policies that are important yet difficult to quantify. The proposed framework is empirically tested at forecasting soybean futures prices in the Chinese market. Testing was based on 9715 online news headlines from July 19, 2012 to July 9, 2018. The results show that the identified influential factors and sentiment-based variables are effective, and the proposed framework performs significantly better in medium-term and long-term forecasting than the benchmark model.</p>
economics,management
What problem does this paper attempt to address?