Massive Text Mining for Abnormal Market Trend Detection.

Ying Li,Ting Jin,Meng Xi,Shengpeng Liu,Zhiling Luo
DOI: https://doi.org/10.1109/bigdata.2018.8622450
2018-01-01
Abstract:The sentiment behind financial text has been observed to have correlations with stock market trend. Though widely discussed, the study on this topic faces the challenge coming from the lack of open dataset and labeled financial text. In this work, we collected a large amount of Chinese financial text from financial news, research report, stock BBS and corporate announcements. It contains 3 million articles about 128 stocks from 2010 to 2018. And then we proposed a model mapping from the text and latent sentiment to the abnormal market trend. It combines the posting amount, daily market index with the RBM-embedded document vector, and extracts the abnormal features via LSTM. After that a neural net is employed to identify the abnormal trend. The experimental results on our dataset show the effectiveness of our approach comparing to baseline methods.
What problem does this paper attempt to address?