Abstract:Predicting stock return volatility is the key to investment and risk management. Traditional volatility-forecasting methods primarily rely on stochastic models. More recently, many machine-learning approaches, particularly text-mining techniques, have been implemented to predict stock return volatility, thus taking advantage of the availability of large amounts of unstructured data such as firm financial reports. Most existing studies develop simple but effective models to analyze text, such as dictionary-based matching algorithms that use a set of manually constructed keywords. However, the latent and deep semantics encoded in text are usually neglected. In this study, we build on recent progress in representation learning and propose a novel word-embedding method that incorporates external knowledge from a well-known finance-domain lexicon (the Loughran and McDonald (2011) word list), which helps us learn semantic relationships among words in firm reports for better volatility prediction. Using over 10 years of annual reports from Russell 3000 firms, we empirically show that, compared with cutting-edge benchmarks, our proposed method achieves significant improvement in terms of prediction error, for example, a 28.4% reduction on average. We also discuss the practical and methodological implications of our findings. Our financial-specific word-embedding program is available as open-source information so that researchers can use it to analyze financial reports and assess financial risks. Summary of Contribution: Predicting stock return volatility is the key to investment and risk management. Traditional volatility-forecasting methods primarily rely on stochastic models. More recently, many machine-learning, especially text-mining, techniques have been developed to predict stock return volatility given the availability of a large amount of unstructured data, such as firm annual reports. Most existing research develops simple but effective approaches, for example, manually constructing a set of keywords to analyze texts. However, the latent and deep semantics encoded in texts are usually ignored. In this research, we build on recent progress in representation learning and propose a novel word-embedding method that incorporates external knowledge from the finance-domain lexicon of Loughran and McDonald (2011), which helps us learn the semantic relationships among words in firm annual reports for better volatility prediction. In this study, we make the following contributions. First, methodologically, we are among the first to incorporate finance-specific lexicon into representation learning for stock volatility prediction. We propose a novel knowledge-driven text-embedding model that is trained on a large amount of unstructured textual data to learn high quality word embedding. Our proposed approach is effective in predicting stock return volatility, and the approach can potentially have broader applications. Second, substantively, we empirically show that the domain lexicon enhanced text representation learning can indeed significantly improve the performance, compared with bag-of-words models and generic word embedding for volatility prediction. Domain knowledge combined with text learning plays a critical enabling role in understanding financial reports. Third, our method adds on to existing literature on designing financial information systems by incorporating ontology knowledge, common-sense knowledge, and general prior knowledge.

Volatility Prediction using Financial Disclosures Sentiments with Word Embedding-based IR Models

Analyzing Firm Reports for Volatility Prediction: A Knowledge-Driven Text-Embedding Approach

Word Vector Models Approach to Text Regression of Financial Risk Prediction

Realised Volatility Forecasting: Machine Learning via Financial Word Embedding

A sentiment analysis approach to the prediction of market volatility

Degree of Irrationality: Sentiment and Implied Volatility Surface

SSCDV: Social media document embedding with sentiment and topics for financial market forecasting

Volatility forecasting using Deep Learning and sentiment analysis

On the prediction of stock price crash risk using textual sentiment of management statement

Empirical Research on the Prediction Effect of Volatility Model Based on the Perspective of Investor Sentiment Health and Market Liquidity

The Research on Financial Volatility with Sentiment Analysis

Improving financial distress prediction using textual sentiment of annual reports

How Does Textual Information Selection Influence Time Series Forecasting? A Cross-modal Perspective on Financial Volatility Prediction

Machine learning-based analysis of volatility quantitative investment strategies for American financial stocks

A Novel Text Mining Approach to Financial Time Series Forecasting

Stock Volatility Prediction Using Recurrent Neural Networks with Sentiment Analysis

Social media sentiment, model uncertainty, and volatility forecasting

Revisiting time-varying dynamics in stock market forecasting: A Multi-source sentiment analysis approach with large language model

Forecasting realised volatility from search volume and overnight sentiment: Evidence from China

Sentiment Analysis for Financial Markets

Web Semantic Analysis of Investor Sentiment, Short Trading, and Stock Market Volatility