Abstract:Predicting stock return volatility is the key to investment and risk management. Traditional volatility-forecasting methods primarily rely on stochastic models. More recently, many machine-learning approaches, particularly text-mining techniques, have been implemented to predict stock return volatility, thus taking advantage of the availability of large amounts of unstructured data such as firm financial reports. Most existing studies develop simple but effective models to analyze text, such as dictionary-based matching algorithms that use a set of manually constructed keywords. However, the latent and deep semantics encoded in text are usually neglected. In this study, we build on recent progress in representation learning and propose a novel word-embedding method that incorporates external knowledge from a well-known finance-domain lexicon (the Loughran and McDonald (2011) word list), which helps us learn semantic relationships among words in firm reports for better volatility prediction. Using over 10 years of annual reports from Russell 3000 firms, we empirically show that, compared with cutting-edge benchmarks, our proposed method achieves significant improvement in terms of prediction error, for example, a 28.4% reduction on average. We also discuss the practical and methodological implications of our findings. Our financial-specific word-embedding program is available as open-source information so that researchers can use it to analyze financial reports and assess financial risks. Summary of Contribution: Predicting stock return volatility is the key to investment and risk management. Traditional volatility-forecasting methods primarily rely on stochastic models. More recently, many machine-learning, especially text-mining, techniques have been developed to predict stock return volatility given the availability of a large amount of unstructured data, such as firm annual reports. Most existing research develops simple but effective approaches, for example, manually constructing a set of keywords to analyze texts. However, the latent and deep semantics encoded in texts are usually ignored. In this research, we build on recent progress in representation learning and propose a novel word-embedding method that incorporates external knowledge from the finance-domain lexicon of Loughran and McDonald (2011), which helps us learn the semantic relationships among words in firm annual reports for better volatility prediction. In this study, we make the following contributions. First, methodologically, we are among the first to incorporate finance-specific lexicon into representation learning for stock volatility prediction. We propose a novel knowledge-driven text-embedding model that is trained on a large amount of unstructured textual data to learn high quality word embedding. Our proposed approach is effective in predicting stock return volatility, and the approach can potentially have broader applications. Second, substantively, we empirically show that the domain lexicon enhanced text representation learning can indeed significantly improve the performance, compared with bag-of-words models and generic word embedding for volatility prediction. Domain knowledge combined with text learning plays a critical enabling role in understanding financial reports. Third, our method adds on to existing literature on designing financial information systems by incorporating ontology knowledge, common-sense knowledge, and general prior knowledge.

Semantic Encoding Algorithm for Classification and Retrieval of Aviation Safety Reports

Hazard Analysis for Massive Civil Aviation Safety Oversight Reports Using Text Classification and Topic Modeling

Aviation-BERT-NER: Named Entity Recognition for Aviation Safety Reports

A method for identifying relevant topics of pilot simulator training based on clustering of flight safety reports

From Text to Safety: A Novel Framework for Mining Unsafe Aviation Events Using Advanced Neural Network and Feature Network

Natural Language Processing of Aviation Occurrence Reports for Safety Management

A Scoping Literature Review of Natural Language Processing Application to Safety Occurrence Reports

Topic Modeling Analysis of Aviation Accident Reports: A Comparative Study between LDA and NMF Models

Learning Visual-Semantic Embeddings for Reporting Abnormal Findings on Chest X-rays

SMAAMA: A Named Entity Alignment Method Based on Siamese Network Character Feature and Multi-Attribute Importance Feature for Chinese Civil Aviation

Can Embeddings Adequately Represent Medical Terminology? New Large-Scale Medical Term Similarity Datasets Have the Answer!

Analysis of Railway Accidents' Narratives Using Deep Learning

Autoencoding Features for Aviation Machine Learning Problems

Translating medical image to radiological report: Adaptive multilevel multi-attention approach

Semantic Similarity Measure of Natural Language Text through Machine Learning and a Keyword-Aware Cross-Encoder-Ranking Summarizer -- A Case Study Using UCGIS GIS&T Body of Knowledge

Toward Safer Flight Training: The Data-Driven Modeling of Accident Risk Network Using Text Mining Based on Deep Learning

Analyzing Firm Reports for Volatility Prediction: A Knowledge-Driven Text-Embedding Approach

A Comparative Study of Text Embedding Models for Semantic Text Similarity in Bug Reports

A Machine Learning Approach with Human-AI Collaboration for Automated Classification of Patient Safety Event Reports: Algorithm Development and Validation Study

Intelligent Word Embeddings of Free-Text Radiology Reports

An Information Integration Technology for Safety Assessment on Civil Airborne System