Abstract:Prediction and quantification of future volatility and returns play an important role in financial modeling, both in portfolio optimisation and risk management. Natural language processing today allows one to process news and social media comments to detect signals of investors' confidence. We have explored the relationship between sentiment extracted from financial news and tweets and FTSE100 movements. We investigated the strength of the correlation between sentiment measures on a given day and market volatility and returns observed the next day. We found that there is evidence of correlation between sentiment and stock market movements. Moreover, the sentiment captured from news headlines could be used as a signal to predict market returns; we also found that the same does not apply for volatility. However, for the sentiment found in Twitter comments we obtained, in a surprising finding, a correlation coefficient of –0.7 ( p < 0.05), which indicates a strong negative correlation between negative sentiment captured from the tweets on a given day and the volatility observed the next day. It is important to keep in mind that stock volatility rises greatly when the market collapses but not symmetrically so when it goes up (the so-called leverage effect). We developed an accurate classifier for the prediction of market volatility in response to the arrival of new information by deploying topic modeling, based on Latent Dirichlet Allocation, in order to extract feature vectors from a collection of tweets and financial news. The obtained features were used as additional input to the classifier. Thanks to the combination of sentiment and topic modeling even on modest (essentially personal) architecture our classifier achieved a directional prediction accuracy for volatility of 63%.

Market Sentiment Analysis Based on Image Processing With Put-Call Volatility Gap Surface

Degree of Irrationality: Sentiment and Implied Volatility Surface

Application of Machine Learning With News Sentiment in Stock Trading Strategies

Deep Learning from Implied Volatility Surfaces

Gated deep neural networks for implied volatility surfaces

A sentiment analysis approach to the prediction of market volatility

ALERTA-Net: A Temporal Distance-Aware Recurrent Networks for Stock Movement and Volatility Prediction

Social media sentiment, model uncertainty, and volatility forecasting

Market Trend Prediction using Sentiment Analysis: Lessons Learned and Paths Forward

Machine learning-based analysis of volatility quantitative investment strategies for American financial stocks

Volatility forecasting using Deep Learning and sentiment analysis

The Research on Financial Volatility with Sentiment Analysis

Financial Option Volatility Prediction Based on Machine Learning Algorithm

Fast generation of implied volatility surface: Optimize the traditional numerical analysis and machine learning

PrivySense: $\underline{Pri}$ce $\underline{V}$olatilit$\underline{y}$ based $\underline{Sen}$timent$\underline{s}$ $\underline{E}$stimation from Financial News using Machine Learning

Using Machine Learning and Alternative Data to Predict Movements in Market Risk

Web Semantic Analysis of Investor Sentiment, Short Trading, and Stock Market Volatility

The Application of Symbolic Regression on Identifying Implied Volatility Surface

Option Volatility Investment Strategy: The Combination of Neural Network and Classical Volatility Prediction Model

Hidden Markov model-based modeling and prediction for implied volatility surface1