Abstract:Prediction and quantification of future volatility and returns play an important role in financial modeling, both in portfolio optimisation and risk management. Natural language processing today allows one to process news and social media comments to detect signals of investors' confidence. We have explored the relationship between sentiment extracted from financial news and tweets and FTSE100 movements. We investigated the strength of the correlation between sentiment measures on a given day and market volatility and returns observed the next day. We found that there is evidence of correlation between sentiment and stock market movements. Moreover, the sentiment captured from news headlines could be used as a signal to predict market returns; we also found that the same does not apply for volatility. However, for the sentiment found in Twitter comments we obtained, in a surprising finding, a correlation coefficient of –0.7 ( p < 0.05), which indicates a strong negative correlation between negative sentiment captured from the tweets on a given day and the volatility observed the next day. It is important to keep in mind that stock volatility rises greatly when the market collapses but not symmetrically so when it goes up (the so-called leverage effect). We developed an accurate classifier for the prediction of market volatility in response to the arrival of new information by deploying topic modeling, based on Latent Dirichlet Allocation, in order to extract feature vectors from a collection of tweets and financial news. The obtained features were used as additional input to the classifier. Thanks to the combination of sentiment and topic modeling even on modest (essentially personal) architecture our classifier achieved a directional prediction accuracy for volatility of 63%.

Correlating Tweets with the Daily Return Reversal of the Us Stock Market

Correlating Twitter with the Stock Market Through Non-Gaussian SVAR

Predicting Return Reversal Through A Two-Stage Method

Identifying Key Drivers of Return Reversal with Dynamical Bayesian Factor Graph

Stock Movement and Volatility Prediction from Tweets, Macroeconomic Factors and Historical Prices

Revisiting time-varying dynamics in stock market forecasting: A Multi-source sentiment analysis approach with large language model

Stock Market Prediction and Performance Analysis Using Machine Learning Algorithms

Tales of Emotion and Stock in China: Volatility, Causality and Prediction

Sentiment Correlation Discovery From Social Media to Share Market

The Effects of Twitter Sentiment on Stock Price Returns

Twitter Sentiment Analysis: How To Hedge Your Bets In The Stock Markets

Analysis of Twitter Feeds for the Prediction of Stock Market Movement

Twitter mood predicts the stock market

Can Online Emotions Predict the Stock Market in China?

Sentiment Analysis Of Social Networks' Comments To Predict Stock Return

Sentiment Analysis of Twitter Data for Predicting Stock Market Movements

A sentiment analysis approach to the prediction of market volatility

Are Twitter Sentiments During COVID-19 Pandemic a Critical Determinant to Predict Stock Market Movements? A Machine Learning Approach

ALERTA-Net: A Temporal Distance-Aware Recurrent Networks for Stock Movement and Volatility Prediction

Twitter Sentiment Analysis and Influence on Stock Performance Using Transfer Entropy and EGARCH Methods