Abstract:Prediction and quantification of future volatility and returns play an important role in financial modeling, both in portfolio optimisation and risk management. Natural language processing today allows one to process news and social media comments to detect signals of investors' confidence. We have explored the relationship between sentiment extracted from financial news and tweets and FTSE100 movements. We investigated the strength of the correlation between sentiment measures on a given day and market volatility and returns observed the next day. We found that there is evidence of correlation between sentiment and stock market movements. Moreover, the sentiment captured from news headlines could be used as a signal to predict market returns; we also found that the same does not apply for volatility. However, for the sentiment found in Twitter comments we obtained, in a surprising finding, a correlation coefficient of –0.7 ( p < 0.05), which indicates a strong negative correlation between negative sentiment captured from the tweets on a given day and the volatility observed the next day. It is important to keep in mind that stock volatility rises greatly when the market collapses but not symmetrically so when it goes up (the so-called leverage effect). We developed an accurate classifier for the prediction of market volatility in response to the arrival of new information by deploying topic modeling, based on Latent Dirichlet Allocation, in order to extract feature vectors from a collection of tweets and financial news. The obtained features were used as additional input to the classifier. Thanks to the combination of sentiment and topic modeling even on modest (essentially personal) architecture our classifier achieved a directional prediction accuracy for volatility of 63%.

Measuring Market Volatility Connectedness to Media Sentiment

The volatility connectedness of US industries: The role of investor sentiment

The Relationship Between Social Media Data and Stock Market Volatility

The impact of sentiment and attention measures on stock market volatility

Sentimental showdown: News media vs. social media in stock markets

A sentiment analysis approach to the prediction of market volatility

Sentiment matters: the effect of news-media on spillovers among cryptocurrency returns

Do social media sentiments drive cryptocurrency intraday price volatility? New evidence from asymmetric TVP-VAR frequency connectedness measures

Asymmetric connectedness of stocks: How does bad and good volatility spill over the U.S. stock market?

Web Semantic Analysis of Investor Sentiment, Short Trading, and Stock Market Volatility

Exploiting News Analytics for Volatility Forecasting

Sentiment correlation in financial news networks and associated market movements

Social media sentiment and the stock market

Who are the receivers and transmitters of volatility spillovers: oil, clean energy, and green and non-green cryptocurrency markets

On the Dynamic Connectedness of the Stock, Oil, Clean Energy, and Technology Markets

Quantile connectedness between sentiment and financial markets: Evidence from the S&P 500 twitter sentiment index

The Measurement Method of Investor Sentiment and Its Relationship with Stock Market

News sentiment to market impact and its feedback effect

Sentiment spillover and price dynamics: Information flow in the cryptocurrency and stock market

Connectedness in implied higher-order moments of precious metals and energy markets

Dynamic sentiment spillovers among crude oil, gold, and Bitcoin markets: Evidence from time and frequency domain analyses