Abstract:Information extracted from social media streams has been leveraged to forecast the outcome of a large number of real-world events, from political elections to stock market fluctuations. An increasing amount of studies demonstrates how the analysis of social media conversations provides cheap access to the wisdom of the crowd. However, extents and contexts in which such forecasting power can be effectively leveraged are still unverified at least in a systematic way. It is also unclear how social-media-based predictions compare to those based on alternative information sources. To address these issues, here we develop a machine learning framework that leverages social media streams to automatically identify and predict the outcomes of soccer matches. We focus in particular on matches in which at least one of the possible outcomes is deemed as highly unlikely by professional bookmakers. We argue that sport events offer a systematic approach for testing the predictive power of social media, and allow to compare such power against the rigorous baselines set by external sources. Despite such strict baselines, our framework yields above 8% marginal profit when used to inform simple betting strategies. The system is based on real-time sentiment analysis and exploits data collected immediately before the games, allowing for informed bets. We discuss the rationale behind our approach, describe the learning framework, its prediction performance and the return it provides as compared to a set of betting strategies. To test our framework we use both historical Twitter data from the 2014 FIFA World Cup games, and real-time Twitter data collected by monitoring the conversations about all soccer matches of four major European tournaments (FA Premier League, Serie A, La Liga, and Bundesliga), and the 2014 UEFA Champions League, during the period between Oct. 25th 2014 and Nov. 26th 2014.

Forecasting of Events by Tweet Data Mining

Mining Concurrent Topical Activity in Microblog Streams

Embedding and Predicting the Event at Early Stage

Predicting the Future With Social Media

Event Early Embedding: Predicting Event Volume Dynamics at Early Stage

Event Popularity Prediction Using Influential Hashtags from Social Media (Extended Abstract)

A Real-Time Method to Predict Social Media Popularity

Prediction and Characterization of High-Activity Events in Social Media Triggered by Real-World News

Twitter Mining for Discovery, Prediction and Causality: Applications and Methodologies

Using Twitter to predict football outcomes

On predictability of rare events leveraging social media: a machine learning perspective

A big data analysis of Twitter data during premier league matches: do tweets contain information valuable for in-play forecasting of goals in football?

Event detection in Twitter: A keyword volume approach

Anticipating Activity in Social Media Spikes

Investigating the Potential of Aggregated Tweets as Surrogate Data for Forecasting Civil Protests

Pachinko Prediction: A Bayesian method for event prediction from social media data

Mining Multi-aspect Reflection of News Events in Twitter: Discovery, Linking and Presentation

Organized Event Participant Prediction Enhanced by Social Media Retweeting Data

A Survey of Prediction Using Social Media

The early bird catches the term: combining twitter and news data for event detection and situational awareness

Retweeting Behavior Prediction Using Probabilistic Matrix Factorization