A Foundation Model for Soccer

Ethan Baron,Daniel Hocevar,Zach Salehe
2024-07-18
Abstract:We propose a foundation model for soccer, which is able to predict subsequent actions in a soccer match from a given input sequence of actions. As a proof of concept, we train a transformer architecture on three seasons of data from a professional soccer league. We quantitatively and qualitatively compare the performance of this transformer architecture to two baseline models: a Markov model and a multi-layer perceptron. Additionally, we discuss potential applications of our model. We provide an open-source implementation of our methods at <a class="link-external link-https" href="https://github.com/danielhocevar/Foundation-Model-for-Soccer" rel="external noopener nofollow">this https URL</a>.
Machine Learning
What problem does this paper attempt to address?
The paper attempts to address the problem of training a foundational model based on historical action data to predict actions following a given input sequence in football matches. Specifically, the authors propose a method based on the Transformer architecture to predict subsequent actions in football matches and compare this method with two baseline models (Markov model and multilayer perceptron). In this way, the model can learn the embedding representations of football actions, which can be used for various downstream tasks such as simulating match progress, analyzing tactical decisions, and evaluating player performance. The main goal of the paper is to demonstrate the superiority of the Transformer architecture in predicting football action sequences and to explore its potential applications.