Prediction and Evaluation in College Hockey using the Bradley-Terry-Zermelo Model

John T. Whelan,Adam Wodon
DOI: https://doi.org/10.13164/ma.2019.09
2023-03-18
Abstract:We describe the application of the Bradley-Terry model to NCAA Division I Men's Ice Hockey. A Bayesian construction gives a joint posterior probability distribution for the log-strength parameters, given a set of game results and a choice of prior distribution. For several suitable choices of prior, it is straightforward to find the maximum a posteriori point (MAP) and a Hessian matrix, allowing a Gaussian approximation to be constructed. Posterior predictive probabilities can be estimated by 1) setting the log-strengths to their MAP values, 2) using the Gaussian approximation for analytical or Monte Carlo integration, or 3) applying importance sampling to re-weight the results of a Monte Carlo simulation. We define a method to evaluate any models which generate predicted probabilities for future outcomes, using the Bayes factor given the actual outcomes, and apply it to NCAA tournament results. Finally, we describe an on-line tool which currently estimates probabilities of future results using MAP evaluation and describe how it can be refined using the Gaussian approximation or importance sampling.
Applications
What problem does this paper attempt to address?
The paper primarily explores how to use the Bradley-Terry model to predict and evaluate the outcomes of NCAA Division 1 men's ice hockey games. Specifically, the paper attempts to address the following key issues: 1. **Model Application and Parameter Estimation**: - How to apply the Bradley-Terry model to NCAA Division 1 men's ice hockey games to assess the strength of each team. - How to estimate the log-strength parameters of each team by constructing a joint posterior probability distribution using Bayesian methods. - Explore the choice of different prior distributions and their impact on the maximum posterior estimation. 2. **Predicting Future Game Outcomes**: - Propose several methods to estimate the posterior predictive probabilities of future game outcomes, including using the maximum a posteriori point (MAP) for prediction, Gaussian approximation, and importance sampling techniques. 3. **Model Evaluation**: - Define a method based on Bayesian factors to evaluate the effectiveness of the predictive model, especially concerning the results of the NCAA tournament. - Evaluate the effectiveness of the model by comparing the predictive ability of different models against the actual tournament results. 4. **Online Tool Development**: - Describe an online tool that can predict future game outcomes based on the current MAP estimates and discuss how to further improve this tool. In summary, the goal of this paper is to improve the accuracy of predicting the outcomes of NCAA Division 1 men's ice hockey games by applying statistical models and to propose a systematic method to evaluate the effectiveness of these predictive models.