Statistical association football predictions
Statistical Football prediction is a method used in sports betting, to predict the outcome of football matches by means of statistical tools. The goal of statistical match prediction is to outperform the predictions of bookmakers[dubious ], who use them to set odds on the outcome of football matches.
The most widely used statistical approach to prediction is ranking. Football ranking systems assign a rank to each team based on their past game results, so that the highest rank is assigned to the strongest team. The outcome of the match can be predicted by comparing the opponents’ ranks. Several different football ranking systems exist, for example some widely known are the FIFA World Rankings or the World Football Elo Ratings.
There are three main drawbacks to football match predictions that are based on ranking systems:
- Ranks assigned to the teams do not differentiate between their attacking and defensive strengths.
- Ranks are accumulated averages which do not account for skill changes in football teams.
- The main goal of a ranking system is not to predict the results of football games, but to sort the teams according to their average strength.
Another approach to football prediction is known as rating systems.While ranking refers only to team order, rating systems assign to each team a continuously scaled strength indicator. Moreover, rating can be assigned not only to a team but to its attacking and defensive strengths, home field advantage or even to the skills of each team player (according to Stern ).
An example of a football rating system is the pi-rating system which provides relative measures of superiority between football teams (also applicable to other sports), and which is said to outperform considerably (in terms of profitability against the betting market) the widely accepted Elo rating system. Modified versions of the pi-ratings ranked 1st and 2nd in the international competition Machine Learning for Soccer hosted by the Machine Learning journal in 2017/18.
Publications about statistical models for football predictions started appearing from the 90s, but the first model was proposed much earlier by Moroney, who published his first statistical analysis of soccer match results in 1956. According to his analysis, both Poisson distribution and negative binomial distribution provided an adequate fit to results of football games. The series of ball passing between players during football matches was successfully analyzed using negative binomial distribution by Reep and Benjamin  in 1968. They improved this method in 1971, and in 1974 Hill  indicated that soccer game results are to some degree predictable and not simply a matter of chance.
The first model predicting outcomes of football matches between teams with different skills was proposed by Michael Maher  in 1982. According to his model, the goals, which the opponents score during the game, are drawn from the Poisson distribution. The model parameters are defined by the difference between attacking and defensive skills, adjusted by the home field advantage factor. The methods for modeling the home field advantage factor were summarized in an article by Caurneya and Carron  in 1992. Time-dependency of team strengths was analyzed by Knorr-Held  in 1999. He used recursive Bayesian estimation to rate football teams: this method was more realistic in comparison to soccer prediction based on common average statistics.
Football Prediction Methods
All the prediction methods can be categorized according to tournament type, time-dependence and regression algorithm. Football prediction methods vary between Round-robin tournament and Knockout competition. The methods for Knockout competition are summarized in an article by Diego Kuonen.
The table below summarizes the methods related to Round-robin tournament.
# Code Prediction Method Regression Algorithm Time Dependence Performance 1. TILS Time Independent Least Squares Rating Linear Least Squares Regression No Poor 2. TIPR Time Independent Poisson Regression Maximum Likelihood No Medium 3. TISR Time Independent Skellam Regression Maximum Likelihood No Medium 4. TDPR Time-Dependent Poisson Regression Maximum Likelihood Time dumping factor High 5. TDMC Time-Dependent Markov Chain Monte-Carlo Markov Chain model High
Time Independent Least Squares Rating
This method intends to assign to each team in the tournament a continuously scaled rating value, so that the strongest team will have the highest rating. The method is based on the assumption that the rating assigned to the rival teams is proportional to the outcome of each match.
Assume that the teams A, B, C and D are playing in a tournament and the match outcomes are as follows:
Match # Home Team Score Away Team Y 1 A 3 - 1 B 2 C 2 - 1 D 3 D 1 - 4 B 4 A 3 - 1 D 5 B 2 - 0 C
Though the ratings , , and of teams A, B, C and D respectively are unknown, it may be assumed that the outcome of match #1 is proportional to the difference between the ranks of teams A and B: . In this way, corresponds to the score difference and is the noise observation. The same assumption can be made for all the matches in the tournament:
By introducing a selection matrix X, the equations above can be rewritten in a compact form:
Entries of the selection matrix can be either 1, 0 or -1, with 1 corresponding to home teams and -1 to away teams:
If the matrix has full rank, the algebraic solution of the system may be found via the Least squares method:
If not, one can use the Moore–Penrose pseudoinverse to get:
The final rating parameters are In this case, the strongest team has the highest rating. The advantage of this rating method compared to the standard ranking systems is that the numbers are continuously scaled, defining the precise difference between the teams’ strengths.
Time-Independent Poisson Regression
According to this model (Maher ), if and are the goals scored in the match where team i plays against team j, then:
and are independent random variables with means and . Thus, the joint probability of the home team scoring x goals and the away team scoring y goals is a product of the two independent probabilities:
while the generalized log-linear model for and according to Kuonen  and Lee  is defined as: and , where refers to attacking and defensive strengths and to home field advantage respectively. and are correction factors which represent the means of goals scored during the season by home and away teams.
Assuming that C signifies the number of teams participating in a season and N stands for the number of matches played until now, the team strengths can be estimated by minimizing the negative log-likelihood function with respect to and :
Given that and are known, the team attacking and defensive strengths and home ground advantage that minimize the negative log-likelihood can be estimated by Expectation Maximization:
Improvements for this model were suggested by Mark Dixon (statistician) and Stuart Coles. They invented a correlation factor for low scores 0-0, 1-0, 0-1 and 1-1, where the independent Poisson model doesn't hold. Dimitris Karlis and Ioannis Ntzoufras  built a Time-Independent Skellam distribution model. Unlike the Poisson model that fits the distribution of scores, the Skellam model fits the difference between home and away scores.
Time-Dependent Markov Chain Monte Carlo
On the one hand, statistical models require a large number of observations to make an accurate estimation of its parameters. And when there are not enough observations available during a season (as is usually the situation), working with average statistics makes sense. On the other hand, it is well known that team skills change during the season, making model parameters time-dependent. Mark Dixon (statistician) and Coles  tried to solve this trade-off by assigning a larger weight to the latest match results. Rue and Salvesen  introduced a novel time-dependent rating method using the Markov Chain model.
They suggested modifying the generalized linear model above for and :
given that corresponds to the strength difference between teams i and j. The parameter then represents the psychological effects caused by underestimation of the opposing teams’ strength.
According to the model, the attacking strength of team A can be described by the standard equations of Brownian motion, , for time :
where and refer to the loss of memory rate and to the prior attack variance respectively.
This model is based on the assumption that:
Assuming that three teams A, B and C are playing in the tournament and the matches are played in the following order: : A-B; : A-C; : B-C, the joint probability density can be expressed as:
Since analytical estimation of the parameters is difficult in this case, the Monte Carlo method is applied to estimate the parameters of the model.
Usage for other sports
Models used for association football can be used for other sports with the same counting of goals (points), i.e. ice hockey, water polo, field hockey, floorball, etc. Marek, Ťoupal and Šedivá (2014) build on research of Maher (1982), Dixon and Coles (1997), and others who used models for association football. They introduced four models for ice hockey:
- Double Poisson distribution model (same as Maher (1982)),
- Bivariate Poisson distribution model that uses generalisation of bivariate Poisson distribution that allows negative correlation between random variables (this distribution was introduced in Famoye (2010)).
- Diagonal inflated versions of previous two models (inspired by Dixon and Coles (1997)) where probabilities of ties 0:0, 1:1, 2:2, 3:3, 4:4, and 5:5 are modelled with additional parameters.
Older information (results) are discounted in the process of estimation in all four models. Models are demonstrated on the highest-level ice hockey league in the Czech Republic – Czech Extraliga between seasons 1999/2000 and 2011/2012. Results are successfully used on fictive betting against bookmakers.
- Stern Hal. (1995) Who's Number 1 in College Football?...And How Might We Decide? Chance, Summer, 7-14.
- Constantinou, Anthony; Fenton, N. (2013). "Determining the level of ability of football teams by dynamic ratings based on the relative discrepancies in scores between adversaries". Journal of Quantitative Analysis in Sports. 9 (1): 37–50. doi:10.1515/jqas-2012-0036. Retrieved 25 March 2014.
- Hubacek, Ondrej; et al. (2018). "Learning to predict soccer results from relational data with gradient boosted trees". Machine Learning.: 1–19. doi:10.1007/s10994-018-5703-7. Retrieved 9 May 2018.
- Constantinou, Anthony (2018). "Dolores: a model the predicts football match outcomes from all over the world". Machine Learning.: 1–27. doi:10.1007/s10994-018-5703-7. Retrieved 9 May 2018.
- Moroney M. J. (1956) Facts from figures. 3rd edition, Penguin, London.
- Reep C. Benjamin B. (1968) Skill and chance in association football. Journal of the Royal Statistical Society, Series A, 131, 581-585.
- Hill I.D. (1974), Association football and statistical inference. Applied statistics, 23, 203-208.
- Maher M.J. (1982), Modelling Association Football scores. Statistica Neerlandica, 36, 109-118
- Caurneya K.S. and Carron A.V. (1992) The home advantage in sports competitions: a literature review. Journal of Sport and Exercise Physiology, 14, 13-27.
- Knorr-Held, Leonhard (1997) Dynamic Rating of Sports Teams. (REVISED 1999). Collaborative Research Center 386, Discussion Paper 98
- Diego Kuonen (1996) Statistical Models for Knock-out Soccer Tournaments
- Lee A. J. (1997) Modeling scores in Premier League: is Manchester United really the best. Chance, 10, 15-19
- Mark J. Dixon and Coles S.G. (1997) Modeling Association Football Scores and Inefficiencies in the Football Betting Market, Applied Statistics, Volume 46, Issue 2, 265-280
- Dimitris Karlis and Ioannis Ntzoufras (2007) Bayesian modelling of football outcomes: Using the Skellam’s distribution for the goal difference
- Rue H. and Salvesen Ø. (1999) Predicting and retrospective analysis of soccer matches in a league. Technical Report. Norwegian University of Science and Technology, Trondheim.
- Marek, Patrice; Šedivá, Blanka; Ťoupal, Tomáš (2014). "Modeling and prediction of ice hockey match results". Journal of Quantitative Analysis in Sports. 10: 357–365. doi:10.1515/jqas-2013-0129. ISSN 1559-0410 – via Research Gate.
- Famoye, F (2010). "A new bivariate generalised Poisson distribution". Statistica Neerlandica. 64: 112–124.