
<p>Fantasy Premier League is a cruel game like no other. Every week millions of people set their teams with high hopes and expectations only for most to end up feeling they have seemingly been slapped silly by the FPL Gods.</p>



<p>While it seems totally intuitive that unpredictable random events impact FPL, how can you know how it&#8217;s affected you relative to others &#8211; almost everyone believes they have been robbed. Doesn&#8217;t it all just even out in the end anyway?</p>



<p>Over the course of the year the FPL Review <a href="http://www.fplreview.com/season-review">Season Review</a> tool has been developed to determine how skilled a FPL Manager is and the level of distortion caused by random events (ie. luck/over-performance). This post will give a quick summary of what&#8217;s going on behind the scenes before running through an extensive analysis of the data and some of the valuable trends it reveals</p>



<h4 class="wp-block-heading">Contents</h4>



<ul>
<li><a href="#jump1">The FPL Review Model</a></li>
<li><a href="#jump2">Analysing the Data</a></li>
<li><a href="#jump3">Are the Veterans Any Good?</a></li>
<li><a href="#jump4">Stress Test: Is &#8216;Luck&#8217; Really Luck? </a></li>
<li><a href="#jump5">What is the best Future FPL Performance Indicator? </a></li>
<li><a href="#jump6">Summary &amp; Conclusion</a></li>
</ul>



<div class="wp-block-image">
<figure></figure>
<figure class="aligncenter"><img loading="lazy" decoding="async" class="alignnone wp-image-7080" src="https://fplreview.com/wp-content/uploads/image-14.png" alt="FPL Skill vs Luck" width="759" height="601" />
<figcaption>Example Output from Season Review Tool</figcaption>
</figure>
</div>



<h2 class="wp-block-heading" id="jump1">The FPL Review Model</h2>



<p>The<a href="http://www.fplreview.com/season-review"> Season Review</a> Tool measures FPL performance in two ways &#8211; how well your team is expected to perform based on pre-match bookmaker odds and how good the situations they found themselves in were based on post-match xG data. Both have value in determining expected performance levels.</p>



<ul>
<li>Odds Perspective: Implied probabilities can be deduced from bookmaker odds. Gambling markets are notoriously brilliant forecasters and it&#8217;s a non-biased way of determining a fair pre-match expectation. For example, choosing an in-form Salah at home against poor opposition would have high probability of returns and can be considered a good decision &#8211; it is unlucky if he performs way below expectations in that match.</li>
<li>xG Perspective: This is effectively a clever version of hindsight and is more intuitive for managers to understand. If a player who is normally a good finisher misses a chance that is scored 90% of the time &#8211; you really are unlucky especially if our mini-league rival has players scoring screamers.</li>
<li>The Season Review Tool uses both perspectives when determining luck (both have justifiable arguments) &#8211; the &#8216;Fair Points&#8217; score is simply (Odds Points + xG Points)/2. Luck is equal to the deviation of FPL Points from the &#8216;Fair Points&#8217; expectation.</li>
</ul>



<p>Of course, it is not as simple as just this, the data must be handled very carefully to deal with all of the things that impact FPL Points (Cards, OGs, Penalties, Bonus, Saves etc.) and a good understanding of bookmaker margins and markets is required. Going into detail on this would require a post of it&#8217;s own (and a pretty dull one at that), so I&#8217;ll jump right into the analysis.</p>
<p>&nbsp;</p>



<h2 class="wp-block-heading" id="jump2">Analysing the Data</h2>



<p>Of course, the theory and data treatment in the model could be totally wayward, so below I&#8217;m going to put a few significant samples through different key tests. The samples collected are as follows:</p>



<ul>
<li>100 random teams from the Top 1k</li>
<li>100 random teams from 1k to 10k Rank</li>
<li>100 random teams from 10k to 100k Rank</li>
<li>100 random teams from 100k to 1M Rank</li>
<li>100 random teams from 1M to 6M Rank</li>
<li><a href="https://www.reddit.com/r/FantasyPL/comments/96aufs/a_list_of_former_champions_veterans_and_pundits/">36 veterans outlined by a Reddit user at the start of the season</a></li>
<li><a href="https://www.reddit.com/r/FantasyPL/comments/96aufs/a_list_of_former_champions_veterans_and_pundits/">13 past winners from the same post</a></li>
<li>4000 random teams from Team ID 1 to 5,000,000</li>
</ul>



<p>Picking these specific samples allows for some very interesting tests to be performed which shine a light on FPL success and failure. The first test below looks at how much luck teams at various ranking levels received this season (up to the end of GW36). It&#8217;s quite clear from the data that teams at ultra-high ranks get more than their fair share of luck (typically ~100pts better off than the mean) &#8211; but is it all really just luck?</p>
<p>&nbsp;</p>



<div class="wp-block-image">
<figure class="aligncenter"><img loading="lazy" decoding="async" class="alignnone wp-image-7058" src="https://fplreview.com/wp-content/uploads/image-6.png" alt="Fantasy Premier League Luck and Skill relationship - top 10k" width="562" height="341" />
<figcaption>Relationship between Luck and FPL Rank</figcaption>
</figure>
</div>



<p>The &#8216;Fair Points&#8217; score is the indicator of skill using the Season Review Tool. Looking at the &#8216;Fair Points&#8217; score of the same team samples as above creates an idea of how skilled managers are based on rank typically. Thankfully this produces a more hopeful note, skill really does matter but the rankings are quite distorted based on luck and the distance of a 100k team to a 1k team is not as large as FPL Points suggest at first.</p>



<p>An extreme example of the distortion caused by luck is that there are a few teams in the Top 1k who have had lower &#8216;Fair Points&#8217; expectations than some teams ranked outisde the Top 100k. For many managers that is the difference between a tremendous season and a non-notable one, but it&#8217;s really not common things go that badly.</p>
<p>&nbsp;</p>



<div class="wp-block-image">
<figure class="aligncenter"><img loading="lazy" decoding="async" class="alignnone wp-image-7059" src="https://fplreview.com/wp-content/uploads/image-7.png" alt="Expected points Luck vs Skill in Fantasy Football" width="562" height="341" />
<figcaption>Relationship between Fair Points expectation and rank<br /><br /></figcaption>
</figure>
</div>



<h2 class="wp-block-heading" id="jump3">Are the Veterans Any Good?</h2>



<p>Now some obvious questions arise, for example maybe it is not luck that is being measured. Perhaps the best managers are simply making better decisions and the <a href="http://www.fplreview.com/season-review">Season Review</a> model is mistakenly picking it up as luck.</p>



<p>To analyse this I had to find a non-biased way of determining who were considered the experts at the start of the season (it would be easy for anyone to cherry pick managers that in hindsight suit their own agenda). Thankfully a <a href="https://www.reddit.com/r/FantasyPL/comments/96aufs/a_list_of_former_champions_veterans_and_pundits/">post on Reddit</a> at the start of the season did this for me, listing out 13 past Winners and 36 Veterans, and all that was required was to collect the FPL Team IDs.</p>



<p>Looking at the data both Veterans and past Winners experienced totally normal luck with a mean score extremely close to 0 Points- which is in line what the typically random manager would expect. Whereas the Top 1k experienced a mean of 126 Points of luck and ranks 1k to 10k averaged 89 Points more than expected. This strongly indicates that the Top 10k while being generally highly skilled also have just had things going their way more than most.</p>
<p>&nbsp;</p>



<div class="wp-block-image">
<figure class="aligncenter"><img loading="lazy" decoding="async" class="alignnone wp-image-7060" src="https://fplreview.com/wp-content/uploads/image-8.png" alt="Are fpl managers luck - the veterans" width="567" height="344" />
<figcaption>Comparison of Past Winners &amp; Veterans Luck against the Top 10k</figcaption>
</figure>
</div>



<p>On top of this, it can be verified whether or not the Veterans and past Winners are worth listening to. Quite clearly the Veterans are very skilled, with &#8216;Fair Points&#8217; expectation at a similar level to the Top 10k (in fact only 1 of the 36 has not been performing at least reasonably well). Past Winners interestingly are less reliable, some look to have been making great decisions whereas others look about as good as a typical active manager (perhaps due to inactivity on their part?).</p>
<p>&nbsp;</p>



<div class="wp-block-image">
<figure class="aligncenter"><img loading="lazy" decoding="async" class="alignnone wp-image-7061" src="https://fplreview.com/wp-content/uploads/image-9.png" alt="FPL is a game of luck " width="572" height="347" />
<figcaption>Comparison of past Winners &amp; Veterans Fair Points against the Top 10k</figcaption>
</figure>
</div>



<p></p>
<p>The table below summarises all the data taken from the Samples. The &#8216;Fair Points&#8217; model has been finding that the average team basically experiences no luck but as you go up the rankings teams typically get more and more of a rub of the green.</p>
<p>

</p>
<div class="wp-block-image">
<figure class="aligncenter"><img loading="lazy" decoding="async" class="alignnone wp-image-7105" src="https://fplreview.com/wp-content/uploads/image-16.png" alt="Summary - Luck vs Skill in FPL" width="489" height="234" />
<figcaption>Analysis Summary</figcaption>
</figure>
</div>
<p></p>



<h2 class="wp-block-heading" id="jump4">Stress Test: Is &#8216;Luck&#8217; Really Luck?</h2>



<p>The output of this tool is labelled luck &#8211; others may call it over-performance (which is also an accurate description) or nonsense (no harm in being sceptical). Some people have, justifiably, wondered whether the tool is just measuring a managers ability to &#8216;beat the odds&#8217;.</p>



<p>It is a fair question and while theoretically, the model seems sound this needs to be investigated. To do so I created a simple test using the random 4,000 team sample</p>



<ul>
<li>Used the sample of 4,000 random teams</li>
<li>Ran them through the FPL Review analysis script</li>
<li>Determined the Teams &#8216;Luck&#8217; in GWs 1-18 and GWs 19-35</li>
<li>If &#8216;Luck&#8217; is actually the &#8216;Beat the Bookies&#8217; skill or similar, it&#8217;s past measure should have a correlation to its future results. ie. people are doing something to cause a positive/negative luck result</li>
</ul>
<p>&nbsp;</p>



<div class="wp-block-image">
<figure class="aligncenter"><img loading="lazy" decoding="async" class="alignnone wp-image-6715" src="https://fplreview.com/wp-content/uploads/Luck-pts-future.png" alt="Past luck and future luck" width="572" height="343" />
<figcaption>Analysis of the relationship of past luck against future luck (N=4000)</figcaption>
</figure>
</div>



<p>The result quite clearly shows no meaningful relationship between past luck measure and future luck measure. Past &#8216;luck&#8217; is not an indicator of future &#8216;luck&#8217; (which will be a relief to many). When this is compounded on top of the fact that Veterans and past Winners don&#8217;t seem to have an ability to gain anything out of this it would very strongly suggest the model is able to determine an indication of a managers skill and luck levels.</p>
<p>&nbsp;</p>



<h2 class="wp-block-heading" id="jump5">What is the best Future FPL Performance Indicator?</h2>



<p>With all this data at hand, there is also the capability to see what the best indicator of a managers FPL performance is. This test is similar to the analysis of luck above.</p>



<ul>
<li>Determined the Teams &#8216;Odds Points&#8217;, &#8216;xG Points&#8217; &amp; FPL Points in GWs 1-18</li>
<li>Compared the result against the same teams FPL Points in GWs 19-35</li>
<li>Check whether past (GW1-18) &#8216;Odds Points&#8217;, &#8216;xG Points&#8217; or FPL Points have the highest correlation to future (GW19-35) FPL Points</li>
</ul>



<p>The first test compares Past FPL Points to Future FPL Points. There is a definite correlation which shouldn&#8217;t be a huge surprise. A manager who performs well in the first half of the season is more likely to do well in the second half &#8211; but is there a better way to predict future performance?</p>
<p>&nbsp;</p>



<div class="wp-block-image">
<figure class="aligncenter"><img loading="lazy" decoding="async" class="alignnone wp-image-6714" src="https://fplreview.com/wp-content/uploads/FPL-pts-future.png" alt="Past vs future performance indicators" width="583" height="350" />
<figcaption>Relationship between past FPL pts [GW1-18] &amp; future FPL pts [GW19-35] (N=4000)</figcaption>
</figure>
</div>



<p>The second test shows that there is. Past xG Points determined by the <a href="http://www.fplreview.com/season-review">Season Review Tool</a> more strongly correlate to Future FPL Points. This is because it trims away at a layer of random luck that distorts how well a manager is performing. But this is not the best indicator of future performance&#8230;</p>
<p>&nbsp;</p>



<div class="wp-block-image">
<figure class="aligncenter"><img loading="lazy" decoding="async" class="alignnone wp-image-6713" src="https://fplreview.com/wp-content/uploads/xG-pts-future.png" alt="Future FPL points correlations" width="580" height="348" />
<figcaption><br />Relationship between post xG pts (from the FPL Review model) [GW1-18] &amp; future FPL pts [GW19-35] (N=4000)</figcaption>
</figure>
</div>



<p>Past Odds Points are the strongest predictor of Future FPL Points. This should not be a surprise, the bookmakers make a living from determining probabilities. Past Odds Points seem to be the best indicator of FPL Skill level that currently exists.</p>



<p>The reason this works so well is because it totally cleans a past managers FPL Points of luck and does not work on hindsight, which xG data does to an extent. This is an extraordinarily strong argument for referring to Odds (in an intelligent way) when making decisions.</p>
<p>&nbsp;</p>



<div class="wp-block-image">
<figure class="aligncenter"><img loading="lazy" decoding="async" class="alignnone wp-image-6712" src="https://fplreview.com/wp-content/uploads/Odds-pts-future.png" alt="Past FPL Odds" width="583" height="350" />
<figcaption><br />Relationship between past Odds pts (from the FPL Review model) [GW1-18] &amp; future FPL pts [GW19-35] (N=4000)</figcaption>
</figure>
</div>



<p>It&#8217;s quite clear from these plots why data based managers are so successful. Odds &amp; xG data gives a big edge to what really is a game of numbers. Both sources of information are useful so while Odds data seems to be a better predictor it would be a mistake to write off well-treated xG data.</p>
<p>&nbsp;</p>



<h2 class="wp-block-heading" id="jump6">Summary &amp; Conclusion</h2>



<p>So what is the point of all this data? Well using this tool there is now the capability to pin-point periods during the season that worked or didn&#8217;t work based on more fundamental data than the resultant FPL Points, on top of that there are many other powerful benefits:</p>



<ul>
<li>Veterans can be verified quite quickly using this tool &#8211; what appears to be an off season, may not be as off as it first appears</li>
<li>It appears data-based models and in particular Odds based models work extremely well (may be worth trying out the<a href="http://www.fplreview.com/team-planner"> FPL Review Team Planner</a>, which is built from Odds and xG data if this interests you)</li>
<li>You can pinpoint which strategies work/don&#8217;t work, rather than leaving a great strategy behind during a rough patch</li>
<li>You can now call out that person who lucked their way ahead of you in your mini-league. Or just smugly know it quietly.</li>
<li>If you were unlucky you can have hope next season things will turn around (the Liverpool fan lifestyle)</li>
<li>If you are &#8216;lucky&#8217; you can call this nonsense and cling onto your high overall rank</li>
</ul>



<p>FPL can be considered similar to Poker. Skill is undoubtedly the biggest component but there can be no doubt a season can be derailed by random events. Based on the data Top 10k is about as high as can be reasonably be targeted if you are very skilled without hoping for things to go your way at least somewhat more than everyone else. Massive success such as coming Top 1k requires both significant skill and luck.</p>



<p>If you wish to give yourself the best chance for 2019/2020 or just wish to check out the tools go to <a href="http://www.fplreview.com">www.fplreview.com</a>.</p>
<p>&nbsp;</p>
<h3></h3>
<h3>Become a Fantasy Football Hub member for just £1</h3>
<p>You can join hundreds of fantasy managers and access this and <a href="https://cms.fantasyfootballhub.co.uk/membership-registration/">all our membership content</a> for just £1. Simply enter coupon code: <strong>REVIEW </strong><a href="https://cms.fantasyfootballhub.co.uk/membership-registration/">at checkout.</a> You&#8217;ll get:</p>
<ul>
<li>How To Win at FPL guides.</li>
<li>Player comparison tool.</li>
<li>OPTA <a href="https://cms.fantasyfootballhub.co.uk/opta/" data-internallinksmanager029f6b8e52c="1" title="FPL Stats by OPTA - Player and Team Stats">Stats</a> tool.</li>
<li>Team reveals form top-ranked players.</li>
<li>Rate my team tool.</li>
<li>Advanced fixture ticker.</li>
<li>Ben Crellin’s FPL planning sheet.</li>
<li>FPL watchlist tool.</li>
<li>Key FPL <a href="https://cms.fantasyfootballhub.co.uk/opta/" data-internallinksmanager029f6b8e52c="1" title="FPL Stats by OPTA - Player and Team Stats">stats</a> tool.</li>
<li>Minimum 50 extra articles each year.</li>
<li>A forecasting model for FPL.</li>
<li>A lot more!</li>
</ul>
<p></p>
<h3><strong>Follow us:</strong></h3>
<p><a href="https://twitter.com/FFootballHub">Twitter</a></p>
<p><a href="https://www.facebook.com/ffootballhub/">Facebook</a></p>
<p><a href="https://www.youtube.com/c/FantasyFootballHub/?sub_confirmation=1">YouTube</a></p>
<p><a href="https://www.instagram.com/cms.fantasyfootballhub.co.uk">Instagram</a></p>
<p><strong>View all our latest fantasy football tips on our <a href="https://cms.fantasyfootballhub.co.uk/">Homepage</a></strong></p>
<p>&nbsp;</p>


Is FPL a game of Skill or Luck? Assessing your Season using FPL Review Odds & xG Data

Save your FPL Season

Community & tools