Total quarterback rating

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

Total quarterback rating (abbreviated as total QBR or simply QBR) is a proprietary statistic created by ESPN in 2011 to measure the performance of quarterbacks in American football. It incorporates all of a quarterback’s contributions to winning, including how he impacts the game on passes, rushes, turnovers, and penalties. Since QBR is built from the play level, it accounts for a team’s level of success or failure on every play to provide the proper context, then allocates credit to the quarterback and his teammate to produce a clearer measure of quarterback efficiency. It was created to be a more meaningful alternative to the passer rating but has been met with criticism among fans and commentators alike.

History and development[edit]

Total QBR was developed by a team at ESPN Stats & Information Group including Jeff Bennett, Dean Oliver, Alok Pattani, Albert Larcada, and Menlo College professor Ben Alamar. The group also received input from ESPN analysts Trent Dilfer, Jon Gruden, and Ron Jaworski. Total QBR was developed based on analysis of 60,000 NFL plays between 2008-2010, and was unveiled on August 5, 2011.[1] The formula was modified in 2012 and again in 2013.[2][3]

Characteristics[edit]

There are six steps to building QBR:[4]

  • Each QB "action play" (passes, rushes, sacks, scrambles, or penalties attributable to the QB) are measured in terms of the expected points added (EPA)
  • Adjust for the difficulty of each play. EPA is adjusted based on the type and depth of a pass, and whether the QB was pressured.
  • If there is a completion, he only is credited for the typical number of yards after the catch (passer rating takes all yards into effect) based on the type and depth of the pass
  • There is a discount on trash time, or a time where the score is out of reach near the end of the game.
  • Opponent adjustment: More credit is given with tougher defenses and vice versa.
  • QBR averages the adjusted EPA per play and transforms it to a 0 to 100 scale, with 50 being average.

Summary of computation[edit]

Raw QBR is calculated as the following:

,

where g() is a function that scales from 0-100, where 50 is average. Total QBR is the raw QBR adjusted for the strength of the opponent.

EPA is calculated based on the down, distance, and the yard line at snap, with each combination having its own point value. The point values are the average net point advantage the team on offense can expect given the particular down, distance, and field position. For example, a 1st and goal chance on the opponent's’ 1 yard line heavily favors the offense, yielding a positive point value. On the other hand, a 3rd and 9 on the team’s own 3 yard line is heavily negative because it drastically favors the opponent.

The value of each play’s outcome is measured by the snap-to-snap change in expected points. This is called Expected Points Added. The Expected Points Added (or lost) in each play are divided among the contributing players on the field based on the role of each player and the type of play. Deeper throws give a higher share of credit to the QB, while screen passes give relatively less credit to the QB and more to the receiver.

Plays that occur in “trash time” are discounted by as much as 30%. Trash time is measured based on the leverage of each play which is primarily a function of score, time, and field position. Important, critical plays that are likely to change the outcome have high leverage, while plays that occur after the game has largely been already decided have low leverage. QBR discounts low leverage plays, but does not boost credit for “clutch” plays.

After each play’s Expected Points Added is adjusted for difficulty, division of credit, and trash time, it is averaged on a per play basis. This average is further adjusted to account for the strength of opponent. Performance against a stronger defense that tends to allow low adjusted EPA per play is adjusted upwards while performance against a weaker defense is adjusted downwards. The degree of adjustment is in direct proportion to the strength of the opponent.

Lastly, the resulting adjusted EPA per play is transformed to a 0 to 100 scale, where 50 is average. The result can be thought of as a percentile. For example, a QBR of 80 means that the QB’s performance is better than 80% of the game performances by QB’s since 2006. A game QBR of 80 would also mean that, given that QB’s performance, his team would be expected to win that game on average 80% of the time.[5]

Comparison to NFL passer rating[edit]

ESPN claims QBR is a more complete and meaningful alternative to the passer rating, which remains the official NFL measure of quarterback performance. The calculation of the NFL passer rating is much simpler than the QBR, as it depends only on aggregate statistics rather than an analysis of each play a quarterback is involved in. However, this calculation is based on purely arbitrary coefficients, and is not based on how the game actually operates. Additionally, passer rating double counts completion percentage, favoring quarterbacks who tend to throw screens and other short passes. Passer rating is calculated using each quarterback's passing attempts, completions, yards, touchdowns and interceptions, and has a maximum value of 158.3 and minimum value of 0.

Passer rating ignores large parts of a quarterback’s performance. It ignores sacks, fumbles, designed runs and scrambles, which punishes mobile QB’s. It also does not put plays into its proper context. For example, a 5-yard gain on second-and-5 is very different from a 5-yard gain on third-and-10. Total QBR takes this into account with EPA. Passer rating treats all yards, whether they are air yards or yards after catch, as equally belonging to the QB.

Example of Total QBR[edit]

Total QBR takes each individual play and measures the expected points added (EPA) for each play. Since every play situation is different, there is a different value for EPA in each case. A team can expect a 0.9 net-point advantage when it is 1st down and 10 yards to go on their own 20 yard line. For the next play, suppose the team passes the ball 8 yards to reach their own 28 yard line on 2nd down and 2. The offense can now expect a 1.4 net-point advantage. EPA is the difference in the expected points at the start and end of a play. In this case it is 1.4 - 0.9 = 0.5 EPA. In a way, the offense has added a half point in potential score based on this play. Similarly, if a team loses yardage on a play, their EPA in that situation would be negative.

Total QBR takes EPA and adjusts it based on the difficulty of the play. If a quarterback is under duress and avoids a sack to throw a 10-yard pass, Total QBR will reward the quarterback in those situations more than a 10-yard pass with lots of time to throw. In addition, it understands the differences of passes that went 40 yards: the quarterback is rewarded more for a 40-yard pass compared to a 10-yard pass where the receiver ran for an extra 30 yards.

There is a discount on trash time. A 40-yard pass as time expires (without scoring a touchdown or field goal) is much different from a 40-yard pass with enough time to score points.

Total QBR takes into account the level of difficulty the opponent team’s defense is based on the opponent's’ defensive FPI, among other factors.

Conceptualizing the detail Total QBR puts in can be explained through the 2015 NFC Wild Card game between the Green Bay Packers and the Washington Redskins.[6] Aaron Rodgers of the Packers completed 21 of 36 passes for 210 yards, 2 touchdowns, and 0 interceptions, which computes to a 93.5 passer rating. Kirk Cousins of the Redskins completed 29 of 46 passes for 329 yards with 1 touchdown and 0 interceptions, computing a 91.7 passer rating. Observing these statistics, one is likely to conclude that Cousins had a better overall game than Rodgers. However, the Packers went on to win 35-18.

Traditional passer statistics omit the rest of the impact that these quarterbacks made. Cousins also took 6 sacks, had 3 fumbles (1 lost), and 2 pre-snap penalties on Washington’s offense. Rodgers, on the other hand, took only one sack, did not fumble, and drew a number of defensive penalties to keep drives alive. Rodgers manufactured fives scoring drives, posting an 87 Total QBR. Cousins’ errors cost Washington the game, resulting in a Total QBR nearly 30 points lower.

Reception[edit]

Total QBR is a complex proprietary statistic that has led to questions on what values are being used and to what degree. The data obtained is from a video analyst tracking system instead of an eye test grading system, similar to a football scout.

Unlike the NFL passer rating, ESPN has not yet been forthcoming on the exact specific formulas and procedures to calculate QBR.[7] The proprietary, complex methodology spans some 10,000 lines of code.[8] In an interview with San Diego's XX Sports Radio, San Diego Chargers quarterback Philip Rivers seemed baffled by the ratings, which put him ninth overall in its metrics for the 2010 season, saying "I still don't get it. I think it's more complicated now".[9][10]

In an op-ed piece published by Deadspin, they opine that the clutch index component of the QBR "looks like a weirdly applied version of baseball's leverage metric and which, tellingly, is the sort of mindless branding you get when the network of 'Who's Now' starts dicking around with numbers.".[11]

Michael David Smith of Profootballtalk.com explained the major drawback of QBR:[12]

Further criticism of QBR was brought about when, before some tinkering with the equation of QBR, Steelers quarterback Charlie Batch had the greatest individual game ever evaluated by QBR. Batch threw for 186 yards with two interceptions in the game.[13]

On the other side, noted football author and researcher Brian Burke of Advanced NFL Stats opined that QBR was superior to the traditional passer rating.[14] The main advantages, in his opinion, are QBR's accounting for many more events in quarterback play than the old rating, and the fact that it avoids the double-counting that plagues the official NFL passer rating. He did however lament the proprietary nature of the statistic, and predicted it would not become widely used so long as its precise computation details were kept secret (i.e., it is unlikely that CBS, Fox, NBC, and other competing media outlets would want to heavily promote something that is proprietary to ESPN).

Further controversy erupted when the Total QBR system gave the Denver Broncos' Tim Tebow a higher rating than the Green Bay Packers' Aaron Rodgers in their respective Week 5 contests in 2011. Noting that Rodgers completed 26 of 39 passes for 396 yards and two touchdowns in a win over the Atlanta Falcons, while Tebow completed four of 10 passes for 79 yards and a touchdown, and six rushes for 38 yards and a touchdown, in a loss to the San Diego Chargers. In a more recent example, a game played on September 24, 2017, Alex Smith of Kansas City Chiefs received an inexplicable QBR of 7.8, half as much as the equally-bad QBR of 16.1 for his counterpart Philip Rivers of the Los Angeles Chargers, even though Smith had a higher completion rate (16/21 vs. 20/40), a better average per completion (7.8 yds vs. 5.9), a far superior TD/int ratio (2-0 vs. 0-3), and won the game handily 24-10. For comparison, the RTG, 128.1 for Smith and 37.2 for Rivers, was by far a better metric of success. Mike Florio of Profootballtalk.com wrote that he'll "continue to ignore ESPN’s Total QBR stat."[15] Rodgers himself was surprised: "I saw the [QBR stats] and chuckled to myself. I played a full game, [Tebow] played the half. He completed four passes, I completed 26. I think it incorporates QB runs as well ... The weighting of it doesn't make a whole lot of sense."[16] ESPN's Stats and Information Group explained that Tebow's higher rating was the result of him staging a partial comeback, taking no sacks, and having positive rushing yards and a rushing touchdown, among other factors.[17][18] However, Doug Farrar of Yahoo! Sports wrote that the QBR system lacks a minimum performance frequency floor that players must meet before they can be rated, and thus it essentially penalizes Rodgers because he played throughout the entire game, while rewarding Tebow because he came off the bench in the second half in an attempt to stage a comeback.[19]

NFL QBR records[edit]

Single-season QBR leaders[edit]

The following is a list of the ten all-time best single-season leaders of the QBR statistic in the NFL:[20]

Rank Season Player QBR Team
1. 2007 Tom Brady 88.20 New England Patriots
2. 2006 Peyton Manning 87.50 Indianapolis Colts
3. 2011 Aaron Rodgers 85.50 Green Bay Packers
4. 2011 Drew Brees 84.30 New Orleans Saints
5. 2009 Drew Brees 84.20 New Orleans Saints
6. 2016 Matt Ryan 83.30 Atlanta Falcons
7. 2016 Tom Brady 83.00 New England Patriots
8. 2009 Peyton Manning 82.80 Indianapolis Colts
9. 2007 David Garrard 82.50 Jacksonville Jaguars
10. 2013 Peyton Manning 82.20 Denver Broncos

Season-by-season QBR leaders[edit]

The following is a list of the season-by-season leaders of the QBR statistic in the NFL:[21]

Season Player QBR Team
2006 Peyton Manning 87.50 Indianapolis Colts
2007 Tom Brady 88.20 New England Patriots
2008 Peyton Manning 78.00 Indianapolis Colts
2009 Drew Brees 84.20 New Orleans Saints
2010 Tom Brady 81.30 New England Patriots
2011 Aaron Rodgers 85.50 Green Bay Packers
2012 Peyton Manning 81.30 Denver Broncos
2013 Peyton Manning 82.20 Denver Broncos
2014 Tony Romo 81.50 Dallas Cowboys
2015 Carson Palmer 78.60 Arizona Cardinals
2016 Matt Ryan 83.30 Atlanta Falcons
2017 Carson Wentz 74.40 Philadelphia Eagles

See also[edit]

References[edit]

  1. ^ Nwulu, Mac (2011-08-02). "ESPN Introduces The Total Quarterback Rating". ESPN MediaZone. Retrieved 2017-03-20.
  2. ^ "NFL - Total QBR gets minor modifications". Espn.go.com. 2012-09-04. Retrieved 2017-03-20.
  3. ^ "NFL - Total QBR updates for 2013". Espn.go.com. 2013-09-05. Retrieved 2017-03-20.
  4. ^ "How is a QB's efficiency rated? - ESPN Video". ESPN.com. Retrieved 2017-11-13.
  5. ^ "Oliver: Guide to the Total Quarterback Rating". ESPN.com. Retrieved 2017-11-13.
  6. ^ "How is Total QBR calculated? We explain our quarterback rating". ESPN.com. Retrieved 2017-11-13.
  7. ^ Ekstrom, Bob (2011-08-10). "ESPN's Double-Secret QBR Still Shrouded in Mystery". Sports Central. Retrieved 2011-08-22. That's what ESPN has done ... keep it secret. No one can criticize a methodology they can't analyze.
  8. ^ Sando, Mike (2011-08-01). "How to identify NFL's best quarterbacks". ESPN. Retrieved 2011-08-22.
  9. ^ Farrar, Doug (2011-08-17). "Philip Rivers at odds with ESPN's new quarterback ranking". Yahoo! Sports. Retrieved 2011-08-22.
  10. ^ "Philip Rivers Doesn't Agree With Or Understand Total QBR". Deadspin. Retrieved 2011-08-22.
  11. ^ "Total QB Rating: Everything Great About ESPN Multiplied By Everything Insufferable". Deadspin. Retrieved 2011-08-22.
  12. ^ Smith, Michael David (2011-08-01). "ESPN tries to build a better quarterback rating". Profootballtalk.com. Retrieved 2011-08-22.
  13. ^ https://profootballtalk.nbcsports.com/2015/11/19/charlie-batchs-186-yard-two-pick-game-has-espns-best-qbr-ever/
  14. ^ Burke, Brian (2011-08-12). "ESPN's New QB Stat". Advanced NFL Stats. Retrieved 2011-08-22.
  15. ^ Florio, Mike (2011-10-10). "ESPN's QBR stat puts Tebow ahead of Rodgers". Profootballtalk.com. Retrieved 2011-10-15.
  16. ^ "Aaron Rodgers Chuckled After Learning that Tim Tebow Had Higher QBR". Larry Brown Sports. 2011-10-10. Retrieved 2011-10-15.
  17. ^ "Tebow's diverse skills boost Total QBR". ESPN. 2011-10-11. Retrieved 2011-10-15.
  18. ^ "Why QBR favored Tebow over Rodgers". ESPN. 2011-10-11. Retrieved 2011-10-15.
  19. ^ Farrar, Doug (2011-10-14). "ESPN's Total QBR stat makes as much sense to Aaron Rodgers as it does to me". Yahoo! Sports. Retrieved 2011-10-15.
  20. ^ "NFL QBR Single-Season Leaders". Pro Football Reference. Sports-Reference. Retrieved February 14, 2018.
  21. ^ "NFL QBR Year-by-Year Leaders". Pro Football Reference. Sports-Reference. Retrieved February 14, 2018.