Football Outsiders posted their top 30 super greatest defenses of the past 30 years a little while back. Unfortunately, I don't really know exactly what their proprietary metric "DVOA" seeks to measure...so I thought it would be interesting to post my own top 10 using a different set of metrics.
This is a long read ~ grab a comfy chair.
Attempting to objectively evaluate a team’s defense means attempting to uncouple its overall performance with a team’s offense. Average opponent starting field position and total number of drives are influenced by the effectiveness of a team’s offense. The average offensive strength of a team’s opponents and overall strength of schedule will also influence a defense’s performance.
Imagine two identical defenses, both extremely strong. But one defense is attached to a very strong offense (team-A), the other to a very weak offense (team-B). Now imagine playing a very strong team with an elite offense and solid defense (team-C). Team-A beats team-C by a blowout, giving up only three points with a dominant offensive showing, and posting a defensive yards per play of 3.8 - truly a spectacular defensive performance. Meanwhile, in an identical situation, team-B also beats team-C, but by a field goal in a very close game, giving up 17 points. Team-B's offense was terrible throwing two interceptions and losing two fumbles, while repeatedly going three and out, and giving the opposing offense a short field on many occasions. In the end, team-B also posted a defensive yards per play of 3.8...but with a very different score. Which defense actually did more, or did they play equally? Which defense was better rested? How do you grade the better defense given the circumstances? Too often in my opinion, the offensive contributions are completely ignored when a great defense hangs a bunch of zeros on its competition. Or the lack of offensive contribution completely excluded when a great defense barely wins a game against a strong opponent with a negative turnover differential and only a handful of first downs.
Trying to evaluate a defense’s true strength would require primarily focusing on defensive yards per play (YD/P), normalized by its differential of median opponent offensive strength, with the same normalization applied to defensive turnovers, and average plays per TD scored. Normalizing the numbers by measure of the average strength of opponent will reflect the percentage of domination over opponent, which would be more accurate than normalizing against league average (which would too heavily reward or punish a team with an easy or difficult schedule). An example of how this would look…consider a team with a very poor offense that only faced off against top 10 offenses with a brutally difficult schedule. The overall defensive statistics of points allowed, total yardage (and even yards per play to a lesser extent), would be proportionally impacted by their own weak offense and the strong offense of their opponents. In this example, the greatest defense of all time may post very average looking numbers…but when you factor in the strength of offense faced and the differential of yardage, turnover, and play count per TD averages, the level of “greatness” is displayed in the percentage of domination over opponent.
If you were to attach a very strong defense to a very strong offense, and give that team a very easy schedule…it would likely set numerous defensive records. If you were to attach an exceptionally strong defense to a terrible offense, and give that team a very difficult schedule, it would likely set no defensive records, and even struggle to win games. The 1991 Eagles are an approximate example of just such a situation – what would the degree of defensive dominance look like when weighted to the team’s opponents, strength of schedule, and while factoring in the lack of offensive contribution? It would look like the 1991 Eagles…which were statistically the most dominate defense in modern NFL history by measure of its domination over opponent. If the 1991 Eagles had the 2000 Ravens schedule or the 1985 Bears offense, the strength of this defense would be far more apparent…but it is still visible in the numbers.
The primary metrics used in this analysis and their explanation:
Regular season:
YD/P opponent offensive differential = the percent change of the team’s average defensive YD/P over the average offensive YD/P of all opponents faced. This will display a truer measure of defensive YD/P dominance (or delta) by factoring in the offensive strength of all opponents faced. A higher number reveals a greater level of dominance – example, 2015 Broncos 4.4 YD/P grades far higher than the 2000 Ravens 4.3 YD/P due to average offensive YD/P of opponents faced.
Defensive turnover (TO) opponent offensive differential = the percent change of the team’s average defensive turnovers per game over the average offensive turnovers per game of all opponents faced. This normalizes the defensive turnover amount by likelihood of offensive turnover of opponents. A higher number reveals a greater level of dominance in defensive turnovers.
Plays per TD opponent variance – due to the lack of available red zone data from the early 90’s and prior, this is an approximation of “scoring resistance” with the differential based on average opponent plays per TD. It is the percent difference of the defended average number of plays per TD, compared to the opponent’s offensive plays per TD as an average. Being that it is scoring based, it is skewered by offensive performance to some degree (the three lowest ranking teams by this metric also had the three worst offenses - including the greatest defense of all time)…however, being that the offensive strength is also graded, provides just a bit of clarity.
Playoffs:
YD/P and points scored opponent offensive differential - or playoff dominance. Dominating in the playoffs is a traditional staple that defines a truly great defense. Did it play against elite offenses? Did it dominate against elite offenses? A defense that dominated in the regular season, but produces less stellar numbers in the playoffs is graded accordingly, with regular season grades averaged with playoff grades. The 2008 Steelers are an example of a fiercely dominant regular season defense, that was far less dominant in the playoffs. This metric is the playoff YD/P and points allowed compared against the opponent’s regular season offensive YD/P and points scored per game. I chose to consider points for two reasons: a) it’s a small sampling of crucially important games, and b) the legacy of a defense’s performance in the playoffs is irreparably tied to points. This metric shows the degree (or percent) of playoff dominance over the opponents faced. I was honestly surprised that we ranked ahead of the 2013 Seahawks in this metric. If we just considered the points scored/average, the Seahawks ranked above us (but not by much). If we just considered yards per play, we ranked above them (but not by much). Yards and points considered jointly, we edged them out by the slimmest of margin (though in fairness, Super Bowl XLVIII probably should have been a shut out, and reminded me of the 85 Bears beat down of the Patriots in Super Bowl XX…giving up a touchdown only in garbage time with the game already well decided), but the stats are what they are. The bulk of their rating came from the destruction of the Broncos’ #1 offense in Super Bowl XLVIII.
Secondary metrics are:
Strength of schedule (as a measure of opponent win percentage), lack of offense by measure of average offensive league ranking in points scored, yards, offensive turnovers, and time of possession (if known), as an opponent forced to play “catch up,” and/or possessing a well-rested defense, and/or advantageous opponent starting field position, is surely of significant defensive benefit. Whether team won the Super Bowl, and if so, the strength of the playoff teams (as measured by SRS or "simple rating system" utilized by pro-football-reference.com, and the degree of defensive dominance over those playoff teams (factoring in opponent offensive strength).
Every defense on this list is superb…and I think “ranking” them does those at the bottom a disservice. Each defense had unique challenges, any of which, could have radically altered the fate of the team. Some defenses had the support of a great offense, while others had an easy or difficult schedule. There is no right or wrong…just discussion…and the opinion that birthed this blathering nonsense. There are plenty of other notable mentions, and not so conspicuously missing from this list are many great defenses from the early 1970’s. My only reasons for excluding those is that I was more interested in the focal point toward the more “modern” game. In a greater list, many 70’s (and 60's) defenses should surely be included, rather than just the two that are.
Lastly, defining “greatness” is purely subjective…and it’s actually quite easy to cherry pick statistics to form a favored outcome. The final listing is not purely formulaic, but rather I used the numbers as guidelines in deciding. I tried to view this as objectively as I could – based on the metrics chosen, this is how I would rank the all-time greats. <Continued next post>
This is a long read ~ grab a comfy chair.
Attempting to objectively evaluate a team’s defense means attempting to uncouple its overall performance with a team’s offense. Average opponent starting field position and total number of drives are influenced by the effectiveness of a team’s offense. The average offensive strength of a team’s opponents and overall strength of schedule will also influence a defense’s performance.
Imagine two identical defenses, both extremely strong. But one defense is attached to a very strong offense (team-A), the other to a very weak offense (team-B). Now imagine playing a very strong team with an elite offense and solid defense (team-C). Team-A beats team-C by a blowout, giving up only three points with a dominant offensive showing, and posting a defensive yards per play of 3.8 - truly a spectacular defensive performance. Meanwhile, in an identical situation, team-B also beats team-C, but by a field goal in a very close game, giving up 17 points. Team-B's offense was terrible throwing two interceptions and losing two fumbles, while repeatedly going three and out, and giving the opposing offense a short field on many occasions. In the end, team-B also posted a defensive yards per play of 3.8...but with a very different score. Which defense actually did more, or did they play equally? Which defense was better rested? How do you grade the better defense given the circumstances? Too often in my opinion, the offensive contributions are completely ignored when a great defense hangs a bunch of zeros on its competition. Or the lack of offensive contribution completely excluded when a great defense barely wins a game against a strong opponent with a negative turnover differential and only a handful of first downs.
Trying to evaluate a defense’s true strength would require primarily focusing on defensive yards per play (YD/P), normalized by its differential of median opponent offensive strength, with the same normalization applied to defensive turnovers, and average plays per TD scored. Normalizing the numbers by measure of the average strength of opponent will reflect the percentage of domination over opponent, which would be more accurate than normalizing against league average (which would too heavily reward or punish a team with an easy or difficult schedule). An example of how this would look…consider a team with a very poor offense that only faced off against top 10 offenses with a brutally difficult schedule. The overall defensive statistics of points allowed, total yardage (and even yards per play to a lesser extent), would be proportionally impacted by their own weak offense and the strong offense of their opponents. In this example, the greatest defense of all time may post very average looking numbers…but when you factor in the strength of offense faced and the differential of yardage, turnover, and play count per TD averages, the level of “greatness” is displayed in the percentage of domination over opponent.
If you were to attach a very strong defense to a very strong offense, and give that team a very easy schedule…it would likely set numerous defensive records. If you were to attach an exceptionally strong defense to a terrible offense, and give that team a very difficult schedule, it would likely set no defensive records, and even struggle to win games. The 1991 Eagles are an approximate example of just such a situation – what would the degree of defensive dominance look like when weighted to the team’s opponents, strength of schedule, and while factoring in the lack of offensive contribution? It would look like the 1991 Eagles…which were statistically the most dominate defense in modern NFL history by measure of its domination over opponent. If the 1991 Eagles had the 2000 Ravens schedule or the 1985 Bears offense, the strength of this defense would be far more apparent…but it is still visible in the numbers.
The primary metrics used in this analysis and their explanation:
Regular season:
YD/P opponent offensive differential = the percent change of the team’s average defensive YD/P over the average offensive YD/P of all opponents faced. This will display a truer measure of defensive YD/P dominance (or delta) by factoring in the offensive strength of all opponents faced. A higher number reveals a greater level of dominance – example, 2015 Broncos 4.4 YD/P grades far higher than the 2000 Ravens 4.3 YD/P due to average offensive YD/P of opponents faced.
Defensive turnover (TO) opponent offensive differential = the percent change of the team’s average defensive turnovers per game over the average offensive turnovers per game of all opponents faced. This normalizes the defensive turnover amount by likelihood of offensive turnover of opponents. A higher number reveals a greater level of dominance in defensive turnovers.
Plays per TD opponent variance – due to the lack of available red zone data from the early 90’s and prior, this is an approximation of “scoring resistance” with the differential based on average opponent plays per TD. It is the percent difference of the defended average number of plays per TD, compared to the opponent’s offensive plays per TD as an average. Being that it is scoring based, it is skewered by offensive performance to some degree (the three lowest ranking teams by this metric also had the three worst offenses - including the greatest defense of all time)…however, being that the offensive strength is also graded, provides just a bit of clarity.
Playoffs:
YD/P and points scored opponent offensive differential - or playoff dominance. Dominating in the playoffs is a traditional staple that defines a truly great defense. Did it play against elite offenses? Did it dominate against elite offenses? A defense that dominated in the regular season, but produces less stellar numbers in the playoffs is graded accordingly, with regular season grades averaged with playoff grades. The 2008 Steelers are an example of a fiercely dominant regular season defense, that was far less dominant in the playoffs. This metric is the playoff YD/P and points allowed compared against the opponent’s regular season offensive YD/P and points scored per game. I chose to consider points for two reasons: a) it’s a small sampling of crucially important games, and b) the legacy of a defense’s performance in the playoffs is irreparably tied to points. This metric shows the degree (or percent) of playoff dominance over the opponents faced. I was honestly surprised that we ranked ahead of the 2013 Seahawks in this metric. If we just considered the points scored/average, the Seahawks ranked above us (but not by much). If we just considered yards per play, we ranked above them (but not by much). Yards and points considered jointly, we edged them out by the slimmest of margin (though in fairness, Super Bowl XLVIII probably should have been a shut out, and reminded me of the 85 Bears beat down of the Patriots in Super Bowl XX…giving up a touchdown only in garbage time with the game already well decided), but the stats are what they are. The bulk of their rating came from the destruction of the Broncos’ #1 offense in Super Bowl XLVIII.
Secondary metrics are:
Strength of schedule (as a measure of opponent win percentage), lack of offense by measure of average offensive league ranking in points scored, yards, offensive turnovers, and time of possession (if known), as an opponent forced to play “catch up,” and/or possessing a well-rested defense, and/or advantageous opponent starting field position, is surely of significant defensive benefit. Whether team won the Super Bowl, and if so, the strength of the playoff teams (as measured by SRS or "simple rating system" utilized by pro-football-reference.com, and the degree of defensive dominance over those playoff teams (factoring in opponent offensive strength).
Every defense on this list is superb…and I think “ranking” them does those at the bottom a disservice. Each defense had unique challenges, any of which, could have radically altered the fate of the team. Some defenses had the support of a great offense, while others had an easy or difficult schedule. There is no right or wrong…just discussion…and the opinion that birthed this blathering nonsense. There are plenty of other notable mentions, and not so conspicuously missing from this list are many great defenses from the early 1970’s. My only reasons for excluding those is that I was more interested in the focal point toward the more “modern” game. In a greater list, many 70’s (and 60's) defenses should surely be included, rather than just the two that are.
Lastly, defining “greatness” is purely subjective…and it’s actually quite easy to cherry pick statistics to form a favored outcome. The final listing is not purely formulaic, but rather I used the numbers as guidelines in deciding. I tried to view this as objectively as I could – based on the metrics chosen, this is how I would rank the all-time greats. <Continued next post>
Comment