4th DOWN ANALYTICS
ESPN.com takes the microscope to all 32 coaches as to how they handle the decision to go for it on 4th down and the success they have with the plays they call. Much edited below with rankings from 1 (Kliff Kingsbury) to 32 (Mike Tomlin):
The NFL is about to set a record for most fourth-down attempts in a season.
Again.
Coaches are on pace to dial up 838 fourth-down tries in 2021, up from 780 the year prior. (Even if this were still a 16-game season, they’d be on track for a 788 attempts.) It will mark the fourth consecutive year a new high has been established.
Not only are coaches going for it more on fourth down, they’re getting better at making those calls that give them the best chance to win. According to ESPN Stats & Information research, the number of fourth-down errors has plummeted each of the past four seasons, reaching a new low of 951 leaguewide in 2020 and on pace for even fewer this season.
The increased application of analytics has changed the game on fourth down. Coaches across the league are being guided by game-management specialists who communicate the probabilities of an upcoming fourth-down try in real time.
NFL Fourth-Down Trends
YEAR ATT 4TH-DOWN ERRORS
2012 481 1,246
2013 527 1,250
2014 490 1,192
2015 526 1,171
2016 540 1,121
2017 555 1,150
2018 611 1,028
2019 687 1,003
2020 780 951
2021 838* 924*
* On pace
The most famous example came in Super Bowl LII between the Philadelphia Eagles and New England Patriots. Before Eagles coach Doug Pederson had his sideline conversation with quarterback Nick Foles, leading to the decision to run the “Philly Special” late in the first half, Pederson spoke with Ryan Paganetti, the Dartmouth grad responsible for feeding Pederson math-based recommendations when it came to, among other things, going for it on fourth down.
Anticipating such a situation, Paganetti clicked into Pederson’s headset prior to the Eagles’ third-and-goal play against the Patriots and told him: If we get to fourth down, the light is green.
And the rest is history.
League sources estimate 28 of 32 head coaches have game-management specialists, with about 10 of those being members of the team’s analytics department. The trend of teams being more aggressive on fourth down is expected to continue for the foreseeable future. The practice is becoming more widely accepted and is likely to be commonplace before long.
Is your team ahead of the curve? Here’s a look at how each head coach stacks up. — Tim McManus
How we rank: To come up with our coaches ranking, we looked at all fourth-down calls made under the current head coach with his current team. (For example, for Mike McCarthy, we would only include fourth-down calls made with the Cowboys, not the Packers.) The timeframe was limited to 2017-21, when analytics were firmly established across the league. We relied on three metrics from the ESPN Analytics team:
Total win probability sacrificed through fourth-down errors
Difference in expected fourth-down conversion rates vs. actual rates
Non-obvious fourth-down error rate
These metrics are shown as per-season averages and measure whether the coach’s decision agreed with our analytics model (accounting for two-thirds of the final ranking) as well as success in running fourth-down plays (one-third). All 32 coaches were sorted on those metrics and then those rankings were used to create the final order.
1. Kliff Kingsbury, Arizona Cardinals
Years covered: 2019-21
Win probability sacrificed on fourth-down errors: 18.7% (Rank: 7)
Difference in expected vs. actual fourth-down conversions: 6.5% (Rank: 1)
Non-obvious fourth-down error rate: 20.2% (Rank: 2)
2. Matt LaFleur, Green Bay Packers
Years covered: 2019-21
Win probability sacrificed on fourth-down errors: 15.3% (Rank: 4)
Difference in expected vs. actual fourth-down conversions: 3.7% (Rank: 5)
Non-obvious fourth-down error rate: 22% (Rank: 5)
3. John Harbaugh, Baltimore Ravens
Years covered: 2017-21
Win probability sacrificed on fourth-down errors: 14.6% (Rank: 3)
Difference in expected vs. actual fourth-down conversions: 2.9% (Rank: 8)
Non-obvious fourth-down error rate: 21.6% (Rank: 7)
4. Robert Saleh, New York Jets
Years covered: 2021
Win probability sacrificed on fourth-down errors: 18.4% (Rank: 6)
Difference in expected vs. actual fourth-down conversions: 1.3% (Rank: 12)
Non-obvious fourth-down error rate: 18.8% (Rank: 1)
5. Andy Reid, Kansas City Chiefs
Years covered: 2017-21
Win probability sacrificed on fourth-down errors: 16.1% (Rank: 5)
Difference in expected vs. actual fourth-down conversions: 0% (Rank: T-14)
Non-obvious fourth-down error rate: 21.1% (Rank: 5)
6. Nick Sirianni, Philadelphia Eagles
Years covered: 2021
Win probability sacrificed on fourth-down errors: 10.2% (Rank: 1)
Difference in expected vs. actual fourth-down conversions: -20.9% (Rank: 31)
Non-obvious fourth-down error rate: 20.5% (Rank: T-3)
7. David Culley, Houston Texans
Years covered: 2021
Win probability sacrificed on fourth-down errors: 19.7% (Rank: 9)
Difference in expected vs. actual fourth-down conversions: 2.2% (Rank: T-10)
Non-obvious fourth-down error rate: 24.2% (Rank: 18)
8. Kevin Stefanski, Cleveland Browns
Years covered: 2020-21
Win probability sacrificed on fourth-down errors: 13.1% (Rank: 2)
Difference in expected vs. actual fourth-down conversions: -12.9% (Rank: 30)
Non-obvious fourth-down error rate: 21.2% (Rank: 6)
9. Matt Rhule, Carolina Panthers
Years covered: 2020-21
Win probability sacrificed on fourth-down errors: 27.2% (Rank: T-22)
Difference in expected vs. actual fourth-down conversions: 4.2% (Rank: 4)
Non-obvious fourth-down error rate: 23.4% (Rank: T-13)
10. Mike Zimmer, Minnesota Vikings
Years covered: 2017-21
Win probability sacrificed on fourth-down errors: 19.6% (Rank: 8)
Difference in expected vs. actual fourth-down conversions: -6.6% (Rank: 24)
Non-obvious fourth-down error rate: 22.7% (Rank: T-10)
11. Mike McCarthy, Dallas Cowboys
Years covered: 2020-21
Win probability sacrificed on fourth-down errors: 21.7% (Rank: 11)
Difference in expected vs. actual fourth-down conversions: 0% (Rank: T-14)
Non-obvious fourth-down error rate: 26.2% (Rank: T-19)
12. Arthur Smith, Atlanta Falcons
Years covered: 2021
Win probability sacrificed on fourth-down errors: 24.1% (Rank: 17)
Difference in expected vs. actual fourth-down conversions: -10.5% (Rank: 27)
Non-obvious fourth-down error rate: 20.5% (Rank: T-3)
T-13. Pete Carroll, Seattle Seahawks
Years covered: 2017-21
Win probability sacrificed on fourth-down errors: 29.4% (Rank: 27)
Difference in expected vs. actual fourth-down conversions: 0.1% (Rank: 13)
Non-obvious fourth-down error rate: 22.1% (Rank: 9)
T-13. Brian Flores, Miami Dolphins
Years covered: 2019-21
Win probability sacrificed on fourth-down errors: 21.9% (Rank: 12)
Difference in expected vs. actual fourth-down conversions: -3.9% (Rank: 22)
Non-obvious fourth-down error rate: 23.6% (Rank: 15)
T-15. Sean McDermott, Buffalo Bills
Years covered: 2017-21
Win probability sacrificed on fourth-down errors: 20.4% (Rank: 10)
Difference in expected vs. actual fourth-down conversions: -11.6% (Rank: 28)
Non-obvious fourth-down error rate: 23.2% (Rank: 12)
T-15. Sean Payton, New Orleans Saints
Years covered: 2017-21
Win probability sacrificed on fourth-down errors: 27.2% (Rank: T-22)
Difference in expected vs. actual fourth-down conversions: 3.2% (Rank: 7)
Non-obvious fourth-down error rate: 26.2% (Rank: T-19)
17. Frank Reich, Indianapolis Colts
Years covered: 2018-21
Win probability sacrificed on fourth-down errors: 24.5% (Rank: 18)
Difference in expected vs. actual fourth-down conversions: -1% (Rank: 17)
Non-obvious fourth-down error rate: 23.8% (Rank: 16)
18. Zac Taylor, Cincinnati Bengals
Years covered: 2019-21
Win probability sacrificed on fourth-down errors: 22.6% (Rank: 14)
Difference in expected vs. actual fourth-down conversions: 0% (Rank: T-14)
Non-obvious fourth-down error rate: 26.8% (Rank: 22)
19. Dan Campbell, Detroit Lions
Years covered: 2021
Win probability sacrificed on fourth-down errors: 22.2% (Rank: 13)
Difference in expected vs. actual fourth-down conversions: -25.8% (Rank: 32)
Non-obvious fourth-down error rate: 22.7% (Rank: T-10)
20. Mike Vrabel, Tennessee Titans
Win probability sacrificed on fourth-down errors: 23.9% (Rank: 16)
Difference in expected vs. actual fourth-down conversions: -6.2% (Rank: 23)
Non-obvious fourth-down error rate: 24.1% (Rank: 17)
21. Vic Fangio, Denver Broncos
Years covered: 2019-21
Win probability sacrificed on fourth-down errors: 26.6% (Rank: 21)
Difference in expected vs. actual fourth-down conversions: 2.2% (Rank: 11)
Non-obvious fourth-down error rate: 27.5% (Rank: T-24)
22. Brandon Staley, Los Angeles Chargers
Years covered: 2021
Win probability sacrificed on fourth-down errors: 61.9% (Rank: 32)*
Difference in expected vs. actual fourth-down conversions: 5.2% (Rank: 3)
Non-obvious fourth-down error rate: 27.3% (Rank: 23)
* Staley’s league-worst WP sacrificed ranking can mostly be chalked up to being too aggressive for our model in going for it as opposed to attempting field goals against the Chiefs in Week 3. Without those plays, he would rank higher on this list.
23. Urban Meyer, Jacksonville Jaguars
Years covered: 2021
Win probability sacrificed on fourth-down errors: 28.7% (Rank: 25)
Difference in expected vs. actual fourth-down conversions: 5.9% (Rank: 2)
Non-obvious fourth-down error rate: 31.8% (Rank: 31)
T-24. Matt Nagy, Chicago Bears
Years covered: 2018-21
Win probability sacrificed on fourth-down errors: 29.3% (Rank: 26)
Difference in expected vs. actual fourth-down conversions: -2.9% (Rank: 20)
Non-obvious fourth-down error rate: 23.4% (Rank: T-13)
T-24. Ron Rivera, Washington Football Team
Years covered: 2020-21
Win probability sacrificed on fourth-down errors: 32.5% (Rank: 29)
Difference in expected vs. actual fourth-down conversions: 3.2% (Rank: 6)
Non-obvious fourth-down error rate: 27.5% (Rank: T-24)
26. Bruce Arians, Tampa Bay Buccaneers
Years covered: 2019-21
Win probability sacrificed on fourth-down errors: 23.8% (Rank: 15)
Difference in expected vs. actual fourth-down conversions: -3.6% (Rank: 21)
Non-obvious fourth-down error rate: 27.6% (Rank: 26)
27. Kyle Shanahan, San Francisco 49ers
Years covered: 2017-21
Win probability sacrificed on fourth-down errors: 25% (Rank: 19)
Difference in expected vs. actual fourth-down conversions: -7.5% (Rank: 25)
Non-obvious fourth-down error rate: 26.8% (Rank: T-21)
28. Joe Judge, New York Giants
Years covered: 2020-21
Win probability sacrificed on fourth-down errors: 31% (Rank: 28)
Difference in expected vs. actual fourth-down conversions: 2.3% (Rank: 9)
Non-obvious fourth-down error rate: 29.2% (Rank: 29)
29. Bill Belichick, New England Patriots
Years covered: 2017-21
Win probability sacrificed on fourth-down errors: 25.7% (Rank: 20)
Difference in expected vs. actual fourth-down conversions: -2.7% (Rank: 19)
Non-obvious fourth-down error rate: 29.8% (Rank: 30)
30. Sean McVay, Los Angeles Rams
Years covered: 2017-21
Win probability sacrificed on fourth-down errors: 28.3% (Rank: 24)
Difference in expected vs. actual fourth-down conversions: -12.5% (Rank: 29)
Non-obvious fourth-down error rate: 28.7% (Rank: 27)
31. Rich Bisaccia, Las Vegas Raiders
Years covered: 2021 (Weeks 6-12)
Win probability sacrificed on fourth-down errors: 47.2% (Rank: 31)
Difference in expected vs. actual fourth-down conversions: -2% (Rank: 18)
Non-obvious fourth-down error rate: 34.8% (Rank: 32)
32. Mike Tomlin, Pittsburgh Steelers
Years covered: 2017-21
Win probability sacrificed on fourth-down errors: 33.1% (Rank: 30)
Difference in expected vs. actual fourth-down conversions: -8.3% (Rank: 26)
Non-obvious fourth-down error rate: 28.9% (Rank: 28)
|