FOOTBALL OUTSIDERS BASICS (a.k.a. "PREGAME SHOW")
by Aaron Schatz
While reading Football Outsiders, or our book Pro Football Prospectus, new readers will often come across an offhand comment about, for example, the idea that fumble recovery is not a skill, and wonder what in the heck we are talking about. In Pro Football Prospectus 2007, we include an essay called "Pregame Show" which gives a basic look at some of the most important precepts that have emerged during four years of Football Outsiders research. That essay is republished here, along with links to the original research online when possible, or mentions of where that research appeared in print.
Please note that some of our basic research findings, such as the split between offense, defense, and special teams, were never addressed in one specific article, but instead developed over time. Therefore, there is no specific article we can point out.
You run when you win, not win when you run.
The first article ever written for Football Outsiders was devoted to debunking the myth of "establishing the run." There is no correlation whatsoever between giving your running backs a lot of carries early in the game and winning the game. Just running the ball is not going to help a team score; it has to run successfully.
There are two reasons why nearly every beat writer and television analyst still repeats the tired oldschool mantra that "establishing the run" is the secret to winning football games. The first problem is confusing cause and effect. There are exceptions—usually involving the Indianapolis Colts without Bob Sanders—but, in general, winning teams have a lot of carries because their running backs are running out the clock at the end of wins, not because they are running wild early in games.
The second problem is history. Most of the current crop of NFL analysts came of age or actually played the game during the 1970s. They believe that the run-heavy game of that decade is how football is meant to be, and today's pass-first game is an aberration. As we addressed in an essay in last year's book on the history of NFL stats, it was actually the game of the 1970s that was the aberration. The seventies were far more slanted towards the run than any era since the arrival of Paul Brown, Otto Graham, and the Cleveland Browns in 1946. Optimal strategies from 1974 are not optimal strategies for 2007.
A sister statement to "you have to establish the run" is "team X is 5-1 when running back John Doe runs for at least 100 yards." Unless John Doe is ripping off six-yard gains LaDainian Tomlinson-style, the team isn't winning because of his 100-yard games. He's putting up 100-yard games because his team is winning.
A great defense against the run is nothing without a good pass defense.
This is a corollary to the absurdity of "establish the run." If you don't believe us, meet our good friends the 2006 Minnesota Vikings. With rare exceptions, teams win or lose with the passing game more than the running game—and by stopping the passing game more than the running game. The reason why teams need a strong run defense in the playoffs is not to shut the run down early, it's to keep the other team from icing the clock if they get a lead. You can't mount a comeback if you can't stop the run.
One person who is willing to buck conventional wisdom when it comes to the primacy of the passing game is the new analyst for Monday Night Football, Ron Jaworski. As he often says, "the pass gives you the lead, and the run solidifies it."
Note that "good pass defense" may mean "good pass rush" rather than "good defensive backs."
Running on third-and-short is more likely to convert than passing on third-and-short.
On average, passing will always gain more yardage than running, with one very important exception: when a team is just one or two yards away from a new set of downs or the goal line. On third-and-1, a run will convert for a new set of downs 36 percent more often than a pass. Expand that to all third or fourth downs with 1-2 yards to go, and the run is successful 40 percent more often. With these percentages, the possibility of a long gain with a pass is not worth the tradeoff of an incomplete that kills a drive.
This is one reason why teams have to be able to both run and pass. The offense also has to keep some semblance of balance so they can use their play-action fakes, and so the defense doesn't just run their nickel and dime packages all game. Balance also means that teams do need to pass occasionally in short-yardage situations; they just need to do it less than they do now. Teams pass roughly 60 percent of the time on third-and-2 even though runs in that situation convert 20 percent more often than passes. They pass 68 percent of the time on fourth-and-2 even though runs in that situation convert twice as often as passes.
Standard team rankings based on total yardage are inherently flawed.
When you open your newspaper on Sunday morning, you'll see that the little agate-type previews of each game list team rankings by total yardage. That is still how the NFL "officially" ranks teams, but these rankings rarely match up with common sense. That is because total team yardage may be the most context-dependent number in football.
It starts with the basic concept that rate stats are generally more valuable than cumulative stats. Yards per carry says more about a running back's quality than total yardage, completion percentage says more than just a quarterback's total number of completions. The same thing is true for teams; in fact, it is even more important because of the way football strategy influences the number of runs and passes in the game plan. Poor teams will give up fewer passing yards and more rushing yards because opponents will stop passing once they have a late-game lead and will run out the clock instead. For winning teams, the opposite is true. Did Detroit really have a better passing game than San Diego or New England in 2006, or did the Lions have more passing yards because they went 3-13 and thus threw the ball more than any team except for Green Bay, while the Chargers and Patriots were a combined 26-6 and spent a lot of time killing the clock with the running game?
Total yardage rankings are also skewed because some teams play at a faster pace than other teams. New Orleans had nearly 200 more passing yards than Indianapolis in 2006, but were the Saints really a better offense than the Colts? The Saints ran 183 offensive drives, while the Colts had just 148. No other team in the league had fewer than 160 offensive drives. If you gave Peyton Manning another 35 drives, he would probably rack up more than 200 passing yards.
- Pro Football Prospectus 2005, Cleveland chapter
- Pro Football Prospectus 2005, New York Jets chapter
A team will score more when playing a bad defense, and will give up more points when playing a good offense.
This sounds absurdly basic, but when people consider team and player stats without looking at strength of schedule, they are ignoring this. In 2004, Carson Palmer and Byron Leftwich had very similar numbers, but Palmer faced a much tougher schedule than Leftwich did. Palmer was better that year, and better in the long run. In 2006, Travis Henry had four games of 120 rushing yards or more, and all four came against defenses that ranked 24th or worse in yards per carry allowed.
The 2007 Sugar Bowl was also a good example of conventional wisdom ignoring the importance of opponent quality. Most observers came out of that game saying that JaMarcus Russell was a better pro prospect than Brady Quinn, ignoring the fact that the LSU defense (5.2 passing yards per attempt in 2006) was far superior to the Notre Dame defense (7.8 passing yards per attempt in 2006).
Because players and teams don't give the exact same performance every week, this is more of a general law, and it doesn't necessarily apply in the short term. Sometimes the short term lasts a whole year -- for example, if you are the 2006 Jacksonville Jaguars.
- Pro Football Prospectus 2005, Cincinnati chapter
If their overall yards per carry are equal, a running back who consistently gains yardage on every play is more valuable than a boom-and-bust running back who is frequently stuffed at the line but occasionally breaks a long highlight-worthy run.
Our brethren at Baseball Prospectus believe that the most precious commodity in baseball is outs. Teams only get 27 of them per game, and you can't afford to give one up for very little return. So imagine if there was a new rule in baseball that gave a team a way to earn another three outs in the middle of the inning. That would be pretty useful, right?
That's the way football works. You may start a drive 80 yards away from scoring, but as long as you can earn 10 yards in four chances, you get another four chances. Long gains have plenty of value, but if those long gains are mixed with a lot of short gains, you are going to put the quarterback in a lot of difficult third-and-long situations. That means more punts and more giving the ball back to the other team rather than moving the chains and giving the offense four more plays to work with.
The running back who gains consistent yardage is also going to do a lot more for you late in the game, when the goal of running the ball is not just to gain yardage but to eat clock time. If you are a Carolina Panthers fan watching your team with a late lead, you don't want to see three straight DeShaun Foster stuffs at the line followed by a punt. You want to see a game-icing first down.
A common historical misconception is that our preference for consistent running backs means that "Football Outsiders believes that Barry Sanders was overrated." Sanders wasn't just any boom-and-bust running back, though; he was the greatest boom-and-bust runner of all time, with bigger booms and fewer busts. Our DVOA stats only go back to 1996, but Sanders led the league in rushing DPAR for 1996 and was second behind Terrell Davis in 1997.
Rushing is more dependent on the offensive line than people realize, but pass protection is more dependent on the quarterback himself than people realize.
The first half of this sentence is easily summed up by eight words: Edgerrin James, Arizona Cardinals, three yards per carry.
Some readers complain that this idea contradicts the previous one. Aren't those consistent running backs just the product of good offensive lines? The truth is somewhere in between. There are certainly good running backs, such as James in 2006, who suffer because their offensive lines cannot create consistent holes. Most boom-and-bust running backs, however, contribute to their own problems by hesitating behind the line whenever the hole is unclear, looking for the home run instead of charging forward for the four-yard gain that keeps the offense moving.
As for pass protection, some quarterbacks have better instincts for the rush than others, and are thus better at getting out of trouble by moving around in the pocket or throwing the ball away. Others will hesitate, hold onto the ball too long, and lose yardage over and over.
Note that "moving around in the pocket" does not necessarily mean "scrambling." In fact, a scrambling quarterback will often take more sacks than a pocket quarterback, because while he's running around trying to make something happen, a defensive lineman will catch up with him.
A running back with 370 or more carries during the regular season will usually suffer either a major injury or a loss of effectiveness the following year, unless he is named Eric Dickerson.
Terrell Davis, Jamal Anderson, and Edgerrin James all blew out their knees. Earl Campbell, Jamal Lewis, and Eddie George went from legendary powerhouses to plodding, replacement-level players. Shaun Alexander struggled with foot injuries, and Curtis Martin had to retire. This is what happens when a running back is overworked to the point of having at least 370 carries during the regular season.
The "Curse of 370" was expanded last year, and now includes seasons with 390 or more carries in the regular season and postseason combined. Research in last year's book showed that receptions don't cause a problem, only workload on the ground.
Plenty of running backs get injured without hitting 370 carries in a season, but there is a clear difference. On average, running backs with 300 to 369 carries and no postseason appearance will see their total rushing yardage decline by 15 percent the following year and their yards per carry decline by two percent. The average running back with 370 or more regular-season carries, or 390 including the postseason, will see their rushing yardage decline by 35 percent, and their yards per carry decline by eight percent.
Wide receivers must be judged on both complete and incomplete passes.
We don't yet know enough to precisely parse the blame for incomplete passes, but we know that wide receiver catch rates are as consistent from year to year as quarterback completion percentages. From 2001 to 2005, Hines Ward caught more than 60 percent of intended passes every year, whether from Kordell Stewart, Tommy Maddox, or Ben Roethlisberger. Plaxico Burress, playing with the same quarterbacks as well as Eli Manning, has never caught more than 60 percent of intended passes.
The total quality of an NFL team is three parts offense, three parts defense, and one part special teams.
There are three units on a football team, but they are not of equal importance. Our DVOA ratings provide good evidence for this. The special teams ratings are turned into DVOA by comparing how often field position on special teams leads to scoring compared to field position and first downs on offense. After figuring out these numbers, the top ratings for special teams are roughly one-third as high as the top ratings for offense or defense.
Offense is more consistent from year to year than defense, and offensive performance is easier to project than defensive performance. Special teams is less consistent than either.
Nobody in the NFL understands this concept better than Indianapolis Colts general manager Bill Polian. Both the Super Bowl champion Colts and the four-time AFC champion Buffalo Bills of the early 1990s were built around the idea that if you put together an offense that can dominate the league year after year, eventually you will luck into a year where good health and a few smart decisions will give you a defense good enough to win a championship. (As the Colts learned in January 2007, you don't even need a year, just four weeks.) Even the New England Patriots, who are led by a defense-first head coach in Bill Belichick, have been more consistent on offense than on defense since they began their run of success in 2001.
Recovery of a fumble, despite being the product of hard work, is almost entirely random.
Stripping the ball is a skill. Holding onto the ball is a skill. Pouncing on the ball as it is bouncing all over the place is not a skill. There is no correlation whatsoever between the percentage of fumbles recovered by a team in one year and the percentage they recover in the next year. The odds of recovery are based solely on the type of play involved, not the teams or any of their players.
Fans like to insist that specific coaches can teach their teams to recover more fumbles by swarming to the ball. Chicago's Lovie Smith, in particular, is supposed to have this ability. The NFC Champion Bears forced 24 fumbles on defense, and recovered 16 of them, one of the highest percentages in the league.
But where were Smith's powers a year earlier, when the Bears forced 21 fumbles on defense and recovered just seven, the worst percentage in the league? The 2004 Bears recovered 13 of 17 fumbles on defense, meaning that in three years, their recovery rate went from a league-best 76 percent to a league-worst 33 percent and then back to 67 percent.
Fumble recovery is equally erratic on offense. The 2005 Oakland Raiders fumbled 20 times but recovered 13 of them, the best percentage in the league. The 2006 Raiders fumbled 30 times and recovered just nine of them, one of the worst percentages in the league.
Fumble recovery is a major reason why the general public overestimates or underestimates certain teams. Fumbles are huge, turning-point plays that dramatically impact wins and losses in the past, while fumble recovery percentage says absolutely nothing about a team's chances of winning games in the future. With this in mind, Football Outsiders stats treat all fumbles as equal, penalizing them based on the likelihood of each type of fumble (run, pass, sack, etc.) being recovered by the defense.
Other plays that qualify as "non-predictive events" include blocked kicks and touchdowns during turnover returns. These plays are not "lucky," per se, but they have no value whatsoever for predicting future performance.
- Pro Football Prospectus 2005, New Orleans chapter
Field position is fluid.
Every yard line on the field has a value based on how likely a team is to score from that location on the field as opposed to from a yard further back. The change in value from one yard to the next is the same whether the team has the ball or not. The goal of a defense is not just to prevent scoring, but to hold the opposition so that the offense can get the ball back in the best possible field position. A bad offense will score as many points as a good offense if it starts each drive five yards closer to the goal line.
A corollary to this precept: The most underrated aspect of an NFL team's performance is the field position gained or lost on kickoffs and punts.
Teams which are strong on first and second down, but weak on third down, will tend to improve the following year. Teams which are weak on first and second down, but strong on third down, will tend to decline the following year.
We discovered this when creating our first team projection system in 2004. It said that the lowly San Diego Chargers would have of the best offenses in the league, which seemed a little ridiculous. But looking closer, our projection system treated the previous year's performance on different downs as different variables, and the 2003 Chargers were actually good on first and second down, but terrible on third.
Teams get fewer opportunities on third down, so third-down performance is more volatile—but it's also is a bigger part of a team's overall performance than first or second down, because the result is usually either very good (four more downs) or very bad (losing the ball to the other team with a punt). Over time, a team will play as well in those situations as it does in other situations, which will bring the overall offense or defense in line with the offense and defense on first and second down.
This trend is even stronger between seasons. Struggles on third down are a pretty obvious problem, and teams will generally target their off-season moves at improving their third-down performance . . . which often leads to an improvement in third-down performance.
By and large, a team built on depth is better than a team built on stars and scrubs.
The Redskins went into 2006 with a Super Bowl-quality starting lineup, and finished 5-11 because they had no depth. You cannot concentrate your salaries on a handful of star players because there is no such thing as avoiding injuries in the NFL. Every team will suffer injuries; the only question is how many. The game is too fast and the players too strong to build a team based around the idea that "if we can avoid all injuries this year, we'll win."
Running backs usually decline after age 28, tight ends after age 29, wide receivers after age 30, and quarterbacks after age 32.
This research was originally done by Doug Drinen of footballguys.com in 2000. In recent years, a few players have had huge seasons above these general age limits (most notably Tiki Barber, Tony Gonzalez, and Corey Dillon), but the peak ages Drinen found a few years ago still apply to the majority of players.
During the summer of 2007, ESPN The Magazine asked us to research when players decline at "non-skill" positions. This research was not as rigorous as our usual work, and needs a little more attention before we're ready to stand by it. For the curious, however, the preliminary results said that defensive ends and defensive backs generally begin to decline after age 29, linebackers and offensive linemen after age 30, and defensive tackles after age 31.
Championship teams are generally defined by their ability to dominate inferior opponents, not their ability to win close games.
Football games are often decided by just one or two plays—a missed field goal, a bouncing fumble, the subjective spot of an official on fourth-and-1. One missed assignment by a cornerback, or one slightly askew pass that bounces off a receiver's hands and into those of a defensive back five yards away and the game could be over. In a blowout, however, one lucky bounce isn't going to change things.
Championship teams beat their good opponents convincingly and destroy the cupcakes on the schedule. Certainly there are exceptions to this rule, including the 2006 Colts. The fact that the most recent Super Bowl champion is an exception to the rule, however, does not mean the rule will now no longer exist.
Finally, here are some important precepts which do not appear in the "Pregame Show" essay in Pro Football Prospectus 2007 because they are specifically explored in essays later in the book.
There is virtually no correlation between a kicker's field-goal percentage one year and his field-goal percentage the next, but kickoff distance is one of the most consistent skills in football.
Teams with more offensive penalties generally lose more games, but there is no correlation between defensive penalties and losses. The penalty that correlates highest with losses is the False Start, and the penalty that teams will have called most consistently from year to year is the False Start
- Pro Football Prospectus 2007, St. Louis chapter
The career peak of first- or second-round quarterbacks can be accurately forecasted using just three statistics: draft pick number, collegiate games started, and collegiate completion percentage
For more on Football Outsiders, see the introduction to our statistical methods as well as the Football Outsiders FAQ.
