The 2015 Saints were the worst defense we have ever measured, and Brandon Browner set a single-season record for penalties, so it's no surprise to see him at the bottom of the coverage tables.
21 Jul 2004
by Aaron Schatz
This article was originally written in July 2004. One year later, I wanted to re-visit it and how accurate it turned out to be. The 2005 updates are in this purple, italicized font.
In our "Extra Points" article blog last week I linked to a long piece by ESPN.com's John Clayton discussing this year's change in the way referees will be calling pass interference. In a reaction to the public mauling given the Colts by the Patriots during the AFC championship, the league wants to clamp down on defensive backs holding and obstructing receivers after five yards.
We keep referring to it as a rule change, but it isn't actually a rule change. According to the Competition Committee, they are only asking referees to enforce the letter of the law, as it was changed in 1994. They tossed a few extra words to hammer the point home, but the rule is the same. As Clayton writes:
The intent of the 1994 "chuck" revision was violated. Out goes the word only and into the rule book goes language that tells defenders not to restrict or impede a receiver "in any way." Defenders can get away with incidental contact but not get away with any intentional contact.
So, will this change anything? Nobody can be sure, really. While it is possible that this rule change will really boost passing this year, I think what is more likely is that the rule will be heavily enforced in the preseason and the first couple weeks, but gradually the referees will revert to the way they have called things in the past, or close to it. This is what seems to happen every time baseball changes its strike zone, for example.
However, if they really do crack down on physical play by cornerbacks, Clayton feels that the results will be similar to the increase in passing that took place in 1994, the last time they tried to call pass interference in this strict fashion. His article also speculates on what the change will mean for the NFL as a whole as well as individual receivers.
So, Clayton's statements seem pretty easy to test. If
a) John Clayton says that the change from 2003 to 2004 will be like the change from 1993 to 1994, and
b) John Clayton says that X, Y, and Z are likely to happen in 2004
then it is probably a good idea to go back and see whether X, Y, and Z happened in 1994.
(Those of you who have a long memory may recall that Bill James did this exact same exercise in his 1988 Baseball Abstract when baseball threatened to call the strike zone "by the book" just like they had in 1963. He went back, figured out what kinds of players improved or declined between 1962 and 1963, and used that as a guideline for which players were likely to improve or decline in 1988.)
Now, of course, if the changes this year are different from what they were in 1994 -- or if the referees don't really change the way they call pass interference at all -- none of this really makes any difference. But for now, let's assume Clayton is right, that the changes in the game this year will match those between 1993 and 1994. Given that idea, how on target are his predictions?
If you want to skip all the specifics, there is a summary at the end.
Clayton: "Some people you talk to tell you the impact will be minimal. Those are the same people who misjudged the impact of Charlie Weis's short passing offense on the opening years of the new millennium."
Really? The exact same people? Like, the same five guys or something? Is one of them Merril Hoge?
Clayton: "Go back to 1994 when the rule was put in. Passing yardage went up a total of 26 yards per game (from 401.2 to 427.2, second highest in the modern era). Average completions went from 11.6 to 11.7. Average attempt went from 5.8 yards to 6. Scoring went from 37.4 to 40.9 per game."
Clayton is partially right here, and partially wrong, and I'm also partially confused. I used Doug Drinen's pro-football-reference.com for my statistics and the numbers for passing yards per game and average yards per attempt are different from the numbers Clayton is giving. I'm not sure where the disconnect lies -- perhaps in how the two sources consider sack yardage? -- but let me go through these numbers to see if they are accurate.
Passing yardage per game did in fact go up from 1993 to 1994. In Drinen's numbers, the increase is a bit smaller, from 430.8 yards per game to 454.8 yards per game. Clayton likes to give stats per game that combine both teams, which isn't really how I generally think of "per game" statistics, and these numbers make the changes look greater than they really are. If I told you that passing went up by 24 yards per game, that sounds more impressive than telling you passing went up by 12 yards per game.
But while Clayton is right about total passing yardage increasing in 1994, his numbers for yards per pass are misleading. First of all, I should point out that Drinen's numbers for yards per attempt are different than Clayton's. He has yards per attempt increasing from 6.7 to 6.8 instead of 5.8 to 6.0. Either way, that's a very small change -- and, when you look at more than just two years of data, it clearly represents normal variation, not a trend towards more success in the passing game. Here are the passing game numbers for the three years before and after the rule change (giving the average per game for one team, not two):
|Passing per game, per team||Comp||Att||Comp%||Yds||Yd/Att||Yd/Comp||TD||INT|
Any increases in the passing game after the 1994 rule change came from more total passes, not more success on each pass. Yards per attempt and yards per completion were actually lower when you compare three-year periods rather than just the years 1993 and 1994. Completion percentage and interceptions per game stayed roughly the same. The difference came from 2.8 more passes per game, probably thanks to a few more first down opportunities that arose from the separate penalties. To me, this looks like nobody really played any differently after 1994. The refs may have been calling a few more pass interference penalties, but it didn't really help players catch passes more often or for more yardage.
(If you are curious, rushing numbers were pretty much the same before and after the rule change.)
2005 Update: Clayton turned out to be right, but it is difficult to tell whether the increase in offense had anything to do with the enforcement of illegal contact because, as this article points out, offense has been trending upwards for a few years. Scoring was up from 2003, but no higher than 2002. Yards per attempt were at their highest since 1989, but yards per completion just returned to the level of 1997-1999. The rate of passing touchdowns per game was the highest in history, the rate of interceptions per game was the lowest.
Clayton: "More teams will have the ability to pass for 4,500 yards. Games will be higher scoring."
Yes, this is what happened in 1994. From 1991-1993, teams averaged 18.8 points per game. From 1994-1996, teams averaged 20.7 points per game. If this happens again this year, though, is anybody going to notice? If your favorite team is suddenly kicking an extra field goal every other game, how long will it take you to realize something is different? As for 4,500 yards, as I noted above, total yardage numbers went up even if yards per pass did not. Before 1994, less than one team a year threw for 4,500 yards. Three hit the mark in 1994, four in 1995. Of course, by 1996 it was back to zero again.
2005 Update: Scores only went up slightly, but wow, more teams certainly did have the ability to pass for 4,500 yards. What made 2004 remarkable is less the level of offense and more the standard deviation, with lots of really good quarterbacking and lots of really bad quarterbacking. Five teams passed for 4,500 yards (IND, MIN, KC, STL, GB) after none did in 2003 and only Oakland did in 2002.
Clayton: "Veteran receivers who get quickly into routes -- Marvin Harrison of the Colts and Isaac Bruce of the Rams for example -- should have monster years."
I'm not sure what defines "getting quickly into routes" but we can go back and see if any veteran receivers had monster years in 1994. 26 receivers went into 1994 with at least five seasons experience and back-to-back years of at least 500 yards receiving. On average, these receivers dropped by 48 receiving yards compared to their average in 1992 and 1993. To me, that sounded like an average year, like nothing really special happened in 1994. But, just to make sure, I decided to see what happened to the receivers from 2003 who fit the same requirements.
Even though I just wrote a long article on a set of wide receivers who declined in 2003, the result still caught me by surprise. 25 receivers went into last year with at least five seasons experience and back-to-back years of at least 500 yards receiving. On average, these receivers dropped by 246 receiving yards compared to their average in 2001 and 2002. Seven of these veteran receivers in 1994 had at least 250 yards more than they had averaged the two seasons before. Only two receivers last year could say the same: Randy Moss and Keenan McCardell.
It sounds like the rule changes really had a strong effect until you realize how many of these receivers really took their big step forward in 1993, the year before the rule change, and not in 1994. Tim Brown, for example, finally blossomed in 1993 after the Raiders stopped futzing around with Todd Marinovich at quarterback. Cris Carter finally put it together in 1993 after screwing around for his first few seasons in Philadelphia. Irving Fryar got traded in 1993 from the Hugh Millen-led Patriots to the Dan Marino-led Dolphins. Each of these receivers had a bigger gain in yardage in from 1992-1993 and then a smaller gain from 1993-1994.
The next two veterans who had big steps forward in 1994 are connected. Henry Ellard left the Rams for the Redskins and ended up having his second-best year in his twelfth NFL season. He went from 945 yards in 1993 to 1397 yards in 1994, and enjoyed two more 1000-yard seasons before retiring after 1998. With Ellard gone, Flipper Anderson became the number one receiver with the Rams and went from 552 yards to 945. This was a total fluke and probably had nothing to do with any rule changes. Somebody had to catch the ball for the 4-12 Rams. Anderson had only eight more catches his whole career.
The sixth receiver in the group was Quinn Early of the Saints, who had 566 yards in 1992, 670 yards in 1993, and 894 yards in 1994. That's nice but not really a "monster year."
The receiver who may best represent what Clayton thinks will happen with Harrison and Bruce is Andre Reed of the Bills. After 913 and 854 yards in the previous two seasons, Reed caught 90 passes for 1303 yards in 1994, fifth in the league and second-highest in his 16-year career. Unfortunately, it is hard to tell how much of a fluke this was because Reed got injured the following year and played only six games. Also, if I was a Ram or Colt fan this isn't really the example I would want my favorite receiver to follow. Reed had that great year but the Bills as a whole collapsed to 7-9 after four straight AFC titles.
Hmm, this is starting to go on a bit, isn't it. OK, as for the other veterans, I can tell you there were plenty of receivers who had years in lines with their last few seasons (Jerry Rice, Anthony Miller, Andre Rison) and a few guys who collapsed as veterans sometimes do (Mark Jackson, Eric Martin, Anthony Carter).
If 2004 does turn out like 1994, what will likely happen is that the decline phase of some veteran receivers will slow down a bit, and a couple of them will have big seasons out of line with what they've done the last two years. For most of them, though, things won't be any different than if there had been no rule change. As for who is most likely to suddenly have an Andre Reed season, can you name this wide receiver?
That current wide receiver whose last two seasons are eerily similar to the ones Andre Reed had at the same age is Eddie Kennison.
2005 Update: Bingo. Eddie Kennison had his first 1,000-yard season in 2004. Numerous receivers above the age of 30 had big seasons, led by Terrell Owens, Muhsin Muhammad, and Joe Horn.
Clayton: "Maybe this is just judgmental, but I believe rookie receivers will have more impact in their first seasons."
On the other hand, if we use 1994 as a guide, some rookies are really going to feel the effect. From 1991-1993, only three rookie receivers taken in the first two rounds of the draft had at least 500 receiving yards. In 1994 alone, three rookie receivers taken in the first two rounds of the draft had at least 500 receiving yards. In fact, two of these receivers had more yards in 1994 than any rookie receiver of the previous four years: Darnay Scott (868 yards) and Derrick Alexander (828 yards). Then, in 1995, Joey Galloway had the first 1000-yard season of any rookie receiver since Bill Brooks with the 1986 Colts. (As an aside, Brooks may have been the most unexpected rookie receiving star of all time; he was a fourth round draft pick from a school, Boston University, that doesn't even play football anymore.) And 1996, of course, was 1996.
In total, eight rookie receivers from 1991-1993 topped 500 yards. 18 rookie receivers from 1994-1996 topped 500 yards. Of course, correlation does not mean causation, and there are plenty of other possible explanations for why rookie receivers were so much better after 1994. But if you believe that the pass interference rule changes will make 2004 much like 1994, rookie wideouts are going to have much better seasons than we expect. Good news for everyone who took a wideout in the draft -- and perhaps another reason to hop on the Jacksonville and Detroit bandwagons.
2005 Update: Right idea, wrong receivers. It was a huge year for rookie receivers, just not the ones from Detroit or Jacksonville. Michael Clayton had an astonishing season, one of only two receivers to rank in the top 10 in DPAR since 1998. (The other? Randy Moss.) Lee Evans and Larry Fitzgerald were very good as well. Roy Williams was good until he was hobbled by injuries.
Clayton: "Defenses will use more blitzing packages to put pressure on quarterbacks and force quicker throws... Sacks fell to 1,092 last year, lowest since 1994. Watch the sack numbers increase."
Unfortunately, I only had enough time to total the sack numbers for 1993 and 1994 (actually, Mike did it for me). There were 1,055 sacks in 1993 and only 936 sacks in 1994. As Clayton notes above, that's the lowest total for the last decade. If sack totals went down last time the NFL fiddled with the pass interference rules, I'm not sure why they would go up this time.
2005 Update: Clayton wins, sort of, as sacks did in fact go up in 2004. There were 1196 sacks compared to just 1092 in 2003. But there were also 1196 sacks back in 2001, with only 31 teams, and more than 1200 sacks in 1999 and 2000.
Before we go, there was one prediction that Clayton didn't make, but many people are making it. After what they did to the Indianapolis receivers in the AFC championship game, it's pretty clear that this rule change is aimed, in part, at the Patriots. So let's figure out what happened to the top defenses of 1993 when the rules were changed.
Lots of people but not Clayton: "This rule change will hurt defenses that depend on physical play from their cornerbacks." (If you are a Colts fan, add: "and cheat all the time")
Didn't happen in 1994. In terms of yards allowed per pass attempt, the top four pass defenses in 1993 were Dallas, Green Bay, Chicago, and San Francisco. In 1994 they were all still in the top six. The fifth-best pass defense of 1993 was Kansas City; they were average in 1994, but that wasn't because the rules had gotten harder on their defensive backs, that was because their defensive backs all left town (Kevin Ross to the Falcons, Bennie Thompson to the Browns).
The number one defense in 1994 in terms of yards allowed per pass attempt was the Cleveland Browns. They were coached by some guy named Bill Belichick.
2005 Update: Yep, sure slowed down the Patriots, didn't it?
We don't really know what effect the change in pass interference guidelines will have this year. However, if the effects are similar to the last time these rules were strictly enforced, back in 1994, here's what you can expect:
8 comments, Last at 13 Jun 2005, 5:33pm by Jeff F