Thanks a lot, Dak Prescott. Now more people will think the fourth round is still a gold mine for quarterbacks, but the data says otherwise. The update to our quarterback draft study for 1994-2016 shows little has changed: finding a good QB is really hard.
28 Jul 2010
by Bill Barnwell
If you haven't already, please read the previous entry in this series on adjusting our plus-minus statistic for a player's team before going through this piece.
What makes this concept of team-adjusted plus-minus so interesting is the promise of producing a measure of hands that is universal across schemes, one that accounts for the benefits of playing with Peyton Manning and the hindrances of catching passes from Derek Anderson.
Before getting into the second part of the research, I wanted to congratulate reader "Peregrine" on successfully guessing that the player since 2006 with the biggest gap between his per-play plus-minus and his team's per-play plus-minus was Packers halfback Noah Herron. In 2006, Herron caught 28 of the 30 qualifying targets thrown to him, producing a 93 percent catch rate and a plus-minus of 4.6 catches above expectation. He was the only Packer that year to be thrown a single pass and not end up with a negative expectation, thanks to Brett Favre's 56 percent completion percentage. The rest of the team had a -47.9 plus-minus on 529 targets, yielding a per-play plus-minus of -.09. Since Herron was at .15, the resulting difference was .24, the highest-such figure over the past four seasons with a minimum of 30 targets.
People asked about the identity of the Darkside Herron in the comment thread. The worst running back with team adjustments built in would be from that same year: Larry Johnson of the Chiefs, who had a -8.7 plus-minus on 61 targets. He had a per-play plus-minus of -0.14, while the rest of the Chiefs were at 0.02. The difference rounds to -0.17, which is the biggest difference of any back.
If we're expanding the scope to players of any stripe, some familiar favorites come into play. It's no surprise that Darrius Heyward-Bey's 2009 season and Ashley Lelie's 2008 campaign are at the top of the charts; by this metric, DHB's season actually figures as the fractionally worse endeavor on a per-play basis. Although Lelie had a worse per-play plus-minus (-.29 to Heyward-Bey's -.28), the absence of JaMarcus Russell for a fair chunk of 2009 means that the baseline for DHB's season (-.04) is slightly better than Lelie's (-.05). The difference is three one-hundreths of a catch per play. Just to mix it up, slightly behind them is the 2008 season by Marty Booker of the Bears, who had a whopping -9.6 plus-minus on 41 targets, which eventually yielded a team-adjusted per-play plus-minus (TAPPPM?) of -.23 catches.
I'd be happy to field questions about the best and worst players over the past four years in the comment thread, but I think it's more relevant here to talk about some particular teams and situations from 2009, and what plus-minus suggests about the performance of both quarterbacks and receivers going forward.
I didn't produce figures that split out performance by a given quarterback, which may color the numbers of the receivers here, since Chris Redman threw 21 percent of the passes by the Falcons a year ago. On the other hand, Redman completed 56 percent of his passes and Matt Ryan was only at 56.3 percent, so it wasn't as if there was a significant difference in accuracy between the two.
By almost any measure, Roddy White didn't do his best work a year ago. This metric goes a step further and says that he was the worst in the league among guys with 100 targets or more. He had a -9.1 plus-minus on 150 targets, and after adjusting that figure for the context of the team (a -.06 per-play figure versus .02 for the rest of the Falcons), his cumulative team-adjusted total of -12.7 catches below expectation was the worst in football.
Now, here's where we need to clarify using this statistic in context. Does that figure mean White was an awful receiver a year ago? Absolutely not. We know from watching games that the team, especially with Redman at quarterback, was desperate to force throws to White. The 2009 figure is out of character with his career team-adjusted plus-minus (-.02 in 2006, 7.0 in 2007, and -2.5 in 2008). It was a down year for White, no question, but it has to be considered in context. His 52 percent catch rate is all but sure to rise in 2010, and it should drive a healthy improvement in White's statistics.
Here's a quick case where a player's skills might be overrated. Ray Rice's primary role in the Ravens' passing offense is to serve as the safety valve/dumpoff option/quick read, and he catches most of his passes at or near the line of scrimmage. As a result, although he caught 79 of his 97 qualifying targets, he only had a plus-minus of 2.7, and once you adjust for the team context, that figure falls to 0.14. In other words, he caught passes at exactly the rate an average player might in this offense.
Fluke alert: Brian Leonard caught 30 of the 34 targets thrown in his direction, putting up a per-play plus-minus of .11 when the rest of the team was at -.03. That's not going to happen again, so expect his catch rate to decline this year.
Just behind White in the annals of poor catch rates is Roy Williams, who went 38-for-80 (-10.3 plus-minus) on a team that was above-average on passes not thrown to him. He finished with a team-adjusted plus-minus of -12.4 catches below expectation, the second year in a row he's been well below expectations.
Here's one where I think the team adjustments make sense. Calvin Johnson has a raw plus-minus of -5.9 on 128 targets; we can't adjust that figure for Matthew Stafford lobbing the ball at him in triple coverage, but we can adjust it for the misthrows Stafford makes elsewhere. Johnson's per-play plus-minus is -.05, but the rest of the team is at -.07; adjusting the figure for team has Johnson at 3.3 catches above expectation.
Another reason to favor Jordy Nelson over James Jones in the battle for the Packers' third receiver job: Nelson had a team-adjusted plus-minus of 4.0 catches above expectation on 28 targets, while Jones was at -6.6 on 56 targets. This camp battle was something we debated a lot in the process of writing the book and putting together the projected role variables in KUBIAK. Nelson's almost certainly the better receiver already, and I firmly believe that Nelson will be playing the larger role this season.
And here's one where we're not modeling the relationship between receivers properly. Andre Johnson has a plus-minus of 4.2 catches above expectation on 156 targets. That's fine. However, Johnson plays on a team where everyone else catches a high percentage of the passes thrown to them, and once we adjust the figure for the team context, Johnson is actually 8.1 catches below expectation.
Of course, that's not realistic. One of the reasons why those guys are so open to make those catches is that Johnson draws attention away from them. On the other hand, his numbers haven't consistently been that bad -- his team-adjusted plus-minus figures go from -13.0 in 2006 to 7.2 in 2007 and 5.0 in 2008. Last year's drop mirrors a decline in his catch rate, which fell to 59 percent after being at 68 percent in 2008 and 70 percent in 2007. This is one where Texans fans would be able to help: Did Johnson struggle to catch the ball in 2009? His catch rate didn't drop significantly in games without Owen Daniels.
Another reason to like Mike Thomas: He had a team-adjusted plus-minus of 6.6 on 59 targets as a rookie last year. Second wideout in the Jaguars' offense isn't a particularly glamorous role, but there's a lot of potential there as a late-round guy in fantasy drafts.
Greg Camarillo had a great fluky season, with a plus-minus of 8.9 catches above expectation on 68 targets. His figure of 19.6 catches above expectation per 150 targets was fifth-best in the league. I don't think he's going to catch 69 percent of the passes thrown to him again this year.
Since one of the reasons this statistic was developed was to try and track players like Wes Welker, I'll mention him here. In 2006, Welker had a plus-minus of 3.6 on 93 targets; after adjusting that figure for the miserable Dolphins offense of that year, Welker's plus-minus more than doubled, to 8.8 catches above expectation. He had a difference between his per-play plus-minus and the rest of the team's per-play plus-minus of .09; good, but not extraordinary. Had we done this statistic in 2006, I don't think people would have recognized Welker as a star waiting to break out, just a good player in a bad offense.
On the other hand, that was the year of Chris Chambers's remarkably terrible season; he had 59 catches on 134 qualifying targets, which yielded a staggering plus-minus of -21.4. The rest of the team was just about average, so his team-adjusted plus-minus was also -21.4. That is the worst single-season team-adjusted plus-minus of any receiver over the four-year stretch by a staggering margin; the next-closest receiver is Torry Holt, who put up a plus-minus of -14.2 for the Rams that year.
This is one that really interested me. The player who has the largest team-adjusted plus-minus of any player over the past four years? It's the Giants' Steve Smith. Last year, Smith had a raw plus-minus of 13.8 on 149 targets, which is a very impressive figure. He had a .09 per-play plus-minus, but the rest of the Giants were at -.02! None of the other players with big target totals were very good at catching the ball -- Mario Manningham was almost exactly average (-.1 -- total -- over 96 targets), Hakeem Nicks was only slightly above-average (2.9 on 69 targets), and Kevin Boss was slightly below-average (-0.3 total on 64 targets). Of course, Ahmad Bradshaw and Brandon Jacobs were both terrible.
As a result, Smith had a team-adjusted plus-minus of 16.7, while everyone else with more than 10 targets besides Nicks ended up with a figure below zero. That raises a question to me: Is the "improvement" in Eli Manning's statistical record really just the effect of replacing Plaxico Burress as his top receiver with Smith? I don't know if the statistical record supports it -- Burress had a -0.3 plus-minus on 117 targets in 2006 and was at -3.4 on 138 targets in 2007 -- but I think there's probably at least some cause there.
Because the wideouts were so bad, Zach Miller ends up looking like one of the great tight ends in league history. He had a 5.8 plus-minus on 90 targets when the rest of the team combined for a -32.7 plus-minus on 348 targets. The resulting difference pushes Miller up to 14.2 catches above expectation, a figure topped by only Jason Witten and one other tight end, both in 2009. (I'll get to that tight end in a minute.)
In 2008, Malcom Floyd had one of the great outlier seasons, with 27 catches on 35 targets and a staggering 8.2 catches above expectation; scaled to 150 targets, his figure of 35.1 catches above expectation was the best of any receiver with 30 targets or more over the four-year stretch.
In 2009? He dropped back to earth. He put up a reasonable plus-minus of 5.2 on 73 targets, but once you strip out the team context, his plus-minus drops to -0.6. Not everyone will bounce back towards the mean the way Floyd did, but staggering outliers in his vision just have to. The aforementioned Camarillo and Miller are two candidates that stand out as almost sure to regress, and the third is the tight end that we promised we'd get to in a minute.
On the Welker hunt? Danny Amendola had a raw plus-minus of 0.1 catches above expectation on 61 targets, but adjust that for the suck of the St. Louis offense, and he was actually at 4.0 catches above expectation.
Minute's up. Kellen Winslow has lived a rough pro existence; in addition to the injuries, he's yet to have a season where his teammates have put up an per-play plus-minus greater than zero, while he's had a positive figure in every season but one (2007, when he was at -.02). Last year, as an example, he put up a 3.5 plus-minus on 117 targets, while the rest of his teammates stumbled through their 367 targets with a combined plus-minus of -38.1. The resulting difference between his per-play plus-minus and the rest of his team's was .13, and his team-adjusted plus-minus of 15.7 catches above expectation was the best of any tight end over the past four years.
It's not going to happen again. Even if Winslow stays healthy and the team goes with two rookie receivers, not even Winslow is likely to sustain a plus-minus rate that represents 20 percent of his actual catches (15.7 versus his 78 receptions, which is 20.1 percent). He's going to drop off, and he's probably overvalued in fantasy drafts at this time.
We aren't able to update plus-minus during the season because it involves charting data, but we'll keep working on improving the methodology for next season, and report back on what we saw in the 2010 season in Football Outsiders Almanac 2011.
But now that we've focused on the catch itself, what's next should be obvious: Next week, we'll be taking a look at how effective receivers are once they've got the ball in their hands.
31 comments, Last at 25 Jul 2011, 8:04pm by nath