The Ratio of Relative Importance

Northwestern student Keith Goldner is working on an Expected Points metric that has some promise; here, he attempts to measure the impact of each facet of the game.

View Full Article


15 comments, Last at 08 Apr 2011, 11:41am

1 Re: The Ratio of Relative Importance

Didn't FO really start when someone suggested looking beyond correlations and explained why "run to win" was a fallacy? This seems like it might make correlations easier to understand, but the net effect on our understanding of the game is pretty minimal.

Brian Cook of once critiqued an article by sports economist David Berri by saying "When you've got a hammer, everything looks like a nail. Berri's hammer is regression analysis, and he goes about hitting everything he can find with it until he finds something that seems vaguely nail-like from a certain angle." I'm worried that something as simple as this would fall prey to that kind of trap.

Cook's critique is here:

2 Re: The Ratio of Relative Importance

You can do pretty much the same math with DVOA. And in both cases it's not telling you "offense matters more than defense;" it's telling you "we measure offense better than we measure defense."

9 Re: The Ratio of Relative Importance

That, my friend, is one of the funniest, awesomest, most word-efficient comments I have seen here in a long, long time. I plan to steal it and use it at some point... maybe when my son says, "I play catcher just like I play running back."

11 Re: The Ratio of Relative Importance

It's telling you offenses are more variable than defenses. If you believe in DVOA, you knew this already. If you don't believe in DVOA, it's easy enough to show -- the SD of Points For (across team seasons) is bigger than the SD of Points Against.

3 Re: The Ratio of Relative Importance

So...I took their data, pasted it into Excel, and then entered the equation they got from doing the regression, and tried to see what the equation predicted the wins would be for various teams. Here are some of the the results I got:

2010 Exp Wins
ARI -622.1682
ATL 332.1576
BAL 249.2379
BUF -228.1708
CAR -702.735

Then I tried with the "Off Rating" and "Def Rating" instead of "Off NEP" and "Def NEP", and that gave me this:

2010 Other Exp Wins
ARI -17.1455
ATL 78.9301
BAL 57.8899
BUF 13.6851
CAR -67.775

Either someone needs to explain what I am doing wrong, or I am going to conclude that doing this sort of regression analysis is not a very useful way to analyze this data.

12 Re: The Ratio of Relative Importance

The main draw here is that you can split credit between offense, defense, and special teams in a reasonably transparent way.

Running my own regression, I get that a win is about 41 NEP. The 2010 Patriots had 270.5 NEP, so they should have been around a 8 + 270/41 = 14.6 win team. Of the 6.6 wins above average, 5.4 were due to offense and 1.2 were were due to special teams; defense was basically average. This doesn't quite square with DVOA, but there are no opponent adjustments.

The Panthers played like a 2.8 win team according to NEP. Their offense lost 4.4 wins, and their special teams lost 0.6 wins. Pretty close to DVOA.

Goldner's normalisation presumably gives you a slightly better picture than this, but not much more.

The explanatory power isn't magic or anything. NEP are almost the same thing as raw points, and we shouldn't be surprised that raw points explain wins pretty well.