FEI 2008 Projections

by Brian Fremeau

College football would be better off without preseason rankings. The poll-anchoring tendencies of many voters grant a season-long unearned advantage to teams placed in lofty preseason positions. The voters can't decide if they should rank teams based on expected strength, expected record, or some inconsistent combination of the two. And perhaps worst of all, preseason polls place exaggerated importance on the final game or games of the previous season, smudging every team's clean slate with the residue of last year's final success or disappointment.

Ah, heck, let's join the fray. The Fremeau Efficiency Index (FEI) was always intended to be a retrodictive evaluation metric, not a predictive one. But as first introduced in an essay in Pro Football Prospectus 2008, the power structures of major college football ideally suit the relative consistency and stability of team strength year in and year out. The correlation of winning percentage from year to year in college football (0.60) is much better than it is for pro football teams (0.26). And our drive-based, opponent-adjusted measure of the strength of each team, FEI, likewise has a stronger year-to-year correlation (0.77) than DVOA does for the pros (0.42).

The PFP 2008 essay introduced an even stronger baseline for projecting team strength, a multi-year team evaluation called Program FEI. Program FEI evaluates a five-year performance of each team in each game as though the entire period were a single season. Even though college football teams cycle through an entire roster over a five-year period, and may fluctuate dramatically in their individual game performances over that span, the 60-game perspective more precisely refines the baseline expectations for each program. The complete 2003-2007 Program FEI Ratings can be found here [1], in Google Spreadsheets.

There aren't too many surprises at the very top of the Program FEI ratings, but a few items are worth highlighting:

• Boston College ranks No. 12 in Program FEI, arguably the biggest surprise in the top 20. AP voters have been consistently surprised by BC; the Eagles have only once been ranked in a preseason poll over the last four seasons, but have finished in the rankings each of those years. Even the one time BC was ranked in the preseason poll, they ended the season with a higher ranking. The Eagles are one of only ten teams with a winning record in the last five seasons against the Program FEI Top Ten, albeit entirely against one team (3-2 against the ACC's best, Virginia Tech, including 2-1 in Blacksburg).
  
  

  Winning Record Against Program FEI Top 10, 2003-2007
  Prog. FEI Rank	Team	Prog. FEI	W-L	vs. Top 10	vs. Top 40
  1	USC	0.311	59-6	5-1	32-5
  2	LSU	0.261	54-10	11-6	26-9
  3	Georgia	0.243	48-14	8-7	23-11
  4	Ohio State	0.237	51-11	5-4	23-9
  7	Texas	0.216	53-10	5-4	15-5
  12	Boston College	0.182	44-17	3-2	26-12
  14	West Virginia	0.181	46-14	3-2	11-9
  15	Wisconsin	0.179	45-17	5-4	17-12
  46	Pittsburgh	0.064	28-28	1-0	7-14
  51	South Florida	0.041	29-25	1-0	6-8

• Also posting a winning record against the Program FEI Top Ten from 2003 to 2007, Wisconsin ranks as the No. 15 Program FEI team despite never finishing a single year better than No. 17. That quirk results from the Badgers' consistent performance over the past five seasons at the top of the Big Ten's second tier, while teams ranked in their vicinity have experienced somewhat less consistency and/or suffered poorer performances against top teams.
• Utah (No. 26) ranks as the best non-BCS conference team over the last five years, ahead of Boise State and conference rival BYU, and far ahead of last season's mid-major darling, Hawaii. The Utes, however, did not play a single Program FEI Top Ten team from 2003 to 2007. They open the 2008 season this Saturday at Program FEI No. 9 Michigan.
• No team has gone undefeated over the last five years against teams ranked outside the Program FEI Top 40. Three teams (USC, LSU, and Florida State) have lost only once to sub-40 opponents. Six others (Ohio State, Virginia Tech, Michigan, Miami, Tennessee, and Maryland) have lost only twice to sub-40 opponents.

[2]

The 2008 FEI Projected Ratings were created from baseline Program FEI data weighted for recent year data, and further adjusted based on returning offensive and defensive starters for each team. This process improved the final correlation of Projected FEI to Y+1 FEI to 0.80. A regression analysis of other transition factors such as conference strength, head coach experience, and returning quarterback experience did not measurably improve the projection model.

Projecting Team Records

It goes without saying that no team should be expected to defeat every team ranked below it, nor to fall to every team ranked above it over the course of the season. In three of the last five seasons, the national champion failed to finish the year undefeated, and last year alone witnessed a barrage of upsets that shook the Top Ten on a weekly basis and allowed two-loss LSU to ultimately be crowned champion. In order to determine how we should expect teams to play against greater or lesser competition, Table 2 presents the five-year composite records of team types against other team types. The Massey Consensus Ratings [3], a composite that combines more than 100 independent computer ranking systems, were used to create the team type categories.

Like the Program FEI data, nothing is too surprising about the relative performances of team types against one another over the course of many games. What this breakdown does help illustrate is a general summary of win expectations of teams against variable competition, and the comparisons that can be drawn between team type data. For instance, Above Average teams are at least as likely to defeat Very Good teams as Very Good teams are likely to defeat Elite teams. Fans of, say, the No. 10 team in the nation might have trouble with that, conceptually, believing that their team certainly has a better shot at knocking off a Top Five opponent than they have of getting upset by a team outside the Top 25. The team type summary data disagrees with this assumption.

Drawing generalizations about seven categories of team types is one thing, but can we use FEI data to refine win expectations for specific teams? In fact, we can, as Figure 1 demonstrates. The graph plots the expected winning percentage of a given team (y-axis) according to its "power advantage" over its opponent (x-axis). The power advantage is equal to the standard deviation delta between the two teams' FEI ratings.

Figure 1: Win Pct vs. "Power Advantage" of FEI

Based on the strong relationship between delta FEI and winning percentage, I projected an expected winning percentage for each team in every FBS game scheduled for 2008, and combined these to create the projected records and conference records for each team. All FCS games were ignored, and since conference championship games and bowl game participants have not yet been determined, the projected records ignore these potential games as well. Table 3 presents the FEI Projected Conference and Division champions for each FBS conference. The complete 2008 Projected FEI Ratings can be found here [4].

The projected records and conference records are not intended to precisely identify the winner of individual games. Note, for instance, that Georgia and Arizona State might be expected to each go undefeated against their out-of-conference slate of opponents, yet the two teams play each other on September 20. In actuality, FEI projects Georgia to win 5.8 games in conference and 2.7 games out of conference (8.5 wins, rounded up to 9); Arizona State is projected to win 5.4 games in conference and 1.2 games out of conference (6.6 wins, rounded up to 7). To further illustrate the record projection process, Table 4 presents a game-by-game breakdown of the expected win percentages of No. 1 Ohio State and No. 2 USC.

Will the 2008 college football season provide any of the drama of last fall's madness? Does Ohio State's entire season hinge on the showdown in Southern Cal? Will any team from the best conference in the land scrape together enough fortune to survive their way to the title, or is the SEC competition too tough? Will USC manage to navigate their challenging slate, or will they slip up against a middle-of-the-Pac-10 foe? Will the old Big 12 heavyweights step up and assert themselves once again, or will Missouri, Kansas and Texas Tech take charge? Are there any contenders in the ACC and Big East? Is Notre Dame ready to bounce back? Is Illinois about to fall back to earth? We're about to get some answers. The FEI 2008 Ratings will appear on Football Outsiders each Wednesday throughout the college football season.