If I only had a Blogpoll Ballot…

Submitted by The Mathlete on

Even though I am like Data and deal strictly in numbers and facts, my cavorting with you Michigan folks has left me in Blogpoll purgatory. My requests for a ballot were summarily dismissed so I am taking my efforts to the people. Even though this is a Michigan site, my Mathpoll will be done strictly on a non-human intervention process.

Methodology

My first ranking will be based on team strength with no relevance to schedule. It will be done using my Points Above Normal (PAN) metric. It’s really Points Above Average but PAN was nicer acronym. The ranking determined using 2/3 historical average, in this case 2003-2008 and 1/3 last season.

There are no adjustments made for returning starters, coaching changes or anything else. I have not done a thorough examination of how this does historically, but doing some quick work indicates that it is appropriate to weight the historical average more than a single previous season. This method is essentially regressing to the mean with the mean being unique for each team.

Teams that have made big strides forward in the last year or two (Alabama, Stanford, Cincy) will seem low because of their variance and historically strong teams that have struggled in the last year or two (Michigan) are bolstered by a strong track record.

After week 1 the poll will be purely in season results based with the exception that for the first four weeks the opponent adjustment will be made based prior year opponent ratings.

The Poll

Rank Team Conf Pred 2009 2003-2008
1 Texas Big XII 22.7 26 21
2 Florida SEC 19.0 22 17
3 Oklahoma Big XII 17.9 16 19
4 Boise St WAC 17.0 22 14
5 LSU SEC 16.6 19 15
6 Ohio St Big Ten 16.0 16 16
7 USC PAC 10 15.3 6 20
8 TCU Mtn West 14.6 29 7
9 Alabama SEC 13.4 24 8
10 Virginia Tech ACC 12.9 18 10
11 Oregon PAC 10 12.6 17 10
12 Penn St Big Ten 12.4 14 11
13 Texas Tech Big XII 12.2 13 12
14 Georgia SEC 11.8 13 11
15 W Virginia Big East 10.4 8 11
16 Auburn SEC 9.5 9 10
17 BYU Mtn West 9.2 13 7
18 Cal PAC 10 8.2 2 11
19 Boston College ACC 8.2 6 9
20 Utah Mtn West 8.1 6 9
21 Wisconsin Big Ten 8.0 10 7
22 Clemson ACC 8.0 11 6
23 Iowa Big Ten 8.0 10 7
24 Oklahoma St Big XII 8.0 6 9
25 Arkansas SEC 7.7 12 6
29 Michigan Big Ten 6.6 1 9
38 Purdue Big Ten 3.9 2 5
45 Michigan St Big Ten 1.7 3 1
59 Minnesota Big Ten (0.1) -3 1
72 Northwestern Big Ten (3.0) -3 -1
75 Illinois Big Ten (3.4) -2 -3
96 Indiana Big Ten (7.9) -8 -9

Based on their strong history, Michigan comes in at #29 with a 6.6 rating (9.5 historically, 0.9 last year).

Comments

meechiganroses

August 23rd, 2010 at 10:45 AM ^

Great work, always interesting to see a different take on how we rank teams in the universe that is college football.  Two questions for you:

1. Why did you choose 2003-2008 as historical?

2. How do you feel strength of schedule on past and future opponents can weigh on ranking?  i.e. would you include them in this poll? why or why not?

The Mathlete

August 23rd, 2010 at 10:58 AM ^

1. 2003 is as far back as I can get data, so it can't go any further than that. A 5-6 year window seems to be a good representation of the calibur of a team. How good a team was 8-10 years prior doesn't have a whole lot of relevance to present day but the period is long enough that one fluky year won't move the needle too much.

2. Strength of schedule is factored into the historical numbers. The numbers used to determine the rankings are all adjusted for strength of opponent in the given year. What is not accounted for is how this season's schedule will affect final records. Boise St and LSU are both essentially +17 but you would be crazy to think that they would have the same record. Boise St's average opponent is a -4.6 rating and LSU's average opponent is +2.0.  The two teams could play equally as well but LSU will likely have a worse record.

amasianblue

August 23rd, 2010 at 2:51 PM ^

wouldn't it make more sense to take historical data to be '06~'08 to account for exposure to players on the current roster (i.e. '06 would have been the earliest year a RS Senior would now be playing)?

The Mathlete

August 23rd, 2010 at 3:04 PM ^

It's not really about the players returning, it's about the program's historical performance. Because of the nature of college football, team success is reasonably consistent over the years as classes come and go. Some obviously do better than others but this is an attempt to establish a baseline of where the program is at. The previous year is used to account for the most current snapshot of program performance.

MGrad

August 23rd, 2010 at 4:01 PM ^

Can you help people understand the rationale for applying 2/3 weight to historic data?  I am used to you being very systematic in your analysis, so this caught me off guard.  I would have thought that the bias would be applied towards last year, with some kind of factor for the percentage of returning starters?

Other than for the effect on recruiting, 2003-2006 are probably no longer relevant to an accurate ranking for 2010.

The Mathlete

August 23rd, 2010 at 4:51 PM ^

I am a bit limited on my dataset, but using what I had, here is what I found. As you increase the years used for the historic portion, the total Mean Absolute Deviation decreases. In other words, the more years back you go, the more accurate the prediction is. This obviously has limits, but with the data from 2003-2009, for each year you add back, you reduce your error by 4-5%. At five years you have reduced the error about 20% from just repredicting the previous season. 

So if you have justified using more years (and through 2009 results, using all years possible has been justified) then the question becomes what is the right mix between new and old. For the completed 2009 season, the answer was 65% old, 35% new which I just rounded to 2/3 and 1/3 because the error isn't very sensitive to small changes in splits. This does make a big difference for team's like Michigan. Depending on which way you move the splits can make a big difference for teams whose recent performance significantly varies from historic performance.

The Mathlete

August 23rd, 2010 at 5:07 PM ^

Those things are definitely factors but they are difficult to model, especially given a limited data set. To effectively factor a coach you have to have an extended period at an old position plus time with a different coach there to compare program baseline (Winning half your games gets you a new job at Eastern Michigan, it gets you fired at Alabama). Plus, this method works extremely well without coaching adjustments. Last year with less data I predicted a final record for all 120 FBS teams and was within 1 game for 58 teams and within two games for 90/120.

umhero

August 24th, 2010 at 1:23 AM ^

I like the effort.  Pre-season polls are typically so flawed anyway that all they are good for is blood in the water for rabid fans.  This approach essentially assigns a value to each program that can then be applied to each game.  I suspect this will result in a very accurate poll at the end of the season.

Well done!

Not a Blue Fan

August 24th, 2010 at 6:40 AM ^

1) Isn't using historical strength going to overweight some teams heavily (e.g. LSU and Michigan)?

2)

It will be done using my Points Above Normal (PAN) metric. It’s really Points Above Average but PAN was nicer acronym.

What about "Points Above Mean" (PAM)?

cheesheadwolverine

August 25th, 2010 at 12:51 AM ^

You mentioned you did some quick empirical work.  How well does this model predict the last couple seasons?  Would be interesting to see if it did better or worse than the blowhards on TV.  Anyway, very cool.  Thanks!

hermus

August 25th, 2010 at 3:35 PM ^

I really enjoy your analysis and just wondered if you might have a separate blog where you post more general college football analysis (not Michigan-centric).  I would love to see your PAN-based ratings for all 120 teams for example, along with other analyses that might look at college football as a whole.  Nothing against Michigan, I just happen to be more of a fan of college football in general (okay okay, I'm actually a fan of [name redacted to avoid taunting] so I'd like to see where they fit into these analyses, but beyond that I really do just enjoy analyses of all college football).