Postmortem: How Much Did They Actually Improve? Comment Count

Brian

After Michigan's 4-0 start the offense skidded downwards into mediocrity and inconsistency, gradually erasing the early giddiness around these parts. Early in the year, I said "the question is not whether this will be Michigan's best rushing offense of the decade, but by how much," which… well… Alan Greenspan has something to say about that.

Still, for anyone who actually watched the team this year and last, the idea that things didn't improve is laughable. The favorite tool of folks who like to claim this is Michigan's scoring offense in the Big Ten. Check this pre-OSU Michigan Monday for an example. Okay, actual scoring—despite being the point of everything—is is kind of a wildly unreliable metric, especially when your quarterbacks are freshmen and very, very turnover-happy. But when a tempo-free aerial says basically the same thing when it comes to yards per attempt…

b10_ypa_2009

…the offense has not exactly reached juggernaut status.

Still, it did improve significantly. All of this focus on conference play ignores that last year Michigan was 1-3 outside the conference and lost to a 3-9 MAC team because it scored 10 points. Against Notre Dame the net offensive output was probably negative because of five horrendous turnovers. This year the MAC snacks were swatted away and Michigan was one of many teams to scorch TAH-NOO-TAH's blitz-mad ways. They were in the ballpark of crappy, and this represents a step forward from last year, when Michigan football was the Indiana basketball of the Big Ten: too terrible to even fit on the scatterplot. To repeat a theme of late, this is progress of a not-very-fun variety.

There is noise yet in the scatterplot, though, as it makes Northwestern's dink-mad offense look worse than Michigan's when it wasn't. Let's take away all the noise caused  by varying numbers of drives, varying average drive start, and opposition offenses, and just look at how efficient Michigan was on a drive-by-drive basis.

Brian Fremeau maintains a rating that does this called the Fremeau Efficiency Index. It's similar in concept to the numbers the Mathlete has posted here over the last year or so: find the average success rate in Situation X and measure teams by how far above or below that break-even line they are. Fremeau has many numbers; we'll look at a few. OE is "offensive efficiency" and is just a measure of how much you score relative to the D-I average. It's a tempo-free stat roughly equivalent to Points Per Possession in basketball. The second, FEI, is this in the words of its author:

College football rating system based on drive-based Game Efficiency data that rewards playing well against good teams, win or lose, and punishes losing to poor teams more harshly than it rewards defeating poor teams.

I couldn't find a more specific definition of what exactly this means; IMO, this is less interesting as a performance measure than it is an attempt to make the ratings more plausible to human eyes looking for a ranking system. So the focus should be on the raw numbers.

100% Awesome Mediocrity

Raw and adjusted, your results:

Year OE OE Rk Off FEI OFEI Rk
2008 -0.29 98 -0.15 80
2009 -0.05 65 -0.01 61

(This rating excludes I-AA games, as all serious attempts to quantify college football do.)

So there you go: from one of the worst teams in D-1 to totally mediocre. Totally mediocre seems acceptable, or better, when you're graduating four starters, have a freshman quarterback, play most of the year without your best offensive lineman, don't get to use your senior tailbacks all that much, and suffer from another epic turnover plague.

The Unfortunate Flipside

The other side of the ball is sort of horrifying:

Year DE DE Rk Def FEI DFEI Rk
2008 -0.14 44 -0.13 45
2009 0.12 75 0.04 63

…but a little less horrifying than i expected. Michigan's defense under Scott Shafer was actually sort of good-ish, but submarined by terrible field position and a ton of drives faced because of the offense. FWIW, I don't think this reflects poorly on Robinson yet; one year doesn't tell you much of anything. Also, Michigan's two best defensive performances of the year (relative to the opposition) were against Minnesota and Northwestern, after Shafer was basically fired. (And, yes, after Michigan's disastrous attempt to switch to the 3-3-5 cost them the Purdue game.)

The Net

Improvement + implosion = ?

Your net numbers in efficiency: Michigan went from 85th last year to 62nd this year. In FEI terms, Michigan went from 71st to 56th. That is almost exactly in line with what I believe is a reasonable take on the team: it was terrible last year and significantly better this year, but the amount of progress was disappointing not just relative to expectations after 4-0 but relative to those in the preseason.

Attempting to downplay the real improvement that was obvious to anyone watching the offense in something other than the fetal position is silly, and a sign they're about to bring up the Braylon Edwards #1 jersey "controversy" as further evidence that Rodriguez should be fired.

Comments

UMaD

December 2nd, 2009 at 4:15 PM ^

was probably the team's most impressive performance of the season. It was the best team they played all year and they gave them a good fight. Without a couple bad 4CA turnovers, this team is going toe-to-toe with the conference champion. Say what you want about Pryor and Tressel, but our Defense stepped up their play. Our offense moved the ball despite QB errors, a freshman RB, and our best OL.

jlvanals

December 2nd, 2009 at 4:54 PM ^

The score was close because of the conservative play calling style of one Mr. James Tressel. When their offense ran anything other than RB into gap 1-4 we were gashed for major yards (go back and look at every zone read Pryor executed). Also, if Pryor could hit the broadside of a barn he would have had at least 3 TD's I counted from blown coverage. Proud of how hard our guys played, but I don't think OSU was a major improvement in any category.

Durham Blue

December 2nd, 2009 at 6:49 PM ^

OSU was the best team in the B10 conference. Tressel played it close to the vest every game. Yet they still won every conference game but one. The argument that "OSU would've pounded Michigan if Jim Tressel didn't get in the way" is WEAK. Last year we got HAMMERED 42-7. This year we were a couple freshman mistakes from winning. Huge difference. Spare the bullshit.

letsgoblue04

December 2nd, 2009 at 6:51 PM ^

their long passes, this year Pryor air-mailed the three long passes he attempted, all of which were wide open.

That said, without looking at the stats the offense felt like it was much, much more effective against OSU this year than it was last year, despite only scoring 3 additional points. The OSU games are the best demonstration of subjective offensive improvement; the worst are the Illinois games.

msoccer10

December 3rd, 2009 at 10:05 AM ^

If Forcier hits his long passes (two at least I can remember) we win. Yes, Tressel played conservative and it may have been a blow out if he had opened it up, but then again, if he had opened it up maybe Pryor throws a couple more interceptions and we win that way too.

I was proud of the fight of the team and the game was closer than I expected.

brianshall

December 2nd, 2009 at 4:10 PM ^

Brian,
love the effort, admire the faith, but, really, the team sucked. I mean, another year, another no bowl game, another Big 10 basement, another little brother beatdown, another seeking out solace in a victory over a punked Notre Dame team. Is this what any of us really expected? At any time in the RR regime? Evdr?

Saying there is improvement is like saying Jennifer Granholm brought in good high paying green tech jobs to the state of Michigan. It's a true statement on its face, but, in fact, meaningless and worse, ignoring that whole big picture thing.

Minimum 8 wins next year, or he's out. As it should be. Don't forget. Lloyd's worst year, his last, the team rebounded, beat Notre Dame, was competitive throughout the season and kicked Tim Tebow's ass in an actual bowl game.

And for all the little girls who get all upset with me cause I'm talking about firing, I remind you, I'm both agreeing with Brian, merely stating the obvious, and not creating a topic, just commenting on one of Brian's typically sublime posts.

mstier

December 2nd, 2009 at 4:25 PM ^

Since you cited Lloyd's worst year as his last, let's remember that he had Henne, Hart, Long, Manningham, and Arrington.

Who the heck does Rodriguez have? The only real threats he had were Minor (injured), Warren (who teams not named Iowa liked to avoid), and Graham (who in all his beastliness, was very limited because of our poor coverage).

Look at the guys who HAVE developed under Rodriguez. Craig Roh has been fantastic. Omameh looked very competent for a red shirt freshman, especially with his athleticism. Vincent Smith and Roy Roundtree were both very effective towards the end of the season. To me, this at least suggests that Rodriguez can pick out talent for his system and develop it.

brianshall

December 2nd, 2009 at 4:53 PM ^

Else, we'd stop calling them Little Brother (which I love to say).

8 wins by end of year 3. You're questioning this? We are Michigan!

I think we'll get 8 wins. I think RR will be around a long long time. I think he'll probably deliver a national championship. But if you're the coach at Michigan and year 3 you don't get 8 wins, I'll sure be there to help you pack. That I'm very cool with.

cjpops

December 2nd, 2009 at 5:13 PM ^

Who will they beat?

I think it's fair to say that it's likely they will lose these 3 games
PSU (A)
Wisconsin
OSU (A)

Only ONE more loss out of this group to go 8-4. Doesn't look likely to me.
UMASS
BGSU
IU (A)
MSU
Illinois
UCONN
ND (A)
Iowa
Purdue (A)

I just don't see it. I don't think they'll win all 3 road games. I think 7-5 would be a very good season for them. However, I don't think that's enough to keep RR's job. I still support him, but it's hard to see him being kept on with that record. Definitely not if they lose to MSU again.

Either way, I'm excited to watch the team again. Can't wait for Spring!! :)

Go Blue Toledo

December 2nd, 2009 at 5:19 PM ^

While I don't agree with all of your points, I think our offensive progress was exceptional considering our circumstance, I do agree that if RichRod doesn't bring in 8 wins then we can probably find a better option...maybe 7 wins depending on how the season goes. As you said, I'm not too worried about reaching that plateau, but I would have no regrets if we did not reach it and RR was fired.

Any loss to Sparty is a beatdown...especially to a 1-3 Sparty.

But to say that our progress was meaningless is ignoring everything that has taken place the last several years here.

cfaller96

December 2nd, 2009 at 6:12 PM ^

Is this what any of us really expected? At any time in the RR regime? Ever? Saying there is improvement is like saying Jennifer Granholm brought in good high paying green tech jobs to the state of Michigan. It's a true statement on its face, but, in fact, meaningless and worse, ignoring that whole big picture thing.

Well, this wasn't unexpected, not by me, Brian, or a lot of other people. Honestly, before the 2008 season began none of us had a clue how it was going to turn out, because A) there were almost literally no returning offensive starters on which to base expectations, and B) the defense had been shitty/inconsistent the previous year. So with the benefit of hindsight, we see that A) the offense needed a complete overhaul, more so after transfers and injuries, and B) the defense had zero depth, little talent, and little development.

With all that in mind, what rate of progress should you reasonably expect? Seriously- starting from scratch on offense and dealing with serious depth problems on defense, how much time do you think it should take to turn that ship around?

If you thought the program was humming along at peak efficiency when RichRod came in, then of course this has been an UNACCEPTABLE!! shock and disappointment to you, and more progress was expected. But for those clear-eyed fans who saw The Horror as merely a continuation of a disturbing trend at M understood that RichRod would need time and space to rebuild the program.

This program was in desperate need of a change, and some people were/are just unwilling to accept that. So be it- there will always be people who deny facts and reality simply because it undermines their faith in something. The world is flat, evolution is just a theory, global warming is a myth, M always has enough talent to win 8+ games, etc.

You speak of the big picture, yet strangely you ignore the future in this "big picture" of yours. That's an odd way to look at things. Do you really think the future is going to be the same or worse than it is now, given what you see on the roster and what you've seen on the field? Be honest.

DoubleB

December 2nd, 2009 at 9:46 PM ^

"Well, this wasn't unexpected, not by me, Brian, or a lot of other people."

I don't recall a lot of 3-9 predictions in 2008 or 5-7 predictions this year. I don't remember anyone writing that Michigan would go 3-13 in the Big Ten over the last two years.

Considering Brian predicted 8-4 in 2008 and 7-5 this year, I would argue these results were at least unexpected to him.

M-Wolverine

December 2nd, 2009 at 11:04 PM ^

No one was predicting Big Ten championships (well, maybe Tater...), but NO ONE was predicting 3-9 with all that foresight knowledge. maybe 5-7 at worst. Then again, likewise this year. And hey, we achieved the worst case scenario - hurray!

Lets not all act like, oh yeah, some of knew it was going to be this bad. Nobody did.

brianshall

December 2nd, 2009 at 11:05 PM ^

There's a whole lot of rewriting history going on around here, including by the little girls referenced above.

3-13 in the conference over the last two years. When the Big 10 has been, what, second best, third best, fourth of all conferences? Lloyd's team beating Tebow's Florida is ignored. Suddenly, the cupboard was really bare? I don't con that easy.

I'm proud that our team is the kind that attracts the top coaches, like RR. I'm also proud that the program is the kind that would say, you can't win 8 games -- at Michigan -- after year 3, then here's your walking papers.

Let's embrace those high standards, not run from them.

cfaller96

December 3rd, 2009 at 9:54 AM ^

Before the 2008 season began, Brian wrote Stalactite of Fear. Passage (emphasis mine):

So why won't [Notre Dame 2007] happen? First... it might. Michigan is unlikely to sink to the horrific depths Notre Dame did solely because of math -- hooray Gaussian distributions -- but failing to reach a bowl would be a real blow to the internet argument capabilities of Michigan fans. And that's totally within the realm of possibility...

Immediately after the Utah game, Brian wrote Under Construction. Passage (emphasis mine):

This program is under construction with a completion date around 2010. This is going to be a tough year. If you’re prone to hysterics you should do everyone a favor, watch something else, and annoy everyone on the Project Runway message boards with your all-caps posts. Get over it.

I think you look at predictions as binary, i.e. "if Brian predicts 7-5 then he has 100% confidence in that prediction and anything short of that is unexpected/unacceptable/tragedy/etc.

That's simply not true. Again- none of us had any idea how this was going to go, but it wasn't entirely unexpected that this wasn't going to start well.

brianshall

December 3rd, 2009 at 10:08 AM ^

and I think it humorous that you provide links to prove your wrongness.

In fact, Brian -- and the vast majority of all posters here -- expected, at minimum, the bowl streak to continue unbroken.

We all absolutely assumed ANY bowl this season.

And start saving your links now cause I, along with Brian, are expecting 8 wins next year, and a bowl game.

Or the end of the Rich Rod experiment.

cfaller96

December 3rd, 2009 at 10:58 AM ^

Again, you seem to think that a prediction is binary, without context or nuance. I don't think there is any evidence whatsoever that Brian said something along the lines of "I fully expect Michigan to win a minimum of 7 games in 2008 anything less is a disappointment," and "I fully expect Michigan to win a minimum of 7 games in 2009 anything less is a disappointment."

This wasn't desired or predicted, but neither was it unexpected. You seem to think that "not unexpected" and "not predicted" are mutually exclusive. That's incredibly dumb.

InterM

December 3rd, 2009 at 11:41 AM ^

Just wondering -- if tomhagen got banned for his constant rants against RR, can Mister "Little Girls" here be far behind? Of course, he insists at every opportunity that he's an RR supporter and expects him to succeed -- but have no doubt that anything short of "success" on his terms (the magic number 8) is UNACCEPTABLE! Can you tell us that a few MORE times, and then challenge us to negbang you for flogging the bejesus out of your one and only point? Time to actually contribute something (if you can) or move along already.

brianshall

December 3rd, 2009 at 12:03 PM ^

Wha?
You really think it's acceptable to win 7 or less in year 3? Really?
Not me.
Not our dear leader Brian, neither.
Not at Michigan.

And, yes, I do expect RR to succeed. Course, I expected Weis to succeed at Notre Dame.

No one is forcing you to read my comments (I assume), and certainly they are no where near the number of ... oh, i knew all along the cupboard was bare and year 3 would still be a rebuilding year and anyone who says otherwise is a dick or a liar or both.

But, it's Brian's site. If he wants to actually ban me for my comments, and I invite him to read every single one, so be it.

In reply to by brianshall

cfaller96

December 3rd, 2009 at 1:07 PM ^

Let's review the questions that are still on the table:

1. What rate of progress should you reasonably expect? Seriously- starting from scratch on offense and dealing with serious depth problems on defense, how much time do you think it should take to turn that ship around?

2. Referring to the "big picture," do you really think the future is going to be the same or worse than it is now, given what you see on the roster and what you've seen on the field? Be honest.

and since I suspect this is the core disagreement we have (as it always ends up being with RichRod critics), perhaps you should answer this question first:

3. How much talent and experience is required on the 2 deep (on both sides) for Michigan to have a reasonable chance to win 7-8 games? Be specific. Did RichRod have that requisite talent and experience when he walked in? Did he have that this year?

I'd love to see you work through the logic on these questions.

brianshall

December 3rd, 2009 at 2:14 PM ^

Are you counting Mallet, Boren et al?
What was the two deep at Saban's Alabama, now in the national hunt?
Oh, and are you actually serious? Year 2, not even going to the Silverdome Bowl and you don't think that we'll make it there after year 3.

At Michigan? Stop the silly re-writing of history about how the Michigan cupboard was bare. Had just one of Lloyd's seasons been as bad as the best of RR's you'd be out for his head. I say, give a coach 5 years, as long as he's a proven candidate. Which RR is.

EXCEPT: if this is Michigan, or Notre Dame, or USC...and you can't win 16 games in THREE YEARS, then I'm sorry, I really wanted it to work out but we have to move in a different direction.

3 years. 16 games. Or go home.

cfaller96

December 3rd, 2009 at 3:30 PM ^

Tell you what: since you can't post, early next week I'll post a diary asking these very same questions so that all the haters can come in and explain how, with the roster that RichRod inherited, 7-8 wins per season right away was the reasonably minimum expectation. I can't wait to see all the willful ignorance concentrated in one thread.

In the meantime, you should take this opportunity to think about what a minimum 7-8 win roster looks like to you, in terms of * rankings, experience, etc.

In reply to by brianshall

InterM

December 3rd, 2009 at 1:34 PM ^

There, I've said it. And, by the way, to the extent you or I need to agonize over whether Brian agrees with us, you might want to check out his most black-and-white statement on the subject, in the post subtly titled "When Can We Fire This Guy?"

"[A]cts of God no[t]withstanding, Michigan has to go 8-5 next year or Rodriguez should be cut loose. 7-6 might be okay if the bowl matchup is obviously bad." (sorry, I would link, but I'm link-challenged)

Now, if you don't mind, I'll go back to actually watching the football games, looking for signs of improvement, and wondering why/what to do about the things that don't seem to be improving. If you'd like, you can come back at the end of next season, check the record, and cast your up-or-down vote on the coach, without regard for anything that actually happened during any of the actual games. In fact, that would suit me just fine.

brianshall

December 3rd, 2009 at 2:09 PM ^

Brian, in your esteemed wisdom, you said, as the feller above quotes:

"Michigan has to go 8-5 next year or Rodriguez should be cut loose."

Funny, I also used the EXACT SAME stupid numerical quota (as opposed to the more common innumerical quota) and Mr 230 points say we should thus just stop participating, stop posting, and not speak til the end of next season.

You can't buy that kind of dumb. Not for no amount of money.

brianshall

December 3rd, 2009 at 2:28 PM ^

Brian and I BOTH SAID: 8 wins or go home.
But, in fact, Brian ALSO said, okay, 7 wins and a tough bowl loss.

Now I understand your consternation. My stupid numerical quota of 8 really should have been 7 plus a tough bowl loss. Such a chasm of disagreement. It's almost like, a whole game. I get it now.

InterM

December 3rd, 2009 at 6:36 PM ^

To me at least. The difference between, say, 8-4 and 7-5 is unlikely to have a huge effect on my assessment of the team's performance next year.

You, OTOH, have committed (ad nauseum) to a strict numerical quota, with anything less than the magic 8 wins leading to RR's head on a platter. So, one win makes all the difference in the world to you. Or does it? Are you now saying that maybe 7-5 would be acceptable? Maybe if Brian says so? How about 6-6, maybe with a bowl win to take us to 7 -- practically no different from 7-5, after all. You're arguing against yourself -- not that I'd expect you to realize that.

DoubleB

December 3rd, 2009 at 2:04 PM ^

I believe Brian posted a worst-case scenario of 4-8 in 2008 and they actually underachieved that low barrier. They did sink to the depths of Notre Dame's 2007 campaign.

Based on the information at hand PRIOR to the season, when expectations are set, Brian predicted 15-9 over the last two seasons. The team is 8-16 in that timeframe. That's not just below those predictions, but quite far below them. Wouldn't that be the very definition of "unexpected?"

cfaller96

December 3rd, 2009 at 3:21 PM ^

That's not just below those predictions, but quite far below them. Wouldn't that be the very definition of "unexpected?"

Quite simply, no. One more time- "not predicting" and "not unexpected" are not mutually exclusive. You can predict something but not feel very confident in that prediction, so that when things don't turn out the way you predicted you're not surprised.

I don't know why "not unexpected" is continually challenged with examples of predictions. The two concepts don't necessarily contradict each other. Why is this so hard to understand?

sharkhunter

December 2nd, 2009 at 4:26 PM ^

I like the charts (even though the little corner UM occupies btw NW and Minn is disheartening), I like empirical evidence of better performance & sustained above-average mediocrity, but damn, still can't feel good about what has happened this season. I have great hope for next season, but I don't think any charts can displace the almighty W/L table when it comes to improvement.

steelymax

December 2nd, 2009 at 4:52 PM ^

First, nice stat breakdown Brian.

Second, the numbers on offense and defense vs. last season, isn't surprising.

Offense:
Like Brian said, from God-awful to mediocre. Consider that we had no returning QB starter (no, Sheridan doesn't count) and the only returning upperclassmen at the skill positions were Minor and Brown who were both injured much of the season.
Instead, we started two-deep freshmen quarterbacks, a position replacement at center, and by the end of the season the offense relied heavily on a sophomore WR (Roundtree) and freshman RB (Smith).
In short, Rodriguez had to start from scratch on the offensive side of the ball two years in a row. The second year was less experienced and they *still* showed improvement because it was players that fit Rodriguez's system.

Defense:
Unlike last year's offense, last year's defense had more upperclassmen and experience. They perhaps underperformed with the new coaching staff, but it was still better than *this* season where the defense had shed most of the upperclassmen and had walk-ons starting.
Ultimately, the difference between this year and last year is not a Shafer vs. Robinson argument, but an issue of experience.

So the difference between offense/defense this year and last makes sense by the numbers and by the personnel.

jamiemac

December 2nd, 2009 at 4:55 PM ^

This is too complicated for my Indiana Univeristy education.

Having watched all 12 games, its obvious without stats.

O improved lots, but further improvement was slowed by 2 ture frosh QBs turning it over time and time again.

The D did not as we slowly realize our talent problem on that side of the ball.

People are actually debating this?

imafreak1

December 3rd, 2009 at 8:45 AM ^

I like numbers. Numbers are good.

In this case, I think the numbers may be obscuring, somewhat, what is qualitatively obvious. Michigan's offense was much better in 2009 than 2008. Just watching the games was enough to know that. Numbers like the SOS or these more complicated metrics can confuse the issue. Michigan was in almost every game it played in 2009. In 2008, Michigan struggled ridiculously in ever single game they played--and lost or nearly lost to some of the worst teams in DI-A.