Postmortem: How Much Did They Actually Improve? Comment Count

Brian

After Michigan's 4-0 start the offense skidded downwards into mediocrity and inconsistency, gradually erasing the early giddiness around these parts. Early in the year, I said "the question is not whether this will be Michigan's best rushing offense of the decade, but by how much," which… well… Alan Greenspan has something to say about that.

Still, for anyone who actually watched the team this year and last, the idea that things didn't improve is laughable. The favorite tool of folks who like to claim this is Michigan's scoring offense in the Big Ten. Check this pre-OSU Michigan Monday for an example. Okay, actual scoring—despite being the point of everything—is is kind of a wildly unreliable metric, especially when your quarterbacks are freshmen and very, very turnover-happy. But when a tempo-free aerial says basically the same thing when it comes to yards per attempt…

b10_ypa_2009

…the offense has not exactly reached juggernaut status.

Still, it did improve significantly. All of this focus on conference play ignores that last year Michigan was 1-3 outside the conference and lost to a 3-9 MAC team because it scored 10 points. Against Notre Dame the net offensive output was probably negative because of five horrendous turnovers. This year the MAC snacks were swatted away and Michigan was one of many teams to scorch TAH-NOO-TAH's blitz-mad ways. They were in the ballpark of crappy, and this represents a step forward from last year, when Michigan football was the Indiana basketball of the Big Ten: too terrible to even fit on the scatterplot. To repeat a theme of late, this is progress of a not-very-fun variety.

There is noise yet in the scatterplot, though, as it makes Northwestern's dink-mad offense look worse than Michigan's when it wasn't. Let's take away all the noise caused  by varying numbers of drives, varying average drive start, and opposition offenses, and just look at how efficient Michigan was on a drive-by-drive basis.

Brian Fremeau maintains a rating that does this called the Fremeau Efficiency Index. It's similar in concept to the numbers the Mathlete has posted here over the last year or so: find the average success rate in Situation X and measure teams by how far above or below that break-even line they are. Fremeau has many numbers; we'll look at a few. OE is "offensive efficiency" and is just a measure of how much you score relative to the D-I average. It's a tempo-free stat roughly equivalent to Points Per Possession in basketball. The second, FEI, is this in the words of its author:

College football rating system based on drive-based Game Efficiency data that rewards playing well against good teams, win or lose, and punishes losing to poor teams more harshly than it rewards defeating poor teams.

I couldn't find a more specific definition of what exactly this means; IMO, this is less interesting as a performance measure than it is an attempt to make the ratings more plausible to human eyes looking for a ranking system. So the focus should be on the raw numbers.

100% Awesome Mediocrity

Raw and adjusted, your results:

Year OE OE Rk Off FEI OFEI Rk
2008 -0.29 98 -0.15 80
2009 -0.05 65 -0.01 61

(This rating excludes I-AA games, as all serious attempts to quantify college football do.)

So there you go: from one of the worst teams in D-1 to totally mediocre. Totally mediocre seems acceptable, or better, when you're graduating four starters, have a freshman quarterback, play most of the year without your best offensive lineman, don't get to use your senior tailbacks all that much, and suffer from another epic turnover plague.

The Unfortunate Flipside

The other side of the ball is sort of horrifying:

Year DE DE Rk Def FEI DFEI Rk
2008 -0.14 44 -0.13 45
2009 0.12 75 0.04 63

…but a little less horrifying than i expected. Michigan's defense under Scott Shafer was actually sort of good-ish, but submarined by terrible field position and a ton of drives faced because of the offense. FWIW, I don't think this reflects poorly on Robinson yet; one year doesn't tell you much of anything. Also, Michigan's two best defensive performances of the year (relative to the opposition) were against Minnesota and Northwestern, after Shafer was basically fired. (And, yes, after Michigan's disastrous attempt to switch to the 3-3-5 cost them the Purdue game.)

The Net

Improvement + implosion = ?

Your net numbers in efficiency: Michigan went from 85th last year to 62nd this year. In FEI terms, Michigan went from 71st to 56th. That is almost exactly in line with what I believe is a reasonable take on the team: it was terrible last year and significantly better this year, but the amount of progress was disappointing not just relative to expectations after 4-0 but relative to those in the preseason.

Attempting to downplay the real improvement that was obvious to anyone watching the offense in something other than the fetal position is silly, and a sign they're about to bring up the Braylon Edwards #1 jersey "controversy" as further evidence that Rodriguez should be fired.

Comments

letsgoblue04

December 2nd, 2009 at 6:25 PM ^

Michigan went from the 44th toughest schedule to the 88th toughest schedule, and ND's defense fell through the floor. The offense was definitely better at moving the ball against horrible teams, but not demonstrably better at moving the ball against reasonable defenses. That could be due to injuries, of course.

maizenbluenc

December 3rd, 2009 at 2:54 PM ^

I want the team to win, and have been all-in / cheering for team and coach -- particularly after the outrageous Freep accusations. I also knew when we missed getting Pryor, the usual year two was at risk because we'd be going through another freshman QB curve. (For those of you who want DG to take over as starter next year, do you really want to go through this three years in a row?) I have read, agreed with, and understood all the mitigating circumstances this year as well. Anyway, this year is over, maybe mercifully. My sense moving forward is this: we either have a winning Big Ten season next year or I'll be about done with patience. We have to knock off MSU, and either PSU or OSU as well. Seriously Brian, everyone: defense aside, his system has to start scoring big time in Big Ten play next year, and it can't be dependent on Tate and Molk (other teams have key injuries too, and overcome them). You can't project to be competitive nationally in 3 years, if you can't put together a winning season in the much maligned Big Ten next year. Anyway, if I were MSC and Bill Martin, I'd be having that conversation with Rich right about now. With a new AD at the end of next season, if we suffer another Big Ten implosion -- well some coaches better coach their butts off. Go Blue!

nazooq

December 2nd, 2009 at 8:54 PM ^

Last off season, one of Brian's oft-cited stats demonstrating the positive effects of Rodriguez Revolution was that Michigan's rushing yards/attempt in conference play climbed from 3.41 yds/att in 2007, the last year of the Carr era, (good for 9th place in the Big 10) to 3.94 yds/att in 2008 (6th in the Big 10). In 2009, that fell to 3.07 yds/att (8th in the Big 10). This is the most worrisome stat in my mind and I'd guess Coach Rodriguez himself is racking his brain to figure out how it happened. Anybody have any theories? Can it all be blamed on the loss of Molk? Too many carries by Forcier? Poor reads in the run game by Forcier? Injuries to Minor and Brown? All of these were undoubtedly factors but there is a pressing need for the offensive line to step up next year and for Tate to make better decisions in the run game. He rushed nearly as often as Minor.

caup

December 3rd, 2009 at 11:47 AM ^

We can't have our cake and eat it too. The RYPA fell off precipitously. I think this can be greatly attributed to: "Yo RR! Why can't you be more creative with our running plays?!?!?!" How many times did Denard go nowhere on an ISQBD??? What was Denard's RYPA? Don't tell me Denard couldn't have learned some triple option plays over the course of the season. Don't tell me that. I won't buy it. Also, it seems like the opposing defenses had M thoroughly scouted out by the middle of the year, and yet... we did little or nothing to counter their cheating! It seems like the opposing defenses were being tipped off by our formations. You want unacceptable? That, my friends, is pretty unacceptable. Good coaching staffs do not tip their hand. Right? I refuse to believe that such a massive drop in RYPA can be attributed to Molk and Minor being injured. Not buying it. Not with this year's speedier QBs, another year of a BARWISSED! offensive line that didn't graduate ANYBODY and other perfectly able RBs with speed to kill like Brown and Shaw and the shifty Vincent Smith. In summation, I was very disappointed with the design of our runnning game over the last 8 games of the season. It lacked creativity, adjustments, and execution. Doesn't that reflect poorly on the coaching?

G Money

December 2nd, 2009 at 10:45 PM ^

1. We were so bad on offense last year, it would take a monumental brain fart not to improve. Read: #1 in the NCAA in 3 and outs. That will never happen in Michigan football. 2. Our conference average in scoring is the same this year as last year. 21 ppg (10th in the conference I believe). 3. Our defense was better this year, making life a touch easier for our offense. Do I think our offense was better this year? Yeah. But unless we join the MAC, I think we'll need to get much better, b/c 21 ppg doesn't cut it in conference. And it showed: we were 1-7 in conference.

Kilgore Trout

December 2nd, 2009 at 11:32 PM ^

"Our defense was better this year, making life a touch easier for our offense." I strongly disagree with this statement. I think last year's offense was so bad that the defense had no prayer. I thought they did admirably last year, given the circumstances. Take away the awful deep safety play last year, and that defense gives up a lot less points. Perhaps Shafer's biggest failing was not moving Wolfolk to safety and letting Stevie Brown flounder back there all season.

spmancuso

December 2nd, 2009 at 11:27 PM ^

Some of the naysayers need it too. Seriously, the offense was substantially better this year, despite a true frosh at QB and our best RB and best OL hurt much/most of the year. The defensive woes are mostly explained by a shocking lack of depth and youth. Not that anyone is happy with the past two years, but realistically it's going to get much better. It's not like RR forgot how to coach football when he left WVU.

Slinginsam

December 3rd, 2009 at 1:10 AM ^

Will win: UMASS BGSU Should Win: UCONN Notre Dame Indiana MSU IOWA ILLINOIS WISCONSIN Might Win: Purdue Won't Win: Penn State Ohio State You will notice that all of the home Big Ten games are "should win". When a coach is in his third year, it should be a real advantage to play in your home stadium(a la Wisconsin,Iowa, PSU, or tOSU). If you are hemming and hawing about your homes games as tossups, your team has not progressed. No excuses. I have been a Michigan fan for a long time, and until recently, coming to Ann Arbor was usually not a pleasant experience for the visitor. Capiche?

msoccer10

December 3rd, 2009 at 10:46 AM ^

I predicted 6-6 in 2008, and was obviously wrong, but closer to reality than most people. I predicted 5-7 this year (switched Purdue and ND). I felt like 5-7 was an average year for this team based on the situation and wrote that a "good" year, meaning playing better than average, would mean winning our last game of the year. It didn't happen and I am dissappointed. But I think next year is the leap. I predict 9-3. I am having a hard time picking out our three losses to be honest. OSU probably, Wisconsin maybe, UConn? but other than that I don't know. PSU loses Darryl Clark, Illinois loses Juice, MSU comes here and barely beat us this year, ND loses Clausen, Purdue will not do it again. Even if Warren leaves, we return 8 starters and all reserves on defense and essentially 9 starters and all significant reserves on offense. That alone is good for two more wins. Add in an easier home schedule getting us 4 home conference wins and I think we are on our way. Having two returning qbs and a defensive coordinator for two years in a row will help a lot. I think Turner and Vlad will be impact players. I think the reason Vlad wasn't this year is that he was still recovering from injury. For Turner (this is speculation) I think Rodriguez was very concerned about him academically and since he came in late anyway, decided to redshirt him no matter what happened on the field. I predict he will start and be good next year. I also think either Ezeh or Mouton or both will have the "light go on" like Brown this year and play really well as seniors. I think Campbell will be a solid starter. I think Roh will get bigger and better along with Martin and Van Bergen. I think Woolfolk will make one of the all big ten teams. I also think Toussaint, who I put in the same category as Turner above, will be pushing for playing time and pass Shaw on the depth chart. Same goes for Gallon. The biggest concern I have for the team next year is health. Forcier cannot get hurt. And the defense will be just as thin at defensive line as this year. A serious injury at either of those places is a major problem. If they stay healthy though, 9-3.

M-Go-Bleu

December 3rd, 2009 at 1:48 PM ^

I don't think you can cherry pick stats to try to prove someone improved and I think Brians points are very well balanced. However, for me at least, if I was trying to measure improvement for college football in the big10 relative to peers my hierarchy would start with Wins, then Offensive Points scored to measure the offense relative to others and Defensive points allowed to measure the D. As for Wins, none of the other stats, no matter how hard you look at them, get you to a bowl game and that is the goal. For offensive points scored in the Big10 and measuring the offense, we were exactly the same as last season 22.1 points per game scored in the Big10(and that includes the 14 points the defense put on the board for us). Relative to the competition we went backwards. 8th in 2008 and 9th in 2009. So others improved at scoring points but we didn't move. Sure we felt more confidence in our offense, but it didn't translate to an improvement in points scored (which is the goal of the offense). For defensive points allowed in the Big10 and measuring the Defense, we allowed 33.5 in 2008 and 33.2 in 2009. Actually, we improved purely on the basis of points allowed from 2008. However, relative to conference we went backwards here to from 10th in 2008 to 11th in 2009. So, strictly speaking we went backwards on offense relative to Big10 and backwards on Defense relative to Big 10 from 2008 to 2009. Since my initial point was it is all about the wins, that is consistent with the story of offense and defense, We went from 2 wins in 2008 to 1 win in 2009. No matter how we hard we try to explain that our offense improved and our defense did not, strictly speaking the improvement in offense really only shows up in the warm and fuzzy feelings we had from the 4-0 start. Relative to the competition in the Big10 we did not show improvement on either side of the ball.

bjk

December 4th, 2009 at 12:39 AM ^

People seem to agree that, despite the seven-game B-10 losing streak and a second year of intermittent second-half collapses, this team looked altogether more viable this year than last. The statistical support for this gut feeling appears to be subject to interpretation. But I think that, even in the worst case, a similar or maybe slightly worse output from a young team that we can reasonably expect to improve with just another year's growth and experience is a step in the right direction. Not all losses are equal, either. I had a better feeling about the chances of beating OSU throughout this year's 11-point loss than I did in 2007, with Henne's arm on the fritz. 2007, though not overwhelming, seemed almost inexorable from the opening kickoff. This is to say that I can picture a trend toward success even starting with 7 Big-10 losses in a row.