Quantifying Michigan's (and the Entire FBS's) Penalty Problems Comment Count

Brendan Roose July 28th, 2021 at 10:59 AM

I have a problem with the way we measure penalties. The stats we use today are fine at communicating raw numbers in a digestible way; penalties per game, for example, is an effective estimate of how often a team’s discipline (or lack thereof) is affecting its success each game. They’re less fine, however, at comparing different teams’ relative ability to avoid penalties. 

In the available stats, we already recognize that college football teams play an uneven amount of games — because of bowl games, conference championships, and in 2020, COVID cancellations — by presenting the numbers in a “per game” format. Saying that in 2020 Notre Dame and Michigan committed 53 and 35 penalties, respectively, is useless for comparison, since the Irish played twice as many games; saying that they committed 4.42 and 5.83 penalties per game solves that problem. 

Here’s my gripe: Why do we stop there? In college football today, offenses vary widely in how quickly they snap the ball. Many teams hurry to the line and try to run as many plays as possible as quickly as possible, while others slow it down and try to milk the clock. Those teams that try to snap the ball more quickly will run more plays each game, and, naturally, that will create the opportunity for more penalties. Let’s say that, on average, two otherwise unrelated teams each commit offensive holding every 30 plays. If Team A runs 60 offensive plays per game, and Team B runs 90, then the stats will only say that Team A commits two holding penalties per game, while Team B commits three. Anyone reading those stats would conclude that Team B is committing holding penalties 50 percent more often, despite the fact they do it at the exact same rate! If your argument is that more penalties is a consequence that should be weighed in the decision to run a hurry-up offense, I’d counter that the defense would also have the opportunity to commit more penalties, so that effect is cancelled. 

[After THE JUMP: penalties per play]

Put simply, penalties (and penalty yards) per game is not an effective measure of a team’s discipline. To remedy this, I’ve converted all 127 FBS teams’ 2020 penalty stats into penalties per play and yards per play, available to view in this Google Sheet. In it, I’ve included the penalties per game rankings that the NCAA wants you to believe [adjusts tinfoil hat] as “P/G Rank” and my adjusted penalties per play rankings as “P/P Rank” (heh heh). I’ve also provided plays per penalty as a more understandable measure of penalty frequency, as well as a separate tab with numbers and rankings for penalty yards per play. 

Why do this? Michigan doesn’t move much on either sheet — they go from 59th in penalties per game to 55th per play, and from 83rd to 81st in penalty yards — so why go to all this trouble to reorganize an incredibly minor stat over a mostly semantic problem? Part of the reason is that I like to complain — especially about the NCAA — and this gives me an opportunity to do just that. 

The bigger reason, though, is that we love to build narratives out of incorrect or misleading facts. In the real world, that leads to some, uh, problems (for everyone’s sanity, please do not discuss these problems in the comments), but in sports, the narratives are mostly just annoying. For example, every time Michigan plays a military academy, we’re subjected to the narrative that the team will hardly commit any penalties, because, well, it’s a military academy, and the athletes there are disciplined! On a per-game basis, that appears true — all three academies rank in the top 20 in penalties per game. When considering penalties per play, though, each academy’s rank falls by double digits, and it’s easy to understand why: they all run a triple option and try to limit the other team’s snaps. As it turns out, the ability to stay disciplined during times of war — noble as it is — does not prevent defensive backs from grabbing jersey when they get beat. 

Michigan by the Numbers 

As expected, Michigan’s penalty numbers were … less than ideal. Let’s start with the (I guess) positives: the Wolverines were better than average at avoiding penalties, but just barely, coming in at 55th of 127. They committed 0.0411 penalties per play, or roughly one penalty every 24 plays, or even more roughly one every three drives. Obviously, penalties are not Michigan’s biggest problem — several notable teams, including Alabama and Ohio State, drew flags more frequently than the Wolverines did. 

What is striking, though, is the gap between Michigan’s penalties per play and penalty yards per play. Where the Wolverines were average at dodging flags, they were awful at avoiding serious penalties, coming in at 81st in penalty yards per play. That gap in rankings — 26 spots, to be exact — was fifth largest in the country, behind Georgia State, Illinois, Boise State, and USC. Effectively, that means Michigan’s penalties were the fifth most serious, or more technically, each flag drew the fifth most yards on average (9.86 yards, based on 35 penalties for 345 yards). 

It’s not hard to guess why that is: the defensive backs were overmatched, and they were forced to play physical with receivers as a result. In the Michigan State game alone, the Wolverines’ secondary combined for 50 yards worth of holding and pass interference penalties (I don’t have individual numbers for the whole season because those aren’t published and I’d rather not dig through the play-by-play of every last game). Especially at corner — and especially when those corners were left in one-on-one coverage — it became a choice between an almost sure touchdown and a likely penalty, when they could, those corners chose penalties. 

On the other end, the offensive line faced similar problems. The injuries that thinned out an already struggling young line created mismatches which, naturally, resulted in holding penalties. When putting those two factors together, and adding a few personal fouls, Michigan’s problem with committing penalties became a problem with giving up too many free yards on penalties. With an offense that struggled to sustain drives and a defense unable to stop them, high-yardage penalties made life that much more difficult. A rate of 0.4054 penalty yards per play means that, discounting opponents’ own penalties, the offense needs to gain a rough average of 1.5 extra yards every four downs, and the defense needs to keep opponents from gaining that same amount. In the Big Ten, the Wolverines are eighth-best in penalties per play and ninth-best in penalty yards per play. Especially for a rebuilding program, those numbers need to improve. 


How can Michigan solve it?

Obviously, it starts in the defensive backfield and on the offensive line. And frankly, as bad as last season was, it’s hard to see anything on the defense getting much better this year. Yes, Gemon Green and Vincent Gray will have another year under their belts, Steve Clinkscale seems like a promising hire to coach the DBs, and Mike Macdonald’s defense will presumably leave them on an island less often. At the same time, learning a new system takes time, the talent gap at CB will still be there, and the defensive line probably won’t provide much help pressuring the quarterback. Even with the year of development, the pass defense should still struggle mightily in 2021, and that will lead to more PIs. 

That being said, barring injuries, I do think there will be some progress on the offensive line. Yes, Jalen Mayfield is gone, but he was hurt for most of last season anyway, and there’s a decent amount of experience returning elsewhere on the line. Let’s keep expectations honest — this is a transitional year, and the line will be far from elite — but also look for positive steps forward and better discipline in protection. 

Beyond that, improvements in avoiding penalties get a little dicey. I would generally agree with the sentiment that penalty problems fall on the coaching staff. Coaches are absolutely responsible for enforcing discipline on the team, but discussion of how they can do that gets vague and unconvincing. For example, speaking strictly anecdotally, Michigan did seem to struggle with jumping offsides in 2020 (though the numbers indicate it was less of a problem than the long-yardage penalties were). Coaching that away isn’t easy; no matter how many times you tell players to “watch the ball,” sometimes they just don’t, and at the collegiate level, you can’t waste reps on “practicing” staying onside. 

Truthfully — and I hate this answer — it comes down to culture. It’s the same issue with avoiding personal fouls; just telling a player “hey, don’t commit personal fouls” isn’t going to stop him from taking cheap shots or pushing back when there’s beef after the whistle. Ultimately, coaches need to build a program where players recognize the consequences of their actions and know how to avoid flags on the field. I’ve never been involved in a college football program, so unfortunately I can’t contribute much on specifics, beyond the fact that it’s clear Michigan isn’t there yet. 
 

Comments

The Blue Collar

July 28th, 2021 at 11:25 AM ^

Cool write up. I always wanted a stat/measure for penalties that took into account how much they "hurt" a team. There's a huge difference between a holding call on your own 20 yard line on a first down run that went for 2 yards when you're up by 49 and a holding call on an opponents 10 yard line on a 3rd down play that went for a TD in the fourth quarter when you're down by 6.

MgofanNC

July 28th, 2021 at 3:53 PM ^

Yes, I agree 100%. 

I love where this write-up is going here, but I'd also love to see some deeper analysis. The point about penalties per game being misleading can go well beyond just a difference in the number of snaps in a game. It doesn't take into account declined or offsetting penalties for example.

But more to the point it doesn't take into consideration the impact particular penalties have on a game. For example, a PI call that takes away an interception or a Holding call that kills a 3rd down conversion are HUGE where as an intentional delay of game penalty by the punting squad looking for field position is actually a smart penalty and offsetting Personal Foul penalties or a declined  penalty of any kind are basically irrelevant to the actual game. A deeper analysis (possibly an "Impact" rating for different penalties) would provide an even more interesting and useful understanding of this issue. 

I appreciate that doing a proper analysis of context would be somewhat daunting but with a narrower focus say on UM and it's opponents I'd bet the work wouldn't be too demanding and still illuminating. 

 

mGrowOld

July 28th, 2021 at 11:25 AM ^

"Many teams hurry to the line and try to run as many plays as possible as quickly as possible, while others slow it down and try to milk the clock."

Others slow it down and try to milk the clock = Michigan

Many teams hurry to the line and try to run as many plays as possible as quickly as possible = every other college football team in America

Blake Forum

July 28th, 2021 at 11:55 AM ^

Interesting analysis, and revealing. Thanks for doing this. The only thing I’ll quibble with is the degree of pessimism about the upcoming season.
 

Last year there appeared to be a near-total breakdown in trust between the players and coaches on defense. The team looked worse than its talent level (tho there is a lot of work to do on that front as well) as a result. So it’s reasonable to hope that new coaches may be able to reach the players and make things less abysmal simply through doing so. Simply using guys in reasonable ways and not doing things like playing Ben Van Sumeren over vastly more talented guys should help a lot. 
 

As for offensive line, there’s enough talent and experience in that unit to expect good things. If we don’t get the good things, we can be mad at the coaches. But at a personnel level, I’d say it should be one of the better units in the B1G.

mpbear14

July 28th, 2021 at 12:09 PM ^

It's going to be ugly this year. Defensively, we are going to get bullied (We are RR small.) Offensively, we have never shown the ability to score quickly and pile on points to support the defense. Any team that can at least match us physically (almost all the high majors on our schedule) are going to be a big problem. 
 

Blake Forum

July 28th, 2021 at 12:36 PM ^

It could definitely get ugly this year if a lot of the question marks come up as bummers. It would be hard for the defense to get worse, tho, since they were 84th in total defense last year, which puts you in the company of directionals and commuter schools that scammed their city government for a stadium 

Blue@LSU

July 28th, 2021 at 12:22 PM ^

Nice analysis. These data should definitely be useful as a counter to P/G stats.

Just wondering whether it would be possible to break this down into offensive and defensive penalties. I know it's difficult to get data on individual penalties (holding, PI, etc.), but aggregate data on penalties and yards for offense/defense would be a nice addition.

Now you got me thinking about a whole number of different ways to think about penalties. Just spitballing here, but I wish I had an army of assistants to collect these data:

  • Drive killing penalties: What was the down and distance before the penalty? A 5 yard false start definitely hurts more on 3rd and 1 than, say, 1st and 10. 
  • Defensive penalties resulting in a first down for the opponent.
  • Loss of yardage gradient: how much of an offensive gain did a penalty negate, e.g., did an holding penalty negate a 50-yard touchdown pass?

Maybe Brian and Seth could hire an intern or two to collect data for the blog?

AC1997

July 28th, 2021 at 12:54 PM ^

I was thinking something like that too.  This is a great column and a good step toward actually mining useful data that can influence change.  Your bullets are all good suggestions to dig further.  Some other thoughts I had while reading....

  • I would love to see this over time for teams to see if there are some systemic drivers or if the data is more influenced by small sample size or other factors like "we played a bunch of young guys due to injury".
  • If you could parse the type of penalty, it would be good to separate out the more "mental" errors versus physical or strategic errors.  Grabbing a WR as a DB or DL as an OL when you're beat is a gamble that you're hoping you avoid a flag to prevent a big play.  Personal fouls, false stars, illegal motion, too many men, and ineligible down field are more "mental" errors that should be easier to correct.  
  • What about declined penalties?  That feels like something missing when doing  a deep analysis.  If the DB grabs and draws a flag but the WR still catches the pass....you are missing some info.  Maybe this is too irrelevant to matter....just a thought.

Blue@LSU

July 28th, 2021 at 1:22 PM ^

Great suggestions there, too. In addition to seeing this over time, it might be nice to see it per opponent as well. Is Michigan committing these penalties against all teams, or just against equally good/better teams? The mental/discipline vs. strategic/physical errors is also a great idea. I don't know how many times I've seen Michigan defensive linemen jump offsides on 3rd and short...

AC1997

July 28th, 2021 at 2:10 PM ^

Selfishly and with much bias I would also love to see if you could get deep enough into the data to show whether there's a ref bias against Michigan or Harbaugh.  I know that all fans think the refs are out to get them and see calls through a skewed lens.  But it does genuinely feel like Michigan has had far more "bad ref" games than our rivals.  

Blue@LSU

July 28th, 2021 at 2:51 PM ^

So you and I had the exact same idea here. I had already downloaded the data because I wanted to look at this as well. Here's what it looks like:

 

These are each team's difference in Penalties/Play and Penalty Yards/Play from the conference mean, as well as the # of standard deviations above or below the conference mean for each difference. Negative values indicate the team had fewer penalties or penalty yards per play than the conference mean, and positive values mean greater penalties or penalty yards.

Surprisingly to me, Michigan is right right next to OSU in each of these metrics. They have slightly fewer penalties/play than OSU and slightly more penalty yards/play. Unsurprisingly, MSU has more than 2x the amount of Penalty Yards/Play than Michigan. Maryland is the big outlier, more than 2 standard deviations from the conference mean for both penalties and penalty yards per play. 

But these are only one year's worth of data, so I'm not putting too much stock into this. Like you said, it would be nice to have a larger sample size to look at. 

Michigan4Life

July 28th, 2021 at 12:34 PM ^

I wonder what's the penalties like under Harbaugh in his entire coaching career. If it's consistent every season then it's probably a feature/trend for Harbaugh. I'm just too lazy to look it up and am just wondering out loud about it

DoubleB

July 28th, 2021 at 12:59 PM ^

What is the correlation of these penalty statistics to winning and losing? Rice and Penn State didn't exactly light it up last season.

I'd like to see a measurement of administrative penalties--delay of game, offsides, false start, illegal shift, not enough men on the line, etc. I would bet that would better correlate with organizational sloppiness.

I might be in the minority here but being a physical team, especially on defense, means playing on the edge of a clean play and a penalty. Going over that line inadvertently is probably worth the occasional penalty if it means you're more active in tackling, pursuit, etc.

lilpenny1316

July 28th, 2021 at 1:32 PM ^

I'm curious to know how many major penalties were due to defensive PI? If that's a major reason for our average to be so high, that speaks to an inexperienced secondary playing man defense. That would seems more like system over culture being the culprit.

Golden section

July 28th, 2021 at 1:51 PM ^

This is comprehensive but I think lacks the metric of timeliness and declined penalties.

I drive extending penalty for two yards is as bad worse than a 10 yard second and 20 penalty.

Defensive offside was also an absolute killer against Indiana. Penix didn't even have a play. The play was designed to draw the defense offside. As soon as they jumped he would snap and it was a free play. All receivers ran trips to the end-zone. They did it 4 times and scored 2 touchdowns and it was the difference in the game. And it was totally on the coaches! They have to be taught to be more disciplined than that. Move when the ball moves. How is that not drilled into their heads?

RAH

July 28th, 2021 at 5:54 PM ^

There are a lot of possibilities for more detailed analysis of penalties that might be interesting but they might be going beyond practical compilation/use. 

However, there's a simple additional breakdown that I think would provide very useful information. 

Itwould be revealing to know the breakdown between offensive and defensive penalties.

JacquesStrappe

July 29th, 2021 at 3:50 PM ^

Great write up! Would love to see a follow up that discusses ranking teams by situational penalties that could be game changers i.e. the bone-headed stuff that as often as not has turned the tide against Michigan via losing a first down or TD to penalties, or, giving our opponents a lifeline on 3rd  or 4th and forever.  Shawn Crable’s late hit in 2006’s OSU game comes to mind as an example.