BoFan

January 12th, 2019 at 9:09 AM ^

At first glance and given some oddities in the numbers this might not be a reflection at all of success rates on 1st, 2nd, and third down but rather its only a reflection of how they defined success differently on 1st, 2nd, and 3rd down.  And in that case, the more likely, and obvious, conclusion is that passing is the most successful option if you need to gain 5 yards (1st down success defintion) or 4 yards (2nd down) and running is on short yardage. 

mGrowOld

January 12th, 2019 at 9:13 AM ^

If you strip it down what it's saying is "dont run plays the defense expects." 

Michigan struggles offensively because we believe we can "out execute" other teams even if they know what we're about to do.  With lesser teams that works.  With equal to or better teams it doesnt.

Grampy

January 12th, 2019 at 1:40 PM ^

Generally agree that we’re too predictable, but it’s more nuanced than run/pass v. Down playcalling. Our lack of tempo is also a factor, in that the more time you give a defense to look at your sets, the more accurate their predictive analysis can be. 

Also, NFL =/= College when it comes to drawing statistical conclusions. Much more variation in CFB. 

DonAZ

January 12th, 2019 at 9:18 AM ^

This post made me think about the yards gained on first down plays.  I looked for statistics that ranked teams by "yards gained on first down plays," or "yards to go on 2nd down," but I couldn't locate any that revealed that.  Does anyone know if such a stat exists?

My sense is Michigan faced a lot of 2nd and long.  I think they ran on 1st a lot, but in general did not gain much.  I'd love to see how teams like Clemson did on first down plays (run vs. pass, yards gained on first down) vs. Michigan, but I'm coming up empty.

There's the NCAA stats on "first downs offense":

https://www.ncaa.com/stats/football/fbs/current/team/693

which has Michigan tied for 50th place, but I'm not exactly sure what those numbers are telling me.

Bottom line: I'm pretty sure there's a correlation between "yards gained on first down" and winning the football game.  A team that doesn't face many 2nd and long will face fewer 3rd and long, etc.  So the "run" vs. "pass" thing is really secondary to "how successful were you on that first down play."  But I can't nail down specifics on that.

RedRum

January 12th, 2019 at 9:29 AM ^

There is a deminsion or two missing. If an air raid everyone knows it's an air raid. If you are I, everyone knows run. Balances is probably the best given Clemson and Alabamas dominance 

Go for two

January 12th, 2019 at 9:30 AM ^

Great data and analysis. I prefer the strategy where you never get to third down. Would be interesting to look at the number of drives vs. the number of third downs for the best offenses. I would bet the 3rd down percentage is low for the best offenses, meaning they don’t get into third down situations as often.

Michrider41

January 12th, 2019 at 9:40 AM ^

He also had Hillary Clinton with a 99% chance of  winning the 2016 Presidential election.  So take it with a grain of salt.  Stats are skewed to get the results that the statistician wants.  Read the fine print on the graphic above.  

NRK

January 12th, 2019 at 4:00 PM ^

This is completely wrong:

1) Nate Silver (presumably the “he” you are attempting to refer to) did not project Clinton at 99%. Not linking due to no politics but is easily google-able.

2) You seem to misunderstand the concept of probability.

3) This article was written by Josh Hermsmeyer, who does sports data work at 538 (and is on twitter as @friscojosh), not Nate Silver. Hermsmeyer isn’t involved in politics analysis, so not sure what the politics probability analysis has to do with this 

jippolito

January 12th, 2019 at 10:04 AM ^

I went through this season's UFR's (no OSU or Florida) to see how Michigan fared by sequence. Success is how often they got a first down or TD, and Frequency is how often they utilized that particular sequence. This is what I came up with:

image_from_ios_1024.jpg

Muttley

January 12th, 2019 at 1:50 PM ^

I think it's rather clever.  Expected Points for the drive ex-post the play minus Expected Points for the drive ex-ante.

I think the next most useful level of granularity would be to breakout the success/failure of preceding downs, i.e.

                  Pass (%Success Outcome)                    

P |[Psuc](%outcome)  P |[Pfail](%outcome)  P |[Rsuc](%outcome)  P |[Rfail](%outcome)

(showing just 1st & 2nd down for series starting w/ a pass due to space limitations)

Then I think yds to go would be the next most useful breakout, but as you can see, the number of branches would be overwhelming and not amenable to presentation in a simple chart.

Each data point in this analysis already reflects down & distance in the Expected Points ex-ante.  

NRK

January 12th, 2019 at 4:23 PM ^

This is a dumb comment. The article literally says it uses EPA to account for down and distance my friend:

 

To answer these questions, I looked at every play called in the NFL regular season from 2009 to 20181 and compared the result of each of the possible permutations of run and pass play sequencing2 using expected points added and success rate.3

 

3 Expected points added adjusts for things like down, distance and field position, and it includes positive plays like touchdowns as well as negative plays like sacks and interceptions. Success rate is the percentage of plays that are positive in EPA, and it maps fairly closely to how coaches think about play success in the NFL. Success rate is analogous to picking up 5 or more yards on first down, 4 or more yards on second down and converting to a new set of downs on third down.

 

micheal honcho

January 12th, 2019 at 10:37 AM ^

Show this to Army & Ga. Tech. They seem to have missed the memo. 

Or, they actually focus on perfectly executing their plays and making the most out of the slightest windows that their system opens instead of just trying to out athlete everyone since they know they cannot. 

I’d love to see a UFR of a game like Army v Oklahoma 2018 and watch heads explode when folks see the + numbers on Army’s offense. 

Point being, it all works until it doesn’t. And it should never work but then it does. If there truly was a formula every game would be the same. The only part of a formula that has any level of predictive consistency is execution. How many plays did we execute with Army like perfection and still fail? When I look at UFR’s it’s not many. 

Dorothy_ Mantooth

January 12th, 2019 at 10:41 AM ^

this overly simplified analysis would need to filter through a host of variables; for instance: personnel, mismatches (either way) and defensive sets - to name just a few

The Fan in Fargo

January 12th, 2019 at 11:51 AM ^

I don't care what the best sequence is. Just don't run the fucking ball on first down on every team. It'll work against Central Michigan and Air Force but then as we all keep saying, you get down to Columbus and they kick your ass every damn play you try it because that's your identity and you don't know how to do anything else. I really think and hope we'll see a different identity from Michigan next year. Going to need a ton more of the quick passing game and get the ball out quick to move the chains down the field. None of this 3 or 4 receivers running all of their routes 20 yards down the field. God damn I should've started out with the passion to be an offensive coordinator. I'm probably way overconfident but I bet if I shadowed this new guy that just came in for 2 years for free and he then takes a head coaching job, I could do his job better and be the best OC your university ever saw.

Ron Utah

January 12th, 2019 at 12:13 PM ^

This is interesting. This is a bit of statistical obfuscation though—since runs are expected on 1st, they are less successful. If passing became expected, its efficiency would wane. 

That said, Michigan is a LONG way from being suspected of passing on 1st down a lot. 

It would be fun to see an offense that called pass plays on early downs and checked into runs when the defense was favorable. 

2timeloozer

January 12th, 2019 at 12:34 PM ^

Seems to me that these stats have no value in selecting run or pass on any down except first.     The right call after first down is dependent on the success or failure off the preceding plays.  Running on second and 10 is likely a bad call following an unsuccessful first down pass.  I guess you can compare the first down option as they each have the same initial conditions.  The rest of the info on the sequences is nonsense.

DCGrad

January 12th, 2019 at 3:52 PM ^

The real strategy is to mix up runs and high percentage passes on first down to keep the defense guessing. I hate when we run on first down seemingly every time, and I hate when teams take deep shots on first down.  A 4-5 yard pass on first down is a good play.