A recruiting-adjusted analysis of which schools are best at producing draft picks

Submitted by Rappin Randle on May 1st, 2023 at 9:16 PM

(I’m lazy so most of this text was written by ChatGPT. Apologies if anything is unclear).

Every year, the NFL draft showcases the best college football players in the country, as they transition from the collegiate level to the professional ranks. However, not all colleges are created equal when it comes to producing NFL draft picks. While some schools consistently send large numbers of players to the draft, others struggle to produce any top-tier talent.

But what if we could adjust for recruiting rankings? Would that change the landscape of which colleges are best at producing NFL draft picks? After all, we know recruiting ranking is correlated with the probability of getting drafted, so it is unclear to what extent teams actually develop NFL players vs simply recruit NFL players. In this post, we'll take a closer look at which colleges are the best at producing NFL draft picks, while taking into account their recruiting rankings. By doing so, we hope to shed light on which colleges are truly the best at developing top-tier talent, and which ones may be relying more on incoming talent.

 

The idea

To conduct this analysis we will attempt to build a “null distribution” that tells us how many NFL players we should expect to produce for a given recruiting class. Specifically, we can do this by using the composite ratings of each player in the recruiting class to create a pool of similarly rated players. From this pool, we will randomly sample players to create multiple "null classes" that serve as a comparison group. We will then track the number of NFL draft picks produced by each null class, and use this distribution to determine how many draft picks we would expect a class of similarly rated players to produce by chance alone. By comparing the actual number of draft picks produced by the class in question to this null distribution, we can identify which colleges are best at developing their players.

 

The data

We’ll consider recruiting classes from the Harbaugh era where most players have finished their college careers (i.e. the 2015-2018* classes). Below is a histogram of the composite rating of all players in the CFBDatabase for this time window as well as the empirical probability a player in each bin of the histogram gets drafted:

*Not everyone from the 2018 class is out of eligibility, but most players who are going to be drafted from that class have probably moved on by now so I included it. The results aren’t too different if we only go up to 2017 though.

 

Some general thoughts:

  • I’m impressed how well the composite predicts draft probability.
  • The top ~25 players in each class (the rightmost bin) have a 64% chance at getting drafted
  • The next bin (guys ranked ~25-50) is also pretty high (45%), but it starts to drop off pretty significantly after that
  • Not all 3*s are created equal: About 15% of highest 3*s are drafted, while mid 3*s are closer to 7%
  • The bin widths I used were 0.015. Any smaller and the draft probability curve gets super wiggly (especially at the top end), so what you should take away is that while a guy rated 0.95 is going to be more likely to pan out than a guy rated 0.9, he might not necessarily be more likely to pan out than a guy rated 0.94. (i.e. rankings matter, but they're noisy)

Evaluating player development

To evaluate the effectiveness of player development at different colleges, for each recruiting class, we will create 1 million null classes as described previously. By tracking the number of NFL draft picks produced by each null class, we will create a distribution that shows how many draft picks we would expect a class of similarly rated players to produce by chance alone. We will then compare the actual number of draft picks produced by the class in question to this distribution, and calculate the percentile rank of the actual class within the null distribution. By using this approach, we can gain a more nuanced understanding of which colleges are truly the best at developing top-tier football talent, and which ones may be relying more on incoming talent than player development. For example, here are the combined results for Michigan’s classes:

So based on recruiting ranking alone, we’d expect Michigan to have 17.8 total players drafted from the 2015-2018 recruiting classes, but in real life Michigan had 30 players drafted, beating 99.96% of null classes.

Results

Finding the percentile rank for each school shows us which schools actually do the best at developing talent:

Some final thoughts:

  • Iowa being #1 shouldn't be surprising. They’re obviously not known as a recruiting juggernaut (7.4 expected draft picks), but they’ve been producing a solid number of draft picks (18 actual picks)
  • Florida, Michigan, and Penn State rounding out the top 4 checks out, as they’re all schools that recruit well but not elite, yet churn out draft picks (even if Florida doesn't churn out wins)
  • Georgia being #5 is seriously impressive given how well they recruit. And it seems like they’re only getting better
  • Minnesota, Wisconsin, and OSU are other Big Ten schools that seem to be very good at developing players, but not quite elite
  • Michigan State is the worst in the Big Ten and among the worst in the country at developing talent (Expected draftees: 10.9, actual: 6). A far cry from the peak of the Dantonio era
  • The Ragin' Cajuns' don't have a particularly staggering draft record (6 picks), but they're nearly tripling expectations (2.3 picks) landing them 7th in this metric
  • I was expecting Clemson to score higher than they did
  • Texas is the most average school: 18.5 expected draftees vs 18 actual
  • Oof Florida State. 22 expected draftees vs only 12. Worse than Army and Navy (who had a combined 0 draft picks)
  • USC has also not been good. 24.3 expected vs 18 actual.

 

Disclaimers

  • Transfers get claimed by the school they originally went to (e.g. Michigan gets credit for Charbonnet but not Olu)
  • Looking at whether or not a player was drafted (vs draft position or even round) is a very coarse metric. The first overall pick counts the same as Mr. Irrelevant 
  • Similarly, players can be successful in college but not drafted
  • An alternative interpretation could be that the results show which schools are the best at identifying talent that the recruiting industry missed

 

Comments

Blue@LSU

May 1st, 2023 at 10:37 PM ^

The only problem is that you need to pick an ending year where the recruits (or the vast majority of them) have run out of eligibility. Otherwise, you can't differentiate between recruits that haven't been drafted and those that haven't been drafted yet.

If he extended it to 2019, then Michigan (for example) would be penalized because CoJo or Keegan haven't been drafted (yet). 

Blue@LSU

May 1st, 2023 at 10:26 PM ^

This is awesome! Thanks for putting it together. 

I wonder how much Georgia's results are influenced by the last two draft classes. They really knocked it out of the park in '22 and 23. 

And it's awesome to see my Chips at #1 in the MAC (as far as I can see). Suck it Broncos!

Rappin Randle

May 2nd, 2023 at 11:01 AM ^

I was curious too so I looked at Georgia's results for the last few years individually:

  • 2011: 71%ile
  • 2012: 79%ile
  • 2013: 10%ile
  • 2014: 89%ile
  • 2015: 74%ile
  • 2016: 87%ile
  • 2017: 98%ile
  • 2018: 99%ile

They went crazy the last two years, but even before that they were consistently beating projections by quite a bit

Seth

May 1st, 2023 at 10:39 PM ^

A lot of this can be explained by how much attention is paid to recruits from some areas of the country (USC, Florida) versus how quickly the scouts discount players in flyover states. It's not really USC's or FSU's fault that the sites overrate the players they get, though those schools have done worse on the field than simple overscouting can account for. On the other side, Iowa gets a lot of credit for finding Jack Campbells, but they're just doing their scouting in Cedar Falls, and didn't really do anything to prevent ESPN from doing the same.

I write this as I'm working on Hayden Moore's scouting profile, and there's no way this guy should be ranked in the 1,000s.

Blue@LSU

May 1st, 2023 at 10:53 PM ^

A lot of this can be explained by how much attention is paid to recruits from some areas of the country (USC, Florida) 

Texas says 'hold my beer'. 😊

I agree that overscouting plays a big role, but the huge differences between UF and YTM, on the one hand, and FSU (and UCF), on the other, would seem to suggest that there's something else at play. Assuming, that is, that they are recruiting from the similar pool in Florida.

Wallaby Court

May 2nd, 2023 at 10:43 AM ^

Assuming, that is, that they are recruiting from the similar pool in Florida.

Are they though? I do not have the time and inclination to deconstruct the relevant recruiting classes for all four schools, but I suspect that the Florida and Miami recruiting classes have more national profiles. Both schools had recent runs of success at the times that they recruited the classes that filled the pool draft-eligible players under consideration in this analysis.

Grampy

May 7th, 2023 at 11:42 AM ^

I wonder if it’s possible that Staee is better at developing passable college players than NFL draft picks. If the data concerning drafted players can be extrapolated to the quality of the rest of the roster, you would expect their record to be the worst in the B1G, as the entire roster would be underdeveloped.

StateStreetApostle

May 2nd, 2023 at 9:48 PM ^

This is so much better than Ari Wasserman's toreador analysis in The Athletic this past week.  I would say you should send it to him but it has too many polysyllables to be helpful to him.

 

Thank you.  The Michigan Difference.

 

teldar

May 4th, 2023 at 1:31 PM ^

Got to wonder about busts. Like OSU db's who are awful but got drafted because OSU. I would imagine some of that happens at the factory schools.

EGD

May 4th, 2023 at 3:31 PM ^

Very well done.

A couple additional thoughts:

1) Would there be an easy way to incorporate players who made NFL rosters as undrafted free agents into the analysis? Could add an interesting additional dimension to the findings.

2) Would it be worth the effort to further control for players who were not drafted because of career-ending injuries or other reasons besides lack of development (at least at, say, the P5 institutions). Seems like that probably doesn't happen enough to materially affect the results, but I don't really know.

Really nice work either way.

DanUMich

May 12th, 2023 at 12:37 PM ^

Adding UDFAs would be interesting but another option could be restricting this to only the first 5 rounds of the draft (as an arbitrary example). The underlying theory being that the difference between UDFAs and Round 7 picks is minimal. 
 

To build on that idea you could analyze draft position vs # of starts to see if there is a clear drop off at some point in the later rounds and then that could become what you restrict your dataset to. 
 

Thanks for the analysis and please don’t take my ideas as criticism! This is great work!

EastCoast Esq.

May 4th, 2023 at 5:44 PM ^

This also doesn't take into account the performance of players in the NFL relative to expectations. For example, Maurice Clarett -- who declined a guaranteed bonus from the Broncos and then was cut -- would count the same as Tom Brady.

Still, very interesting. And seems to pass the smell test for the most part.

4roses

May 6th, 2023 at 10:48 AM ^

Excellent post. I think this is by far the best analysis I've seen on this subject and I really appreciate you taking the time to do this. I do have one thought that I am wondering if you considered. Rather than looking at just "was a player drafted", could you look at where they were drafted? What I am envisioning is using the data to determine expected overall draft position by recruiting ranking and then seeing whether a school overperformed against the expectation. Been a while since I had my last stats class so I could be talking out of my ass, but, hey thought I'd ask.