BPI - What is it and WTF?

Submitted by Lordfoul on

Looking at ESPN this morning, I clicked on the link to "BPI" - a supposed Basketball Power Index.  Updated today it shows Michigan at #22, behind Wisconsin, Iowa, OSU, and MSU, good for only the #5 rated Big 10 team and a projected 6 seed!!! 

I would assume this is not looked at for NCAA seeding, right?  How can this possibly be calculated to come out with this rediculous result? 

<edit> Even better, it projects Michigan as an Auto-Bid for the Big Dance - meaning it expects M to win the Big 10 tournament and still only get a 6 seed?  It is insulting that they even would post these rankings in a format that would suggest it as data.

ish

March 3rd, 2014 at 9:58 AM ^

bpi is like rpi, kenpom, sagarin, etc.  it's just a ranking system.  however unlike the others, it massively discounts victories over teams missing "key" players.  it was invented by espn last year.

because it discounts our wins against MSU (missing "key" players, huh, huh), it isn't as favorable to us as it would be in other years.  but there's not much we can do about that.  it is one of many ranking systems that the tournament committee looks at and it shouldn't hurt us.

MGoLogan

March 3rd, 2014 at 10:26 AM ^

I could be wrong about this but I don't believe the committee uses this "tool" at all in the selection process.  I think this was just something ESPN created so they could use it on their broadcasts instead of RPI or Kenpom.

MaizeAndBlueWahoo

March 3rd, 2014 at 10:49 AM ^

Relax, man.  It's one of many alternate-to-RPI ranking systems out there, all of which have flaws one way or another (because there will never be such a thing as a perfect system) and none of which have any bearing on seeding whatsoever.

"Mai favrit team iz 2 low!!!" is widely reviled as the worst possible critique of a ranking system there is.

ish

March 3rd, 2014 at 11:03 AM ^

it doesn't because it basis its assessment of a "key player" on minutes played.  mcgary never accumulated enough minutes to be a key player.  that's one of the reasons that bpi undervalues our season and overvalues state's.  but worry not; the committee looks at many factors and will not give us a lower seed simply because some dude at espn came up with a system that gives us an anomalous ranking.

LSAClassOf2000

March 3rd, 2014 at 10:00 AM ^

For what it is worth, ESPN explains their system to some extent in this 2012 article here - LINK

I will say, although it is annoying that they do not go into much technical detail on the claim that most would not be interested (obviously, they've not seen us pick apart systems here), they do mention one thing that they have somehow incorporated:

On top of this, we decided to incorporate a little bit more information than the other power ranking systems use. In particular, we added a way of accounting for missing players. If a team or its opponent is missing one of its most important players (determined by minutes per game) for a contest, that game is less important for ranking the teams compared to games in which both teams are at full strength.

So, that might explain MSU to some extent in their system. In any case, there is a chart in the article comparing what they factor into this to Sagarin and Kenpom as well. 

 

NittanyFan

March 3rd, 2014 at 10:14 AM ^

ESPN may SAY it's better than a Colley Rating, Pomeroy Rating or the RPI --- but they aren't putting the formula out there for anyone to critically review it.  

 

Each of the three ratings above is replicable --- they may each have their flaws but at least one knows how the rating is calculated.  

 

For BPI, for all we know ESPN has inserted a line of code that says "IF TEAM = 'SYRACUSE' THEN RATING = RATING + 10."  Only they would know.

CompleteLunacy

March 3rd, 2014 at 6:31 PM ^

doesn't take it into account.

Even if the ranking is sensible, there is far too much room for ESPN to tweak them to fit their personal agenda. And I mean, we could blindly trust that ESPN would not do that...but come on. The whole idea of rankings is to be totally objective. And it's kind of hard to prove that when we have no idea how there rankings were made. It's way too open for abuse.

Especially seeing how the supposedly are taking into account "missing players". How? Are you doing it consistently? Does it take into account missing a guy like McGary? It seems like a very very subjective thing, and I wouldn't be surprised if there were a variety of "fudge factors" in their formula.

Yeoman

March 3rd, 2014 at 10:02 AM ^

On your last point, pretty much every bracket projection uses the current conference leader as the filler for the autobid until they're knoced out of the conference tournament, at which point they're replaced by the highest remaining seed. That doesn't mean they've already plugged wins from the conference tournament into their computers.

Don

March 3rd, 2014 at 10:10 AM ^

players (determined by minutes per game) for a contest, that game is less important for ranking the teams compared to games in which both teams are at full strength.

Given that UM is ranked behind a team they swept—Michigan State—the translation of this metric is thusly:

If Michigan State is missing one of its most important players (determined by minutes per game) for a contest, that game is less important for ranking the Spartans compared to games in which Michigan doesn't have a consensus lottery pick available the entire fucking season.

joeyb

March 3rd, 2014 at 10:56 AM ^

What about a team like Arizona that loses a guy for the remainder of the season? Do their losses mean less when predicting their future success? Unless, of course, they are manipulating data by hand, which renders the whole ranking as potentially biased.

Also, at some point, you have to just discount the effects of the injuries because of the potential of another injury happening in the future.

Kilgore Trout

March 3rd, 2014 at 11:08 AM ^

I don't think it's really a problem to manipulate it by hand. It makes sense to treat the injuries to Brandon Ashley and Mitch McGary differently than those of Dawson / Payne / Appling. If the entire goal is to predict, you'd be silly not to use that information. Not accounting for injuries (assuming you do it in an intelligent way) is going to make your metric worse.

In reply to by SECcashnassadvantage

Don

March 3rd, 2014 at 12:22 PM ^

ESPN's BPI geniuses to Tom Izzo: "There, there, Tommy, let's dry your eyes and blow your nose...that's good, now blow. OK, we promise to be nice to you since two of your players have boo-boos but are coming back."

To John Beilein: "Mitch who?"

SECcashnassadvantage

March 3rd, 2014 at 10:21 AM ^

The reason is the SEC is way better because they have a number one team. We are a much weaker conference according to SECSPN.

SECcashnassadvantage

March 3rd, 2014 at 10:27 AM ^

Could you imagine the SEC not having a 1 seed in a football tournament, because of multiple losses. We are getting screwed as a conference. A team that plays nobody will get a 1 seed and the BIG Will get a 3 seed at best. What a fucking joke thay people are dumb enough to buy into that. Most every team in the BIG would beat and many would demolish Wichita State. They got so lucky last year.

Kilgore Trout

March 3rd, 2014 at 11:05 AM ^

Here's a table from ESPN comparing some of the popular rankings systems.

System comparison

How is the College Basketball Power Index by the ESPN Stats & Information group) different than RPI or other advanced rating systems like Kenpom.com and Sagarin? Here is how the included elements compare to other systems.

Includes RPI BPI Sagarin Kenpom
Scoring margin No Yes Yes Yes
Diminishing returns for blowouts No Yes Yes No
Pace of game matters No Yes No Yes
Home/Neutral/Road Yes Yes Yes Yes
SOS beyond Opponent's opponents' W-L No Yes Yes Yes
All wins are better than losses (before Opp Adj) Yes Yes No No
De-weighting games with missing key players No Yes No No

They are all best guess ways of predicting. I don't think you can necessarily say the system is crap because it doesn't like Michigan.

bronxblue

March 3rd, 2014 at 12:16 PM ^

I think it is a bit down on Michigan, but it's a system ESPN is trying to make relevant.  Kind of like their QBR stat.  I think there is merit, but like all predictive models it can be skewed one direction or other because of the input set, and I think the one issue is that they take in so many different factors (cascading SOS, missing players, etc.) that it may be introducing so much noise that is is causing issues.  

goblueatkettering

March 3rd, 2014 at 12:28 PM ^

The system is hugely flawed from our POV in particular because Michigan is a strange anomaly due to the McGary and MSU situations. That being said, it just doesn't pass the eye test for me. Anyone watching Ohio State basketball this calendar year agree.