Washington Post: Is the NFL's deflategate report flawed or falsified?

Submitted by michelin on

The Washington Post just reviewed the widely reported study of a think tank (AEI), which dismantled the NFL's Wells report.  AEI showed that the Pats balls were not abnormally deflated.  That had already noted by many reputable scientists. What’s new about the Washington Post’s take, however, is that it comes out and says what many of us who've read the AEI report were too polite to say.  The Post provides a scathing—almost directly accusatory-- rebuke of the Wells reports' analysts and of the NFL itself.


Why?  When AEI reanalyzed the data, “The math in the Wells report didn’t add up….the results could not be replicated.... What’s worse, is the methods it used were not the ones it said it used. “The Wells report said it would use one equation, but then used a different (and weird) equation to arrive at its numbers (see my summary of the details below).*

It’s a standard principle in science: If you can’t replicate a set of results, then …a flaw or a fraud is at work. Either you made a mistake, or you made it up. Another plain English phrase possibly applies to all of this:


Falsifying results.


….”Lately the NFL has begun turning these special counsel investigations into manipulated campaigns calculated to enhance the commissioner’s profile and powers.
And they seem to be written to fit predetermined conclusions.”
(a not surprising fact given that the analysts it paid had previously written reports to help industries dispute links between cancer and 3 known causes of it: asbestos, toxic waste and cigarette smoke.)

 

According to the Washington Post, The AEI’s re-analysis of the Wells report supports the NFL Players Association’s charge that the Wells report “delivered exactly what the client wanted. It ….wasn’t an investigation; it was a frame job by the commissioner’s office desperate to reestablish its authority.”

“Twice now Goodell has ginned up false scandals that seriously and unfairly targeted individual players, and damaged franchises, on what turned out to be bogus or flawed evidence. Forget his bungled handling of Adrian Peterson and Ray Rice — at least those guys actually did something wrong. In the Deflategate and Bountygate affairs, Goodell hammered people who appear to have done nothing.”  (even if they were apparently paid to do it in Bountygate)


 Recall that the NFL also enabled Brady and the Pats to be convicted in the court of public opinion through daily leaks of false information about ball pressures, switched kicking balls, trips the john, and other incidents. Meanwhile, it withheld for over a month the true data, which could refute not only the data inaccuracies but also the faulty analyses)


The Post continues: “The AEI’s entry into Deflategate is important, because the institute was a major factor in righting the Goodell-driven injustice in Bountygate back in 2012. The Commissioner went all hanging judge on the New Orleans Saints, suspending several officials and players for a supposed bonuses system to injure opponents between 2009-2011. But then AEI analyzed injury data — something that surely the commissioner should have done. The AEI found that the Saints injured fewer opposing players than all but two teams in 2009 and all but one from 2009-11. After AEI’s report was presented at an NFL hearing, the suspensions were vacated……

.
Goodell is now in a truly interesting and awkward position. …Does Goodell stand by the conclusions of the Wells report, dig in and refuse to budge — thus establishing that he’s incapable of fairly considering evidence and is a serial abuser of his powers? Does he try to parse and sidestep the AEI analysis, by claiming that the scientific evidence is just a small part of the case against Brady? Trouble with that is, more than half of the Wells report’s 243 pages is taken up by pressure gauges and pounds-per-square-inch analysis – all of which must be thrown out according to AEI. If the balls weren’t deflated, then what’s left? One e-mail exchange, in which Brady complained that some game balls against the New York Jets were ludicrously overinflated. Is this evidence of ill intent? Hardly. Brady’s solution to the over-inflation was to suggest the refs check the rulebook. Not the act of a cheater.
Or does Goodell do the right thing and rescind Brady’s suspension on the basis of the new info in the AEI report — thus admitting that the league spent millions on a railroading farce? There is trouble for Goodell in this option too, because it suggests that the league office under Goodell’s leadership is either incapable of executing a proper investigation, or unwilling to….Brady may or may not win his appeal. But there is one sure loser here, trapped in a box of his own making: the commissioner.”

 

 

*you can read the AEI report link below. Among the Wells reports’ questionable practices:
1.  it claimed to include a mean term in the statistical model (ANOVA) as well as a second error term and other interaction effects,  But it actually did not use this model to obtain the reported results.
2. The authors also give the impression of running a regression using all the data but instead used a series of individual regressions.
3. They falsely claim that substituting different pressure gauges’ results in the analysis yielded the same results.
4. The halftime measures suggest the two referees switched gauges between testing the Pats and Colts balls, and this is not noted in the report. (the two gauges different by as much a 0.7 PSI, about half the degree of deflation claimed).
5. In their statistical analysis, the Wells study only compared the pressure changes in the Pats balls with the Colts balls, not with the expected pressure changes based on atmospherics. This not only invalidated the statistical assumptions (since similar changes from pregame to halftime measures will occur due to atmospheric conditions, leading to correlated error terms in an incompletely specified model). Beyond merely changing confidence in the statistical significance of results, however, it also made the results completely misleading. To show this, AEI does a separate and study of atmospherics (the relation of the ball’s pressure to temperature and other factors). When the latter are analyzed, the Patriots balls do not significantly deviate from the prediction of the Ideal Gas Law in the direction that one would expect based on the Wells report’s conclusions. By contrast, the Colts halftime pressures were higher than predicted, implying less deflation occurred than actually should have been the case. That was because the balls were given more time to warm up and were not measured until just before the halftime ended.
The AEI’s analysis of this point is incredibly detailed--even to the point of analyzing sequential pressure changes in the measures of the Pats, then the Colts’ balls. It thereby shows how the pressure changes could be explained by the order of measurement of the Pats and Colts balls. It is not consistent with the NFL’s allegations that the Pats deflated the balls. .


http://www.washingtonpost.com/sports/redskins/as-brady-appeal-nears-rog…
https://www.aei.org/wp-content/uploads/2015/06/On-the-Wells-report.pdf

https://www.aei.org/publication/deflating-deflategate/

 

 

ADDENDUM: Summary of the appeal letter sent to the NFL (with expected arguments)

1. Brady was not proven guilty.

The accusation disregards contrary evidence. It’s based on speculation piled upon speculation about Brady’s involvement with two Pats’ employees’ purported conduct. It grasps at dubious, contradictory and mischaracterized circumstantial evidence merely to conclude that it is “more probable than not” that Mr. Brady was “generally aware of” “inappropriate activities.”

(Also, the balls were not abnormally deflated in the first place).

2. Brady's punishment is unfair and inconsistent.

The NFL stipulates a $25,000 fine for a team, not for a player. Yet, Brady suspension would cost him nearly $2,000,000 in unpaid salary for an alleged “general awareness” of actions

(not to mention endorsements lost already from the NFL’s defamatory and inaccurate media leaks, a million dollar Pats’ fine, the loss of 2 draft picks worth more millions, and the consequent threat to the future success of Brady’s teams).

Even if there were one iota of definitive proof of deflation and guilt, no player in the NFL’s history has ever gotten anything approaching this level of investigation or discipline for similar behavior.

(Brady’s initial suspension far exceeds that of Adrian Peterson for child abuse or Ray Rice for knocking his wife unconscious and dragging her out of an elevator by her hair. Also, 2 teams escaped any punishment at all after definite proof that they overinflated kicking footballs).

Never before in history had the NFL even tested football pressure at half time, let alone conducted a sting operation on other players for similar behavior.

(A former Bears QB admitted deflating balls. Colts’ sideline employees were never investigated despite the suspicious actions they accuse the Pats of. Reportedly, they carried under their sleeves the pins that could be used to deflate balls illegally. Other Pats critics like Jerry Rice were never investigated or penalized despite admitting that he applied stickum to his gloves to make it easier to achieve a completion. That’s a clearer advantage for Joe Montana than Brady).

3. Goodel should not arbitrate this case and the Exec VP Vincent should not have determined discipline in the first place.

An independent arbiter is needed due to NFL bias Only Goodel—not Vincent—is supposed to determine discipline. (Such delegation is a ruse to let him control the investigation and avoid embarassment). In fact, a previous independent arbitrator said Troy Vincent was unfamiliar with proper disciplinary procedure and should have no role in it. Also, Vincent cannot be unbiased as he was directly involved in game day events. As such, he must testify about his own involvement in such events. Goodel must too.

(The implicit accusation is that the NFL and Indy set up a “sting operation” to implicate Brady and the Pats. Who was the driving force behind the investigation? Mike Kensil, whose father was the Jets president and who himself worked 20 years for this team—one that has had longstanding legal disputes with the Pats. Kensil reportedly walked up to the Pats equipment manager at halftime and said, “We weighed the balls. You are in big f—ing trouble.” The NFLPA believes this statement not only showed prejudgment but also that Kensil took joy in trying to catch the Pats in the act. To make matters worse, Kensil destroyed the alleged “evidence.” Kensil inspected the footballs at halftime and instead of preserving them as evidence had them reinflated. As such, it was not possible to judge the pressure of all Pats and Colts balls together under the same atmospheric conditions. Remember that the AEI report found that such conditions fully explained the pressure differences).

Also, both Goodel and Vincent must both testify about when they became aware of the Colts’ complaints about ball deflation and what decisions and steps were thereafter taken. Specifically, the NFL had claimed it did not suspect deflation until a ball was intercepted in the game’s 2nd quarter. But there is now written evidence that Indy informed the NFL of their concerns a day earlier. If the Colts had notified the league that the Patriots were breaking the rules, the league is supposed to notify the Patriots about the complaint.

Also, since we now know that league officials were alerted before the game, they must explain why the exact PSI of each ball wasn’t recorded by NFL officials before the game.

(Apparently, the refs were not told of the concern of league officials prior to the game so that an improper sting operation could proceed. The NFL officials’ sting operation proceeded even though refs could have prevented this crucial game from being played with presumably underinflated balls).

The NFL is biased and lacks credibility in this case. Goodel, Vincent, and other NFL officials are themselves suspected of improper behavior. So, Goodel must explain why a neutral party with no ties to the League should not be appointed for Brady to maintain the integrity of the investigation. Goodel previously concluded that one was needed to hear Ray Rice’s case for that

4. In a footnote, the NFLPA letter also says that Brady did not knowingly violate rules or fail to cooperate with the investigation.

(But would any celebrity hand over their cell phones and emails to a biased organization that previously defamed his character through unauthorized and inaccurate news leaks?).

5. If the NFL does not appoint an independent party, the Brady and the NFLPA will sue the NFL.

http://www.patspulpit.com/2015/2/19/8071143/deflategate-nfl-did-run-a-s… http://espn.go.com/video/clip?id=13089148 https://nflpaweb.blob.core.windows.net/media/Default/PDFs/Media%20Resou…

Comments

turtleboy

June 17th, 2015 at 6:42 PM ^

It is a pretty obvious railroading job. It was surprising to me to hear from Kraft on television (after scrutiny of the report revealed all its many flaws) that the Pats would not challenge the ruling and willingly vacate a first round pick. It's mind bottling.

michelin

June 17th, 2015 at 11:33 PM ^

Granted, an NFL owner is not given the right to appeal the commissioner's decision.  His only recourse is the courts.  And by suing the NFL he would be suing the owners--including himself--who made the rules and chose Goodel. 

At the same time, with the strength of his current case and the outrageousness of the NFL's behavior, I do not see why he would not do this.

One possibility is that he has a deal with Goodel to elminate or lessen the draft pick penalties in the light of the AEI study.  I am not sure if those results were available, however, when he spoke to Goodel and made the announcement.

Another possiblity is that Kraft knows that some NFL heads will fall over this--combined with the litany of other past failures by them.  nesn.com or csnne.com suggested that there is a lot more to come in the next week about the keystone cop approach they've been taking.  Certainly, Kraft could make a good case for investigating the NFL--to trace their malicious news leaks and  evidence of their agenda.  But all that would probably take a long time--unless there is already a smoking gun.  And given the NFL charter, I'm not sure how that would lead to a reduction in the Pats' penalties, short of seeking that end in court.

EDIT: I thought of one more possibility.  Maybe Kraft was sandbagging Goodel.  Now, after the unexpected AEI bombshell, Goodel is really in a  pickle.  And he has less than a week before meeting with Brady and his lawyers.

SysMark

June 17th, 2015 at 10:41 PM ^

Kraft's acceptance I think is indicative of how close a lot of the owners are to Goodell.  Why I have no idea but to a lot of them he's their guy.  We'll see if that erodes after the most recent incidents, the Rice case still being the most egregious.

Heteroskedastic

June 17th, 2015 at 7:52 PM ^

Thanks for posting this, I am not a Pats fan, but was always skeptical of the reports findings. My interest in the NFL has decreased drastically since Goodell assumed the commissioner role, to the point where I hardly follow the Lions anymore. (As a reference point, I fondly remember the Fontes years and went to as many games as my meager budget could afford in the 90's.) Every time I read something about Goddell and the League, I can't help but think of him as Dave Brandon, but with a bigger soap box.

SFBlue

June 17th, 2015 at 8:36 PM ^

This doesn't address the most meaningful conclusions of the Wells Report (such as they are--I think the conclusions are an overstatement of the evidence).

This seems to be a debate about whether the inflation was statistically significant. 

It does not address the findings with respect to whether there was an agreement among Patriots personnel to deflate game balls after they had been shown to the referees. Patriots personnel appear to admit to deflating balls. You do not need statistical analysis to prove that up. Thus, even if all this is true about the sampling, it's tertiary. 

logan54

June 17th, 2015 at 10:13 PM ^

Sorry, that logic is flawed though taken piecemeal it appears to be the case.  The "deflator" texts were in May of last year.  If that is admitting deflating balls, there would have been now way the Jets game balls in October would have been 16psi as reported.  And Brady's response referring to the rulebook isn't the text of someone asking why the deflating didn't happen.  It really is easy to take messages out of context under intense scrutiny.  For example, I looked at all of your texts over the past year under assumption of, say, theft.  And then said you saying "I wish I had that..." or "i wish i had more money", and then said you had stolen without true evidence you really had stolen anything.  How do you prove me wrong if those texts are the only basis for saying more probable than not?  This is really the same thing.  They talk about deflation, but where do they talk about illegal deflation outside of rulebook instead of just getting the balls to where Brady wanted them within the rules?  And I guarantee you'd have confusion too over any random text you sent over the past year....

michelin

June 17th, 2015 at 11:29 PM ^

(even though that would alone have been quite relevant).

In addition, when atmospheric factors were properly considered, the Pats balls were not deflated more than expected; rather, the Indy balls were inflated more than expected--thus, the false impression that there was more deflation in the Pats than the Indy balls.  The reason for that was shown to be the fact that the Indy balls were tested at halftime later--after more time to equilibrate to a warm room.

If there was no abnormal deflation, then the ambiguous, out-of-context and incomplete messages become irrelevant--especially since there was no explicit statement of a scheme to deflate the balls.  Even if there had been a scheme, the situation would be like that of bounty gate--in which players there was a scheme to hurt more other players--but the AEI found that more players were not hurt (actually fewer, if I remember correctly).  To accuse somebody of a crime, you have to prove it actually occurred..

To me, the fact that the Wells study analysts misrepresented their methods in so many ways is by far the most distrurbing part of this whole overblown fiasco.  The second most disturbing part is the way the NFL tried to disrupt the Pats and smear Brady on the eve of the Super Bowl with news leaks now proven to be inaccurate.  I would not be surprised to see this matter end up in court.

Fitz

June 18th, 2015 at 8:52 AM ^

The statistics show the balls were within a range at halftime that would indicate they were within a legal range at the beginning of the game. Unless you think the Patriots had a devious plan to overinflate the balls, get them tested, then deflate them to a lower, yet still legal, level, then it doesn't really make any sense.

Armbuster

June 18th, 2015 at 8:38 AM ^

is that they actually went along with this report. I mean, if you're the NFL and you're paying somebody to bs a report for you, aren't you at least going to check and make sure they bs it well?

OC Alum91

June 20th, 2015 at 4:23 AM ^

Agree.  Despite the AEI report's findings, most have already made up their minds because Brady has already been tried in the Court of public opinion.  Although the NY Times did publish the anti-Wells report opinion written by the AEI authors, and the Washington Post and Sporting News covered the story, the damage of the Wells report has already been done--most of the damage and coverage (think ESPN's huge amount of airtime and also all the radio talk shows) was done in the immediate aftermath.

Also, Average Joe isn't going to read through the science/facts of the Wells report and these rebuttals, they are just going to take in the conclusions.   Average Joe doesn't read the New York Times or Washington Post, nor does Average Joe know or care who the AEI is. 

I thought that (in addition to this new AEI report) ,the Kraft website response and the letter from the 2003 Nobel Prize chemistry winner did a good job of rebutting the Wells report evidence.  Others have mentioned the that the Wells report firm may have a track record of biased conclusions.  

However, I don't think the report is really directly aimed at changing the opinion of the masses, but rather to put pressure right before Brady's hearing next Tuesday.  The masses might not read the AFI report and may already have their minds made up on Brady's innocence or guilt, but the NFL's decision from the hearing will be widely covered.

 

Farnn

June 18th, 2015 at 12:57 PM ^

Does Brady have grounds for a multimillion dollar lawsuit against Goodell and the NFL? This whole thing has definitely damaged his reputation and hurt future earnings from endorsement deals. Not that he needs the money, but he could pledge to donate all of it to charity. Maybe a huge endowment for science education?

michelin

June 18th, 2015 at 7:38 PM ^

I've read that the problem in such cases is that you need to prove an intent to harm.  That is often not easy to do.   I don't think that the court would accept an NFL-type criterion ie that Goodel "more probably than not" intended to harm Brady's reputation--or that he was "generally aware" of a scheme to do so. 

 

charblue.

June 18th, 2015 at 2:05 PM ^

players union were renegotiating their current bargaining agreement, one of the primary concerns the players voiced about the league was the influence and the authority of the commissioner to judge and settle disputes. The players were right to be concerned about this. What has become clear since then is that Goeddel isn't any good at finding or rendering judgment

The nation's two leading newspapers have now issued independent confirmation of each other from outside experts looking at the NFL investigation of the Patriots alleged ball-deflation case and both reported the same findings: the NFL special investigation shouldn't be trusted because the methodology and results don't add up. 

Quite honestly, the NFL has more to lose in being wrong about this, then it does in spanking one of its most stellar franchises and defending Super Bowl winning team and one of the game's best-ever quarterbacks (who I believe would do most anything to support his team to win a game). But if the ball deflation facts don't add up or conflate with the circumstances of the case, then you can't indict or support a cse of cheating even against a team known for it. 

And, if the NFL overrides the findings of these independent studies, to back the results of its own investigation in order to justify itself and not show up its now tarnished report, why should we believe in its ability to administer anything but a rigged game designed, like the NCAA, to prop itself up? 

I mean Goeddel had to take a private course on women's issues after announcing an initiial four-game suspension in the Ray Rice affair last summer after the NFL supposedly conducted  an incredibly thorough independent investigation of that case, which turned out to be anything but thorough or properly conducted. 

michelin

June 18th, 2015 at 2:31 PM ^

(detailed above as an addendum at the very end of the OP with a lot of details added)


1. Brady is not guilty


2. His punishment is unfair and inconsistent


3. Goodel and Vincent cannot judge this case due to bias as well as league rules.


4. If Goodel does not substitute an independent arbitrator, the NFLPA will sue the NFL.

michelin

June 19th, 2015 at 5:20 PM ^

Where is SI author Mike Rosenberg when a real scandal breaks---like the NFL commissioning a possibly fabrcated report?  Does the NFL have some kind of hold on SI?

This entire week, SI has said nothing I could find about the AEI critique of the Wells Report.
All I could find is this tweet by the reporter covering deflategate (greg bedard), who has consistently sided with the NFL. In fact, he characterizes the public release of the AEI report as a “news leak.”

Greg A. Bedard ‏@GregABedard

@bruin_9 yeah right. They're totally above board with press leaks and releases. Would have more weight if they shut up and gave it to NFLPA

One blogger responded to this tweet:

"Did he recently suffer a blow to the head that affected his memory? He has a problem with AEI "leaking" information to the press? I don't know how he can get snippy about that topic with this particular story when the NFL was running to the media right after the AFCCG and then leaking false information 2 days later. But, yeah, those AEI guys, how dare they..."

I do not know the financial relationship between SI and the NFL, but Bedard this week admitted the NFL wants this whole thing to go away.  In any case, it’s disturbing that they seem to want to help the NFL make it go away--by criticizing the release of major news and themselves suppressing news that has appeared in most major newspapers and sports media, including but not limited to the:

NY Times
Washington Post
New Orleans Sun Times
San Diego Union Tribune
Las Vegas Review-Journal
Boston Globe
CBS News
NBC News
The Sporting News
ESPN (although their coverage too has been underwhelming—I’ve seen no headlines on it)

http://www.nytimes.com/2015/06/14/opinion/deflating-deflategate.html?_r…
http://espn.go.com/nfl/story/_/page/reissmailbagweek0616/new-england-pa…
http://profootballtalk.nbcsports.com/2015/06/13/american-enterprise-ins…
http://boston.cbslocal.com/2015/06/15/aeis-analysis-of-wells-report-sho…
http://www.sportingnews.com/nfl/story/2015-06-12/deflategate-patriots-n…
http://www.washingtonpost.com/sports/redskins/as-brady-appeal-nears-rog…
http://neworleans.suntimes.com/nola-news/7/126/196124/think-tank-calls-…
http://www.reviewjournal.com/sports/sideline/wells-report-called-deeply…
http://espn.go.com/blog/new-england-patriots/post/_/id/4782194/deflatin…
https://www.bostonglobe.com/sports/2015/06/13/pats/NAM52G6ozkTwv9DG50X4…
http://www.patsfans.com/new-england-patriots/messageboard/threads/defla…
http://media.weei.com/theme/7568/a/106590722/deflategate-tide-may-be-tu…

 

brookehiggins007

June 26th, 2015 at 2:44 AM ^

Foot ball is the most famouse game in all ovber the world and people always looking for latest updates and informtion about foot ball. specilay during ant famouse championship and event people got crazy about it. Though i can not play football but I also love to watch it anf liked to read this information about the game.parking luton airport

ruthgeorge

July 29th, 2015 at 8:08 AM ^

If there was no abnormal deflation, then the ambiguous, out-of-context and incomplete messages become irrelevant--especially since there was no explicit statement of a scheme to deflate the balls.Luton airport carparking