Stopping momentum, part I
For as long as I have had any statistical training, I have loathed the way that sports commentators use the term “momentum." I realize that I am probably not alone in this regard as member at MGoBlog, nor am I any where near the first to criticize the spurious use of “momentum” or related concepts (“Hot Hand” Fallacy, Gilovich, Vallone and Tversky (1985); Silver (2012); though see Berger and Pope (2009)), but I wanted to be a bit more concrete in my criticisms in the context of college football. Thus, I decided to work on a series of Diaries to try out various ideas about how momentum is discussed – the “Convential Wisdom of Momentum” (CWoM), and see what (if any) evidence there is to show for it.
Adapted from classical mechanics, momentum is commonly understood to mean that once an object or actor has been set in a particular direction, it will continue along this path until acted upon by another force. In the context of sports, momentum would suggest that teams that have had success tend to continue to be successful, and typically is discussed at the micro-level within individual games (i.e. play-to-play, drive-to-drive), as opposed to the macro level across games. Note that I do acknowledge “psychological momentum,” in that players may start to view the game differently depending upon recent events. Most athletes have had some experience of “flow” (Csikszentmihalyi 1988) wherein they get "in the zone," and their automated responses drive their performance. However, I think this plays a relatively small role at high-level athletic competition since most athletes are "flowing," having spent sufficient time training to develop it.
With this game-level focus in mind, the first example of "momentum" I wanted to consider was the idea that in overtime games, the team coming from behind has momentum, which became all the more germane after this weekend’s game. CWoM suggests that the team that has to tie the game up to force overtime would be more likely to win the game outright.
To investigate this hypothesis, I decided to look into the awesome CFB Stats data, which was released under an Open Data Commons attribution license. I only looked at complete years, so all of my analysis is based on games from the 2005-2011 football seasons. Out of 5,534 FBS and FCS games during this time period, 231 games went to overtime. I eliminated one game (the October 22, 2005 matchup between Arkansas State and Florida Atlantic) from the analysis because at the end of regulation, the game was tied 0-0 and thus neither team could be considered to be leading going into overtime. This left me with 230 games in the sample.
The basic prediction of CWoM in overtime is that the last team to score before the end of regulation will have a greater chance of winning in overtime. I’ll test this prediction, along with a couple of other ways of looking at the same underlying phenomenon. So, how do teams that come from behind fair in OT?
Leading Win |
126 |
From Behind Win |
104 |
|
230 |
Not especially well. Out of 230 games, the team coming from behind won only 104/230 (45%) of the time. A Chi-square t test suggests that the differences observed here are random (χ2(1) = 2.10, p = .15), indicating that our data does not suggest that either come-from-behind or leading teams have an advantage in overtime. Breaking things out by conference does not suggest anything unusual, either, nor do the results of the statistical tests differ (χ2(11) = 6.11, p = .87). This result is also not changed by only considering the six biggest conferences (ACC, Big East, B1G, PAC-12, SEC and Big 12) where results could be less affected by the small sample sizes (χ2(5) = 2.46, p = .78).
|
Leading Win |
From Behind Win |
Total |
ACC |
12 |
10 |
22 |
Big East |
6 |
9 |
15 |
B1G Ten |
14 |
8 |
22 |
PAC-12 |
9 |
7 |
16 |
SEC |
16 |
10 |
26 |
Big 12 |
13 |
11 |
24 |
What about home teams? Given the excitement of a come-from-behind score to tie the game and send it to overtime, it would seem very plausible that home teams might fare better in come-from-behind overtime scenarios. Note that for this analysis, neutral site games are treated as “away” games for both teams. Overall, home teams won 128/230 games (56%), and within come-from-behind games, 60% of the time the home team won. However, the difference observed is not significant (χ2(1) = 1.21, p = .27), suggesting that home teams do not perform unusually well in come-from-behind games.
|
Leading Win |
From Behind Win |
Total |
Home Lose |
60 |
42 |
102 |
Home Win |
66 |
62 |
128 |
|
126 |
104 |
230 |
So far, we have not found any evidence to support the CWoM hypothesis that come-from-behind teams perform better in overtime. There are two more factors I considered that might shed more light on the situation. The first was how close to the end of the game the final score occurred. If the final, tying score in regulation happened very close to the end of the game, this might make it more likely that the team coming from behind would continue their success into overtime. For this analysis, I only considered games wherein the tying score occurred in the fourth quarter, leaving 216 out of the 230 total games. To model this relationship, I used a binary logistic regression with the dependent variable as the outcome of the game for the coming-from-behind team, and the independent variable the number of seconds remaining in the game. The results of this regression indicate that the time at which the tying score occurs does not predict the outcome of the game (Exp(β) = 1.00, p > .65). Because logistic regressions do not lend themselves to obvious interpretation, I split the data into groups of more or less than two minutes of game time remaining. Across both groups, we see a similar pattern to what we observe in the overall data set – that the team that led most recently tends to win in overtime, but this difference appears a bit more pronounced when the tying score occurred in the last two minutes of regulation. This difference is not significant, though (χ2(1) = 1.27, p > .26)
|
Leading Win |
From Behind Win |
Total |
<2min |
94 |
81 |
175 |
>2min |
26 |
15 |
41 |
|
120 |
96 |
216 |
The last component of the come-from-behind momentum hypotheses I wanted to investigate was how big the comeback was – that is, does coming back from a bigger deficit increase the odds of coming out on top? Again, I used a logistic regression with the dependent variable as the outcome of the game for the coming-from-behind team, and the independent variable the maximum point differential between the two teams through the game. The results of this regression indicate that the maximum point differential does not predict the outcome of the game (Exp(β) = 1.11, p > .71). Again, for clarity, I also provide a categorical analysis, with the maximum point differential divided into less than two TDs and more than two. In close games, we see largely the same pattern as before, with the team coming from behind winning only 42% of the time. However, in games with bigger differentials in points, 57% of the time, the team coming from behind comes out on top. This difference is marginally significant (χ2(1) = 2.42, p > .08), but I put more faith in the logistic result since it is a more robust test.
|
Leading Win |
Come From Behind Win |
Total |
<2TD Differential |
106 |
78 |
184 |
>2TD Differential |
20 |
26 |
46 |
|
126 |
104 |
230 |
In conclusion, I do not see any evidence to support the CWoM hypothesis that the last team to score has “momentum” going into overtime. Even considering a variety of other factors that have some lay theoretical association with momentum (home team advantage, scoring late and big comebacks), nothing presents an even mildly compelling case for it. Our experience this weekend – tying the game following a dramatic Roundtree catch with less than 10 seconds on the clock – brought us to overtime with what one would call a great deal of momentum, which we capitalized on by winning decisively. However, the numbers just do not support this narrative. In reality, our odds of winning based on the way in which we got to overtime were not different from a coin toss.
I am hoping to continue this series by looking at various other situations that the CWoM views as “momentum swings,” such as 4th down stops, kickoff returns, picks and safeties. If you have other ideas, would like to see more analysis within this data or have comments on this project, please let me know. Thanks for reading, and Go Blue.
November 11th, 2012 at 8:57 PM ^
November 11th, 2012 at 9:10 PM ^
Great analysis; and I'd hypothesize that overtime is a weighted coin flip, weighted towards the better team (and not waited towards or away from "momentum").
November 11th, 2012 at 9:20 PM ^
Yes, this is what I'd expect as well. Unfortunately, the CFBstats data doesn't include any rankings in it, and from other experiences, incorporating rankings from external sources is quite difficult unless there is some sort of lookup table between the existing CFBstats data and the rankings. However, it would probably be a good thing to control for in other analysis, so I'll see what I can do.
November 11th, 2012 at 10:05 PM ^
Isn't the best predictor of OT the coin flip? I think I read somewhere that the team that wins the toss (and invariably goes second) wins like 55-60% of the time. If so, we beat the odds Saturday.
November 11th, 2012 at 10:21 PM ^
I was curious about this too and checked, but based on my data, the starting team won more often (132 times out of 231, χ2(1) = 4.71, p < .05). However, its worth noting that this analysis is only looking at who started the very first drive of all OT, not the winning round of OT.
November 11th, 2012 at 9:40 PM ^
so what you are saying is that RichRod should have went for two when Tate forcier Drove us down for a last second touchdown against Michigan State four years ago?
lol
but seriously, momentum is one of the most ridiculous statements used in sports. Right next to the team that wanted it more.
jdon
November 11th, 2012 at 9:50 PM ^
I thought this was going to be about Demens' tackle
November 11th, 2012 at 10:34 PM ^
it may not be statistically measurable, but something left the Wildcats when Roundtree made that catch (and M had it in abundance the rest of the way).
November 11th, 2012 at 11:00 PM ^
November 12th, 2012 at 1:55 AM ^
I love this blog. That is all.
November 12th, 2012 at 9:27 AM ^
I propose that the concept of team momentum be eliminated from the sports analysis vernacular. It's a vague, immeasurable concept that awful announcers use as a crutch.
Comments