Abstract
We examine loss aversion in the context of professional golf at US Open tournaments. In particular, we analyze data from two courses, Pebble Beach Golf Links and Oakmont Country Club, where they have hosted six and five US Opens, respectively. The United States Golf Association changed the par rating of a hole on each course from a par 5 to a par 4, without fundamentally altering the hole, in each US Open hosted by these courses since 2000. In this natural experimental setting, we find evidence of significant loss-aversive behavior in the world’s best golfers based solely on par rating.
Introduction
Loss aversion is a frequent topic of investigation in behavioral economics. As made famous by Kahneman and Tversky (1979) in their work on prospect theory, loss aversion states that people tend to value something they already have at above the level that others would value it. This has been studied in both the lab (Kahneman et al., 1990; Knetsch, 1989; Novemsky & Kahneman, 2005) as well as in the field (Fehr & Goette, 2007; Fryer et al., 2012; Novemsky & Kahneman, 2005). The effect of loss aversion is strong, where Putler (1992) estimated that someone would have to offer a gain of approximately 2–2.5 times the value of the loss for someone to engage in a risky endeavor. Loss aversion is not unique to western societies, as it has been tested in several countries (Tanaka et al., 2010). Camerer (2005) even suggests that loss aversion may not be a judgment error but rather a reaction to fear, which can be a fear of failure or a temporary transitive state while moving from one setting to another.
Loss aversion has been studied in many contexts in the field. Several of them include investing, teaching, and retail consumer shopping (Sokol-Hessner et al., 2009). Here we study it in the context of sports, and specifically golf. In sports, there are many famous examples of coaches and players exhibiting loss-averse behavior. This would include coaches using non-optimal kicking strategies in American football (Romer, 2002; Urschel & Zhuang, 2011), teams playing for a draw instead of a win in soccer (Riedl et al., 2015), and baseball team construction (Pedace & Smith, 2013). Loss aversion is seen as applying even in sports as a way to explain the behavior of individuals in the context of a game, just as others might in a purchasing decision.
Golf has also been studied as a context for loss aversion. In their 2011 American Economic Review paper, Pope and Schweitzer (2011) famously ask the question “Is Tiger Woods Loss Averse?” They study not just Tiger Woods, but multiple PGA Tour players’ putting statistics and find evidence of loss aversion among the best golfers in the world. They used multiple pieces of evidence, such as aggression and putts made, to show that golfers are more likely to protect par (the number of strokes that an average highly-skilled player should take to complete a hole) than they are to make birdies (a score of one less than par). In addition to loss aversion, the economic theory of superstar effects in golf was the subject of investigations by Brown (2011) and Babington et al. (2020).
The concept of par, as explained above, is a semi-arbitrary measure designed to inform a golfer of the number of strokes expected to play the hole. It is usually defined as the number of strokes it should take a golfer to reach the putting surface (the green), plus two putts. In general, holes of 250 yards or less in length are defined as par 3s, 300–500 yards are defined as par 4s, and holes greater than 500 yards are par 5s. Holes tend to not be defined in the 250–300 yard range, but when they do they may be labeled as Par 3s or Par 4s. Similarly, as equipment has improved and players are becoming more skilled, some holes that are longer than 500 yards are labeled as par 4s. In the end, however, professional golf tournaments are played by players against each other, and not against the course or the (somewhat) arbitrary par rating. In some tournaments, the winning score over 72 holes might be 25 strokes or more under par, while in others it might be above par.
We posit, however, that there is a psychological effect on the golfer created by labeling a hole as a par 3, 4, or 5. Though par labeling does nothing to change the rules of the game, as stroke play tournaments are settled by seeing who completes 72 holes in the fewest number of strokes, individuals might think of holes as “tough par 4s,” or “easy par 5s.” Among lesser skilled golfers, a long par 3 might put a mandate in the player’s brain that (s)he has to reach the green with the tee shot, though in reality the player would be much better served purposely attempting a shot that would not reach the green (“laying up”) and, thereby, setting up the player for a higher likelihood of a lower total score on that hole. We propose this effect is found not only in lesser-skilled golfers, but also in those of the highest level of skill. The par rating can be thought of as a reference point, a concept examined in Tversky and Kahneman (1991).
The United States Golf Association (USGA) is the ruling body of golf throughout the USA. Part of their mandate is to conduct national championships, the most famous of which is the men’s US Open. This 72-hole tournament is often known as the toughest test of golf and rotates annually to some of the most famous golf courses in the country. One hundred and fifty six golfers start the tournament each year, with the field size cut by about half after two rounds. The winning score at the US Open is often over par, and only four times in its history has it been more than 10 strokes under par.
Examining the golf courses used for past US Opens, we are presented with a unique natural experiment. There are instances in which the same hole has been rated as a par 5 in some US Opens and as a par 4 in others. In most situations, this is due to architectural changes to the course, such as adding new tee boxes to lengthen or shorten the holes. However, in other cases the change appears to have been made for no other reason than attempt to “protect par,” or to not have the winner be “too many” strokes under par and, thus, contributing to the US Open’s reputation as the toughest golf tournament. We see this at two courses in particular: Pebble Beach Golf Links (Pebble Beach) and Oakmont Country Club (Oakmont).
Pebble Beach has hosted the US Open six times in the past, with the most recent being in June 2019. The first three times it hosted the US Open (1972, 1982, 1992), the 502-yard second hole was rated as a par 5. In 2000 (the year Tiger Woods was the only player under par and won by a record 15 strokes), in 2010, and again in 2019, the same hole played as a par 4 with only minor changes to its length to accommodate normal movement of the tee markers and flag that would happen with any other hole. Similarly, Oakmont has hosted the US Open nine times. The first seven times, from 1927 to 1983, the ninth hole was played as a par 5. In 2007 and 2016, it was played as a par 4. During these nine tournaments, the hole was listed at a relatively consistent length of 475–488 yards. If prospect theory holds, the players should concentrate more on playing the hole in four strokes (par) when it is classified as a par 4 rather than a par 5, and as such should score better when it is labeled as a par 4. This assertion is the motivation for our current work presented here.
This remainder of this paper is outlined as follows. We describe our data and research hypothesis in Data and Research Hypothesis section. The statistical methods and results are presented in Statistical Methods and Results sections, respectively. Finally, we present our concluding remarks and future research directions in Conclusion and Discussion section.
Data and Research Hypothesis
The USGA provided data to the authors on every course that had been used multiple times for a US Open and specific information on any holes in which the par rating had changed. They also provided us with the score that every golfer recorded on every hole in those US Open tournaments.
For the purposes of this analysis, we restrict our attention to four US Opens: 1992 and 2000 at Pebble Beach Golf Links and 1994 and 2007 at Oakmont Country Club. The earlier dates, 1992 and 1994, are the last US Open tournaments played with hole number two at Pebble Beach and hole nine at Oakmont were rated as a par 5. The holes were both changed to a par 4 in subsequent tournaments. The resulting data set contains 31,710 unique hole scores across the four US Opens. A total of 156 golfers participated in the 1992, 2000, and 2007 US Opens, and 158 golfers played in the 1994 tournament at Oakmont. Forty-six golfers played in both tournaments at Pebble Beach whereas only 14 played in both at Oakmont.
A preliminary analysis of the data led us to believe that there was indeed better absolute performance when holes were rated as par 4s instead of par 5s and thus a possible instance of loss-aversive behavior. This preliminary analysis can be seen graphically in Figures 1 and 2 which show the distribution of scores across holes two and nine at Pebble Beach and Oakmont, respectively. It is immediately obvious that more threes and fours are recorded when holes are rated as par 4s rather than as a par 5. On the other hand, more fives and sixes are observed when both holes are rated as a par 5 than when the same hole was rated a par 4.

The relative frequency of scores on Pebble Beach Golf Links’ second hole by round. The black bars are relative frequencies for tournaments prior to 2000 and the gray bars are relative frequencies for the 2000 and 2010 tournaments.

The relative frequency of scores on Oakmont Country Club’s ninth hole by round. The black bars are relative frequencies for tournaments prior to 2007 and the gray bars are relative frequencies for the 2007 and 2016 tournaments.
Figures 1 and 2 suggest that players may be trying harder when playing to avoid losing a stroke (on par 4s) rather than when they are playing simply to maintain their current score (on par 5s). Indeed, Jordan Spieth, a three-time major winner and former number one ranked golfer in the world said in his 2019 U.S. Open pre-tournament (coincidentally held at Pebble Beach Golf Links) press conference, “Obviously par doesn’t really matter, but it’s nice when you feel like ‘Oh, I have to lay up, but I can still hit a wedge and get a birdie putt,’ instead of, ‘Oh, man, I don’t want to make a bogey’” (Costa, 2019). We investigate this anecdote in a statistically rigorous manner in the following section by carefully examining our principal research hypothesis stated below.
The uniqueness of this scenario in the context of a natural experiment on loss aversion should not be understated. Levitt and List (2008) remark that “Perhaps the greatest challenge facing behavioral economics is demonstrating its applicability in the real world.” By changing the par rating on two holes in the US Opens at Pebble Beach and Oakmont while not fundamentally changing how each hole is played, the tournament organizers have effectively created a natural experiment that we can use to answer if professional golfers behave in a loss averse fashion.
Statistical Methods
In order to assess whether or not the differences observed in Data and Research Hypothesis section are meaningful in a statistical sense, we need to develop an appropriate model. To this end, we present the following model as the basis of our analysis. In its most general form, we are simply using an unbalanced two-way layout with non-additive effects, see for example Chapter 23 in Kutner et al. (2005). Note, however, that we model the possible loss averse effect on each course independently using two separate, but consistent, models. This is done (primarily) to ensure parsimonious interpretations of effects, if they are present.
The statistical model for course
for The The The Finally, the year by hole interaction terms are defined by Our primary interest is in testing if the expected change in scores on hole two at Pebble Beach is significantly less than zero, before and after the change in the hole’s par rating. Similarly, we wish to assess test for this change on hole nine at Oakmont. Mathematically, the expected difference on hole two at Pebble Beach under this model formulation is written as
This is the statistical representation of our research hypothesis, H1.
It should be noted that we treat each golfer’s scores as independent within each tournament as well as across years at the same (or different) tournament(s). To be more precise in this description, consider the scores on holes one and two at the 1992 US Open for its champion, Tom Kite. Kite recorded scores of 4, 4, 4, and 3, and 4, 5, 4, and 5 on the first and second holes in 1992 at Pebble Beach when he won the tournament. Each of these observations are treated as independent of the others. In addition, Kite’s scores of 5, 4, 5, and 4 (hole 1) and 5, 4, 5, and 5 (hole two) in 2000 when he finished in thirty-second place are independent of those 1992 scores. In other words, all scores are independent both within year and across years. Given that we are treating each course independently, Kite’s scores at Oakmont in 1994 are necessarily independent from his Pebble Beach scores given the two separate models. Note that Tom Kite did not participate in the 2007 US Open at Oakmont.
We initially included player-specific random intercepts within year, however, the fact that so many golfers will have recorded the same scores in a given year, such an effect would be rendered meaningless. In fact, standard model selection tools such as the Bayesian Information Criterion (BIC) and the Akaike Information Criterion (AIC) recommend omitting the random effect terms.
Results
In this section, we describe the results related to our main hypothesis of interest, as well as several ancillary findings. The results related to Pebble Beach are presented first, followed by those of Oakmont. All of the analysis in this manuscript was performed using the R Software (R Core Team, 2020) and is available upon request in a fully reproducible format.
Pebble Beach Results
The overall F test associated with fitting the model defined in Equation 1 to the Pebble Beach data is 316.53 (
The Estimated Two-Way Layout ANOVA Models for the Data at Each Course Under Study.
The fitted values, or estimated average scores at Pebble Beach by hold and year, are displayed in Figure 3. It is immediately obvious that there are differences in average scores across the different hole/year combinations. Hypothesis H1, however, is concerned with hole two at Pebble Beach specifically. That is, are the average scores on hole two when it played as a par 4 (2000) lower than when it played as a par 5 (1992).

The estimated fitted values of the model defined in Equation (1) using the data from Pebble Beach. Note that hole five at Pebble Beach was substantially redesigned prior to 2000 and, as a result, played significantly more difficult than its 1992 version.
The one-sided t test associated with the contrast defined in Equation 2 for Pebble Beach yields an estimate of 0.23 (

The before changing par minus after changing par effect sizes for each hole on each golf course. Recall that only hole two and hole nine actually changed par at Pebble Beach and Oakmont, Respectively. Note that positive values indicate that the hole played easier in the latter tournaments (2000 at Pebble Beach and 2007 at Oakmont). The estimated coefficients and standard errors are found using the contrast defined in Equation (2) and general linear hypothesis testing theory. Note that hole five at Pebble Beach was substantially redesigned prior to 2000 and, as a result, played significantly more difficult than its 1992 version.
Oakmont Results
We performed a similar analysis on the data from Oakmont Country Club’s US Opens in 1994 and 2007, with particular attention being paid to hole nine. Similar to hole two at Pebble Beach, Oakmont’s number nine was changed from a par 5 to a par 4 prior to the 2007 US Open tournament. The overall F test associated with fitting the model defined in Equation 1 to the Oakmont data is 292.92 (

The estimated fitted values of the model defined in Equation (1) using the data from Oakmont.
Diving deeper into the test for loss averse behavior Oakmont’s hole nine, we apply the test associated with the contrast defined in Equation 2. The one-sided test in this case results in a point estimate of 0.13 (

Ancillary Results
As mentioned in Data and Research Hypothesis section, a total of 46 golfers played in both US Open tournaments at Pebble Beach and 14 played in both US Opens at Oakmont. This equates to 29.5% and 9.0% of the golfers playing in the 2000 and 2007 tournaments, respectively. Therefore, we thought it prudent to examine the scores on hole two at Pebble and hold nine at Oakmont during the latter tournaments held at each course. In particular, we examine the scores for the two distinct cohorts of players: those players who played in the previous tournament versus those who did not.
The relative frequency of scores on hole two at Pebble Beach and hole nine at Oakmont are displayed in Figures 7 and 8. It appears that at both courses tournaments, players who played both tournaments (1992 and 2000 at Pebble Beach and 1994 and 2007 at Oakmont) scored slightly higher on the two holes under study. Neither difference between the two groups at each course is statistically significant based on using Welch’s two sample T tests (

The relative frequency of raw scores for players who played in both tournaments at Pebble Beach (gray) versus those who did not (black).

The relative frequency of raw scores for players who played in both tournaments at Oakmont (gray) versus those who did not (black).
At an initial glance, these results might seem surprising. Upon closer inspection, however, there is almost certainly a degradation of skillsets over time that might attenuate any expected, pronounced loss averse effect for players who played in both tournaments. Indeed, the winner at the US Open in 1992, Tom Kite, was ranked 22 according to the Official World Golf Rankings (OWGR) in the week prior to that tournament, but by the 2000 US Open he was not ranked in the OWGR Top 200.
Conclusion and Discussion
The results presented in this manuscript provide compelling evidence that a loss averse behavior exists among professional golf players. In particular, this behavior manifests when a golf hole is changed from a par rating of par 5 to a par 4 in a US Open tournament, without fundamentally changing the hole’s character.
In this study, we analyzed data from two particular US Open courses: Pebble Beach Golf Links and Oakmont Country Club. Both courses changed a single hole (hole two at Pebble Beach and hole nine at Oakmont) from a par 5 to a par 4 without materially altering the makeup of the hole itself. Therefore, the USGA unintentionally created a natural experiment in which we could quantify the affect of this change in a loss aversion context. The results support prospect theory (Kahneman & Tversky, 1979).
One might be tempted to argue that the technological advances in the game (ball, club, etc.) and/or player improvements (e.g., fitness) over time are responsible for the observed decreases in scoring. While it is certainly true that players today are hitting the ball longer and straighter than ever before, there is still a noticeable, statistically significant decrease on the holes in question (hole two at Pebble Beach and hole nine at Oakmont) following the change in par. We attribute this decrease on those holes to loss aversion. As we have shown, there is a decrease in average scoring on holes number two at Pebble Beach and number nine at Oakmont that is markedly different from any changes on the other 17 holes on each course (see Figures 4 and 6). No hole on either course shows a consistent decrease in scoring average after the changes were implemented when they kept a consistent par rating and, in fact, several holes played harder. We would expect a similar decrease over all holes if the results were simply due to better golfing technology.
It is possible that factors other than length could go toward making a hole more or less difficult. For example, there can be holes that turn from tee to green (“dog legs”) rather than being relatively straight from tee to green, or even incorporate hazards such as sand, water, trees, or tall grass. It does not appear that the holes considered here were altered in any way to change the positions or amounts of hazards. Furthermore, a hole can become more or less difficult from day to day depending on where on the green the hole was actually positioned. Holes cut in the middle of the green are considered to be easier to play than those cut near the edges or potentially near sand traps or water. The USGA tries to spread this out by identifying five different pin positions for each green, so that they can rotate the wear on the greens as the players play the course on four consecutive days (and, up until 2018, potentially a playoff on a 5th day). This leads to some easier pin positions and some more difficult ones, and as a consequence should lead to variance evening out about the pin positions.
Another possible factor could be that the weather was much worse in the years when the holes were rated as par 5s than par 4s, which would lead to higher scores. If this were the case, however, we should see higher scores on the other 17 holes as well. We do not expect the weather to be appreciably different over the five or so acres that make up the holes in question, relative to the other 17 holes on the course. Indeed, we could not identify a consistent factor making one year an outlier that might indicate several days of bad weather.
Finally, we should mention how future US Opens, or golf tournaments in general, might be able to utilize the results of this study. Organizers could choose to change short par 5s to par 4s in order to protect par. The expected result would be more pars and bogeys, but the overall golf should be played at a higher level. As a specific example, the 2020 US Open Golf Championship is scheduled to be played at Winged Foot Golf Club (West Course) in Mamaroneck, New York. The fifth hole at Winged Foot is a 515 yard par 5. In other words, the hole is a relatively short par 5 by professional golfing standards. If it were changed from a par 5 to a par 4, we might expect a statistically significant decrease in average scores on that hole during the tournament.
Footnotes
Authors’ Note
The views expressed in this article are those of the authors and do not necessarily reflect the official policy or position of the United States Air Force Academy, Air Force, Department of Defense, or the US Government.
Acknowledgments
The authors would like to acknowledge Victoria Student, Senior Historian at the United States Golf Association, for providing the data used in this study. In addition, we would like to thank Professor Amy Finkelstein and several anonymous referees for their suggestions on improving earlier versions of this manuscript.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
