Abstract
Individuals can be sensitized to the reinforcing effects of exercise, although it is unknown if this process increases habitual exercise behavior. Sedentary men and women (body mass index: 25–35 kg/m2, N = 52) participated in a 12-week aerobic exercise intervention. Exercise reinforcement was determined by how much work was performed for exercise relative to a sedentary alternative in a progressive ratio schedule task. Habitual physical activity was assessed via accelerometry. Post-intervention increases in exercise reinforcement predicted increases in physical activity bouts among those who expended over 2000 kcal per week in exercise and who compensated for less than 50 percent of their exercise energy expenditure.
Keywords
Introduction
The reinforcing value of exercise refers to one’s motivational drive to consistently engage in exercise (Flack et al., 2017a, 2017b). Cross-sectional work has demonstrated that adults who find aerobic exercise highly reinforcing are more likely to meet the physical activity (PA) guidelines for vigorous physical activity (VPA), while those who find resistance-type exercise more reinforcing are more likely to meet the recommendations for muscular-strengthening activities and VPA (Flack et al., 2017a). The reinforcing value of exercise is also a far greater predictor of habitual PA than liking (Flack et al., 2017b), operating on different neurobiological pathways with liking determined more by the central opioid system, whereas reinforcement is controlled by central dopamine (Berridge and Robinson, 1998, 2003; Ekkekakis et al., 2011; Robinson et al., 2015).
Increasing the reinforcing value of exercise among sedentary individuals has great potential for promoting the long-term adoption of exercise behaviors and thus the health of many Americans. Recent evidence points to the process of incentive sensitization, originally used to explain drug addiction, also applying to exercise. Incentive sensitization refers to sensitizing an individual to a reinforcing stimulus after repeated exposures, specifically transforming the perception of stimuli, imbuing them with salience and making them attractive, “wanted,” incentive stimuli (Robinson and Berridge, 1993). This is a prime component of the dopamine hypothesis of reward, well known to be implicated in motivating behaviors such as gambling, eating, and drug abuse (Spanagel and Weiss, 1999). Recent work from our lab has demonstrated single nucleotide polymorphisms (SNPs) important for dopamine signaling and transport previously linked to drug abuse, also to be predictors of exercise reinforcement, tolerance for exercise intensity, and habitual PA (Flack et al., 2019a; Robinson et al., 2015). Using genetic knockout models, others have demonstrated dopamine transporter and receptor expression to influence PA behaviors (Bronikowski et al., 2004; Rhodes and Garland, 2003). This offers an explanation for why exercise dependency has been demonstrated in both humans (Belke, 1997; Chan and Grossman, 1988; Chapman and De Castro, 1990; Holden, 2001) and rodents (Belke, 1997, 2000; Iversen, 1993; Lett et al., 2000), with the notion that central dopamine is playing a major role in the choice to be physically active, in line with the dopamine hypothesis of reward (Knab and Lightfoot, 2010).
We have previously demonstrated a high-dose exercise intervention to be effective at increasing exercise reinforcement (5 days per week, 600 kcal per session; Flack et al., 2019b), while low-dose interventions (3 days per week at 150 or 300 kcal per session) are effective at decreasing sedentary behavior reinforcement, but not capable of instilling incentive sensitization for exercise reinforcement (Flack et al., 2019c). The development of sensitization of drug abuse can be dose-dependent (Liu et al., 2005), and if drug abuse and exercise follow similar patterns (i.e. dopamine-mediated reinforcement), we would expect greater doses of exercise to be required in order to instill incentive sensitization. There are still questions regarding the best way to modify the dose of exercise (frequency of sessions, energy expended per session, exercise intensity), and we have yet to demonstrate physiological or behavioral benefits to increasing exercise reinforcement. This study fills some of this void by using pre–post change in exercise reinforcement to predict changes in PA behavior post-intervention, which influences energy compensation to an exercise program and thus weight-loss success. The present investigation’s hypothesis was that more frequent but shorter exercise sessions would produce greater increases in exercise reinforcement, compared to less frequent but longer sessions that produce greater energy expenditures per session but lower total expenditure over an entire 12-week intervention. This increase in exercise reinforcement was hypothesized to serve as an independent predictor in the increase in PA behaviors post-intervention. As a secondary analysis and hypothesis, we assessed the compensatory response to the exercise intervention, that is, the difference in expected weight loss (based on energy expended) and actual fat and lean mass loss converted to kcal equivalents. For instance, if a participant exercised to expend 30,000 kcal during the intervention but only lost 15,000 kcal, they would have compensated 15,000 kcal, or 50 percent of their energy expended. Although we did not determine the source of this compensatory response, one possibility is individuals become less active when engaging in exercise, reducing their non-exercise PA as a compensatory mechanism (King et al., 2007). We hypothesized individuals who increase their reinforcing value of exercise would compensate less, possibly by increasing habitual PA to increase energy expenditure.
Materials and methods
Participants
A total of 80 participants aged 18–49 years volunteered and were enrolled into the study. Of these, 52 completed all baseline tests and were randomized into one of three groups during this longitudinal, randomized, controlled trial. Of these 52 randomized participants, 44 completed the study (32 female), with 6 (4 female) withdrawing for personal reasons and 2 females being excluded for non-compliance (did not complete the required 85% of exercise sessions assigned per month). A consort diagram is depicted in Figure 1. All participants had a body mass index (BMI) ranging from 25 to 35 kg/m2 and were inactive (not engaging in any form of exercise), determined during screening where participants were asked about their exercise behaviors and validated by accelerometry (baseline participant characteristics are presented in Table 1). Participants were also non-smoking and free of any health conditions that may preclude them from exercise (metabolic or heart disease, cancer). Recruitment began in the winter of 2018 and continued until recruitment goals were met (spring of 2019) in and around Lexington, Kentucky, USA. Participants were a sample who responded to recruitment media including printed brochures and flyers and online advertisements placed on University of Kentucky’s Center for Clinical and Translational Science (CCTS) website. This study was approved by the University of Kentucky Institutional Review Board. The present analysis is a secondary outcome of a trial aimed at assessing mechanisms of energy compensation at different doses of exercise ClinicalTrials.gov identifier: NCT03413826, currently in review.

Enrollment and allocation of research participants.
Demographics, vigorous physical activity, and resistance exercise training behavior of the study participants at baseline, all participants randomized included.
MVPA: moderate to vigorous physical activity.
Data are mean ± SD.
Exercise reinforcement: final schedule completed for access to exercise during the relative reinforcing value task in order to gain access to exercise when sedentary behavior was available as a behavioral alternative.
Sedentary reinforcement: final schedule completed for access to sedentary behaviors during the relative reinforcing value task in order to gain access to exercise when sedentary behavior was available as a behavioral alternative.
Minutes of MVPA: weekly minutes of moderate to vigorous physical activity assessed via accelerometery using Freedson cut-points.
Minutes of VPA: weekly minutes of vigorous physical activity assessed via accelerometery using Freedson cut-points.
Minutes of sedentary: weekly minutes of sedentary activity assessed via accelerometery using Freedson cut-points.
MVPA bouts: number of moderate to vigorous physical activity bouts assessed via accelerometery using Freedson cut-points.
Liking of activities: assessed on a 1–10 point scale, with 10 representing “like very much.”
Preference and tolerance for exercise intensity, assessed via the Preference for and Tolerance of the Intensity of Exercise Questionnaire (PRETIE-Q).
Significantly different between groups, p ⩽ 0.05.
Procedures
During the initial screening and consenting visit, participants provided their written informed consent and were screened for eligibility criteria, completing a PA readiness questionnaire (PARQ), health history questionnaire, and screened on their dieting, weight loss history, and PA behaviors. Participants were provided an ActiGraph Accelerometer (Pensacola, Fla) to wear for the following 7 days to objectively assess PA prior to completing baseline testing. Participants also completed the Preference for and Tolerance of the Intensity of Exercise Questionnaire (PRETIE-Q) (Ekkekakis et al., 2005, 2008). Subsequent visits included assessments for exercise liking and reinforcement, rate of energy expenditure during exercise, and body composition (all detailed below).
Study design
The study was a randomized, controlled trial that included a 12-week exercise intervention of six sessions (days) per week, two sessions per week, or a sedentary control group (no exercise) blocked on gender. The study statistician generated and maintained the concealed allocation sequence. Participants were randomized upon completion of all baseline assessments with no blinding of intervention assignments. Participants were assessed for outcome measures at baseline and immediately after the intervention. Exercise reinforcement, preference and tolerance for exercise intensity, and body composition were assessed 24–48 hours after the participants completed their final exercise session of the 12-week intervention. Seven-day PA was assessed prior to beginning baseline assessments and after participants completed all other post-testing assessments. Participants were instructed not to begin a new exercise program during baseline assessments. In the 24–48 hours after the exercise intervention was completed and post-testing assessments for exercise reinforcement, preference and tolerance, and body composition were being performed, participants were instructed not to exercise. Participants were allowed, however, to exercise as they wished during the following 7 days while wearing the accelerometer to assess PA post-intervention as we were primarily interested in whether they increased their exercise behaviors once the intervention ceased.
Exercise intervention
Participants were provided a Polar A-300 heart rate (HR) monitor (watch and chest strap, Kempele, Finland) for the duration of the 12-week intervention and instructed to perform aerobic exercise (treadmill, bicycle, or elliptical ergometer) either two or six times per week on their own and were provided access to a fitness center. Participants in the control group were instructed to remain sedentary and return for post-testing 12 weeks later, receiving the exercise intervention after post-testing if they desired. Those in the exercise groups returned to the lab weekly to meet a researcher and download their exercise sessions using the PolarFlow software, which allowed research staff to monitor and track compliance. If a participant was not at least 85 percent compliant (completed 85% of expected exercise sessions per month), they were removed from the study. The downloaded exercise session reports provided the amount of time spent in each HR zone, which allowed for the calculation of the total energy expended during each exercise session based on individual rates of energy expenditure averaged across each HR zone calculated from the graded exercise test with indirect calorimetry performed at baseline and week 6. Participants in the 2-day per week group were instructed to perform two long exercise sessions per week and encouraged to try to expend 1000 kcal per session. Participants in the 6-day per week group were instructed to keep their sessions to 400 kcal per session and averaged just over 53 minutes per session. Although most participants in the 2-day per week group were not able to attain the 1000 kcal goal, they still expended significantly greater kcal per session compared to the 6-day group and spent on average 94.5 minutes per session. Participants received personalized HR-based exercise prescriptions that, if followed, would result in them expending the assigned energy per exercise session. Participants were also provided feedback each week on their energy expenditure of each session of the prior week so they could tailor future exercise sessions. All participants were instructed not to purposely change dietary habits during the intervention, that is, not begin an energy-restricted diet.
Assessments
PA
Habitual, free-living PA was measured using an ActiGraph accelerometer (GT3X + model; Pensacola, Florida). Each participant wore the device for 7 days prior to baseline testing and immediately after completing all other post-testing assessments. Participants were instructed to wear the monitor at the hip using the provided belt during all hours awake except when bathing or swimming. Data were cleaned of non-wear time, defined as consecutive strings of zeros greater than 20 minutes. An epoch of 10 seconds was used for data collection as a shorter epoch is more suitable to reflect bout duration under free-living conditions of sedentary individuals, where many bouts of sporadic activity last 30 seconds or less (Ayabe et al., 2013; Gabriel et al., 2010). These data were used to determine participants’ weekly minutes of moderate to vigorous PA (MVPA), number of MVPA bouts, vigorous intensity physical activity (VPA), and sedentary activity using the Crouter et al. (2010) algorithm, and Freedson cut-points (Freedson et al., 1998).
Liking of exercise
Participants’ liking (hedonic value) of the exercise options (treadmill, elliptical, stationary bike) and sedentary alternatives (computer games, reading, puzzles/Sudoku) was assessed using a 100-point scale (1 = “do not like at all” and 100 = “like very much”). The most liked activity was used for the exercise reinforcement testing session.
Exercise reinforcement
Exercise reinforcement (specifically, aerobic-type exercise, treadmill, elliptical, or bicycle ergometer) was assessed against a sedentary alternative (playing computer games, reading magazines, doing crossword puzzles, Sudoku). Exercise reinforcement is assessed by evaluating the amount of operant responding (mouse button presses) a participant is willing to complete to gain access to exercise (Bickel et al., 2000; Epstein et al., 2011). The testing space includes two workstations. One station is a computer and mouse on which the participant can earn points toward their most liked exercise activity, while the other station is a computer that can be used to earn points toward their most liked sedentary alternative. Participants can switch between stations as much as they choose. The program presents a game that mimics a slot machine; a point is earned each time the shapes match. For every five points, a session is completed, and the participant receives 5 minutes of access to the reinforcer that was earned (either exercise or sedentary activity). The game is performed until the participant no longer wishes to work for access to either the exercise or sedentary activities. At first, points are delivered after every four presses, but then the schedule of reinforcement doubles (4, 8, 16, 32, [. . .] 1024) each time five points are earned. For instance, the participant initially has to click the mouse button four times to earn each point for Schedule 1. After the first five points are earned, Schedule 1 is complete, and the participant earns 5 minutes for exercise. Then eight clicks are required to earn each of the next five points for Schedule 2 before another 5 minutes of exercise is earned. Schedule 3 would require 16 clicks to earn one point, Schedule 4 would require 32 clicks to earn one point, and so on (Bickel et al., 2000; Epstein et al., 2011). Participants engage in the activity for the time earned after they complete the game, which ends when the participant no longer wishes to earn points (time) for exercise or the sedentary alternative. In essence, the more reinforcing exercise or the sedentary behavior is, the more operant responding participants will do for access to these behaviors. Similar button pressing tasks are valid predictors of the reinforcing value of physical versus sedentary activity and for determining the reinforcing value of food (Barkley et al., 2009; Epstein et al., 1999, 2007). Participants self-selected the intensity level when performing any earned exercise time, which was typically a low to moderate steady-state intensity. These assessments took place in a laboratory space adjacent to the Human Performance Laboratory on the University of Kentucky campus, equipped with exercise equipment available for the participant to engage the exercise they had earned during the task. The reinforcing value of exercise and sedentary activity was conceptualized as the number of clicks required to earn each point of the last schedule completed (i.e. 4, 8, 16, 32 . . .) for exercise and the sedentary alternative, respectively, each assessed separately and often referred to as Pmax (Bickel et al., 2000; Scheid et al., 2014).
Rate of energy expenditure
A graded exercise treadmill test was used to determine each participant’s rate of energy expenditure at five different heart-rate zones. Oxygen consumed and CO2 produced were analyzed by indirect calorimetry (VMAX Encore Metabolic Cart, Vyaire Medical, Mettawa, IL, USA) which included an integrated 12 lead ECG for monitoring HR and used in conjunction with the Trackmaster TMX428 Metabolic cart interfaced treadmill. Upon completion of a 5-minute warm-up walking at 0 percent grade, 3.0 mph, the treadmill grade increased to 2.5 percent for 3 minutes. The treadmill grade was then increased every 3 minutes to produce an approximately 10 beat per minute increase in HR from the previous stage with the speed fixed at 3.0 mph. The test continued until an HR of 85 percent heart rate reserve (HRR) was attained or the participant felt they could no longer continue. Energy expenditure (kcal per minute) was determined from the amount of oxygen consumed and CO2 expired using the Weir equation (Weir, 1949). The average rate of energy expenditure during the last 30 seconds of each stage of the graded exercise test was regressed against the HR averaged over the last 30 seconds of the corresponding stage to calculate the rate of energy expenditure at different HRs. HR zones were calculated using the HRR formula as (220 − age) − resting HR × zone percent + resting HR (Swain et al., 1998). HR Zone 1 ranged from 0 percent to 25 percent HRR, Zone 2 corresponded to 26–40 percent HRR, Zone 3 was 41–58 percent HRR, Zone 4 was 59–75 percent HRR, and Zone 5 was 76–90 percent. Energy expenditure in kcal/minute was then averaged across each HR zone for determination of energy expenditure per minute for each zone. This test was completed at baseline and week 6 to recalculate rates of energy expenditure to account for improvements in fitness.
Body composition
Body composition was measured using a GE Lunar iDXA machine prior to the exercise test. The iDXA technique allows the noninvasive assessment of soft tissue composition by region with a precision of 1–3 percent (Rothney et al., 2012). A total body scan was conducted with participants lying supine on the table and arms positioned to the side. Most scans were completed using the thick mode suggested by the software as participants were overweight to obese. All scans were analyzed using GE Lunar enCORE Software (13.60.033). Automatic edge detection was used for scan analyses. The machine was calibrated before each scanning session, using the GE Lunar calibration phantom. Outcome measures included total body weight, fat-free mass (FFM), and fat mass (FM).
Energy compensation
To calculate compensation for the energy expended during the exercise program (ExEE), the accumulated energy balance (AEB) was calculated from changes in FM and FFM upon completion of the study as body composition changes reflect long-term alterations in energy balance (Rosenkilde et al., 2012). Gains of 1 kg FM or 1 kg FFM were assumed to reflect 12,000 and 1780 kcal, respectively (Elia et al., 2003). Losses of 1 kg FM or 1 kg FFM were assumed to equal 9417 and 884 kcal, respectively (Forbes, 1990). ExEE was calculated from the training-induced energy expenditure in kcal/session with the addition of 15 percent excess post-exercise energy expenditure (Bahr et al., 1987). The resting energy expenditure (REE) that would have occurred during the exercise sessions (REE × 1.2) was subtracted. Thus, ExEE = (TrEE × 0.15) + (TrEE—training duration × (REE × 1.2)) (Rosenkilde et al., 2012). The overall compensatory response to the increase in ExEE was assessed as described by Rosenkilde et al. (2012), with percent kcal compensated calculated as (ExEE + AEB)/ExEE × 100 percent. A 0 percent kcal compensation occurs when AEB equals − ExEE, or changes in the energy equivalent of FM and FFM equal energy expended during exercise. Positive compensation suggests that changes in body composition indicate a less negative energy balance than expected based on ExEE, whereas negative compensation indicates a greater than expected negative energy balance. ExEE, AEB, and percent kcal compensated could be calculated only for those participants who completed the study as both pre- and post-treatment data points were needed to calculate these variables.
Preference and tolerance for exercise intensity
The Preference for and Tolerance of the Intensity of Exercise Questionnaire (PRETIE-Q) (Ekkekakis et al., 2005, 2008) assesses how much a person tolerates and/or prefers the discomfort associated with intense exercise (Ekkekakis et al., 2005; Gulati et al., 2005; Lind et al., 2005). This was assessed by the questionnaire during the initial screening and consenting visit and during the final follow-up visit separate from any bout of exercise. Preference and tolerance scores are associated with the frequency of participation in strenuous exercise and total leisure-time exercise (Ekkekakis et al., 2008), a strong predictor of PA behavior (Flack et al., 2017a), and have been implicated in the process of incentive sensitization for exercise reinforcement (Flack et al., 2019a, 2019c).
Analytic plan
Baseline participant characteristics were assessed via 1-way analysis of variance (ANOVA) between groups exercising 6- and 2-days per week and sedentary control. Differences in the pre–post changes in exercise reinforcement, 7-day MVPA bouts, sedentary reinforcement, and changes in body fat were tested between groups and if changes were different from zero using analysis of covariance with the corresponding baseline value as the covariate. Between- group analyses were performed on randomized groups (exercise 6-days per week, 2 days per week, or control) in addition to retrospectively split groups on exercise energy expenditure (expending greater than 2000 kcal per week, less than 2000 kcal per week, or control), and compensation groups (compensating for greater than 50 percent of their kcal expended during the exercise intervention, less than 50 percent, or control). Linear regression analyses were used to predict changes in MVPA bouts, as this was the variable we hypothesized to be affected by our exercise intervention, with specific hypotheses on the relationship between changes in exercise reinforcement and changes in MVPA bouts. Therefore, changes in exercise reinforcement was our primary predictor of interest, with other variables that were differently affected by the exercise intervention (energy expended per week through exercise, percent changes in FM, percent kcal compensated for during the exercise intervention, changes in sedentary behavior reinforcement, and liking of exercise and sedentary activities) also entered as independent variables. Additional separate regression analyses were performed on retrospectively assigned groups. The choice to split groups on exercise energy expenditure above and below 2000 kcal and compensation groups above and below 50 percent was based on weekly energy expenditures per week averaging 2041.7 kcal and percent kcal compensated averaging 50.25. All analyses were performed in IBM SPSS Version 26 (IBM corporation, Armonk, New York, USA). Power Analysis: Our recent study (Flack et al., 2019b) demonstrated significant increases in exercise reinforcement after 12 weeks of high-dose exercise (five sessions per week, 600 kcal expended per session). Using an 80 percent power and 95 percent confidence level, 15 participants per group were needed to detect a significant change in exercise reinforcement (Pmax) from baseline to post-intervention.
Results
Baseline characteristics are presented in Table 1, with differences in sedentary behavior reinforcement between all groups, body fat percentage between 6-day per week and 2-day per week groups, and differences in MVPA bouts between control and 2-day per week group. Because of these differences, pre- to post-change scores were calculated and analysis of covariance was used to determine differences between the groups while controlling for the corresponding baseline value. Table 1 also indicates that participants were meeting the MVPA recommendations (150 minutes per week) despite reporting not engaging in any form of exercise (defined as leisure-time PA performed with the goal of increasing fitness and/or losing weight). We believe this is due to most participants accumulating shorter, spontaneous bouts of walking through the day, traveling across a sprawling university campus, and not indicative of actual exercise. This is supported by the finding that all groups were far below the recommendations for VPA (75 minutes per week). We therefore chose to use MVPA bouts as the primary outcome variable, which would include lower intensity exercise but only if performed for 10 or more minutes at a time, more indicative of purposeful exercise and in line with current recommendations that exercise sessions should last at least 10 minutes (Piercy and Troiano, 2018).
The mean ± standard error (SE) kcal/session for participants in the 2-day per week group was 745.33 ± 61.04, while the 6-day per week group expended 460.37 ± 26.04 kcal per session, mean ± SE, which was different (p < 0.01) between groups as expected. This equates to 2762.24 ± 156.23 kcal per week for the 6-day group and 1490.66 ± 122.07 kcal per week in the 2-day group, means ± SE. Further information on the exercise intervention outcomes have been reported previously (Flack et al., in review). Table 2 presents the change scores between the exercise frequency groups (randomized group), and between the retroactively assigned groups based on the amount of kcal expended per week during the exercise intervention (over 2000 kcal vs under 2000 kcal) and on the percent of kcal compensated for (over 50% vs under 50%). There were no differences in the change in exercise reinforcement between any groups or across time, although adjusted differences between 6- and 2-day groups approached significance (p = 0.06). Changes in the MVPA bouts were greater in both the 6-day and 2-day groups compared to the control (p < 0.01), whereas the control group was the only group that observed significant changes over time, decreasing the number of MVPA bouts. Adjusted change in MVPA bouts between the groups split on energy expenditure per week (above or below 2000 kcal per week) were also different from the control, while groups split on energy compensation (greater or less than 50 percent of energy expended during the exercise intervention) were different between each other and between the control. Adjusted changes in the FM percentage were different when comparing the control group with those exercising either 6 or 2 days per week, or above or below 2000 kcal per week. The 6-day per week group, those exercising over 2000 kcal per week, and those compensating less than 50 percent of their kcal lost significant FM (change different from zero). All compensation groups were different from each other in FM percent change (p < 0.05). Neither the preference for or tolerance of the intensity of exercise (assessed by the Preference for and Tolerance of the Intensity of Exercise Questionnaire, PRETIE-Q) were different between groups at baseline, did not change as a result of the exercise intervention, and did not change differently between any groups. Exercise intensity did not differ between groups, with the 2-day per week group and 6-day per week group spending 52.3 percent and 47.7 percent of their time in HR zones 3–5, respectively.
Changes in outcome variables (exercise and sedentary behavior reinforcement, MVPA bouts, percent change of body fat mass) between groups randomized based on exercise frequency in addition to participants retrospectively split into groups expending greater or less than 2000 kcal per week through exercise during the intervention and into groups compensating for greater or less than 50 percent of the kcal expended during exercise. Differences between groups tested via ANCOVA with corresponding baseline value used as covariate.
MVPA: moderate to vigorous physical activity; ANCOVA: analysis of covariance.
∆Exercise reinforcement: pre- to post-changes in the final schedule completed for access to exercise during the relative reinforcing value task in order to gain access to exercise when sedentary behavior was available as a behavioral alternative.
∆Sedentary reinforcement: pre- to post-changes in the final schedule completed for access to sedentary behaviors during the relative reinforcing value task in order to gain access to exercise when sedentary behavior was available as a behavioral alternative.
∆MVPA bouts: pre- to post-changes in the number of moderate to vigorous physical activity bouts assessed via accelerometery using Freedson cut-points.
∆Body fat percentage: calculated as ((12-week kg fat mass—baseline kg fat mass)/baseline kg fat mass)), representing percentage of change in body fat mass.
Preference and tolerance for exercise intensity, assessed via the Preference for and Tolerance of the Intensity of Exercise Questionnaire (PRETIE-Q).
Symbols indicating significant differences between groups (p ⩽ 0.05).
Value significantly different from zero (significant change over time, p ⩽ 0.05).
Linear regression results are presented in Tables 3 to 5 predicting changes in MVPA bouts. Changes in exercise reinforcement and percent kcal compensated were both independent predictors of changes in MVPA bouts, with greater increases in exercise reinforcement and less energy compensation predicting greater increases in MVPA bouts. Table 4 regression analysis only includes participants expending greater than 2000 kcal per week (n = 16) as when analyzing those expending less than 2000 kcal per week (n = 16), there were no significant predictors of changes in MVPA bouts. Table 5 regression analysis includes only those compensating for less than 50 percent of the kcal expended during exercise (non-compensators, N = 13) as no significant relationships were found for those compensating greater than 50 percent of the kcal expended during the intervention (N = 19). These analyses demonstrate that among all participants, changes in exercise reinforcement predict changes in MVPA bouts when controlling for all relevant variables, including energy expended during the exercise intervention, changes in FM, percent kcal compensated for, sedentary behavior reinforcement, and liking of exercise and sedentary behaviors. Percent kcal compensated and changes in exercise reinforcement remained significant independent predictors of changes in MVPA bouts when analyzed separately from nonsignificant variables. Changes in exercise reinforcement only predicted changes in MVPA bouts among those expending greater than 2000 kcal per week during exercise during the intervention and among those who compensated for less than 50 percent of their kcal expended. An additional regression analysis predicting changes in FM is presented in Table 6, indicating that change in MVPA bouts is a significant predictor of FM change when controlling for energy expended during exercise.
Regression models predicting pre- to post-intervention changes in MVPA bouts (7-day total) using independent variables that were expected to be influenced by the exercise intervention or a characteristic of the intervention (energy expended per week).
SE: Standard error.
∆Exercise reinforcement: pre- to post-changes in the final schedule completed for access to exercise during the relative reinforcing value task in order to gain access to exercise when sedentary behavior was available as a behavioral alternative.
kcal expended/week: weekly exercise energy expenditure during the 12-week exercise intervention.
∆Body fat percentage calculated as ((12-week kg fat mass—baseline kg fat mass)/baseline kg fat mass), representing percent change in body fat mass.
Percent kcal compensated: calculated from comparing accumulated energy balance post-intervention (changes in fat and lean mass converted to kcal) to total kcal expended through exercise during the intervention: (accumulated energy balance + exercise energy expenditure)/exercise energy expenditure.
Liking of activities: assessed on a 1–10 point scale, with 10 representing “like very much.”
∆Sedentary reinforcement: pre- to post-changes in the final schedule completed for access to sedentary behaviors during the relative reinforcing value task in order to gain access to exercise when sedentary behavior was available as a behavioral alternative.
Regression model predicting changes in MVPA bouts (7-day total) from prior to exercise intervention to after the intervention among those expending greater than 2000 kcal per week in exercise during the 12-week exercise intervention (no significant effects among participants expending less than 2000 kcal per week).
SE: standard error.
∆Exercise reinforcement: pre- to post-changes in the final schedule completed for access to exercise during the relative reinforcing value task in order to gain access to exercise when sedentary behavior was available as a behavioral alternative.
Percent kcal compensated: calculated from comparing accumulated energy balance post-intervention (changes in fat and lean mass converted to kcal) to total kcal expended through exercise during the intervention: (accumulated energy balance + exercise energy expenditure)/exercise energy expenditure.
Regression model predicting changes in MVPA bouts (7-day total) from prior to exercise intervention to after the intervention among those compensating for fewer than 50 percent of their kcal expended during the 12-week exercise intervention (no significant effects among participants compensating greater than 50%).
SE: standard error.
∆Exercise reinforcement: pre- to post-changes in the final schedule completed for access to exercise during the relative reinforcing value task in order to gain access to exercise when sedentary behavior was available as a behavioral alternative.
kcal expended/week: weekly exercise energy expenditure during the 12-week exercise intervention.
Regression model predicting changes in body fat (kg body fat post—kg body fat baseline/kg body fat baseline) among all participants.
SE: standard error; MVPA: moderate to vigorous physical activity.
kcal expended/week: weekly exercise energy expenditure during the 12-week exercise intervention.
∆MVPA bouts: pre- to post-changes in the number of moderate to vigorous physical activity bouts assessed via accelerometery using Freedson cut-points.
Mediation analysis were conducted to test whether changes in MVPA bouts mediated changes in exercise reinforcement or amount of weekly energy expended per week may have mediated changes in body fat. There were no significant mediation effects (p > 0.05).
Sensitivity analysis was conducted removing males from the analysis (n = 12). There was no difference in the overall results, indicating gender was not a confounding variable.
Discussion
There has been a wealth of research centered on behavioral reinforcement as an important component in the participation of certain, reinforcing, behaviors, positing the central dopamine system provides the physiological basis for realizing their reinforcing value (Berridge and Robinson, 1998; Robinson and Berridge, 1993). Recent and current research has focused on drug abuse, nicotine use, gambling, and eating energy dense foods as reinforcing behaviors all operating under the dopamine hypothesis of reward (Berridge and Robinson, 2003; Epstein et al., 2007, 2011; Liu et al., 2005; Rhodes and Garland, 2003; Robinson and Berridge, 1993; Robinson et al., 2015; Spanagel and Weiss, 1999). These behaviors are all common in that their engagement is not advantageous for one’s health (mental or physical), with many researching how we can improve these behaviors by understanding the underling physiological process implicated in their development, with one theory being incentive sensitization. One behavior that is starting to receive greater attention in the context of behavioral reinforcement is exercise, with early work investigating the reinforcing value of active play in children (Barkley et al., 2009; Epstein et al., 1999) and more recent cross-sectional analyses pointing to the reinforcing value of exercise being an important predictor of exercise behavior among adults (Flack et al., 2017a, 2017b). In contrast to the other reinforcing behaviors more traditionally researched, engaging in consistent exercise is beneficial for one’s health, making incentive sensitization for exercise an advantageous process. Therefore, we and others have taken an interest in trying to understand ways to induce incentive sensitization for exercise with the goal of increasing PA behaviors which would, theoretically, improve health. We have recently demonstrated greater doses of exercise are needed to instigate this process, possibly because a high-dose exercise program can increase the tolerance for exercise intensity to allow it to become a reinforcing behavior (Flack et al., 2019a, 2019c). Specifically, expending 3000 kcal per week (five sessions/week, 600 kcal per session) increased the reinforcing value of exercise, while exercising to expend 1500 (five sessions/week 300 kcal per session) did not (Flack et al., 2019b). These results support an earlier investigation where low doses of exercise (450 or 900 kcal per week) were effective at reducing the reinforcing value of sedentary behaviors but did not increase exercise reinforcement (Flack et al., 2019c). The results of the current investigation are parallel with these findings, as among those in the 6-day per week group (2762 kcal expended per week) the increase in exercise reinforcement approached significance (p > 0.06) with change scores greater than 30-fold of that compared with the control and those exercising twice per week (1491 kcal expended per week). The lack of statistical significance despite what appears to be clinically significant differences could be due to unexplained variability among participants, potentially related to genetic polymorphisms in the central dopamine system that have been demonstrated to influence exercise reinforcement (Flack et al., in review). This study did not observe any changes in preference or tolerance for exercise intensity. Since tolerance for exercise intensity appears to be an important player in the process of incentive sensitization for exercise (Flack et al., 2017a, 2019c), the lack of improvements in tolerance may be another reason why improvements in exercise reinforcement did not reach significant levels. Although only speculative, this may be related to the intensity of exercise individuals self-selected, with 6-day and 2-day groups not differing in time spent in HRR zones 3–5 or 1–2. It is possible that greater intensities are needed to produce tolerance for exercise intensity and improve exercise reinforcement. Research is under way to investigate how high-intensity exercise may work to develop tolerance and how this may influence incentive sensitization for exercise reinforcement.
Despite the lack of significant changes in exercise reinforcement, this investigation, for the first time, uncovered important implications for increasing exercise reinforcement. These findings support our hypothesis that increasing exercise reinforcement increases exercise behaviors and further justifies future research in this area. We chose to assess MVPA bouts (Freedson cutoff, ⩾10 consecutive minutes of moderate to vigorous intensity) instead of total minutes of MVPA as many of the participants in the study were college students or employees who were obligated to walk sporadically between classes on the college campus, therefore accumulating many bouts of walking less than 10 minutes in duration while not engaging in any structured exercise. Increasing MVPA bouts would therefore be more indicative of increasing purposeful exercise, the goal of our intervention. It is important to note that participants’ 7-day assessment of MVPA bouts at post-testing were performed between 1 and 2 weeks after completion of the exercise intervention as other assessments were performed immediately upon completion. This time between the end of the intervention and habitual activity assessment may have provided the needed break from forced exercise and allowed the process of incentive sensitization to take effect, creating a craving/wanting for exercise, which occurred in spite of participants not told to exercise nor given a fitness center pass as their pass was only valid for the 12-week intervention. In this light, it may have been advantageous to wait a week to perform the post-testing exercise reinforcement task. We also do not know how long-lasting the exercise intervention effects were, that is, if these exercise behaviors remained increased several months after the intervention ceased, creating permanent behavior change. Future studies may investigate these issues with multiple post-testing assessments of exercise reinforcement and PA, including long-term follow-up assessments.
An additional outcome analyzed in the present investigation centered on changes in percent FM (body fat change in kg/baseline body fat kg). Weight loss, specifically body fat loss, is a prime reason individuals partake in exercise and thus a relevant variable to assess in any exercise intervention (Obert et al., 2017). Indeed, we demonstrated significant decreases in body fat in the 6-day per week group and those expending greater than 2000 kcal per week, slight, but not significant decreases in the 2-day per week group and those expending fewer than 2000 kcal per week, and nonsignificant increases in body fat in the control group. This indicates the greater energy expenditures of the 6-day per week group and the greater than 2000 kcal group are needed to sustain the negative energy balance needed for weight loss. When energy expenditure is controlled for, however, one’s level of energy compensation determines weight loss success with exercise. Individuals compensating for fewer of the kcal they expended during the exercise intervention are, by definition, in a greater energy deficit compared with individuals who have a greater compensatory response. In this study, the average percent of kcal compensated for was 50.25 percent, in line with our previous work (Flack et al., 2018). Those who compensated greater than 50 percent of their kcal were deemed “compensators” and did not display the relationship between changes in exercise reinforcement and changes in MVPA bouts. This is in contrast to the “non-compensators,” who were more successful at weight loss and whose changes in exercise reinforcement predicted changes in MVPA bouts. Furthermore, changes in MVPA bouts predicted changes in percent FM when controlling for energy expended during exercise. It therefore appears that individuals who are less prone to compensate for the energy they expend during exercise realize the reinforcing effects of exercise and increase their exercise behavior, aiding in weight loss. Similar findings have been demonstrated previously, where increases in non-exercise PA were associated with lower energy compensation during a high-intensity exercise intervention (Schubert et al., 2017). Alternatively, increasing exercise reinforcement could be an effect of successful weight loss with exercise, where improvements in health, wellbeing, and appearance could feedback to increase exercise reinforcement and increase PA. Knowing these two features are interrelated (health physiology and behavioral physiology) is an additionally important finding future research may build upon.
This study is not without limitations. A more robust design may have been to match groups (2-day and 6-day) on weekly exercise energy expenditure, to control for some of the variability in the session/week group analysis. The average energy expenditure was just over 2000 kcal per week, with previous research indicating 1500 kcal per week to be ineffective at inducing incentive sensitization for exercise reinforcement while 3000 kcal per week to be effective (Flack et al., 2019b). Thus, it is possible that weekly energy expenditures of this study were not great enough for incentive sensitization to take place, although levels approached significance with expenditures of 2762 kcal per week. If participants exercise at greater energy expenditure per week, it is likely that improvements in exercise reinforcement and potentially greater improvements in MVPA bouts would have resulted. It is also possible that when using greater exercise energy expenditures, mediation analysis between group, exercise reinforcement, and MVPA bouts would have been more fruitful. The analysis also included mostly female, all between the ages of 18 and 40. It is not known whether older populations would experience a different effect or of any potential gender effects at play. In addition, the stage of menstrual cycle was not accounted for among female participants, which may have influenced the calculated ExEE during the 12-week intervention. The unsupervised nature of the exercise program may also be considered a limitation as participants could have exercised for additional time while not recording it (did not start watch), although we have no reason to believe this occurred. Finally, calculating energy expenditures averaged across HR zones based on the HRR formula may not have been as precise as conducting a maximal exercise test and assigning exercise zones based on VO2 max.
Conclusion and future directions
Research on increasing exercise reinforcement remains in its infancy, with more questions than answers at this point. This study provides evidence that PA behaviors can be increased as a result of increasing exercise reinforcement while further defining parameters that appear necessary for incentive sensitization to take place. It seems that exercising twice weekly, even when energy expenditures average greater than 740 kcal/session, is inadequate to improve exercise reinforcement and thus exercise behaviors. When exercise is performed six times per week (460 kcal per session), improvements in exercise reinforcement approach significance and positively influences habitual PA after the intervention has ceased. This 2762 kcal per week of the present 6-day group expended is slightly under the 3000 kcal/week previously used to induce incentive sensitization, indicating that 3000 kcal per week may be the minimum energy expenditure needed to increase exercise reinforcement. The optimum frequency, dose, and intensity needed to instill incentive sensitization remain an area of future research, with this investigation adding to that research question. We also demonstrate the interplay between behavioral outcomes (exercise reinforcement, changes in PA) and physiological outcomes (improvements in body composition and energy compensation). It appears that those who limit their energy compensation and are thus more successful at decreasing body fat through exercise are able to realize exercise as a reinforcing behavior and increase habitual exercise after the intervention has ceased. Although it is uncertain whether the behavioral outcomes influenced body fat loss or whether greater body fat loss caused exercise to be more reinforcing and made PA more appealing or possibly more attainable, a potentially new and interesting research question and an area for future work. Additional research is underway to shed light on some of these questions, with the goal of promoting sustained increases in exercise behaviors, resulting in more Americans meeting PA guidelines, attaining a healthy body composition, and improving health.
Footnotes
Acknowledgements
The authors thank the student volunteers and CCTS staff who aided in data collection and entry. Gratitude is also expressed toward all the research participants for their time and efforts in completing the intervention and assessments.
Data availability statement
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
