Abstract
Abstract
Objectives:
To investigate whether a commercially available brain training program is feasible to use with a middle-aged population and has a potential impact on cognition and emotional well-being (proof of concept).
Method:
Fourteen participants (ages 46–55) completed two 6-week training conditions using a crossover (counterbalanced) design: (1) experimental brain training condition and (2) active control “find answers to trivia questions online” condition. A comprehensive neurocognitive battery and a self-report measure of depression and anxiety were administered at baseline (first time point, before training) and after completing each training condition (second time point at 6 weeks, and third time point at 12 weeks). Cognitive composite scores were calculated for participants at each time point.
Results:
Study completion and protocol adherence demonstrated good feasibility of this brain training protocol in healthy middle-aged adults. Exploratory analyses suggested that brain training was associated with neurocognitive improvements related to executive attention, as well as improvements in mood.
Conclusion:
Overall, our findings suggest that brain training programs are feasible in middle-aged cohorts. We propose that brain training games may be linked to improvements in executive attention and affect by promoting cognitive self-efficacy in middle-aged adults.
Introduction
O
In contrast to the well-documented cognitive benefits of action-based videogames in younger cohorts, 3 the impact of brain training games on cognitive aging is less clear. This genre of games uses components from traditional psychological measures (e.g., mental arithmetic and pattern recognition) to train underlying cognitive functions associated with the tasks (e.g., working memory and perceptual reasoning, respectively). These games typically use feedback and reinforcement to promote learning, with task difficulty manipulated to facilitate within game skill acquisition—a critical feature for skill transfer. 1
To date, the research shows inconsistent findings on the effectiveness of the brain training programs in the aged. Some studies have demonstrated improvements in controlled processing, attention, memory, and executive skills using commercially available games (Nintendo Brain Age, 4 Lumosity,5–8 Nintendo DS Brain Training 9 ) and custom-designed platforms,10,11 with cognitive gains related to the participants' perceived cognitive abilities and quality of life. 9 In contrast, other studies have reported no cognitive gains in older participants 12 and no transfer effects to untrained tasks in individuals aged 18–60 years. 13 These inconsistent findings may reflect differences in participant demographics, training programs (within-subject, crossover vs. between-subject design), control conditions (mentally stimulating vs. no-training/no contact), and/or outcome measures (standardized neuropsychological tests vs. experimental computerized tasks).
Interestingly, these studies have primarily focused on individuals older than 60 years, despite cognitive decline beginning decades earlier. 14 The dearth of intervention studies on middle-aged cohorts is likely related to recruitment and engagement issues. That is, middle-aged participants are difficult to recruit and fully engage in intervention studies because they are usually working full-time and/or have other competing commitments. As such, although commercially available games are marketed toward this demographic group, it is unclear whether brain training programs aimed at improving cognition can actually be effectively applied to middle-aged populations, where decline is first noted. To understand the necessary parameters and practicality of this intervention approach to cognitive aging, a feasibility study is necessary. In the present study, we investigated the feasibility of using a commercially available brain training game (Nintendo DS Big Brain Academy) as an interventional tool that could improve neurocognitive functioning in middle-aged adults.
As depression and anxiety are known to negatively impact cognition, are related to early cognitive decline,15,16 and have been associated with increased risk of dementia, 17 we also investigated the influence of brain training on emotional functioning. To date, there is limited research exploring the effect of brain training on mood and anxiety. Preliminary findings suggest that brain training games can attenuate depressive symptoms in healthy older adults. 18 Likewise, other gaming platforms that integrate play with physical activity (e.g., Nintendo® Wii™ Sports or Fit) have been shown to reduce depressive symptoms in older adults 19 and stroke patients, 20 as well as symptoms of anxiety and depression in Lupus patients. 21 Given the impact of mood and anxiety on cognition and well-being, it is important to identify ways to mitigate these symptoms early in the aging process. Therefore, in addition to our cognitive indices, we examined symptoms of anxiety and depression as outcome measures in our participants.
In sum, we investigated the feasibility of using a commercially available brain training game as a potential interventional tool to improve neurocognitive and emotional functioning in an understudied group that is critically relevant to cognitive aging (i.e., middle-aged adults).
Materials and Methods
Participants
Fourteen middle-aged adults (ages 46–55), recruited from the community surrounding York University in Toronto, Ontario, participated in the study. Participants were entered into a draw for a Nintendo DS for participating. All participants provided informed consent, were fluent in English, and were nongamers (i.e., reported playing less than 1 hour of video or brain training games per week over last 2 years). Exclusion criteria included the following: history of neurological or psychiatric illness, head injury, or alcohol/substance abuse; presence of an untreated sleep disorder; and taking medication(s) known to impact cognition (e.g., antipsychotics, psychotropics, and benzodiazepines).
Design and procedure
The study was approved by the York University Research Ethics Board and conducted in accordance with the Helsinki Declaration. Using a crossover design, participants completed two 6-week training conditions: experimental brain training game playing (GP) condition and active control answering trivia questions (TQ) condition. The training condition order was counterbalanced. Participants were required to complete 18 one-hour training sessions (3 hours/week) per condition at their homes, and were asked to keep a journal documenting their hours and performance. Participants were contacted weekly to verify adherence to the training.
GP condition
Participants were provided with a Nintendo DS gaming system and Big Brain Academy software. Big Brain Academy consists of 15 activities grouped into five categories (think, memorize, analyze, compute, and identify) designed to stimulate/train and practice mental abilities. Activities required various cognitive skills, including simple attention and working memory, perceptual reasoning, and visuospatial skills (see Table 1 for a description of the expected skills associated with each activity 12 ). All activities had a speeded component and increased in difficulty as the player advanced through the game. During the training sessions, participants could practice a specific activity or complete a test that consisted of five randomly selected activities (one from each category). Each activity took 60 seconds to complete and players were provided with trial-by-trial accuracy feedback. In addition, a performance score was given at the end of each activity in terms of “grams” of brain weight, with higher values reflecting better performance. On completing a test, players were also provided with an overall performance score (sum of the five activity scores), letter grade, and information on what areas needed improvement. Participants were asked to document and submit their weekly highest test score (“brain weight”) across the 6 weeks of training.
TQ condition
Participants answered a set of randomly generated TQ on a variety of topics, including music, history, science, art, and literature (e.g., “How fast is hypersonic?”). Participants were required to use the Internet during this condition to control for the amount of time spent interacting with technology. They were allowed to use any available online resource to answer these questions. Explicit feedback was not provided during this condition, and task difficulty was not manipulated.
Outcome measures
Study completion and protocol adherence (self-reported and submitted weekly test scores) rates were used to assess feasibility. A neuropsychological testing battery, administered at baseline (before training) and after completing each training condition, provided measures of neurocognitive (i.e., “near” skill transfer) and emotional change. The battery included measures of attention and processing speed, memory, and executive skills (see Table 2 for measures). Participants were also administered the Hospital Anxiety and Depression Scale (HADS) 22 at each time point to measure emotional functioning. This 14-item self-report questionnaire assesses the presence and severity of anxiety (e.g., worrying thoughts, restlessness) and depression (e.g., anhedonia, apathy) symptoms with solid validity (Cronbach's α = 0.67–0.93). 23 Finally, general intellectual functioning 24 was measured at baseline. Each testing session took ∼90 minutes to complete and alternate forms were used whenever possible.
All neuropsychological test data represent standardized T scores (education and/or age corrected), with composite scores reflecting the sum of T scores associated with that factor.
BVMT, Brief Visuospatial Memory Test-Revised (forms 2, 3, and 4); HADS, Hospital Anxiety and Depression Scale (raw score out of 21); GP, game playing; HVLT, Hopkins Verbal Learning Test-Revised (forms 2, 3, 4); TMT, Trail Making Test (versions 1 and 2); TQ, trivia questions; WAIS, Wechsler Adult Intelligence Scale-Third Edition; WASI: FSIQ-2, estimated full-scale IQ score, two-subtest form Wechsler Abbreviated Scale of Intelligence.
Data preparation
Based on data collected simultaneously in our laboratory for another study, 25 we conducted an initial exploratory factor analysis to determine the structure of the neurocognitive battery. A principal component factor analysis with an Oblimin rotation and Kaiser Normalization was completed on the standardized T scores (based on education- and/or age-adjusted norms) obtained from 91 healthy community dwelling adults (ages 18–82; including the baseline data from the 14 individuals who participated in the present study), with no reported history of neurological or psychiatric illness, head injury, and/or alcohol/substance abuse. A four-component solution best explained the data, with 70.3% of the variance accounted for using this structure (Table 3). Based on this four-factor solution, composite scores (sum of T scores) were calculated for participants in the present study at each time interval. These composite scores were labeled as follows: Executive attention (Trail Making Test—Parts A and B 26 ; Matrix Reasoning 24 ; letter fluency 26 ); Verbal memory (Hopkins Verbal Learning Test-Revised 27 : immediate and delayed recall); Nonverbal associative learning and memory (Brief Visuospatial Memory Test-Revised 28 : immediate and delayed recall; Digit Symbol Coding 29 ); and Attention/language (Digit Span 29 ; category fluency 26 ).
All neuropsychological test data represent standardized T scores (education and/or age corrected).
Results
Demographic data and mean performances across measures are presented in Table 2. Training order groups were well matched on demographic variables, estimated intellectual functioning, and baseline measures (P > 0.10).
Outcome measures
Protocol feasibility
All participants successfully completed the study, including both training conditions and three outcome assessments. Across weekly check-ins, all participants reported completing the training protocol as required (i.e., three 1-hour training sessions/week) in both conditions (self-reported adherence = 100%). During the GP condition, participants documented and submitted their weekly highest Big Brain Academy test score on the majority of the training weeks (86.9%). Of the 14 participants, eight documented and submitted their test scores each week (57%).
Neurocognitive and emotional
Proportional changes in neurocognitive performance and anxiety and depression scores following the experimental GP condition relative to baseline are presented in Table 4 for each participant. In addition, proportional improvements on Big Brain Academy test scores after 6 weeks of training (relative to the first week) are provided. Within task skill acquisition (test scores) and “near” skill transfer was generally observed. The majority of participants showed improvements in executive attention (86%), attention/language (79%), verbal memory (71%), and Big Brain Academy test score (79%). The majority of participants also reported fewer symptoms of anxiety (93%). In addition, just under half of the participants reported fewer symptoms of depression (43%). No participants reported more symptoms of anxiety or depression following the GP condition. In contrast to these favorable findings, only 36% showed an improvement in nonverbal associative learning and memory, with declines noted in most participants (64%).
Proportional changes on neurocognitive and emotional functioning measures are based on the following equations: GP-TQ group: (scores at six-weeks) − (scores at baseline)/(scores at baseline) × 100; TQ-GP group: (scores at 12-weeks) − (scores at baseline)/(scores at baseline) × 100. For proportional changes in Big Brain Academy test scores, the following equation was used: (score at six-weeks) − (score at one-week)/(score at one-week) × 100. Positive values on the neurocognitive measures represent improvements in performance. Whereas negative values on the HADS represent reductions in reported symptoms.
When examining the proportional changes following the control TQ condition relative to baseline (Table 5), a similar pattern of results was observed. That is, the majority of participants performed better on measures of executive attention (64%), attention/language (79%), and verbal memory (57%). In addition, most participants reported fewer symptoms of anxiety (79%), with 21% endorsing fewer symptoms of depression. Again, similar to the experimental GP condition, only 43% showed an improvement in nonverbal associative learning and memory, with declines in performance noted in 57% of the participants.
Proportional changes on neurocognitive and emotional functioning measures are based on the following equations: GP-TQ group: (scores at 12-weeks) − (scores at baseline)/(scores at baseline) × 100; TQ-GP group: (scores at six-weeks) − (scores at baseline)/(scores at baseline) × 100. Positive values on the neurocognitive measures represent improvements in performance. Whereas negative values on the HADS represent reductions in reported symptoms.
To explore these training effects further, we compared the proportional changes associated with the GP condition with the changes associated with the control TQ condition using a series of paired sample t-tests. Overall, participants showed greater improvements in executive attention following the GP condition relative to the TQ condition, t(13) = 2.52, P = 0.026. Likewise, participants showed a greater reduction in depressive symptoms following the GP condition relative to the TQ condition, t(13) = −2.79, P = 0.015. A similar nonsignificant pattern was observed with the anxiety index, with participants generally reporting fewer symptoms following the GP condition relative to the TQ condition, t(13) = −1.77, P = 0.100. In contrast, the proportional changes associated with verbal memory [t(13) = 0.74, P = 0.475], nonverbal associative learning and memory [t(13) = −0.63, P = 0.540], and attention/language [t(13) = −0.36, P = 0.728] were not significantly different between the conditions.
As suggested by the data presented in Tables 4 and 5, there appears to be a potential relationship between improvements in executive attention and reductions in anxiety associated with the experimental GP condition. To explore this potential association, we correlated the proportional changes on our neurocognitive measures (with Bonferroni control, P < 0.01) with the proportional changes on the HADS across training conditions. A significant relationship between improved executive attention and reductions in anxiety was found following the GP condition, r = −0.723, P = 0.003, but not following the control TQ condition, r = 0.047, P = 0.872. This suggests that as anxiety decreased on the GP condition, performance on executive attention tasks improved. No other correlations were found for either training condition (Table 6).
Significant correlation between proportional changes in neurocognitive performance and HADS score (P < 0.01).
In sum, our findings demonstrate good feasibility, with preliminary results showing promising efficacy. That is, improvements in neurocognitive performance and emotional well-being were observed following the experimental GP condition. Relative to our active control condition, engaging in the brain training program was associated with greater improvements on measures of executive attention, as well as reduced symptoms of depression. Interestingly, improvements in executive attention were associated with reductions in anxiety, but only for the experimental GP condition.
Discussion
It is well established that select cognitive abilities decline with age, with measurable changes starting in middle age.14,30 Over the past several decades, researchers have been exploring different ways to ameliorate age-related decrements in cognition with varying success. 31 Rarely, however, have studies reported on the impact of brain training on emotional functioning. Furthermore, the majority of programs have focused on older cohorts (ages 60+). In the present study, we explored the feasibility of using a commercially available brain training program as an intervention tool, as well as report preliminary findings on the impact of brain training on neurocognitive and emotional functioning in middle-aged adults. Study completion and protocol adherence demonstrated good feasibility of a brain training protocol in healthy middle-aged adults. In addition, preliminary findings suggest potential training efficacy (proof of concept), with target “near” skill transfer and improved affect observed. Specifically, participants showed a greater improvement in executive attention and a reduction in depressive symptoms following 18 hours of brain training over a 6-week period relative to an active control condition. Although participants also demonstrated improvements in attention/language and verbal memory relative to baseline performance, this effect was similar across training conditions and thus most likely reflects a practice effect. Interestingly, we found that proportional improvements in executive attention and reductions in anxiety were related following the experimental GP condition, although reductions in depressive symptoms were not associated with improvements in neurocognitive performance. As anxiety is known to interfere with attention and executive control, 16 our results suggest that improved executive attention following our brain training intervention may be the consequence of reduced anxiety.
As suggested elsewhere, 32 middle-aged adults commonly worry about cognitive changes and neurodegenerative conditions such as Alzheimer's disease. Consistent with previous findings of self-efficacy influencing cognitive training outcomes, 9 we suggest that our brain training program may have promoted cognitive self-efficacy, which subsequently reduced anxiety in our cohort and resulted in performance improving on executive attention measures. That is, participants were able to engage in a cognitively stimulating activity, see their performance improve with practice (as measured by “brain weight”), and have a better understanding of their ability to enhance their cognitive skills after completing the brain training condition. This likely resulted in reductions in anxiety and subsequent improvements in executive attention performance. Similar to most brain training games, Big Brain Academy provides constant feedback and task difficulty is titrated to the player's performance (with difficulty increasing as the player advances through the game and skills are adequately acquired). According to Green and Bavelier, 1 this type of training procedure is likely associated with motivation and arousal. Therefore, by engaging in this brain training game program, it is possible that symptoms of anxiety were reduced (and cognitive performance subsequently improved) because participants were provided with feedback about their performance, were adequately challenged during training, and were able to observe improvements with practice.
In support of this interpretation, the initial improvements seen in the participants who completed the brain training condition first were diminished after completing the control condition (see GP-TQ group performance in Table 2). Specifically, executive attention and attention/language performance returned to baseline levels, with symptoms of depression and anxiety (at least partially) rebounding when participants were not engaged in the brain training condition. Future studies will need to directly measure cognitive self-efficacy to validate this interpretation. In addition, we recommend that the seemingly transient nature of the gains reported here be explored further. That is, future studies should determine whether individuals need to continually engage in brain training games to reap the suggested benefits, or can gains in cognition and affect be sustained with or without booster game training sessions. Demonstration of a lasting impact is particularly important when determining the utility of this cognitive aging intervention approach.
The relatively limited improvement in cognition associated with our brain training program is consistent with other studies that use similar crossover designs and standardized neuropsychological measures. 12 It is possible that the “unspecified” nature of our training program may have interfered with showing more widespread cognitive gains. That is, we did not prescribe the type of brain training that needed to be completed (specific activities or tests on Big Brain Academy); rather, participants were allowed to freely engage with the game during the required hours of play and it was only requested that training be completed at the same time of day throughout the study. Although this maximizes the ecological validity of this training approach, future research should explore whether more structured programs are necessary to improve cognitive skills (i.e., provide prescribed training, while controlling for potential time-of-day effects). Furthermore, measuring the impact of brain-GP on cognition using more sensitive indices (e.g., computer-based tasks) instead of standard clinical measures would be beneficial.
The present study's design allowed us to measure the feasibility of brain training in middle-aged adults, as well as present preliminary outcome findings on neurocognitive functioning and affect. Although we successfully demonstrated the feasibility of using a commercially available brain training program as an intervention tool, our sample size limits our ability to generalize our conclusions on the impact of brain training in middle-aged populations. In addition, we only explored “near” skill transfer effects * —again limiting the application of these preliminary findings.
Contrary to previous brain training studies5–8,10,11 that use a no-contact/no-training control group, we included a cognitively stimulating active control condition and implemented a crossover design. This approach is generally considered superior in terms of scientific rigor, as it attempts to control for placebo effects while allowing participants to serve as their own control. However, a potential criticism of our design is that training conditions were not matched adequately on expectation of improvement or task characteristics. 33 In general, matching expectations is a significant challenge in brain training game research, and findings such as ours may simply reflect a placebo effect. This genre of videogame is marketed to improve brain health and/or cognition, with explicit messages embedded within the game itself. This software design is not unique to Big Brain Academy and is found throughout commercially available brain training games. As such, finding an adequate control condition that can equate the expectation factor will be an important consideration moving forward.
Regarding task characteristics, brain training games use a complex learning paradigm that utilizes feedback and reinforcement to promote learning, with task difficulty appropriately manipulated to facilitate skill acquisition. These characteristics, which are challenging to control, are likely critical for skill transfer (as suggested elsewhere 1 ). Again, future studies should attempt to match task characteristics across experimental and control training conditions.
In conclusion, our results demonstrate the feasibility of brain training in middle-aged adults using a commercially available game. Our novel, although preliminary, findings suggest a relationship between engaging in brain training games, reductions in anxiety, and improved executive attention. Indeed, improvements in executive attention appear to be related to reduced anxiety, possibly through a cognitive self-efficacy mechanism. To understand the mechanism of change proposed here, future studies will need to incorporate appropriate control condition(s) that consider task characteristics and potential placebo effects. In addition, it will be important for future studies to examine the transient nature of improvements found in the present study. Incorporating long-term follow-ups beyond the initial post-test period will be important. These methodological considerations (appropriate control conditions, with longer follow-ups) are surprisingly rare, but necessary to determine the extent to which reductions in anxiety may be linked to the brain training programs.
Footnotes
Acknowledgments
This work was supported by an internal grant from York University, Faculty of Health (S.J.E.M.). We thank Gordon Flett for his useful comments and advice throughout this study. Aspects of this study were presented at the 19th annual Cognitive Neuroscience Society meeting (Chicago, April 2012).
Author Disclosure Statement
None of the authors (P.M.M., A.F.C., L.M.B.-C., J.K.C., S.J.E.M.) have any perceived, potential, or actual conflicts of interest to disclose in connection with the present article. No competing financial interests exist.