Abstract
The purpose of this study was to estimate the effect of Cognitive Orientation to Daily Occupational Performance (CO–OP) compared with usual occupational therapy on upper-extremity movement, cognitive flexibility, and stroke impact in people less than 3 mo after stroke. An exploratory, single-blind randomized controlled trial was conducted with people referred to outpatient occupational therapy services at two rehabilitation centers. Arm movement was measured with the Action Research Arm Test, cognitive flexibility with the Delis–Kaplan Executive Function System Trail Making subtest, and stroke impact with subscales of the Stroke Impact Scale. A total of 35 participants were randomized, and 26 completed the intervention. CO–OP demonstrated measurable effects over usual care on all measures. These data provide early support for the use of CO–OP to improve performance and remediate cognitive and arm movement impairments after stroke over usual care; however, future study is warranted to confirm the effects observed in this trial.
Although the death rate from stroke continues to decline in the United States and globally, the number of people living with chronic symptoms is rising. More than 7 million people have experienced stroke, and it is now the leading cause of long-term disability in the United States (National Stroke Association, 2015).
Although current best evidence has shown that repetitive practice of functional tasks is associated with improvements, such as better gait speed and upper-extremity function (French et al., 2008), most occupational therapy practitioners continue to use impairment-based approaches that emphasize remediation of impairments (Connell, McMahon, Eng, & Watkins, 2014; Teasell, Foley, Salter, & Jutai, 2008; Veerbeek et al., 2014). The expectation with these impairment-based rehabilitation approaches, also called bottom-up approaches, is that gains in the targeted component (e.g., motor function) will translate into improvement in performance in everyday life activity. Unfortunately, evidence suggests that gains do not occur; almost half of the people living in the community with stroke are still dependent in the activities necessary to support their daily lives (Appelros, Samuelsson, Karlsson‐Tivenius, Lokander, & Terént, 2007). Most of them have significant restrictions in their everyday life participation compared with their age-matched peers (Alzahrani, Ada, & Dean, 2011; Hackett, Glozier, Jan, & Lindley, 2012; Mayo, Wood-Dauphinee, Côté, Durcan, & Carlton, 2002).
For occupational therapy practitioners, this lack of association between impairment-based approaches and improvement in everyday activity should not be surprising. During the inception of the profession of occupational therapy in the early 1900s, Adolph Meyer established the philosophical foundation for occupational therapy. He challenged the profession to view disease not merely as a demon that had to be excised from the body, but rather as an affliction of maladaptation that can be addressed with a well-fitted use of time and occupation (Meyer, 1922). Mary Reilly (1962) further supported this foundation of occupational therapy in her 1962 Eleanor Clarke Slagle lecture when she declared the hypothesis of occupational therapy to be that “man, through the use of his hands, as energized through mind and will, can influence the state of his own health” (p. 92). Thus, for more than a century, occupational therapy theorists have espoused top-down approaches with the assumption that engagement in occupation can improve health and remediate impairment. Although increasing evidence has shown that bottom-up approaches do not improve occupation, little information exists on the impact of top-down approaches on impairment.
Cognitive Orientation to Daily Occupational Performance (CO–OP; McEwen, Polatajko, Huijbregts, & Ryan, 2010) is a top-down approach that reduces impairments and improves health. CO–OP is defined as “a client-centered, performance-based, problem solving approach that enables skill acquisition through a process of strategy use and guided discovery” (Polatajko et al., 2001, p. 108). The goal of CO–OP is to focus treatments directly on improving performance in everyday life activity rather than treating the underlying impairments and hoping for secondary improvement in meaningful activities. CO–OP was originally developed for use with pediatric populations, but a growing body of literature has supported its use to improve performance in people with stroke. Early evidence from two single-case experimental series in people with chronic stroke showed improvement in trained and untrained activities (McEwen et al., 2010; McEwen, Polatajko, Huijbregts, & Ryan, 2009). This improvement in activity performance was also demonstrated in an early-phase pilot clinical trial that compared people with chronic stroke with an active control group (Polatajko, McEwen, Ryan, & Baum, 2012). Although these early results with people with chronic stroke were promising, the general consensus is that rehabilitation early after stroke can have a greater effect on outcomes (Ploughman, 2002; Salter, Foley, & Teasell, 2010; Teasell et al., 2008).
With this in mind, our research group undertook an early-phase clinical trial using CO–OP with people less than 3 mo after stroke compared with usual and customary care delivered in the occupational therapy outpatient setting. On the primary outcome, objective performance of meaningful, functional activities as measured by the Performance Quality Rating Scale (PQRS; Martini, Rios, Polatajko, Wolf, & McEwen, 2015), CO–OP was found to have a medium effect (d = 0.5) over usual care on self-selected trained activities and a large effect (d = 1.2) on untrained activities. The effect on trained activities increased at 3 mo after intervention (d = 1.6), whereas the effect on untrained activities was maintained (d = 1.1; McEwen et al., 2015). Because of previous preliminary evidence that CO–OP may affect impairments and components of stroke impact (McEwen et al., 2010), we also sought to explore its effect on a group of secondary outcomes postulated to be affected by this complex, client-centered, performance-based, problem-solving approach. Specifically, our objective was to estimate the effect of CO–OP compared with usual occupational therapy on immediate and longer term secondary outcomes for upper-extremity movement, cognitive flexibility, and stroke impact in people less than 3 mo after stroke.
Method
This study was a single-blind, exploratory, randomized controlled trial with participants referred to outpatient stroke rehabilitation. The study was conducted at two rehabilitation centers collaborating with university investigators. All participants in this study were randomized to receive either usual outpatient occupational therapy provided at the institution (usual care) or CO–OP. All participants received other health care services as was typical at the centers, including, but not limited to, physical therapy, speech–language pathology, counseling, and nursing. Eligibility for participation in this study, however, was related only to occupational therapy services. The study was reviewed and approved by the Washington University in St. Louis School of Medicine Human Research Protection Office and the research ethics board of Sunnybrook Health Sciences Centre. A complete description of this study’s methods can be found in the previously published primary results article (McEwen et al., 2015).
Participants
Patients with ischemic stroke who were referred for outpatient therapy services at either Sunnybrook–St. John’s Rehab (Toronto) or The Rehabilitation Institute of St. Louis were recruited for participation in this study. Anyone who met these criteria was considered eligible. Patients were excluded on the basis of the following criteria: (1) more than 3 mo after stroke at the time of enrollment, (2) not referred to receive occupational therapy, (3) any prior neurological diagnoses other than stroke, (4) any major psychiatric illness, (5) moderate or greater aphasia as determined by combined scores of 6 or less on the Canadian Institute for Health Information (CIHI) National Rehabilitation Reporting System (NRS) Listing of Data Elements (CIHI, 2009) Items 64 and 66, and (6) significant cognitive impairment as determined by a score of 21 or less on the Montreal Cognitive Assessment (MoCA; Nasreddine et al., 2005).
A blocked randomization procedure stratified by site was used to determine group allocation. A statistician external to the study team developed the randomization sequence. A block size of 6 and an allocation ratio of 1:1 were used to ensure equal distribution in groups of 6 at each site. Group allocation was completed after consent and final determination of eligibility. The entire study team was blinded to the randomization procedure and block size.
Procedures
Participants with consent completed a baseline assessment (Time 1) with a rater blinded to allocation before starting the intervention. The baseline assessment also included the MoCA and the CIHI to determine final eligibility. After the baseline assessment, eligible participants completed an occupational interview using the Canadian Occupational Performance Measure (COPM; Law et al., 1998) with an occupational therapist, who was also blinded to group allocation, to establish goals for participation in this study.
During the COPM interview, participants selected functional activity goals that would become the focus of CO–OP treatment. After completion of the COPM, participants completed a third assessment to obtain PQRS scores. To complete the PQRS, participants were videotaped performing the self-selected goals from the COPM; the videos were later scored by a rater who was blinded to group allocation.
Next, participants were randomized to either CO–OP or usual care by the study coordinator at each site, and the results of the COPM were distributed to each participant’s treating occupational therapist. Participants had a range of stroke impairments and rehabilitation needs; therefore, the number of treatment sessions varied. However, the CO–OP group received a maximum of 10 CO–OP intervention sessions, and any additional sessions received were through usual care. After completion of the intervention, participants completed a postintervention assessment (Time 2) and a 3-mo follow-up assessment (Time 3) that included all the outcome measures described subsequently.
Intervention
Cognitive Orientation to Daily Occupational Performance.
Complete details about the theoretical underpinnings and implementation of the CO–OP approach have been previously published (Polatajko et al., 2001). In this study, CO–OP treatment was delivered in a separate location and with separate occupational therapists from those who administered the usual-care intervention. The first therapy session included a review of the CO–OP treatment model and the global strategy of Goal–Plan–Do–Check, adapted from Meichenbaum and Goodman (1971). In the first session, the participant and therapist also collaborated using results from the COPM to select three goals to address in treatment.
Throughout the subsequent therapy sessions, the participant used the problem-solving strategy Goal–Plan–Do–Check to address and master each goal activity. After the participant identified a goal for each session, the therapist used the process of guided discovery to help the participant establish a plan to accomplish the goal. The plan could have many parts and address aspects of the environment, the person, and how the activity was done. Performance problems related to the activity were assessed collaboratively by the participant and the therapist, and the therapist encouraged problem solving to allow the participant to self-discover domain-specific strategies specific to the activity such as modifying the task or changing body position to resolve the performance problem. Next, the participant executed the selected strategy (do the plan) and then checked to evaluate the success of the plan. The check presents an opportunity to refine or modify the plan or to decide that the goal was met. To achieve the goal, the Plan–Do–Check portion was often repeated more than once. The participant decided when the goal was achieved and the preferred plan to achieve the goal, not the therapist.
Usual Care.
Usual-care therapy took place at one of two freestanding rehabilitation centers and was done by the usual staff, who were unaffiliated with the research group. The clinicians received no direction from the research study staff. They were provided with the COPM results and personalized activity goals for each participant; however, no information was given to the usual-care therapist about how to use the COPM results. During study preparation, a survey conducted at both sites with a sample of experienced therapists indicated that usual-care stroke rehabilitation consisted of a combination of functional, task-based training, such as practicing dressing, and component-based training, such as grasping objects, chosen by each individual therapist to meet individual patient needs.
Outcome Measures
Table 1 provides an overview of the study outcome measures. All measures were administered at baseline (Time 1), postintervention (Time 2), and at 3 mo after completion of the postintervention assessment (Time 3). Although the total number of intervention sessions varied, therapists in both arms of this study were instructed to inform the study coordinator when the participant was being discharged from occupational therapy or when the maximum of 10 intervention sessions was reached, whichever came first, to complete the posttreatment assessment. This instruction was given to ensure dose equivalence at Time 2, considering the necessary variability that was expected in the number of treatment sessions in this population.
Description of Outcome Measures
Note. From “Combined Cognitive-Strategy and Task-Specific Training Improve Transfer to Untrained Activities in Subacute Stroke: An Exploratory Randomized Controlled Trial,” by S. McEwen, H. Polatajko, C. Baum, J. Rios, D. Cirone, M. Doherty, & T. Wolf, 2015, in Neurorehabilitation and Neural Repair, 29, 529. http://dx.doi.org/10.1177/1545968314558602. Copyright © 2015 by the American Society of Neurorehabilitation. Adapted with permission.
The video of the PQRS was rated on a scale ranging from 1 (can’t do the activity at all) to 10 (does the activity very well) by an independent blinded rater who viewed and scored the PQRS videos in randomized order (by participant, goal, and time). All raters were trained by the study investigators and had to demonstrate competency in administration of all the assessments with people with stroke before they were qualified to administer the assessments to study participants.
Analysis
After data cleaning and accuracy checks, analyses were conducted using IBM SPSS Statistics (Version 21; IBM Corporation, Armonk, NY) and Excel (Microsoft, Redmond, WA). Normal distribution was verified using the Shapiro–Wilk test. Descriptive statistics for the primary outcomes, PQRS, COPM, and participation were previously reported (McEwen et al., 2015). Descriptive statistics for Action Research Arm Test (ARAT; Lyle, 1981), Delis–Kaplan Executive Function System (D–KEFS; Delis, Kaplan, & Kramer, 2001), and Stroke Impact Scale (SIS; Duncan, Bode, Min Lai, & Perera, 2003) domains related to function were calculated, and baseline comparisons were made between sites and between groups. Time 1 to Time 2 and Time 1 to Time 3 mean change scores and standard deviations were calculated for normally distributed data, and Cohen’s d effect sizes and confidence intervals were calculated. For non-normally distributed data, medians and ranges were determined, and a nonparametric effect size r was calculated using the formula r 2 = z 2/N (Fritz, Morris, & Richler, 2012).
Results
A CONSORT (CONsolidated Standards Of Reporting Trials) diagram depicts participant flow through the study (Figure 1). A total of 35 participants were randomized between The Rehabilitation Institute of St. Louis (n = 20) and St. John’s Rehab in Toronto (n = 15). Of these 35 participants, 26 completed the intervention and the postintervention assessment (Time 2). Table 2 provides demographic data for participants by group and site. Overall, participants in St. Louis started outpatient occupational therapy services sooner than participants in Toronto (p = .04); however, participants had no other significant differences between sites at baseline. Table 2 shows that participants in both groups received almost an equal number of occupational therapy sessions; however, for this analysis, two outliers were removed, one from each treatment group, who had received more than 100 sessions of occupational therapy, perhaps related to their ability to pay privately for services.
Participant Demographics (N = 35)
Note. CO–OP = Cognitive Orientation to Daily Occupational Performance; M = mean; SD = standard deviation; UC = usual care. From “Combined Cognitive-Strategy and Task-Specific Training Improve Transfer to Untrained Activities in Subacute Stroke: An Exploratory Randomized Controlled Trial,” by S. McEwen, H. Polatajko, C. Baum, J. Rios, D. Cirone, M. Doherty, & T. Wolf, 2015, Neurorehabilitation and Neural Repair, 29, 532. http://dx.doi.org/10.1177/1545968314558602. Copyright © 2015 by the American Society of Neurorehabilitation. Used with permission.
Table 3 displays score and change score means and standard deviations and effect sizes for all normally distributed data for stroke impact and cognitive flexibility between the CO–OP and the usual-care groups. Cohen’s d effect size interpretation is as follows: 0.2 = small effect, 0.5 = medium effect, and 0.8 = large effect. At Time 2, CO–OP had a large effect over usual care for SIS Recovery (d = 0.8) and a medium effect over usual care for changes in the SIS Physical summary score (strength, hand function, mobility, and ADL/IADL scores), SIS Hand Function, and the D–KEFS Trail Making subtest (d = 0.5). At Time 3, there was a medium effect for SIS Hand Function (d = 0.6) and the D–KEFS Trail Making subtest (d = 0.5). ARAT and SIS Communication, Physical summary score, Emotion, and Memory domains were all found to be non-normally distributed, thus nonparametric analyses were conducted.
Comparisons Between Groups for Stroke Impact and Cognitive Flexibility
Note. ADLs = activities of daily living; CI = confidence interval; CO–OP = Cognitive Orientation to Daily Occupational Performance; D–KEFS = Delis–Kaplan Executive Function System; M = mean; SD = standard deviation; SIS = Stroke Impact Scale; UC = usual care.
Effect size: 0.2 = small effect, 0.5 = medium effect, and 0.8 = large effect.
Table 4 displays score and change score medians and ranges and the nonparametric effect size r (r 2 = z 2/N) for stroke impact and arm movement between the CO–OP and the usual-care groups. Effect size r interpretation is as follows: 0.1 = small effect, 0.3 = medium effect, and 0.5 = large effect (Fritz et al., 2012). At Time 2, changes in the ARAT and SIS domains all showed a small to medium effect of CO–OP over usual care. At Time 3, changes in SIS Communication showed a medium effect of CO–OP over usual care, and changes in the ARAT showed a small effect of CO–OP.
Comparison Between Groups for Stroke Impact and Arm Movement
Note. ARAT = Action Research Arm Test; CO–OP = Cognitive Orientation to Daily Occupational Performance; SIS = Stroke Impact Scale; UC = usual care.
Effect size: 0.1 = small effect, 0.3 = medium effect, 0.5 = large effect.
UC group, n = 7; CO-OP group, n = 8.
Given that the primary outcome of this study was to evaluate the effect of CO–OP on performance, no inclusion or exclusion criteria were related to upper-extremity function. Therefore, as the data show, the sample in both intervention groups included a wide range of upper-extremity function. Therefore, we also evaluated the effect of the interventions only in participants who had an impairment as defined by the ARAT (i.e., score <49). This criterion for impairment was established in an ongoing clinical trial, conducted by Catherine Lang and colleagues (NCT01146379), to evaluate the necessary dose of task-specific training to improve upper-extremity function. In participants with upper-extremity impairment (CO–OP group, n = 8; usual-care group, n = 7), a medium effect of CO–OP over usual care was still maintained at follow-up (see Table 4).
Discussion
The results of this study suggest that CO–OP, a top-down intervention focused primarily on skill performance, may have a broader positive effect on stroke recovery than usual care and a broader effect than might be expected of a top-down approach. In addition to positive gains in the targeted areas, subjective and objective occupational performance (McEwen et al., 2015), these data support a positive effect of CO–OP over usual occupational therapy on upper-extremity function, cognitive flexibility, and perceived body functions, areas not directly targeted during treatment. Note that the effect size estimates reported are the effect of CO–OP compared with usual occupational therapy services, rather than the absolute effect of CO–OP.
Although overall the differential effect on some secondary measures lessened between Time 2 and follow-up, there was still a measureable positive effect of CO–OP over usual care on all of the outcomes except the single SIS question related to self-report global recovery. This question asks participants to rate overall recovery from stroke on a scale ranging from 0 to 100. The CO–OP participants reported consistently better overall recovery over time, whereas the usual-care group decreased from baseline to postintervention assessment before improving at follow-up. Overall, the mean change scores for overall recovery for the CO–OP group were consistently higher than those for the usual-care group. The differential and positive effect of CO–OP on the objective measure of cognitive flexibility (D–KEFS Trail Making subtest) was maintained at a moderate level through the 3-mo follow-up. The differential and positive effect of CO–OP was moderate (r = .3) on the objective measure of arm movement (ARAT) postintervention and lessened minimally to r = .2 at 3-mo follow-up.
The explanation for the differential and positive effect of CO–OP over usual care remains unknown; however, some potential hypotheses could explain the results. First, CO–OP’s focus on skill performance, cognitive strategy use, and guided discovery could serve as a catalyst that provides an initial increase in both effect and efficiency (rate of effect) over usual care, as seen at Time 2. This hypothesis could be tested in a future study and would provide support for the use of CO–OP to expedite recovery poststroke. Second, almost all of the CO–OP participants received some usual-care occupational therapy after their 10 CO–OP sessions, which may have influenced the results at follow-up. We postulate that this situation may have caused confusion and mixed messages because participants went from a largely self-directed approach to a more traditional therapist-led approach. Future studies could evaluate whether additional CO–OP sessions instead of usual care would lead to maintenance of the larger differential effect observed postintervention.
CO–OP’s stated clinical objectives also include cognitive strategy use and transfer and generalization beyond the specific activities trained. Therefore, some of the moderate effects on secondary outcomes are perhaps expected. It can be postulated that using the CO–OP approach that implements global cognitive strategy in combination with guided discovery is linked to changes in cognitive flexibility. In CO–OP, participants are trained to use the global strategy Goal–Plan–Do–Check to develop a specific plan to improve performance of a self-selected goal, review performance, and modify the plan accordingly if performance is not satisfactory. This process is consistent with psychology theories of cognitive flexibility that describe cognitive flexibility as necessary to assess a situation when a nonroutine response is required, plan a new response or action to be taken, and use strategies to deal with the demands of the novel environment (Cañas, Quesada, Antolí, & Fajardo, 2003; Norman & Shallice, 1986). Therefore, the CO–OP process, in essence, helps to retrain cognitive flexibility in a way that usual care, which most likely focuses on remediation of habitual activities and function, does not. This effect could explain the gains in cognitive flexibility in the CO–OP group and the relative stability in such flexibility in the usual-care group. It is also consistent with at least one other study that has evaluated the use of key CO–OP components with people with stroke (Skidmore et al., 2014).
CO–OP has been found to have a medium effect over usual care on self-efficacy in ability to perform daily activities (McEwen et al., 2015). It can be postulated that this increase in self-efficacy leads to increased motivation to participate in everyday life activities and thereby increased use of the impaired upper extremity. This improvement in self-efficacy could also explain the differential effect on self-perception of function observed between the two groups. Regardless, the measurable effect of CO–OP over usual care provides preliminary evidence to support the use of CO–OP to improve occupational performance and remediate impairments in arm movement and cognitive flexibility. These results bring into question the continued clinical practice of focusing treatment on impairments with the hopes that reducing impairments will lead to meaningful occupational changes. The causal relationship between the effects observed remains unknown and is an area for future investigation.
This study has several limitations on the generalizability of the findings. First, all CO–OP participants were eligible to receive additional occupational therapy services after their completion of 10 CO–OP sessions. The majority of participants did receive additional usual-care occupational therapy services between the postintervention and the follow-up assessment that could not be controlled for in the data analysis because of the relatively small sample. Although dosage data were collected and were comparable between groups, there were unequal numbers of sessions between sites. In addition, the content of these additional sessions is largely unknown and may have biased the results. These additional sessions may potentially be responsible for the decrease in the differential effect between CO–OP and usual care at follow-up.
Second, for unknown reasons, there were more dropouts between Time 2 and 3 in the usual-care group (i.e., 3 participants) than in the CO–OP group (i.e., 1 participant); therefore, effect sizes between Time 2 and Time 3 could not be directly compared. Third, this early-phase feasibility study had a small sample with the aim to identify within-group and between-groups effects on a wide range of outcomes. The study was not powered for hypothesis testing, and further research is required to confirm the effects found. Fourth, little information was available to evaluate what specifically constituted usual-care occupational therapy at each site. The study team was limited to self-report from the therapists and daily notes; however, these items were not sufficiently descriptive. Future studies will have to document and classify usual-care occupational therapy more thoroughly. Fifth, upper-extremity dysfunction was not a specified inclusion criterion for this study. Therefore, the final sample had unequal upper-extremity function between groups. A future study that targets upper-extremity function as a primary outcome will need to take this function into account in the design of the study.
Finally, the effect of the interventions on impairment remediation was considered a secondary outcome in this study. Therefore, data were limited to evaluate the effect of the interventions on impairment and function. Future studies should more thoroughly evaluate potential outcome measures to try to capture this effect with more sensitive and comprehensive tools.
Implications for Occupational Therapy Practice
This study’s findings have the following implications for occupational therapy practice:
CO–OP, a top-down performance-based approach, has a positive effect on performance and impairment reduction in this early-phase study.
The generalizability of these findings is currently limited, and future research is necessary to confirm them.
These findings call into question the continued use of impairment-based rehabilitation methods to improve occupational performance and reduce impairment after stroke.
Conclusion
CO–OP, a top-down intervention targeting performance, cognitive strategy use, and transfer and generalization has a measureable effect not only on performance but also on impairment reduction and stroke impact. Specifically, measurable effects of CO–OP were seen in cognitive flexibility, arm function, and most self-reported stroke impact domains compared with usual-care occupational therapy. This early-phase feasibility study provides support for the use of CO–OP over usual care; however, it has several limitations on generalizability of the results. Future investigation is warranted to confirm and expand these findings.
Footnotes
Acknowledgments
This study was funded by a Canadian Institutes of Health Research Open Operating Grant (Funding Reference No. 111200) and was supported by the St. John’s Rehab Hospital and The Rehabilitation Institute of St. Louis. The authors acknowledge the assistance of Alisa Grigorovich, Tanya Ramsey, Carin Roth, Tammy Craig, Kimberly Walker, and Duana Russell-Thomas and of the staff in the Performance, Participation, and Neurorehabilitation Laboratory in the Program in Occupational Therapy at Washington University in St. Louis in assessment, evaluation, and treatment. Sara McEwen’s salary support came from the St. John’s Rehab Foundation. Timothy J. Wolf received salary support from the National Center for Medical Rehabilitation Research, National Institute of Child Health and Human Development, National Institutes of Health under award numbers K12HD055931 and K23HD073190. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.