Abstract
Traumatic brain injury (TBI) leads to diverse physical, cognitive, and behavioral impairments that can affect the capacity to resume valued preinjury occupations and occupational roles (Tate & Broe, 1999). Adjustment to TBI is influenced by how people appraise their injury-related impairments and the extent to which they recognize the impact of the TBI on their current and future functioning (Hart, Seignourel, & Sherer, 2009). Self-perceptions of the everyday consequences of TBI can influence motivation for therapy and emotional adjustment to postinjury circumstances (Fleming, Strong, & Ashton, 1998). These self-perceptions and related changes in motivation and emotional status need to be monitored in rehabilitation to assist occupational therapists in determining a client’s readiness for particular components of therapy (e.g., goal setting) and to signal potential issues that may hinder therapy progress (Ownsworth & Clare, 2006). In this article, we describe the development and preliminary psychometric investigation of the Self-Perceptions in Rehabilitation Questionnaire (SPIRQ), which was developed for administration to adults with TBI during rehabilitation.
Impaired self-awareness can pose a significant barrier to rehabilitation progress and adjustment after TBI (Abreu et al., 2001; Fleming, Winnington, McGillvray, Tatarevic, & Ownsworth, 2006). Research has indicated that impaired self-awareness is associated with lower motivation for rehabilitation (Fleming et al., 1998; Lam, McMahon, Priddy, & Gehred-Schultz, 1988), reduced use of coping strategies (Ownsworth, McFarland, & Young, 2000), and poorer psychosocial outcomes (Sherer, Bergloff, Levin, et al., 1998). A systematic review of 12 studies involving participants with mixed etiology of brain injury identified that people with greater self-awareness generally achieved more favorable rehabilitation outcomes (Ownsworth & Clare, 2006).
Self-awareness typically improves with time since injury and is facilitated by participation in real-life tasks in a familiar environment after hospital discharge (Dirette, 2002; Fleming & Strong, 1999). However, the development of self-awareness is often accompanied by increased symptoms of depression and anxiety (Godfrey, Partridge, Knight, & Bishara, 1993), which can in turn impede community reintegration (Felmingham, Baguley, & Crooks, 2001; Ownsworth et al., 2011). Such findings underscore the need to monitor the emergence of awareness and associated changes in motivation and emotional distress during the postacute rehabilitation phase.
Despite growing interest in the implications of impaired self-awareness, its formal assessment in clinical practice is typically limited to the start and end of rehabilitation programs. Semistructured interviews such as the Self-Awareness of Deficits Interview (SADI; Fleming, Strong, & Ashton, 1996) provide quantitative and qualitative data concerning self-perceptions of current and future functioning but are time consuming and therefore not practical for repeated administration throughout rehabilitation. The Canadian Occupational Performance Measure (COPM; Law et al., 1998) uses an interview approach to measure self-perceptions of and satisfaction with performance on individualized occupational goals. However, the COPM does not capture self-perceptions of broader functions such as adaptation to injury, motivation for rehabilitation, or emotional adjustment.
An alternative approach is the use of questionnaire-based measures of self-awareness. These include the Patient Competency Rating Scale (Prigatano et al., 1986) and the Awareness Questionnaire (Sherer, Bergloff, Boake, High, & Levin, 1998), which compare client self-ratings with ratings of significant others and have the key advantage of brevity. Various factors, however, influence the extent to which significant-other ratings reflect a true measure of a client’s functional status, including familiarity with the person before and after the TBI and emotional issues such as denial and stress (Fleming et al., 1996).
A third option for assessing self-awareness involves behavioral observation of error recognition, self-correction, and strategy use in a functional activity (e.g., Abreu et al., 2001; Ownsworth, Fleming, Desbois, Strong, & Kuipers, 2006). This method typically does not reflect clients’ subjective understanding of their TBI-related limitations, because these internal processes cannot be directly inferred from behavioral observations.
To have clinical utility for administration throughout hospital-based rehabilitation, a tool measuring change in self-perceptions needs to be brief and capture key issues relevant to adjustment to TBI, namely, self-perceived functioning, motivation, and emotional reactions. We developed the SPIRQ for this purpose. Because of its brevity, the SPIRQ is feasible to administer on a periodic basis and may thus support occupational therapists in identifying the timing and pattern of changes. In turn, therapists may be better informed about clients’ current readiness for particular therapy components (e.g., clients who do not perceive any changes in their abilities may find it difficult to engage in goal setting) and the need to address issues that could impede progress in rehabilitation (e.g., a lack of understanding of the benefits of rehabilitation). Moreover, assessing clients’ current emotional reactions on the SPIRQ periodically throughout rehabilitation may serve as a useful screen for occupational therapists to detect signs of emotional distress that require further assessment by a psychologist.
The development of the SPIRQ items was supported by the same model of self-awareness that guided the development of the SADI (Fleming et al., 1996). We developed a set of items to assess the self-perceived impact of postinjury changes on current functioning and the need for compensatory strategies (Current Self scale). Another set of items was developed to reflect awareness of the impact of deficits on future functioning and the perceived need to modify plans in life (Future Self scale). We also developed items focused on assessing the perceived benefits of participating in rehabilitation (Self in Rehabilitation scale), which is a key aspect of motivation for change (Lam et al., 1988). Finally, we developed a set of items to assess common signs of emotional distress after TBI (Emotional Reactions scale), including depression (hopelessness and low self-worth), anxiety (worry), and reduced self-efficacy (Ownsworth, Fleming, Stewart, & Griffin, 2009).
Our main aims in this initial study were to examine the factor structure, internal consistency, and test–retest reliability of the SPIRQ. We hypothesized that factor analysis would support the conceptual structure of the SPIRQ and that each of the four scales would demonstrate acceptable internal consistency (α > .70; George & Mallery, 2003). We further hypothesized that the SPIRQ would demonstrate satisfactory test–retest reliability (r > .70; Nunnally, 1967) and that scores would not significantly differ between the two assessment sessions over an interval of approximately 1 wk. A further aim was to examine the associations between the SPIRQ scales and identify whether responses on the SPIRQ vary according to injury characteristics.
Method
Research Design
We used a cross-sectional design to examine the psychometric properties of the SPIRQ on the basis of a single administration. A repeated-measures component was incorporated to assess the SPIRQ’s test–retest reliability over a 5- to 7-day reassessment interval. Ethical clearance was obtained from relevant hospital and university ethics committees, and appropriate consent procedures were followed.
Participants
Occupational therapists working in inpatient or outpatient brain injury rehabilitation at major metropolitan hospitals in Brisbane, Queensland, and Sydney, New South Wales, Australia, were asked to administer the SPIRQ to patients with TBI who met the study eligibility criteria. The inclusion criteria included having been diagnosed with TBI within the past 12 mo; having adequate receptive and expressive communication skills; having been assessed as being out of posttraumatic amnesia (PTA); and being age 18–65 yr. Eligible participants were identified by their treating occupational therapist and approached by the same therapist to participate in the study.
Instrument
We generated items for the SPIRQ, with the initial pool of items developed on the basis of various models of metacognition (Fleming et al., 1996; Ownsworth et al., 2000; Toglia & Kirk, 2000) as well as clinical experience. Feedback regarding the item suitability and feasibility of administering the measure was provided by six occupational therapists at the Brisbane Brain Injury Rehabilitation Unit (BIRU) who piloted the SPIRQ with 10 patients during an occupational therapy session. Some minor changes to the wording and format were made on the basis of therapist and patient feedback.
The SPIRQ comprises 20 items across four miniscales that are designed to measure clients’ self-perceptions of injury, perceived benefits of rehabilitation, and emotional reactions throughout inpatient or outpatient rehabilitation. The SPIRQ items are presented in Table 1, according to each scale (i.e., Current Self, Future Self, Self in Rehabilitation, and Emotional Reactions). Each SPIRQ item is rated on a 6-point Likert scale (ranging from 1 = strongly disagree to 6 = strongly agree), and six negatively worded items (Items 4, 5, 7, 11, 12, and 15) are reversed before deriving scale scores. Higher scores on each scale reflect greater acknowledgment of the consequences of TBI, increased perceived benefits of rehabilitation, and greater emotional distress. No total score is calculated for the SPIRQ.
Self-Perceptions in Rehabilitation Questionnaire Items
Procedures and Data Collection
Occupational therapists received training on the administration of the SPIRQ before study commencement and at regular staff meetings to ensure consistency of administration. For the internal consistency analysis, all occupational therapists in brain injury rehabilitation administered the SPIRQ to their own clients at the beginning of an occupational therapy session. For the test–retest reliability analysis, occupational therapists at the Sydney BIRU were asked to administer the SPIRQ at the end of an occupational therapy session, and then the same occupational therapist conducted a second administration 5–7 days later at the end of an occupational therapy session. All participants with TBI received two sessions of occupational therapy between the two administrations. The interval of approximately 1 wk was considered sufficient to minimize carryover effects yet short enough to reduce the likelihood of actual clinical change occurring (Domholdt, 2005).
Data Analysis
Data screening procedures identified missing data for 2 participants on a small number of SPIRQ items. These participants were excluded from further analysis. We conducted an exploratory factor analysis of the SPIRQ using principal components analysis with varimax rotation of factors with eigenvalues >1. A sample size of at least 100 participants and ratio of 5 participants per item is generally regarded as the minimum for a reliable factor solution (Guadagnoli & Velicer, 1988; Hatcher, 1994). Internal consistency was assessed using Cronbach’s α, with the criterion of .70 regarded as acceptable (George & Mallery, 2003). Item suitability was considered according to Pallant’s (2007) guidelines, with an item deemed problematic if at least two of the three following conditions exist: (1) Values for interitem correlations are negative; (2) values for corrected item–total correlations are <.3; and (3) a higher α value would be obtained if the item was excluded. Data screening identified that data on the SPIRQ scales were normally distributed, and we therefore examined test–retest reliability using Pearson’s product–moment correlation. We also conducted paired t tests to determine whether scores significantly differed between the two administrations conducted 5–7 days apart (Domholdt, 2005).
Results
Participant Characteristics
Participants were 105 patients admitted to BIRUs at major metropolitan hospitals in Brisbane and Sydney. Occupational therapists administered the SPIRQ to all eligible patients with TBI as part of their occupational therapy program. No attrition occurred. At the Brisbane BIRU, 72 patients with TBI were recruited as they received inpatient occupational therapy (81%) or outpatient occupational therapy consisting of weekly intervention sessions (19%). Participants at the Sydney BIRU (n = 33) were all receiving inpatient occupational therapy.
The demographic and injury characteristics of the total sample and the subsamples are summarized in Table 2. Participants were in their 1st yr post-TBI, were predominantly male (79%), and were on average 36.3 yr old (standard deviation = 13.9). The causes of TBI included road traffic accidents (n = 81; 77%), falls (n = 10; 10%), assaults (n = 9; 9%), sporting accidents (n = 3; 2%), and self-inflicted penetrating injuries (n = 2; 2%).
Demographic and Injury Characteristics of the Sample With Traumatic Brain Injury
Note. BIRU = brain injury rehabilitation unit; M = mean; SD = standard deviation.
The 33 participants with TBI from the inpatient unit in Sydney were somewhat older than the Brisbane participants and had more recent injuries (Table 2). On the basis of the duration of PTA recorded in medical files, participants had all sustained a severe TBI, although data for PTA were missing for approximately 17% of the sample. Where PTA data were unavailable, Glasgow Coma Scale (GCS) scores indicated that approximately 8% of the sample had sustained mild to moderate TBI (GCS > 8/15). Functional status as rated on the Disability Rating Scale was similar between the two samples. The participants with TBI in the Sydney BIRU were involved in the test–retest reliability analysis and received two SPIRQ administrations over a 5- to 7-day interval.
Factor Analysis
An exploratory factor analysis with varimax rotation resulted in a four-factor solution based on factors with eigenvalues >1 and accounted for 56.9% of the variance. The eigenvalues for each factor and proportion of variance accounted for were as follows: Factor 1 = 5.70 (28.5%); Factor 2 = 3.00 (15.0%), Factor 3 = 1.42 (7.1%), and Factor 4 = 1.25 (6.27%; see Table 3). The first factor extracted included seven items with loadings of .58–.77 and was labeled Changes in Self and Life Plans. The items spanned both the Current Self (three items) and Future Self (four items) scales. The second factor extracted, Emotional Reactions, included all six items of the Emotional Reactions scale (item loadings = .45–.81). That two of the Emotional Reactions items (Item 3 and Item 10) also loaded positively (.51 and .44, respectively) on the first factor extracted is noteworthy; however, their item loadings were highest on the second factor (.68 and .48, respectively). The third factor extracted, Self in Rehabilitation, included four items of the Self in Rehabilitation scale (item loadings = .50–.81).
Principal Components Analysis of the Self-Perceptions in Rehabilitation Questionnaire (N = 103)
The fourth and final factor extracted included three items: one from the Self in Rehabilitation scale and two from the Current Self scale (item loadings = .60–.70). The content of these items suggested that this factor reflected views on recovery or returning to one’s premorbid functioning. However, we had concern about treating this factor as a scale for further psychometric analysis because it had only three items, all of which were reverse scored. Hence, the wording of each item required participants to disagree with the statement to acknowledge the consequences of their TBI (e.g., “I feel that I have made a full recovery from my brain injury”). Cronbach’s α (.62) for this set of three items was also low. Therefore, because of uncertainty about the valid interpretation of the fourth factor, we excluded these items from further analysis in this study.
Internal Consistency
Examination of Cronbach’s α for the three scales of the SPIRQ identified that α was acceptable (α > .70) for the Changes in Self and Life Plans (7 items, α = .83), Emotional Reactions (α = .72), and Self in Rehabilitation scales (α = .80). Moreover, the item–total correlations were all positive and greater than .30 (.46–.60, .39–.65, and .40–.69 for the three scales, respectively), and removing an item would not improve Cronbach’s α for any of the scales.
Test–Retest Reliability
Paired-samples t tests revealed no significant differences between the first and second administration of the SPIRQ for any of the scales over the 5- to 7-day interval for the Sydney inpatient sample (n = 33; see Table 4). Test–retest reliability was good (r > .80) for the Changes in Self and Life Plans scale and acceptable (r > .70) for the Emotional Reactions scale. The test–retest coefficient was significant for the Self in Rehabilitation scale (r = .67, p < .001), although it was below the acceptable criterion (r < .70).
Test–Retest Reliability for the Self-Perceptions in Rehabilitation Questionnaire Scales Over a 5- to 7-Day Interval (n = 33)
p < .001.
Associations Between the SPIRQ and Clinical Variables
The final analysis examined the associations between the SPIRQ scales and injury characteristics. The Changes in Self and Life Plans scale was significantly associated with the Self in Rehabilitation scale (r = .34, p < .001) and Emotional Reactions scale (r = .49, p < .001), indicating that participants who recognized greater functional consequences of their TBI were more likely to perceive rehabilitation as beneficial and report increased emotional distress. However, the association between the Self in Rehabilitation and Emotional Reactions scales was small and nonsignificant (r = −0.10, p > .05). Responses on the SPIRQ were unrelated to injury characteristics, with one exception; participants with greater time since injury were more likely to perceive changes to self and their life plans (r = .29, p < .01).
Discussion
The exploratory factor analysis provided some support for the conceptual structure of the SPIRQ, particularly the two scales assessing emotional reactions and perceived benefits of rehabilitation. However, the distinction between Current Self and Future Self was not empirically supported because most of these items loaded onto a single factor, Changes in Self and Life Plans. Internal consistency of the three factor-derived SPIRQ scales was sound. Test–retest reliability was generally acceptable, and scores did not significantly differ over the 5- to 7-day readministration interval. Responses on the SPIRQ scales were largely unrelated to injury characteristics, although participants with greater time since injury were more likely to perceive the functional consequences of their TBI on the Changes in Self and Life Plans scale.
An interesting finding of this study is that participants’ perceptions of their current functioning (e.g., changes in abilities and the need to use strategies) were not distinguishable from their perspectives on the future impact of their TBI. Instead, a single factor (Changes in Self and Life Plans) best accounted for their views on their current and future functioning. However, two items developed to assess current self did not load onto this factor. Specifically, “I feel I have made a full recovery from my brain injury” and “I manage everyday tasks the same as how I used to before my brain injury” loaded onto a fourth factor. This fourth factor also included one item from the Self in Rehabilitation scale (“I would be back to normal if I was allowed to return to all the things I used to do, e.g. driving, work, playing sports”). These three items appear to reflect views on recovery and returning to “normal” that have previously been found to be a major theme of adjustment during this period (Turner, Ownsworth, Cornwell, & Fleming, 2009). Agreement on these items may also reflect that participants were in the precontemplation stage of change in terms of their treatment readiness (see Lam et al., 1988).
Despite the potential relevance of these self-perceptions to rehabilitation, we were concerned about forming a scale based on only three items. Moreover, these items possibly loaded on the same factor because of the response format rather than a shared meaning. Further research is needed to ascertain whether self-perceived views on recovery and returning to normal represent a distinct construct to assess during rehabilitation by generating more items related to this theme and wording items as both positive and negative statements.
The findings indicated that the internal consistency and test–retest reliability of the three SPIRQ scales were mainly in the acceptable to good range (Tate, 2010). Both forms of reliability were strongest for the Changes in Self scale, which also had the most items (seven). The Self in Rehabilitation scale had the fewest items (four) and demonstrated less stability over the 5- to 7-day reassessment interval. This scale assesses the extent to which participants feel that they are learning to understand and cope with the effects of their brain injury as well as working on areas of personal importance and achieving their goals in rehabilitation. The somewhat lower test–retest reliability for this scale may indicate that perceptions of the benefits of occupational therapy rehabilitation can fluctuate over a short period of time during inpatient rehabilitation.
Responses on the SPIRQ scales did not vary according to injury severity (PTA) or functional status on the Disability Rating Scale. This finding is broadly consistent with research on self-awareness within populations with moderate to severe TBI, suggesting that clients’ subjective appraisals of their injury and the functional consequences are typically unrelated to indices of injury severity (Fleming & Strong, 1999). Responses on the Changes in Self and Life Plans scale were positively related to time since injury, reinforcing previous findings that, with time, people are better able to make sense of their postinjury impairments and the long-term implications (Godfrey et al., 1993; Hart et al., 2009). Moreover, participants who reported greater functional consequences of their TBI were more likely to perceive rehabilitation as beneficial and report increased emotional distress. This pattern mirrors previous findings that people with high self-awareness report greater levels of both motivation and emotional distress than people with low self-awareness (Fleming et al., 1998). The lack of association between the Self in Rehabilitation and Emotional Reactions scales suggests that emotional distress is not uniformly related to higher or lower appraisals concerning the benefits of participating in rehabilitation.
The direction of associations between the SPIRQ scales cannot be assumed because of the cross-sectional data. Hence, the pattern of responses on the SPIRQ and associations between the scales need to be investigated over an extended time period, for example, from admission to discharge. Related to this, an important future objective for validating the SPIRQ involves assessing the tool’s sensitivity, or capacity to detect clinically meaningful change in the context of rehabilitation (Domholdt, 2005).
Limitations and Future Research
Several other methodological issues need to be considered in this preliminary study. As with all self-report measures, responses on the SPIRQ are prone to self-report biases that may affect the validity of information gained. Future research needs to examine the extent to which SPIRQ responses are influenced by potential sources of bias, including social desirability, denial, and memory impairment. In terms of sampling and related validity considerations, the occupational therapists administered the SPIRQ to all eligible inpatients with TBI, and hence the sample is likely to be broadly representative of patients receiving inpatient rehabilitation. However, the characteristics of patients with TBI differed between the two services (i.e., age and time since injury) and may indeed differ from other settings. Because only a small number of outpatients were included, further research is needed to examine the reliability of the SPIRQ for outpatient rehabilitation and across different postacute rehabilitation settings.
The sample size of just more than 100 participants is considered the minimum for exploratory factor analysis (Hatcher, 1994), and the factor solution and item loadings might change with the addition of more participant data. Accordingly, the stability of this solution needs to be examined in future research using a larger sample with TBI (i.e., >200). Additionally, both the convergent and the divergent validity of the SPIRQ require investigation to provide further indication of the tool’s construct validity. Another key priority for future research is to examine the SPIRQ’s sensitivity to change in hospital-based rehabilitation as well as in response to particular interventions (e.g., self-awareness training).
Although further psychometric evaluation is warranted before clinical use, the potential applications of the SPIRQ may be considered. The tool may assist in detecting the emergence of self-awareness, which often occurs during the early community reintegration period (Fleming & Strong, 1999). The SPIRQ may also help to identify people who begin to overestimate the functional consequences of their TBI relative to objective indices, which is commonly associated with emotional distress and poorer long-term functional outcomes (Ownsworth et al., 2007). Therefore, to support accurate interpretation of responses, the SPIRQ is intended as a supplement to other measures that provide more objective indices of functioning. For example, clients who report only minor consequences of TBI on the Changes in Self and Life Plans scale may do so because they experience only mild functional deficits. It is therefore necessary to interpret clients’ responses on the SPIRQ in the context of their current functional status.
The client-centered, occupation-based, and goal-directed emphasis of occupational therapy means issues of self-awareness and motivation for rehabilitation are highly relevant (Doig, Fleming, Cornwell, & Kuipers, 2009). Therefore, use of the SPIRQ in the context of occupational therapy may be particularly appropriate. However, the SPIRQ may also have value as an instrument administered with a multidisciplinary rehabilitation team focus, and therefore the SPIRQ’s reliability and validity need to be specifically examined in this context in the future.
Implications for Occupational Therapy Practice
The results of this study have the following implications for occupational therapy practice:
In postacute rehabilitation, evaluation of self-perceptions of clients with TBI may assist occupational therapists in understanding their readiness to engage in therapy.
The SPIRQ is a brief scale designed to periodically monitor clients’ self-perceptions, motivation, and emotional reactions related to therapy.
Monitoring changes over time on the SPIRQ scales (Changes in Self and Life Plans, Self in Rehabilitation, and Emotional Reactions) could enhance the client-centeredness of occupational therapy practice.
Conclusion
In summary, the SPIRQ was designed as a brief tool to provide occupational therapists with the option to periodically monitor clients’ self-perceptions, motivation, and emotional reactions during TBI rehabilitation. By administering the SPIRQ at different time points throughout rehabilitation, occupational therapists may be better informed about a client’s readiness to engage in particular therapy components (e.g., goal setting, receiving feedback) and the need to address issues that could impede progress in rehabilitation, including a lack of understanding of the benefits of rehabilitation and the emergence of emotional distress. Further research is needed before clinical use that involves examining the SPIRQ’s construct validity and sensitivity to change as well as its potential application for use by a multidisciplinary rehabilitation team.
Footnotes
Acknowledgments
We gratefully acknowledge the occupational therapists and patients at both brain injury rehabilitation units.
