Abstract
People with a chronic psychiatric disorder (CPD) have low employment rates worldwide. This multicenter retrospective cohort study examined the employment outcomes of an innovative in-house vocational training program for people with CPD in Taiwan and explored which program parameters significantly predicted outcomes. Data were retrieved from the records of 323 participants who completed the training program. Satisfactory employment rates were found at 1 (52.9%), 3 (60.4%), and 6 (65.6%) mo posttraining, and 38.7% of participants demonstrated high employment sustainability (employed throughout the first 6 mo posttraining). Three program parameters significantly predicted employment outcomes: (1) occupational therapists’ pursuit of additional training or short-term apprenticeship pertinent to clients’ job interests, (2) posttraining vocational counseling provided by community-based occupational therapists, and (3) the duration of 6 mo posttraining to allow clients to prepare for competitive employment. Occupational therapist–led in-house vocational training is a promising alternative to traditional vocational training for people with CPD.
People with a chronic psychiatric disorder (CPD) often aspire to employment. Employment is an important path to social inclusion, and it is associated with self-efficacy, economic security, meaningful participation, health, and quality of life (Broyd et al., 2016; Lloyd et al., 2010). Yet, globally, people with CPD have the lowest employment rate of all people with disabilities (World Health Organization, 2010). Several factors influence the ability of people with CPD to obtain and sustain employment, including residual deficits (e.g., cognitive distortion, attention deficits, slow movement or rigidity, emotional disturbance, low esteem, social withdrawal) and environmental barriers (e.g., lack of extended services, societal attitude and stigmatization; Haslam et al., 2010; Tsang et al., 2010).
Vocational training, sheltered workshops, and supported employment are common service options for clients with CPD. Social enterprises are another promising employment model (Mandiberg, 2016; Stickley & Hall, 2017; Zaniboni et al., 2011). Of these options, supported employment has had the most favorable outcomes (Bond et al., 2008; Waghorn et al., 2014), but it is often difficult to implement internationally because of attitudinal, technical, and political barriers (Boardman & Rinaldi, 2013; Kinoshita et al., 2013). In Taiwan, no clear policy regulates funding or manpower for supported employment for this population; such services are in their infancy or lack trained specialists, administrative strategies, or community support (Jang et al., 2014; Lee et al., 2010). Vocational training thus remains a common service option for people with CPD in Taiwan, but it has not been effective, with clients experiencing prolonged job searches and short job tenure (Kinoshita et al., 2013). Mental health and vocational training services usually occur in separate organizations, with separate finances, workforces, and documentation, which leads to poor services coordination between hospital and community settings (Bond et al., 2008). This study tests an innovative vocational training model that might be a sound alternative to the traditional approach.
In-House Vocational Training Programs
The in-house vocational training (IHVT) programs are government-funded services for newly discharged inpatients or current outpatients with CPD of four regional psychiatric hospitals in Taiwan. The IHVT programs use existing hospital spaces, facilities, and manpower and community sources and networks to train participants in a range of job options. Each program has three to five occupational therapists who serve as program director, case manager, or training therapists. The hospitals’ psychiatrists, psychologists, social workers, and nurses and community vocational specialists and paid or volunteer job coaches are available during some program sessions.
The Person–Environment–Occupation–Performance (PEOP) model (Christiansen et al., 2014) guided IHVT program design. This design considers each patient’s work-related strengths and limitations and potential environmental supports and barriers. Job training options include bakery, coffee shop, culinary, computer data processing, auto wash and detailing, janitorial, and laundry service work. Placement is determined on the basis of the participant’s interests, demands of the local job market, and results of a case manager or team evaluation. IHVT programs are generally 6–10 mo long (with duration varying with job options), 5 days/wk, 4–6 hr/day. Before participating in an IHVT program, occupational therapists are encouraged to complete basic job-specific training or serve a short-term apprenticeship related to the job options, sometimes earning a board-issued entry-level job certification or license. This training ensures that occupational therapists are equipped with hands-on skills and experience to support specific job analysis and accommodations when working with job coaches and participants at a job site.
IHVT programs have three areas of focus: (1) work-related behavior training, (2) on-the-job skill training, and (c) life balance counseling. Work-related behavior training includes lectures and discussion, group activities and presentations, and take-home assignments related to proper appearance and attire; punctuality, attendance, and responsibility; communication and self-assertion; engagement, concentration, and work completion; workplace social skills and etiquette; problem solving and conflict resolution; and job search and interview skills.
On-the-job skill training consists of a half- or full-day unpaid internship in which participants gain job-specific training and hands-on experience and receive necessary supervision, guidance, and intervention from a job coach and an on-site occupational therapist. The training occurs in hospital facilities or affiliated businesses (bakeries, coffee shops, restaurants, cafeterias, offices, janitorial departments, laundry facilities, and car wash or detailing workshops), located either in or near the hospitals. Many are open to the public.
Life balance counseling involves individual and group counseling to enhance clients’ ability to tackle hardships and barriers to work. Stress management and relaxation techniques, coping strategies, work and leisure, time management, medication issues, self-advocacy, and community outreach and resources are common areas in which counseling is offered by occupational therapists (case managers) or cross-disciplinary personnel (e.g., psychiatrists, psychologists, social workers, nurses, or other). Posttraining vocational counseling provided by the IHVT case manager or other community therapists or specialists is also available. Of note, although all four hospitals had the essential IHVT areas, each had variations in program parameters (e.g., length, staffing, job training options, posttraining counseling services) as a result of differences in their infrastructure, manpower, and resources.
Purpose and Method
We determined IHVT program outcomes (employment rate) for participants 1, 3, and 6 mo after the intervention. We also determined whether participants remained employed during the first 6 mo posttraining. The unintentional variations in IHVT program parameters across the four hospitals enabled us to be among the first researchers to explore the effects of program parameters on employment outcomes. Previous studies have primarily examined the social, economic, and client factors (e.g., lack of service and support, stigmatization, inadequate job opportunity, diagnostic and functional characteristics) that affect employment outcomes for people with CPD.
Research Design
This multicenter retrospective cohort study used data retrieved from the files of the IHVT participants in four regional psychiatric hospitals in Taiwan. It included IHVT participants who (1) had a psychiatrist-determined CPD diagnosis according to Diagnostic and Statistical Manual of Mental Disorders (5th ed.; American Psychiatric Association, 2013) criteria, (2) were newly discharged inpatients or current outpatients of one of the hospitals, and (3) had completed the entire IHVT program and all the follow-up testing. No specific exclusion criteria were applied. Table 1 provides detailed definitions of the study variables.
Definitions of Dependent and Independent Variables
Note. IHVT = in-house vocational training.
Outcome Variables.
We determined employment rates as the percentages of participants who were employed at 1, 3, and 6 mo posttraining. We deemed participants to be employed if they had a full-time paid job (≥30 hr/wk) in sheltered, supported, or competitive or regular employment. Sheltered employment included jobs in community day care programs, in private nonprofit organizations for people with disabilities (e.g., assembly line, gift wrapping), or available through the hospitals’ facilities, as previously described. Supported employment refers to the government-funded service offered to people with disabilities in a competitive workplace. Both sheltered and supported employment have been common employment goals for people with CPD in Taiwan (Jang et al., 2014; Lee et al., 2010). Employment sustainability was graded into five levels: 1 = high sustainability (employed throughout the 1-, 3-, and 6-mo follow-up periods; 5 points), 2 = medium sustainability (employed across two consecutive time periods; 4 points), 3 = medium low sustainability (employed in two nonconsecutive time periods; 3 points), 4 = low sustainability (employed only in one time period; 2 points), and 5 = very low sustainability (not employed throughout the 1-, 3-, and 6-mo periods; 1 point).
Independent Variables.
Independent variables were (1) participant’s pretraining screening or evaluation, (2) whether the therapist had obtained a specific job certification or licensure, (3) case manager’s length of time in practice, (4) case manager’s experience in community settings, (5) cross-disciplinary support for life balance counseling, (6) amount of life balance counseling (hr/wk), (7) type of professionals used for posttraining vocational counseling (e.g., occupational therapists, vocational specialists), and (8) time since training (1, 3, or 6 mo).
Control Variables.
Control variables included participant demographics (i.e., gender, educational attainment, marital status, age), diagnostic characteristics (i.e., major diagnosis, age at onset, time since onset), and functional levels (i.e., hand function, attention span, and activities of daily living [ADLs]).
Instrumentation
Participants’ functional levels were measured with Chu’s (1991, 1997) Occupational Assessment Inventory, which consists of the Hand Dexterity Test, Attention Test, and ADL Test (2nd ed.). These tests were developed and validated for use with people with CPD. Chu’s Occupational Assessment Inventory has been routinely administered in many psychiatric occupational therapy settings in Taiwan. Norms for the three tests were established with Taiwanese national samples (Chu, 1997). Functional levels across the three tests were scored as follows: 5 = good, 4 = fair, 3 = mild impairment, 2 = moderate impairment, 1 = severe impairment, and 0 = very severe impairment. The tests’ reliability and validity have been demonstrated (Chu, 1997, 2001; Lu et al., 2009).
Data Analysis
We analyzed the data using IBM SPSS Statistics (Version 22; IBM Corp., Armonk, NY). We first summarized the data using descriptive statistics and frequency analyses. We used univariate analyses for categorical employment status, including the χ2 test and simple logistic regression, and univariate analyses for continuous employment sustainability, including one-way analysis of variance (ANOVA) and correlations (Pearson’s r) to preselect program parameter and client factors that could have an effect on participants’ employment outcomes. We then used a generalized estimating equation (GEE) to analyze 1-, 3-, and 6-mo longitudinal employment data with the selected program parameters offset by the client factors to test whether program parameters predicted participants’ employment rates and employment sustainability, respectively.
Results
Participant Characteristics
Three hundred forty-four participants originally enrolled in the IHVT programs, but 21 withdrew and were excluded from our analysis. The 323 participants who completed the IHVT programs also completed the 1-, 3-, and 6-mo interviews. The job training options chosen most often were bakery training (n = 110), followed by barista training (n = 55); those least selected were computer data processing (n = 8) and janitorial training (n = 20). Table 2 summarizes participant characteristics and relevant program parameters. Of the 323 participants, 114 (35.3%) were from Hospital A, 84 (26.0%) were from Hospital B, 67 (20.7%) were from Hospital C, and 58 (18.0%) were from Hospital D. The majority were male (n = 192; 59.4%), were single (n = 272; 84.5%), had a high school diploma (n = 167; 53.9%), and had schizophrenia (n = 278; 86.9%). Participants’ ages ranged from 18 to 59 yr (mean [M] = 34.2, standard deviation [SD] = 7.5). Age at onset ranged from 8 to 44 yr (M = 23.3, SD = 6.5). Time since onset ranged from 1 to 36 yr (M = 10.7, SD = 6.8). Most participants scored their hand function as 2 (moderate impairment; n = 73; 39.0%), attention as 3 (mild impairment; n = 109; 45.2%), and ADLs as 5 (good; n = 119; 44.1%).
Summary of Participant Characteristics and Program Parameters (N = 323)
Note. Ns are based on the number of available data entries for participants. ADLs = activities of daily living; IHVT = in-house vocational training.
Variable categories with a low quantity were collapsed for the purpose of subsequent statistical analyses.
Program Parameters
Cross-disciplinary teams conducted most of the pretraining screenings and evaluations (54.2%). Most of occupational therapists did not attend additional job-specific training or earn a certification or license (73.4%). Most IHVT case managers had clinical experience in a community setting (72.8%). Occupational therapists provided most of the individual or group life balance counseling (69.3%). IHVT case managers provided most of the posttraining vocational counseling services (40.2%). The length of IHVT case managers’ clinical experience ranged from 24 to 264 mo (M = 117.2, SD = 67.0) and the average amount of individual or group life balance counseling received ranged from 1 to 13 hr per week (M = 5.5, SD = 3.2).
Employment Outcomes
Employment Rates.
Table 3 shows participants’ employment rates at 1, 3, and 6 mo posttraining. Regardless of type of employment, overall employment rates were 52.9%, 60.3%, and 65.6%, respectively, gradually increasing across the three time points. Although more participants had obtained sheltered employment at the 1- and 3-mo follow-ups, the rate for competitive employment was the highest (24.1%) among the three employment types by the 6-mo follow-up.
Employment Rates at 1-, 3-, and 6-Mo Posttraining Follow-Up (N = 323)
Employment Sustainability.
Most participants demonstrated high employment sustainability (n = 125; 38.7%), followed by very low sustainability (n = 69; 21.4%), medium sustainability (n = 63; 19.5%), low sustainability (n = 55; 17.0%), and medium low sustainability (n = 11; 3.4%).
Program Parameters Predictive of Employment Rates
The preliminary analyses using χ2 and simple logistic regression indicated that all eight program parameters (Table 4) and 3 of 10 client factors (i.e., gender, age at onset, attention span) reached statistical significance (p < .05) in differentiating employment rates for at least one of the three time periods (1, 3, or 6 mo posttraining). Because of space constraints, not all of the preliminary results are described in this article. Eighty-two participants had missing attention span data and were excluded from the GEE analysis. With the eight preselected independent variables offset by the three control variables, the GEE model (n = 241) showed that three factors significantly predicted posttraining employment rates (see Table 4).
Factors Predictive of Employment Rates and Sustainability of Employment
Note.
For employment rate, degree of freedom (df) = 240; for sustainability of employment, df = 322.
Eighty-two participants were missing data for attention span and were excluded from the generalized estimating equation for employment rates.
First, participants whose occupational therapists had certification or licensure related to their assigned job training (e.g., Class C license for baking) were 24% more likely to be employed than their counterparts whose occupational therapists did not have such certification or licensure. Second, participants who received posttraining vocational counseling from occupational therapists in a community mental health setting were 49% more likely to be employed than those who received vocational counseling from a job coach in the workplace. However, compared with posttraining vocational counseling provided by a job coach, that provided by an IHVT case manager or vocational service specialist yielded no difference in participants’ employment rates. Last, participants’ overall employment rate at 6 mo posttraining was 10% higher than at 1 mo posttraining. No difference was found in employment rates at 1 and 3 mo posttraining.
Program Parameters Predictive of Employment Sustainability
Five independent variables (see Table 4) and one control variable (age at onset) were preselected for the GEE analysis (n = 323). Posttraining vocational counseling provided by a community-based occupational therapist was the only significant predictor of employment sustainability. Participants who received posttraining vocational counseling from an occupational therapist in a community mental health setting were 45% (β: 1.78/4 = 0.45) more likely to demonstrate higher employment sustainability than those who had received vocational counseling from a job coach in the workplace. Again, we found no difference in employment sustainability for participants who received posttraining vocational counseling provided by an IHVT case manager or a vocational service specialist and those who received counseling provided by a job coach.
Discussion
Our findings indicate that the IHVT programs had positive employment outcomes for people with CPD. Satisfactory employment rates were found at 1, 3, and 6 mo posttraining. These rates were higher than the 21.5% employment rate found for European participants with schizophrenia who received vocational services (Marwaha et al., 2007). They were also higher than the employment rate of 50.7% found for Taiwanese people with CPD who had government-sponsored Disability Employment Services (Jang et al., 2014). Although more participants held sheltered or supported employment shortly after the training program, most were competitively employed at 6 mo posttraining. Given the low accessibility of competitive or supported employment for people with CPD in Taiwan (Jang et al., 2014; Lee et al., 2010), the employment rates found in this study are impressive.
Our analysis confirmed that the 6-mo time parameter was a significant predictor of employment. We assume that the 6-mo interim is a reasonable posttraining period for participants to secure competitive employment. However, this assumption needs further validation because of the paucity of current empirical findings in this area. Moreover, among participants in our study who were employed at least one point in time posttraining, nearly half demonstrated high sustainability of employment. This finding coincides with the finding of a previous review of six randomized controlled trials (RCTs) of an average job tenure of 22 wk for clients with CPD who received Individual Placement and Support (IPS) services (Bond et al., 2008). Similarly, a more recent RCT on employment outcomes after IPS services for people with CPD reported an average job tenure of 25.3 wk (Waghorn et al., 2014).
Although the IHVT programs were found to yield satisfactory outcomes, we were intrigued by the potential effects of the varying program parameters on employment. Parameter estimates suggested that, with client factors controlled, the therapist having specific job certification or licensure, posttraining vocational counseling service being provided by a community-based occupational therapist, and a 6-mo posttraining period (discussed earlier) had significantly positive effects on participants’ employment rates. However, posttraining vocational counseling services provided by a community-based occupational therapist significantly strengthened employment sustainability.
Although the number of participating occupational therapists who had earned an entry-level job certificate or license after pertinent training was low, those therapists’ clients had a higher employment rate than their counterparts’ clients. Occupational therapists serving in an intensive, multicomponent vocational training program for people with CPD may often feel challenged in situations in which they have to address clients’ functional limitations along with the demands of jobs that are unfamiliar to them (Arbesman & Logsdon, 2011). Therapists should obtain specific hands-on job skills training and experiences relevant to clients’ chosen job options so that they can understand the necessary job analysis and recommendations and be better able to communicate and collaborate with job coaches. Moreover, ongoing vocational counseling service posttraining is instrumental in enhancing clients’ employment outcomes (Waghorn et al., 2015).
Our findings on both employment rates and employment sustainability favored vocational counseling implemented by occupational therapists in a community mental health setting as opposed to certified vocational service specialists or job coaches. Employment specialists and job coaches often require substantial guidance in how to accurately identify their clients’ functional deficits and how to determine what accommodations are appropriate (MacDonald-Wilson et al., 2003). In contrast, occupational therapists have expertise in discerning clients’ functional limitations and in designing individualized strategies based on job demands while emphasizing the necessary skills for life balance (Auerbach & Jeong, 2005).
The provision of well-rounded counseling services by occupational therapists provides the scaffolding for enhanced client job performance. It is interesting that although vocational counseling provided by occupational therapists working in community mental health settings surpassed that provided by job coaches, this result did not hold true in the case of the occupational therapists who served as IHVT case managers in the hospitals. Despite the similarities in their skill sets, community-based occupational therapists are more likely than hospital-based occupational therapists to have strong connections to potential employers, resources, and social networks in the community and to have more frequent updates on the opportunities in and demands of the local job market. These factors may explain the corresponding difference in results.
Limitations and Future Research
This retrospective cohort study has limitations that merit consideration. First, the lack of control and randomization limits the interpretation of IHVT program efficacy. Second, analyses were limited to data available in the participants’ files. Other employment factors and outcomes, such as family support, income, government benefits, employment history, and job title and wages, were not fully assessed. For example, studies conducted in the United States and other Western countries have found that governmental income support programs are a disincentive to work for many people with CPD (Danziger et al., 2009; Frutos & Castello, 2015). Whether this phenomenon exists in the client population in Taiwan is unknown. Similarly, we did not investigate whether family support was an incentive or a disincentive to participants’ employment in the collectivist and family-oriented culture of Taiwan. Moreover, we had no information about the relationship between participants’ job training options and acquired employment or employment status beyond 6 mo. Last, some service and job parameters explored in this study may be culturally and contextually specific to Taiwan. Caution is warranted in generalizing the findings.
Future studies should use a prospective longitudinal design that uses systematic measures of the employment and outcome variables not documented and analyzed in this study. Likewise, experimental research with randomization and control procedures should be prioritized to further test the effects of program parameters on employment outcomes as well as the role of occupational therapy in vocational service for people with CPD.
Implications for Occupational Therapy Practice
The implications of this study for occupational therapy practice are as follows:
A holistic and client-centered employment service program for people with CPD should include work-related behaviors, on-the-job skills, and life balance issues along with ongoing vocational counseling and support.
Practitioners should consider the following important parameters when developing a vocational training program for people with CPD: (1) When applicable, occupational therapists should pursue additional training or short-term apprenticeship pertinent to clients’ job interests, (2) posttraining vocational counseling should be provided continuously by resourceful community-based occupational therapists, and (3) sufficient time posttraining (≥6 mo) should be included to allow the clients to prepare for and obtain competitive employment.
Conclusion
Supporting employment of people with CPD is a complex but rewarding endeavor, and it requires an all-encompassing approach to those factors that are remediable. Through their specialized knowledge and training, occupational therapists play an important role in helping people with CPD develop the skills and obtain the supports necessary for employment. Our study introduces the systematic PEOP-based IHVT programs and services that are led by occupational therapists. The demonstrated training and program parameters, albeit embedded in vocational training, reflect the typical and critical components of employment services for clients with CPD (Arbesman & Logsdon, 2011; Williams et al., 2015). Therefore, these parameters can be applied to or modified in other employment service models such as supported employment. The positive employment outcomes found in our participants support the efficacy of the IHVT programs.
Footnotes
Acknowledgments
We thank I-Chia Chien, Happy Kuy-Lok Tan, Hong Chen, Hua Feng, and I-Chun Huang for their initial guidance and support for this project. We also express our gratitude and appreciation to Shu-Jen Lu, Tzyh-Chyang Chang, and Ting Kao for assisting in data collection. This project was sponsored by the Ministry of Health and Welfare of Taiwan (Project ID 2123152) and was registered with
(NCT03152032).
