Face-to-face versus Video Teleconference Group Cognitive Behavioural Therapy for Anxiety and Related Disorders: A Preliminary Comparison

Abstract

French

Objective:

Telehealth is being increasingly incorporated into the delivery of mental health care and has received widespread attention during the COVID-19 pandemic for its ability to facilitate care during physical distancing restrictions. Videoconferencing is a common telehealth modality for delivering psychotherapy and has demonstrated similar outcomes to those of face-to-face therapy. Cognitive behavioural therapy (CBT) is the most common psychotherapy evaluated across various telehealth modalities; however, studies on CBT delivered via videoconference, particularly in a group therapy format, are lacking. Further, little research exists on videoconference group CBT for anxiety disorders. Accordingly, the present study compared the outcomes of group CBT for anxiety and related disorders delivered via videoconference versus face-to-face.

Method:

Using a non-randomized design, data on attendance, dropout, clinical outcomes, and functional impairment were collected from 413 adult outpatients of a tertiary care anxiety disorders clinic who attended a CBT group for panic disorder/agoraphobia, social anxiety disorder, generalized anxiety disorder (GAD), or obsessive-compulsive disorder delivered either face-to-face (pre-COVID-19 pandemic) or via videoconference (since the onset of COVID-19 pandemic). Outcomes were assessed using well-validated self-report measures. Data were collected pre-treatment, across 12 weekly sessions, and post-treatment. Intent-to-treat analyses were applied to symptom outcome measures.

Results:

Face-to-face CBT conferred only a slight benefit over videoconference CBT for symptom outcomes across all groups, but when assessed individually, only the GAD group showed greater symptom improvement in the face-to-face format. Effect sizes for significant differences between the delivery formats were small. Participants in videoconference groups tended to have slightly higher attendance rates in some instances, whereas functional improvement and treatment dropout were comparable across the delivery formats.

Conclusions:

Results provide preliminary evidence that videoconference group CBT for anxiety and related disorders may be a promising and effective alternative to face-to-face CBT. Additional research is needed to establish equivalence between these delivery formats.

Keywords

telemedicine videoconferencing cognitive behavioural therapy group psychotherapy anxiety disorders social phobia panic disorder agoraphobia generalized anxiety disorder obsessive-compulsive disorder

Introduction

As technology has become widely accessible to health-care consumers, with 99.3% of Canadian households subscribing to either mobile or Internet services,¹ telehealth is being increasingly incorporated into the delivery of health care.^2,3 The principal advantage of telehealth is its ability to reduce access-to-care barriers such as limited health services in remote communities,^3,4 travel costs,^5,6 patients’ functional limitations,^7,8 and stigma associated with certain types of care.^9,10 Since the outbreak of the COVID-19 pandemic, telehealth has additionally received widespread attention for its ability to facilitate an alternative avenue to care while reducing the risk of disease transmission.^11
–13 Indeed, recent reports highlight the explosive expansion of telehealth services during COVID-19,^14

–17 which has transformed health-care delivery across numerous systems.¹⁷

Telehealth has been particularly actively adopted in the mental health field,^18

–21 where it is termed telemental health. A common modality in telemental health is videoconferencing, which facilitates real-time communication between users at different locations using both audio and video input. Telemental health has demonstrated feasibility and acceptability when used for diagnostic assessment and treatment services across diverse clinical presentations, populations, and age groups.^18,19,22 Furthermore, outcomes of various videoconference interventions (e.g., psychotropic medication, psychotherapy, combination treatment) have generally demonstrated symptom improvement comparable to face-to-face interventions for common clinical presentations (e.g., depression, anxiety, posttraumatic stress disorder [PTSD]).^{23

–31} Similarly, treatment adherence,²⁵ attendance,³⁰ dropout,³⁰ and satisfaction^24
–26,30 have been shown to be comparable between videoconference and face-to-face interventions.

Evaluations of videoconference psychotherapy in particular have largely focused on cognitive behavioural therapy (CBT),³² an evidence-based treatment for a wide range of disorders.³³ Consistent with the broader literature on videoconference interventions, studies of videoconference CBT support its feasibility,³⁴ and preliminary findings suggest similar clinical outcomes to those of face-to-face CBT for concerns such as anxiety and depressive disorders,^26,28,29 PTSD,^31,35 and bulimia nervosa.³⁶ Similarities in clinical outcomes have further been reported in systematic reviews.^37
–39

Although promising effects have thus far been reported, when compared to the volume of research on other telemental health modalities, considerably less literature has focused on videoconference CBT.^37,40,41 Furthermore, most work in this area has investigated individual rather than group CBT.³² While evaluations of videoconference group CBT are scant, a recent systematic review demonstrated that generally, group-based psychotherapies are feasible and efficacious in a videoconference format.⁴² The few studies that have more specifically evaluated videoconference group CBT have primarily focused on PTSD, with results demonstrating outcomes similar to face-to-face CBT groups.^30,43
–45

Surprisingly, there is little research on videoconference CBT groups for anxiety disorders, the most prevalent psychiatric disorders⁴⁶ with a high burden of illness.⁴⁷ CBT is the psychological treatment of choice for anxiety disorders,^48,49 and, in a face-to-face context, CBT groups for anxiety disorders are as efficacious as individual CBT.⁵⁰ To our knowledge, no studies have evaluated anxiety outcomes in videoconference group CBT for anxiety disorders, highlighting the need for further research to establish the effectiveness of this treatment modality for these common disorders.

Group therapy offered via videoconference has the potential to be resource efficient (e.g., more patients can be seen concurrently without the need for more physical space) while conferring additional benefits of telehealth. These potential benefits must be considered alongside any unique resource requirements for videoconferencing, such as technological equipment and the number of clinicians required to facilitate a videoconference group. The development of accessible mental health interventions is highly relevant during the COVID-19 pandemic, which has seen a marked rise in reported mental distress in both general^51
–53 and psychiatric⁵⁴ populations alongside access-to-care barriers associated with physical distancing. It is also important within the broader mental health care milieu, where numerous barriers to accessing mental health care have been identified.⁵⁵

The purpose of the current study was to conduct a preliminary analysis of outcomes from group CBT for anxiety and related disorders delivered via videoconference versus face-to-face. These treatments were compared within a tertiary care specialist anxiety disorders clinic, which, like many health services during COVID-19, rapidly pivoted from in-clinic face-to-face care to remote care via videoconference. Using a non-randomized design, data on clinical outcomes, attendance, dropout, and functional impairment were collected from groups delivered via videoconference in spring/summer 2020 and compared to respective data from face-to-face groups collected prior to the pandemic. Our goal was to contribute our findings to the telehealth literature during a time when various stakeholders are seeking novel ways to reduce barriers to mental health care. Based on the reviewed literature, we hypothesized that we would observe similar outcomes between group CBT delivered via these two modalities with respect to symptom change, treatment attendance, dropout, and functioning.

Methods

Participants

Participants were outpatients of a tertiary care anxiety disorders clinic in a public hospital in Hamilton, Ontario, who consented to the inclusion of their demographic and clinical information in a research database. Inclusion criteria for research participation paralleled the eligibility criteria for treatment, including age 18 or older, a current Diagnostic and Statistical Manual of Mental Disorders, fifth edition (DSM-5) anxiety or related disorder diagnosis for which group treatment was available, and English language proficiency. Exclusion criteria included other more pressing clinical issues (e.g., another disorder causing more distress/impairment, active suicidality, significant substance use). We elected to include individuals (n = 6) who completed two different courses of CBT (i.e., completed a group for one disorder followed by a group, later, for a different disorder) within the study period, resulting in a sample of 419 observations from 413 unique individuals.

Participants’ mean age was 34.94 years (SD = 12.27). The majority identified as female (68.4%), white (87.4%), in a relationship (62.9%), and had completed college or university (56.8%). All participants had a primary diagnosis of a DSM-5 anxiety or related disorder (panic disorder and/or agoraphobia [PDA], social anxiety disorder [SAD], generalized anxiety disorder [GAD], or obsessive-compulsive disorder [OCD]), as determined by a semi-structured psychodiagnostic interview⁵⁶ (73.0%) or psychiatric consultation (27.0%). Forty-nine percent of participants had at least two diagnoses, most commonly another anxiety or mood disorder. For additional sample characteristics, see Table 1.

Table 1.

Baseline Sample Characteristics.

Variable	Face-to-face	Videoconference	P ^a
Age, M (SD)	35.02 (12.25)	34.69 (12.37)	.815
Sex, % female	67.5	71.1	.499
Relationship status, % in relationship	59.9	72.2	.030
Education, % completed college/university	53.9	66.0	.040
Ethnicity, % white	89.2	81.8	.550
Employment, % employed part- or full-time	52.9	43.4	.104
DASS-21, M (SD)
Depression	18.95 (11.71)	17.13 (9.88)	.132
Anxiety	16.00 (9.68)	15.82 (10.41)	.871
Stress	21.70 (9.61)	22.09 (9.61)	.721
WHODAS
Total	83.36 (27.78)	80.46 (22.73)	.309
Comorbidities
Major depressive disorder^b	20.1%	8.6%	.005
Social anxiety disorder	15.8%	12.1%	.330
Generalized anxiety disorder	13.2%	6.9%	.070
Persistent depressive disorder	8.6%	8.6%	.990
Panic disorder	6.3%	4.3%	.440
Obsessive-compulsive disorder	3.3%	3.4%	.940
Posttraumatic stress disorder	4.0%	0.0%	.030
Cannabis use disorder	3.3%	1.7%	.387
Alcohol use disorder	2.0%	.9%	.424

Note. DASS-21 = Depression, Anxiety and Stress Scales-21; WHODAS = World Health Organization Disability Assessment Schedule 2.0.

^a P values are independent samples t test for continuous variables and 2 × 2 Pearson chi-square for categorical variables; group by time interaction for 2 × 2 analysis of variance for pre/post-treatment Illness Intrusiveness Rating Scale outcomes are presented in the Results section.

^b Given the significance of this result, we also assessed this variable between diagnostic subgroups. The only group to show a significant difference was social anxiety disorder, in which the videoconference group had significantly lower rates of major depressive disorder (8.7%) compared to the face-to-face group (31.6%; p < .05).

Treatment

Both face-to-face and videoconference CBT were facilitated using 12-session disorder-specific manualized CBT group protocols for SAD, PDA, GAD, and OCD. The treatment manuals were developed at our clinic based on existing widely used CBT protocols.^{57

–66} The same manuals were used for both treatment modalities, but additional supplementary materials were developed for the videoconference groups detailing in-session exposures suitable for videoconferencing. To prepare for the delivery of the videoconference groups, we consulted other teams with experience in videoconference treatment, reviewed the literature on virtual treatments, and held numerous meetings to plan risk management, engagement, and in-session exposures. For both delivery formats, 2-hour weekly group sessions were facilitated by two therapists, including at least one experienced clinician (e.g., psychologist, social worker) and another clinician or a clinical learner. The same therapists facilitated treatment through both modalities. The mean number of participants per group was 9.79 (SD = 2.31).

Face-to-face groups were facilitated in conference rooms at the clinic, with participants seated around a large table. A whiteboard was used to deliver some of the treatment content. Videoconference groups were facilitated through a secure cloud-based platform, Zoom Video Communications Inc.,⁶⁷ which participants accessed through their electronic medical record. Participants used a range of electronic devices to attend sessions, most commonly a laptop (55.4%) and a smart phone (15.4%), although only 56% of participants reported on this variable. Participants attended the videoconference sessions from their home or other private environment. They received extensive operational instructions for the videoconference platform and guidelines to ensure appropriate decorum and participation using this platform. Group norms were established to approximate face-to-face treatment (e.g., video on with face showing; “gallery view” to simultaneously see the therapists and other participants). Videoconference sessions were provided in real time. A screen share function was used to display a virtual whiteboard on which some of the treatment material was presented; content from the treatment manuals was additionally screen-shared.

Measures

Psychodiagnosis

Current diagnoses were determined with either a psychiatric interview or the Diagnostic Assessment Research Tool (DART),⁵⁶ a semi-structured diagnostic interview for assessing DSM-5 mental disorders. Preliminary findings demonstrate excellent construct validity of DART modules as well as good convergent and discriminant validity.⁶⁸

Baseline distress and functioning

Distress at pre-treatment was assessed with the Depression, Anxiety and Stress Scales-21 (DASS-21),⁶⁹ a psychometrically sound⁷⁰ self-report measure comprised of three 7-item scales assessing symptoms of depression, anxious arousal, and stress (tension/negative affect). Global functioning was assessed pre-treatment with the World Health Organization Disability Assessment Schedule-2.0,⁷¹ a 36-item measure of self-reported disability secondary to psychiatric and medical illness.

Attendance and dropout

Group therapists recorded weekly treatment attendance on an attendance record. Dropout was conceptualized as attending <8 sessions and not attending the final three sessions.

Symptom change

Symptom change was assessed with disorder-specific, self-report measures, including the following: in the SAD groups, the Social Phobia Inventory (SPIN),⁷² a 17-item measure of social anxiety symptoms; in the PDA groups, the Panic Disorder Severity Scale–Self-Report (PDSS-SR),^73,74 a 7-item measure of the frequency of panic attacks and associated distress, avoidance, and functional impairment; in the GAD groups, the Penn State Worry Questionnaire (PSWQ),⁷⁵ a 16-item measure of trait-like worry severity, and the Penn State Worry Questionnaire–Past Week (PSWQ-PW),⁷⁶ a 15-item measure adapted for weekly assessment of worry; and in the OCD groups, the Obsessive Compulsive Inventory–Revised (OCI-R),⁷⁷ an 18-item measure of the severity of OCD symptoms. These widely used measures have demonstrated sound psychometric properties in clinical samples (SPIN,^72,78 PDSS-SR,^74,79 PSWQ,^80,81 and OCI-R⁸²). The SPIN, PDSS-SR, and OCI-R were administered pre- and post-treatment and weekly for 12 sessions. The PSWQ was administered pre- and post-treatment, and the PSWQ-PW was administered weekly.

Change in functioning

Functional changes from pre- to post-treatment were assessed with the Illness Intrusiveness Rating Scale (IIRS),⁸³ a 13-item self-report measure of functional impairment secondary to illness assessed across Instrumental, Intimacy, and Relationships and Personal Development subscales. The IIRS has demonstrated sound psychometric properties in psychiatric populations.⁸⁴

Procedures

All procedures were approved by the Hamilton Integrated Research Ethics Board. Psychometric assessment was completed upon entry to the program. Participants were referred to group CBT if their principal concern matched the disorder treated in one of the available groups. Those who attended group CBT between May 2018 and December 2019 received the treatment face-to-face, and those who attended between May 2020 and September 2020 received the treatment via videoconference.

Self-report measures were administered electronically via a browser-based data collection software (Research Electronic Data Capture).⁸⁵ Participants received emailed links with a specified period to complete the measures. Group therapists completed the attendance record on a weekly basis.

Statistical Analysis

Hierarchical linear modelling (HLM)⁸⁶ was used to assess the effect of group (face-to-face vs. videoconference) on the trajectory of change in symptom severity over time. Primary outcomes were assessed with time (coded weekly) at Level 1 and group at Level 2. Single-level HLMs were also performed on each of the face-to-face and videoconference groups, individually, to assess the difference in effect size between treatment formats. An intent-to-treat approach was taken for symptom outcome measures to maximize sample size and external validity of results. Data were collected weekly from pre-treatment, through 12 weeks of treatment, to post-treatment (14 data points). Finally, a series of independent samples t tests and Pearson chi-squares were performed to assess attendance variables and pre-/post-change in IIRS scores. Given the sample-intensive nature of HLM analyses, we prioritized maximizing the total number of observations rather than ensuring equal group size between face-to-face and videoconference samples.

Z-scores were calculated for comparisons across groups. Given differences in methodology between validation studies for each of the respective questionnaires, z-scores were used for the full-sample analysis, whereas raw scores were used for individual group analyses. Where possible, sample means for non-anxious controls were used. All sample means were gathered from each questionnaire’s respective validation study. These were 48.80 (SD = 13.80) for the PSWQ,⁷⁵ 18.82 (SD = 11.10) for the OCI-R,⁷⁷ and 6.10 (SD = 6.00) for the PDSS-SR.⁸⁷ No control sample was available, to our knowledge, for the PSWQ-PW. We elected to use a mid-treatment reference score of 45.43 (SD = 16.48).⁷⁶ The SPIN score for non-anxious controls is 12.10 (SD = 9.30).⁷² Given this score is low relative to sample means for SAD, this value results in overly inflated z-scores relative to the other samples in the present study. Furthermore, some researchers also support a higher cut-off value of 30 on the SPIN.^88,89 Therefore, the sample mean of 22.70 (SD = 10.00) for the “mildly impaired” subsample was used.⁷²

Results

There were no baseline differences, as assessed by independent samples t tests, between the face-to-face and videoconference groups on any outcome variable (see Table 1).

Attendance and Dropout

Significantly more sessions were attended by participants in the videoconference versus face-to-face GAD groups, t(146) = −2.02, p = .045, d = .17. The difference in attendance between the two delivery formats approached significance for the full sample, t(371) = −1.94, p = .053, d = .10. Figure 1 shows the mean session attendance for all groups. Treatment dropout did not differ significantly between groups, with observed dropout rates of 24.5% for face-to-face and 15.3% for videoconference, χ² (1, N = 371) = 3.18, P = 0.08, φ = .09.

Figure 1.

Session attendance between face-to-face and videoconference group delivery (total 12 sessions). GAD = generalized anxiety disorder; OCD = obsessive-compulsive disorder; PDA = panic disorder and/or agoraphobia; SAD = social anxiety disorder. *P < 0.05.

Symptom Change over Time

There was a significant effect of group in the full-sample analysis, b = .05, SE = .01, t = 4.74, P < 0.001, d = .23, and in the GAD subsample, b = .69, SE = .01, t = 2.70, P = 0.008, d = .20. These results indicate a small but significant positive effect of face-to-face treatment on reduction in symptom severity over time, relative to videoconference treatment (see Table 2 and Figure 2). This effect was not significant for SAD (P = 0.11), PDA (P = 0.17), and OCD (P = 0.69) groups.

Table 2.

Hierarchical Linear Modelling Assessing the Change in Primary Outcome Variables over Time from Pre- to Post-treatment.

Effect	b	SE	t	df	P	d
Full-sample z-score
Initial z-score (intercept)	1.55	0.07	21.26	417	<0.001
Group	−0.40	0.13	−3.21	417	0.003	−0.16
Z-score over time (slope)	−0.11	0.01	−18.08	417	<0.001	−0.89
Group	0.05	0.01	4.74	417	<0.001	0.23
GAD PSWQ-PW score^a
Initial PSWQ-PW (intercept)	65.76	1.31	50.36	178	<0.001
Group	−2.59	2.26	−1.15	178	0.252	−0.09
PSWQ-PW over time (slope)	−1.64	0.15	−10.93	178	<0.001	−0.82
Group	0.69	0.26	2.66	178	0.008	0.20
OCD OCI-R score
Initial OCI-R (intercept)	26.66	1.82	14.60	73	<0.001
Group	−0.05	2.86	−0.02	73	0.987	0.00
OCI-R over time (slope)	−0.82	0.13	−6.13	73	<0.001	−0.71
Group	−0.09	0.23	−0.40	73	0.690	−0.05
PDA PDSS-SR score
Initial PDSS-SR (intercept)	13.72	0.95	14.93	60	<0.001
Group	−0.97	1.71	−0.57	60	0.572	−0.07
PDSS-SR over time (slope)	−0.42	0.07	−6.14	60	<0.001	−0.78
Group	0.16	0.11	1.40	60	0.168	0.18
SAD SPIN score
Initial SPIN (intercept)	47.85	1.16	41.12	100	<0.001
Group	−5.50	2.25	−2.45	100	0.016	−0.24
SPIN over time (slope)	−1.49	0.12	−12.80	100	<0.001	−1.27
Group	0.29	0.18	1.59	100	0.114	0.16

Note. Group is coded as 0 = face-to-face, 1 = videoconference. GAD = generalized anxiety disorder; OCD = obsessive-compulsive disorder; OCI-R = Obsessive Compulsive Inventory–Revised; PDSS-SR = Panic Disorder Severity Scale–Self-Report; PSWQ-PW = Penn State Worry Questionnaire–Past Week; PDA = panic disorder and/or agoraphobia; SAD = social anxiety disorder; SPIN = Social Phobia Inventory.

^aPSWQ-PW was only collected in-session, not at pre- and post-treatment; only 12 time points were used in the analysis rather than 14. The PSWQ and PSWQ-PW were converted to z-scores for the full-sample analysis in order to use all 14 time points.

Figure 2.

Results of 2-level hierarchical linear modelling models with group (0 = face-to-face, 1 = videoconference) predicting trajectory of change in symptom severity over the course of treatment. (A) GAD PSWQ-PW scores over time. (B) OCD OCI-R scores over time. (C) PDA PDSS-SR scores over time. (D) SAD SPIN scores over time. (E) All groups z-scores over time. GAD = generalized anxiety disorder; OCD = obsessive-compulsive disorder; OCI-R = Obsessive Compulsive Inventory–Revised; PDA = panic disorder and/or agoraphobia; PDSS-SR = Panic Disorder Severity Scale–Self-Report; PSWQ-PW = Penn State Worry Questionnaire–Past Week; SAD = social anxiety disorder; SPIN = Social Phobia Inventory.

Of note, there was an effect of group on the intercept for the full sample. To assess whether baseline z-score had any effect, we performed a model including group, baseline z-score, and the group × z-score interaction at Level 2. Both group, b = .03, SE = .01, t = 3.48, P < 0.001, d = .19, and baseline z-score, b= −.04, SE = .01, t = -6.97, P < 0.001, d = −.37, were independently significant predictors of change in symptom severity over time, but the interaction was not, b = .01, SE = .01, t = .53, P = 0.60, d = .03. These results indicate that participants who received face-to-face treatment achieved greater symptom severity reductions regardless of baseline severity.

Effect sizes (Cohen’s d) for treatment were mostly comparable between face-to-face and videoconference delivery, with videoconferencing tending to have slightly lower effects than face-to-face. This was true for the full sample (videoconference = −.90, face-to-face = −1.04), GAD (videoconference = −.61, face-to-face = −.97), PDA (videoconference = −.67, face-to-face = −.95), and SAD (videoconference = −1.43, face-to-face = −1.44) but not OCD (videoconference = −1.11, face-to-face = −.82).

Given heterogeneous comorbidities throughout the sample, and the higher incidence of depression in the face-to-face vs. videoconference groups, we performed supplementary analyses observing the effect of group at Level 2 while controlling for comorbidities and DASS-21 depression scores at baseline at Level 1. Although DASS-21 depression was an independently significant predictor of the primary symptom outcome measure in each group and in the full sample (with greater depression scores indicating worse symptom severity, Ps < 0.001), this was not the case for overall comorbidities (Ps = 0.057 to 0.83). Most importantly, neither depression nor comorbidities significantly impacted the effects of group at Level 2. This finding was supported by nearly identical significance and deviance statistics between the models with and without comorbidity variables.

Change in Functioning

All IIRS scores (see Table 3) showed significant main effects of time (Ps < 0.001), indicating improved functional impairment over the course of treatment. Neither the main effects of group nor the group by time interactions were significant (Ps > 0.05) for the IIRS total or subscale scores.

Table 3.

2 × 2 Group × Time ANOVA for IIRS Total and Subscale Scores.

IIRS Subscales	Time Point	Face-to-face (n = 129) M (SD)	Videoconference (n = 50) M (SD)	Time P	Group P	Interaction P
RPD	Pre	3.84 (1.29)	3.83 (1.16)	<0.001	0.800	0.532
RPD	Post	3.33 (1.38)	3.43 (1.14)
Intimacy	Pre	4.05 (1.99)	4.29 (1.82)	0.008	0.535	0.655
Intimacy	Post	3.73 (1.97)	3.76 (1.92)
Instrumental	Pre	4.59 (1.44)	4.48 (1.42)	<0.001	0.867	0.458
Instrumental	Post	3.88 (1.55)	3.92 (1.36)
Total	Pre	54.39 (15.54)	53.84 (14.17)	<0.001	0.884	0.631
Total	Post	46.82 (17.35)	47.72 (14.87)

Note. IIRS = Illness Intrusiveness Rating Scale; RPD = Relationships and Personal Development; ANOVA = analysis of variance.

Discussion

This study compared outcomes in face-to-face and videoconference group CBT for anxiety and related disorders. When evaluating symptom outcomes across all groups, there were only slight differences between the treatment formats, conferring a small benefit for face-to-face delivery, although this was not the case for all groups. When assessed individually, only the GAD group showed greater symptom improvement in the face-to-face format. Furthermore, effect sizes for significant differences between formats were small (d = .20 to .23). It is possible, however, that subsample analyses were not adequately powered to detect differences between groups via HLM. Participants in videoconference groups tended to have slightly higher attendance rates in some instances, whereas the two treatment modalities evidenced comparable improvement in illness intrusiveness. Given the relatively small sample size of the videoconference groups, these results are preliminary; however, they point towards potentially promising similarities in outcomes between virtual and in-person treatment delivery.

Despite the distress and uncertainty associated with COVID-19,^51

–54,90 our findings demonstrate that group CBT for anxiety can be successfully delivered via videoconference even during a pandemic. Indeed, participants who received videoconference group therapy did so during a time when we might anticipate poorer anxiety treatment outcomes, irrespective of the mode of delivery. Further, the small effect sizes we observed between delivery formats on symptom measures are similar to those reported elsewhere,^26,91 and the medium-to-large effect sizes we observed in symptom changes over time are generally consistent with those reported in meta-analyses of CBT.^92
–94

The finding of greater GAD symptom improvement in face-to-face versus videoconference delivery warrants attention. GAD is characterized by intolerance of uncertainty, causing excessive worry about new situations.^95
–97 With telehealth care being unfamiliar to many individuals, videoconferencing might have provoked greater treatment-related anxiety among the GAD sample, hampering their outcomes. Additionally, symptom improvement might have been more difficult to achieve in this population via videoconference treatment during a global catastrophic event compared to that observed in the face-to-face treatment predating the pandemic. This is tempered with the observation that at least at baseline, both groups did not significantly differ in reported depression, anxiety, or stress.

Importantly, the results of this investigation support positive outcomes in CBT delivered via videoconference despite this treatment being rapidly adapted to a virtual context to continue service delivery during a pandemic. Although the shift necessitated quick action, important steps were nonetheless taken by our team to optimize treatment engagement, including research and preparation to apply this model of care; adaptation, where relevant, of treatment components; and extensive support to patients to increase the usability of the technology.

As this investigation has pioneered some of the first data comparing face-to-face versus videoconference group-based CBT for anxiety disorders, it has brought forth important limitations and considerations for future research. First, while this investigation is timely and contributes to the literature supporting videoconference group psychotherapy during a globally challenging period, our results may have been affected by important confounds that were not possible to control in the current study design. First, the face-to-face and videoconference groups were facilitated during different time periods. It is necessary to compare service delivery formats in an ongoing fashion to determine comparability as environmental and societal stressors change. This would additionally clarify whether the benefits to attendance we observed in videoconference relative to face-to-face treatment are better explained by the delivery format, other factors such as greater engagement in treatment offered during global distress, or other pandemic conditions that might have uniquely impacted the sample attending videoconference groups.

Second, with only those equipped with an electronic device participating in videoconferencing, self-selection bias may have influenced our results. Higher retention may have occurred due to a motivated and technologically adept cohort opting to enter treatment in this format. Moreover, the face-to-face versus videoconference groups significantly differed in education status, with more participants in the latter having a post-graduate degree. Whether this difference underlies self-selection, such that a cohort with higher socioeconomic status entered videoconference treatment, remains to be further investigated.

It is also notable that we implemented a treatment model with participants attending videoconference sessions from their homes, but various other models are possible (e.g., videoconference sessions attended from a local clinic, videoconference sessions augmented with prerecorded psychoeducational videos). The extent to which our findings are consistent with, or diverge from, those implementing other variations of videoconferencing is an important avenue for future research.

Although previous work has demonstrated similar treatment satisfaction between telepsychotherapy and in-person psychotherapy,^24
–26,29 this investigation is additionally limited in having not measured patient satisfaction with treatment. Future qualitative research may be valuable to elucidate patients’ experiences with videoconference group psychotherapy, particularly in a pandemic context. We also did not measure group process mechanisms (e.g., group cohesion), which warrant closer examination. A nascent literature suggests small reductions in cohesion in videoconference versus face-to-face groups but no significant impact on outcome.⁴² Finally, in addition to benefits conferred by videoconferencing, there are limitations to consider (e.g., online or environmental distractions during sessions, requirement of an electronic device, type of device used to attend sessions).

The results of this preliminary investigation suggest that videoconference group CBT for anxiety disorders may be a reasonable alternative to face-to-face treatment, which is particularly valuable in the context of the COVID-19 pandemic but also holds broader potential to widen the accessibility of mental health services. Future research is critical to strengthen the emerging literature on group CBT for anxiety disorders via videoconference, with efforts to determine whether equivalence in modalities can be claimed (i.e., through randomized controlled trials).

Footnotes

Authors’ Note

For access to the data, please contact the corresponding author.

Acknowledgements

We wish to acknowledge the clinicians at the Anxiety Treatment and Research Clinic at St. Joseph’s Healthcare Hamilton who facilitated the CBT groups, as well Ashleigh Elcock for her assistance with data collection.

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

ORCID iDs

Irena Milosevic, PhD

Duncan H. Cameron, PhD

References

The Canadian Radio-television and Telecommunications Commission. Communications monitoring report 2018; 2019 [accessed 2020 Oct 9]. https://crtc.gc.ca/pubs/cmr2018-en.pdf

Canada’s Health Informatics Association. 2015 Canadian telehealth report; 2015 [accessed 2020 Oct 9]. https://livecare.ca/sites/default/files/2015%20TeleHealth-Public-eBook-Final-10-9-15-secured.pdf

O’Gorman

Hogenbirk

Warry

Clinical telemedicine utilization in Ontario over the Ontario telemedicine network. Telemed J E Health. 2016;22(6):473–479.

Jong

Mendez

Jong

. Enhancing access to care in northern rural communities via telehealth. Int J Circumpolar Health. 2019;78(2):1554174.

Saqui

Chang

McGonigle

, et al. Telehealth videoconferencing: improving home parenteral nutrition patient care to rural areas of Ontario, Canada. JPEN J Parenter Enteral Nutr. 2007;31(3):234–239.

Serhal

Lazor

Kurdyak

, et al. A cost analysis comparing telepsychiatry to in-person psychiatric outreach and patient travel reimbursement in Northern Ontario communities. J Telemed Telecare. 2020;26(10):607–618.

Gellis

Kenaley

McGinty

Bardelli

Davitt

Have

. Outcomes of a telehealth intervention for homebound older adults with heart or chronic respiratory failure: a randomized controlled trial. Gerontologist. 2012;52(4):541–552.

Choi

Marti

Wilson

, et al. Effect of telehealth treatment by lay counselors vs by clinicians on depressive symptoms among older adults who are homebound: a randomized clinical trial. JAMA Netw Open. 2020;3(8):e2015648.

Obisike

. The effectiveness of telemedicine on stigmatization and treatment burden in patients with health compromising lifestyles and chronic diseases: a critically appraised topic. Open Sci J. 2018;3(1).

10.

Shore

Goranson

Ward

. Meeting veterans where they’re at: a VA home-based elemental health pilot program. Int J Psychiatry Med. 2014;48(1):5–17.

11.

Monaghesh

Hajizadeh

. The role of telehealth during COVID-19 outbreak: a systematic review based on current evidence. BMC Public Health. 2020;20:1193.

12.

Poletti

Tagini

Brugnera

, et al. Telepsychotherapy: a leaflet for psychotherapists in the age of COVID-19. A review of the evidence. Couns Psychol Q. 2020;1–16. https://doi.org/10.1080/09515070.2020.1769557

13.

Wind

Rijkeboer

Andersson

Riper

. The COVID-19 pandemic: the ‘black swan’ for mental health care and a turning point for e-health. Internet Interv. 2020;20:100317.

14.

Gratzer

Torous

Lam

, et al. Our digital moment: innovations and opportunities in digital mental health care. Can J Psychiatry. 2021;66(1):5–8

15.

Bokolo

Jr. Use of telemedicine and virtual care for remote treatment in response to COVID-19 pandemic. J Med Syst. 2020;44:132.

16.

Mann

Chen

Chunara

Testa

Nov

. COVID-19 transforms health care through telemedicine: evidence from the field. J Am Med Inform Assoc. 2020;27(7):1132–1135.

17.

Wosik

Fudim

Cameron

, et al. Telehealth transformation: COVID-19 and the rise of virtual care. J Am Med Inform Assoc. 2020;27(6):957–962.

18.

Bashshur

Shannon

Bashshur

Yellowlees

. The empirical evidence for telemedicine interventions in mental disorders. Telemed J E Health. 2016;22(2):87–113.

19.

Chakrabarti

. Usefulness of telepsychiatry: a critical evaluation of videoconferencing-based approaches. World J Psychiatry. 2015;5(3):286–304.

20.

Francisco

Archer

. The impact of telehealth on mental healthcare in Canada. Am J Med Res. 2016;3(2):59–83.

21.

Richardson

Frueh

Grubaugh

Egede

Elhai

. Current directions in videoconferencing tele-mental health research. Clin Psychol (New York). 2009;16(3):323–338.

22.

Drago

Winding

Antypa

. Videoconferencing in psychiatry, a meta-analysis of assessment and treatment. Euro Psychiatry. 2016;36:29–37.

23.

Choi

Hegel

Marti

Marinucci

Sirrianni

Bruce

. Telehealth problem-solving therapy for depressed low-income homebound older adults. Am J Geriatr Psychiatry. 2014;22:263–271.

24.

Luxton

Pruitt

Wagner

Smolenski

Jenkins-Guarnieri

Gahm

. Home-based telebehavioral health for U.S. military personnel and veterans with depression: a randomized controlled trial. J Consult Clin Psychol. 2016;84(11):923–934.

25.

Ruskin

Silver-Aylaian

Kling

, et al. Treatment outcomes in depression: comparison of remote treatment through telepsychiatry to in-person treatment. Am J Psychiatry. 2004;161(8):1471–1476.

26.

Stubbings

Rees

Roberts

Kane

. Comparing in-person to videoconference-based cognitive behavioral therapy for mood and anxiety disorders: randomized controlled trial. J Med Internet Res. 2013;15(11):e258.

27.

Tuerk

Keller

Acierno

. Treatment for anxiety and depression via clinical videoconferencing: evidence base and barriers to expanded access in practice. Focus (Am Psychiatr Publ). 2018;16(4):363–369.

28.

Bouchard

Paquin

Payeur

, et al. Delivering cognitive-behavior therapy for panic disorder with agoraphobia in videoconference. Telemed J E Health. 2004;10(1):13–25.

29.

Bouchard

Allard

Robillard

, et al. Videoconferencing psychotherapy for panic disorder and agoraphobia: outcome and treatment processes from a non-randomized non-inferiority trial. Front Psychol. 2020;11:2164.

30.

Frueh

Monnier

Yim

Grubaugh

Hamner

Knapp

. A randomized trial of telepsychiatry for post-traumatic stress disorder. J Telemed Telecare. 2007;13(3):142–147.

31.

Germain

Marchand

Bouchard

Drouin

M-C

Guay

. Effectiveness of cognitive behavioural therapy administered by videoconference for posttraumatic stress disorder. Cogn Behav Ther. 2009;38(1):42–53.

32.

Backhaus

Agha

Maglione

, et al. Videoconferencing psychotherapy: a systematic review. Psychol Serv. 2012;9(2):111–131.

33.

Hofmann

Asnaani

Vonk

Sawyer

Fang

. The efficacy of cognitive behavioral therapy: a review of meta-analyses. Cognit Ther Res. 2012;36(5):427–440.

34.

Matsumoto

Sutoh

Asano

, et al. Internet-based cognitive behavioral therapy with real-time therapist support via videoconference for patients with obsessive-compulsive disorder, panic disorder, and social anxiety disorder: pilot single-arm trial. J Med Internet Res. 2018;20(12):e12091.

35.

Liu

Thorp

Moreno

, et al. Videoconferencing psychotherapy for veterans with PTSD: results from a randomized controlled non-inferiority trial. J Telemed Telecare. 2020;26(9):507–519.

36.

Mitchell

Crosby

Wonderlich

, et al. A randomized trial comparing the efficacy of cognitive-behavioral therapy for bulimia nervosa delivered via telemedicine versus face-to-face. Behav Res Ther. 2008;46(5):581–592.

37.

Berryhill

Halli-Tierneyb

Culmer

, et al. Videoconferencing psychological therapy and anxiety: a systematic review. Fam Pract. 2019;36(1):53–63.

38.

Norwood

Moghaddam

Malins

Sabin-Farrell

. Working alliance and outcome effectiveness in videoconferencing psychotherapy: a systematic review and noninferiority meta-analysis. Clin Psychol Psychother. 2018;25(6):797–808.

39.

Rees

Maclaine

. A systematic review of videoconference-delivered psychological treatment for anxiety disorders. Australian Psychologist. 2015;50(4):259–264.

40.

Lamb

Pachana

Dissanayaka

. Update of recent literature on remotely delivered psychotherapy interventions for anxiety and depression. Telemed J E Health. 2019;25(8):671–677.

41.

Luo

Sanger

Singhal

, et al. A comparison of electronically-delivered and face to face cognitive behavioural therapies in depressive disorders: a systematic review and meta-analysis. EClinicalMedicine. 2020;24:100442.

42.

Gentry

Lapid

Clark

Rummans

. Evidence for telehealth group-based treatment: a systematic review. J Telemed Telecare. 2019;25(6):327–342.

43.

Morland

Greene

Rosen

, et al. Telemedicine for anger management therapy in a rural population of combat veterans with posttraumatic stress disorder: a randomized noninferiority trial. J Clin Psychiatry. 2010;71(7):855–863.

44.

Morland

Hynes

Mackintosh

Resick

Chard

. Group cognitive processing therapy delivered to veterans via telehealth: a pilot cohort. J Trauma Stress. 2011;24(4):465–469.

45.

Morland

Mackintosh

Greene

, et al. Cognitive processing therapy for posttraumatic stress disorder delivered to rural veterans via telemental health: a randomized noninferiority clinical trial. J Clin Psychiatry. 2014;75(5):470–476.

46.

Kessler

Berglund

Demler

Jin

Merikangas

Walters

. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication (NCS-R). Arch Gen Psychiatry. 2005;62(6):593–602.

47.

Whiteford

Degenhardt

Rehm

, et al. Global burden of disease attributable to mental and substance use disorders: findings from the global burden of disease study 2010. Lancet. 2013;382(9904):1575–1586.

48.

Olatunji

Cisler

Deacon

. Efficacy of cognitive behavioral therapy for anxiety disorders: a review of meta-analytic findings. Psychiatr Clin North Am. 2010;33(3):557–577.

49.

Otte

. Cognitive behavioral therapy in anxiety disorders: current state of the evidence. Dialogues Clin Neurosci. 2011;13(4):413–421.

50.

Barkowski

Schwartze

Strauss

Burlingame

Rosendahl

. Efficacy of group psychotherapy for anxiety disorders: a systematic review and meta-analysis. Psychother Res. 2020;30(8):965–982,

51.

Mental Health Research Canada. Mental health during COVID-19 outbreak, wave 1; 2020 [accessed 2020 Dec 24]. https://static1.squarespace.com/static/5f31a311d93d0f2e28aaf04a/t/5f86800c5757437eb2b17f08/1602650133129.

52.

Mental Health Research Canada. Mental health during COVID-19 outbreak, poll 2; 2020 [accessed 2020 Oct 9]. https://static1.squarespace.com/static/5f31a311d93d0f2e28aaf04a/t/5f866fab9ec4b03a7a306890/1602645935216.

53.

Pierce

Hope

Ford

, et al. Mental health before and during the COVID-19 pandemic: a longitudinal probability sample survey of the UK population. Lancet Psychiatry. 2020;7(10):883–892.

54.

Hao

Tan

Jiang

. Do psychiatric patients experience more psychiatric symptoms during COVID-19 pandemic and lockdown? A case-control study with service and research implications for immunopsychiatry. Brain Behav Immun. 2020;87:100–106.

55.

Moroz

Slovinec D’Angelo

. Mental health services in Canada: barriers and cost-effective solutions to increase access. Healthc Manage Forum. 2020;33(6):282–287.

56.

McCabe

Milosevic

Rowa

, et al. Diagnostic Assessment Research Tool (DART). Hamilton (ON): St. Joseph’s Healthcare/McMaster University; 2017.

57.

Heimberg

Becker

. Cognitive behavioral group therapy for social phobia: basic mechanisms and clinical strategies. New York (NY): Guilford Press; 2002.

58.

Craske

Barlow

. Mastery of your anxiety and panic. Boulder (CO): Graywind; 2000.

59.

Clark

. Cognitive therapy for panic disorder. In: Wolfe

Maser

, editors. Treatment of panic disorder: a consensus development conference. Washington (DC): American Psychiatric Association; 1994. p. 121–132.

60.

Antony

McCabe

. 10 Simple solutions to panic: how to overcome panic attacks, calm physical symptoms, and reclaim your life. Oakland (CA): New Harbinger Publications; 2004.

61.

Waters

Craske

. Generalized anxiety disorder. In: Antony

Ledley

Heimberg

, editors. Improving outcomes and preventing relapse in cognitive-behavorial therapy. New York (NY): Guilford Press; 2005. p. 77–127.

62.

Dugas

Buhr

Ladouceur

. The role of intolerance and uncertainty in etiology and maintenance. In: Heimberg

Turk

Mennin

, editors. Generalized anxiety disorders: advances in research and practice. New York (NY): Guilford Press; 2004. p. 164–186.

63.

Heimberg

Turk

Mennin

, editors. Generalized anxiety disorder: advances in research and practice. New York (NY): Guilford Press; 2004.

64.

Gyoerkoe

Wiegartz

10 Simple solutions to worry. Oakland (CA): New Harbinger Publications; 2006.

65.

Borkovec

Costello

. Efficacy of applied relaxation and cognitive-behavioral therapy in the treatment of generalized anxiety disorder. J Consult Clin Psychol. 1993;61(4):611–619.

66.

Foa

Yadin

Lichner

. Exposure and response (ritual) prevention for obsessive compulsive disorder: therapist guide. New York (NY): Oxford University Press; 2012.

67.

Zoom Video Communications Inc. Security guide. San Jose (CA): Zoom Video Communications Inc.; 2016 [accessed 2020 Oct 7]. https://d24cgw3uvb9a9h.cloudfront.net/static/81625/doc/Zoom-Security-White-Paper.pdf.

68.

Schneider

Pawluk

Milosevic

, et al. The Diagnostic Assessment Research Tool (DART) in action: a preliminary evaluation of a semistructured diagnostic interview for DSM-5 disorders. Manuscript submitted for publication. 2021.

69.

Lovibond

. Manual for the Depression Anxiety Stress Scales. 2nd ed. Sydney (Australia): Psychology Foundation; 1995.

70.

Antony

Bieling

Cox

Enns

Swinson

. Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales in clinical groups and a community sample. Psychol Assess. 1998:10(2);176–181.

71.

Ustun

Kostanjesek

Chatterji

, et al. Measuring health and disability: manual for WHO Disability Assessment Schedule (WHODAS 2.0). Geneva (Switzerland): World Health Organization; 2010.

72.

Connor

Davidson

Churchill

Sherwood

Foa

Weisler

. Psychometric properties of the Social Phobia Inventory (SPIN): new self-rating scale. Br J Psychiatry. 2000;176(4):379–386.

73.

Shear

Brown

Barlow

, et al. Multicenter collaborative Panic Disorder Severity Scale. Am J Psychiatry. 1997;154(11):1571–1575.

74.

Houck

Spiegel

Shear

Rucci

. Reliability of the self-report version of the Panic Disorder Severity Scale. Depress Anxiety. 2002;15(4):183–185.

75.

Meyer

Miller

Metzger

Borkovec

. Development and validation of the Penn State Worry Questionnaire. Behav Res Ther. 1990;28(6):487–495.

76.

Stöber

Bittencourt

. Weekly assessment of worry: an adaptation of the Penn State Worry Questionnaire for monitoring changes during treatment. Behav Res Ther. (1998);36(6):645–656.

77.

Foa

Huppert

Leiberg

, et al. The Obsessive-Compulsive Inventory: development and validation of a short version. Psychol Assess. 2002;14(4):485–496.

78.

Antony

Coons

McCabe

Ashbaugh

Swinson

. Psychometric properties of the Social Phobia Inventory: further evaluation. Behav Res Ther. 2006;44(8):1177–1185.

79.

Lee

Kim

. Reliability and validity of the self-report version of the Panic Disorder Severity Scale in Korea. Depress Anxiety. 2009;26(8): E120–E123.

80.

Brown

Antony

Barlow

. Psychometric properties of the Penn State Worry Questionnaire in a clinical anxiety disorders sample. Behav Res Ther. 1992;30(1):33–37.

81.

Wuthrich

Johnco

Knight

. Comparison of the Penn State Worry Questionnaire (PSWQ) and abbreviated version (PSWQ-A) in a clinical and non-clinical population of older adults. J Anxiety Disord. 2014;28(7):657–663.

82.

Abramowitz

Deacon

. Psychometric properties and construct validity of the Obsessive-Compulsive Inventory-Revised: replication and extension with a clinical sample. J Anxiety Disord. 2006;20(8):1016–1035.

83.

Devins

. Illness intrusiveness and the psychosocial impact of lifestyle disruptions in chronic life-threatening disease. Adv Ren Replace Ther. 1994;1(3):251–263.

84.

Bieling

Rowa

Antony

Summerfeldt

Swinson

. Factor structure of the Illness Intrusiveness Rating Scale in patients diagnosed with anxiety disorders. J Psychopathol Behav Assess. 2001;23(4):223–230.

85.

Harris

Taylor

Thielke

Payne

Gonzalez

Conde

. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381.

86.

Raudenbush

Bryk

. Hierarchical linear models: applications and data analysis methods. 2nd ed. Thousand Oaks (CA): Sage Publications; 2002.

87.

Shear

Rucci

Williams

, et al. Reliability and validity of the Panic Disorder Severity Scale: replication and extension. J Psychiatr Res. 2001;35(5):293–296.

88.

Moscovitch

Gavric

Merrifield

Bielak

Moscovitch

. Retrieval properties of negative vs. positive mental images and autobiographical memories in social anxiety: outcomes with a new measure. Behav Res Ther. 2011;49(8):505–517.

89.

Moser

Hajcak

Huppert

Foa

Simons

. Interpretation bias in social anxiety as detected by event-related brain potentials. Emotion. 2008;8(5):693–700.

90.

Rettie

Daniels

(2020). Coping and tolerance of uncertainty: predictors and mediators of mental health during the COVID-19 pandemic. Am Psychol. 2021;76(3):427–437.

91.

Strachan

Gros

Ruggiero

Lejuez

Acierno

. An integrated approach to delivering exposure-based treatment for symptoms of PTSD and depression in OIF/OEF veterans: preliminary findings. Behav Ther. 2012;43(3):560–569.

92.

Hofmann

Smits

JAJ

. Cognitive-behavioral therapy for adult anxiety disorders: a meta-analysis of randomized placebo-controlled trials. J Clin Psychiatry. 2008;69(4):621–632.

93.

Norton

Price

. A meta-analytic review of adult cognitive-behavioral treatment outcome across the anxiety disorders. J Nerv Ment Dis. 2007;195(6):521–531.

94.

Stewart

Chambless

. Cognitive-behavioral therapy for adult anxiety disorders in clinical practice: a meta-analysis of effectiveness studies. J Consult Clin Psychol. 2009;77(4):595–606.

95.

Dugas

Freeston

Ladouceur

. Intolerance of uncertainty and problem orientation in worry. Cognit Ther Res. 1997;21:593–606.

96.

Ladouceur

Talbot

Dugas

. Behavioral expressions of intolerance of uncertainty in worry: experimental findings. Behav Modif. 1997;21(3):355–371.

97.

Buhr

Dugas

. The Intolerance of Uncertainty Scale: psychometric properties of the English version. Behav Res Ther. 2002;40(8):931–945.