Abstract
Keywords
Introduction
Childhood cancer survivorship care is complex. The gold standard of survivorship care includes regular access to an expert, interdisciplinary team spanning all aspects of physical and mental health (Lown et al., 2015) to ensure evidence-based screening for life-threatening late effects (Gramatges et al., 2018). In addition, survivorship care must include regular and systematic psychosocial assessment (Wiener et al., 2015) with access to social work support and/or mental health intervention (Lown et al., 2015). Not only do survivors in follow-up care have better health, quality of life, and educational outcomes (Gramatges et al., 2018; van den Oever et al., 2022; Wiener et al., 2015), they also have life years saved with adherence to recommended screening (Ehrhardt et al., 2020; Yeh et al., 2020). Thus, more survivors could benefit from flexing to creative access models.
Literature Review
Life Years Saved
Most people diagnosed with childhood cancer today will survive the disease but remain vulnerable to long-term therapy-related health problems with a risk of early death and morbidity (Gibson & Robison, 2015; Hudson et al., 2021). This risk has been shown to be as high as 18% mortality at 30 years, which is 7 times higher than the general population (Armstrong et al., 2009). Cardiac complications and second malignancies are primary concerns (Leerink et al., 2020). Evidence-based screening has been shown to improve outcomes in survivorship (Ehrhardt et al., 2020; Landier et al., 2018; Yeh et al., 2020). Survivors who regularly participate in follow-up care, including input from pediatric oncology specialists, have better health and educational outcomes. Thus, lifelong survivorship care with late effects screening and education is imperative (Gramatges et al., 2018; Signorelli et al., 2017).
Psychosocial Care/Quality of Life
Cancer therapy has long-term psychosocial impacts (Wiener et al., 2015). Longevity and well-being are supported when mental health sequelae of childhood cancer are addressed (Lown et al., 2015). The 2015 publication Standards for the Psychosocial Care of Children With Cancer and Their Families provides a strong evidence-based recommendation that childhood cancer survivors (CCSs) receive annual screening in the areas of education, vocation, social function, relationship difficulties, risky behaviors, and mental health challenges (Wiener et al., 2015). The success of telehealth support of psychosocial needs in other populations has been demonstrated (McLoone et al., 2020; Phelan et al., 2023), but a gap in the literature exists regarding virtual psychosocial care in the context of interdisciplinary survivorship care.
Access to Care
Poor outcomes related to access to survivorship care include barriers, such as transportation and distance to the clinic, major life changes, lower socioeconomic status, lower educational level, lack of insurance coverage, work or school conflicts, and lack of time (Gramatges et al., 2018). Financial toxicity is also experienced both during therapy and for years afterward (Kelada et al., 2020). The transition from pediatrics to adult care may result in poor communication between providers, gaps in care, and decreased awareness and access to screening (Casillas et al., 2015; Hudson et al., 2021). Follow-up care in a cancer survivorship clinic may address some of these barriers, improve adherence to long-term follow-up guidelines, and reduce the need for emergency medical care (Gramatges et al., 2018).
Virtual Models
Postpandemic, a substantial shift took place in the number of survivorship-related consultations through alternative methods such as virtual visits, telephone calls, and email. Capacity, access to care, and proximity to an academic center were factors in the shift (Phelan et al., 2023; van den Oever et al., 2022). Other distance-delivered models in CCS have included support groups, cognitive behavioral therapy, skills training with an interventionist, family group sessions, and nurse-led telehealth visits (McLoone et al., 2020). High provider and patient satisfaction with virtual screening has been reported, including the desire for virtual visits to remain an ongoing option (Kenney et al., 2021; Pham et al., 2020; van den Oever et al., 2022). Technology for virtual visits has been reported to increase health system capacity and improve access to care, especially for survivors living in remote areas (Pham et al., 2020; van den Oever et al., 2022).
Limitations of virtual visits include lack of physical examination, technology disparities, difficulty organizing off-site testing, and inconsistent training (Kenney et al., 2021; Pham et al., 2020; van den Oever et al., 2022). In addition, the impact of social determinants of health, how best to incorporate cultural compassion, and privacy/security concerns need further investigation (Pham et al., 2020). Other knowledge gaps exist regarding access for patients with low socioeconomic status and outcomes of virtual survivorship care (van den Oever et al., 2022).
When the COVID-19 pandemic halted in-person care, programs pivoted to find creative solutions to keep CCSs engaged and meet their needs. Many institutions found a way to transition to virtual care for the medical provider visit, but the literature is less clear about how psychosocial care was addressed. Given the complex needs of CCS, bundling care into an interdisciplinary clinic is common, but challenging when shifting to the virtual world. The infrastructure for managing a patient-friendly, complex, interdisciplinary virtual clinic did not exist. Building one required a process that could accomplish the following: successful assessment and survivorship education in a virtual setting; a method to keep traffic flowing with short wait times between providers; real-time communication between team members during a fast-paced interdisciplinary virtual clinic; a system that considered the needs of collaborators and included user-friendly technology; and a patient-centered experience. After an extensive literature search, we did not find a comparable program, so we report here the process to create and sustain virtual survivorship clinics. Our aim is to provide an example for institutions which may be considering the addition of a virtual option to their current model.
Description of Process
Context
As the only public academic health center in a large rural state, our pediatric hematology/oncology program has a wide catchment area, including a three-state region. Our survivorship program monitors survivors of childhood/adolescent/young adult cancer or bone marrow transplant who completed treatment at least 2 years prior. Limited adult transition services exist, so patients of all ages are followed in our clinic. Prior to the COVID-19 pandemic, we had two in-person clinic types: (a) weekly at our main hospital campus and (b) monthly at an outreach clinic approximately 60 miles south of our main campus. Team members included physician or advanced practice provider, neuropsychologist, social worker, educational specialist/teacher, dentist, registered nurse, dietician, and research associate. Each patient sees a provider in each applicable discipline to optimize anticipatory guidance, with visits adjusted according to patient needs. We used an iterative process to develop and implement virtual childhood cancer survivorship care (Figure 1).

Implementation Process
Virtual Survivorship Care Elements
To design this new clinic model, the team identified which disciplines were needed for each patient, often 5–6 team members per patient. A team member in the appropriate specialty was slotted time with the patient. We deliberately prioritized simplicity for patients by having them log into one virtual visit. The providers (from remote work locations) rotated through the virtual room while the patient stayed in the same encounter for over 3–4 hr (Table 1).
Elements of a Survivorship Virtual Clinic Model
We purposefully left the frequency and type of visits open. As COVID-19 restrictions lessened, we began to assess the frequency of virtual visits versus in-person visits on a case-by-case basis. Although we have received positive verbal patient feedback regarding this model, we have not yet determined the optimal interval of virtual visits. We plan to collect outcomes and patient experience data for evidence to inform any standard of virtual clinic frequency.
Collaborators
To launch a virtual interdisciplinary clinic, support from various collaborators was necessary. The technology needed for clinical requirements was discussed with the information technology group. Electronic health record (EHR) procedures for hosting and documenting telehealth visits were established. We sought support from the electronic medical record patient portal (MyChart) team and the telehealth department to understand the patient experience. Additionally, we consulted with the billing and insurance departments.
Operationally, it was imperative to have input from the clinic scheduling team and medical assistants. The schedulers created templates for the virtual interdisciplinary clinics, and medical assistants completed the previsit check-in process. We ensured that we provided high-quality language interpretation for patients and families with limited English proficiency. We worked with our institution's language services department to learn the process for adding a third-party interpreter to the virtual visit. Finally, we consulted with our institution's legal department to ensure that our plan for virtual interdisciplinary clinics conformed to institutional and privacy policies.
Communication and Visit Planning
Accurate and real-time communication was a necessity to keep our virtual interdisciplinary clinic running smoothly. Our preclinic team meeting was accomplished via an online platform (Webex). During the visit, we used Microsoft Teams software to track the providers (virtual whiteboard) and real-time communication among team members during the clinic (chat function). The whiteboard entries documented the in/out times and the Zoom link with the designated time (Figure 2). All communication during virtual clinics was saved for future access.

Example Clinic Flow
To ensure patient privacy, we used a two-step authentication (Duo Mobile) for all devices not connected to the hospital network. MyChart and Zoom visits through EHR are encrypted to meet Health Insurance Portability and Accountability Act (HIPAA) regulations and safeguard protected health information. Microsoft Teams is both HIPAA and Family Education Rights and Privacy Act compliant. Through the utilization of a private channel and chat, we limited access to protected health information to only those staff members involved in the clinic.
Clinic Flow
The survivorship program coordinator or clinic medical assistant called the patient 15 min prior to the visit to make sure their technology was working and orient them to the planned flow of the visit. In the EHR, the virtual visit tab included a questionnaire and medication list the patient was asked to review prior to their visit. The patient then launched a virtual visit through MyChart, which connects to Zoom technology. The EHR notification turned green when the patient arrived, and the first provider launched the Zoom virtual visit through the patient's EHR encounter. Then the Zoom meeting link was shared in the Microsoft Teams timeslot planner. We used color-coded web-based spreadsheets, accessible to all team members.
Evaluation
In assessing this model, we defined feasibility as whether or not the model could accomplish virtual, interdisciplinary survivorship care and was reproducible over time. We measured this by comparing the total number of virtual visits accomplished per year to the prepandemic baseline of 205 in-person visits per year. We defined reproducibility by the total number of completed visits. To evaluate process change outcomes, we utilized consensus of efficiency, difficulties, and successes through informal feedback from staff, providers, and patients. Adjustments were made accordingly in real time. To determine long-term potential, we evaluated the number of successful visits and an informal survey of provider experience. Three years into the process change, eight providers who had previously participated in the clinic (excluding the primary authors of this article) were surveyed utilizing a Likert scale. No validated tool was found that fit our circumstances, so an informal questionnaire was developed.
Results
We completed 205 in-person visits at our main campus in 2019. 2020 was a process change year. And then in 2021 and 2022, we had 190 (93% of the baseline in-person visits in 2019) and 194 (95% of the baseline in-person visits in 2019) virtual visits, respectively. In total, there were 593 interdisciplinary survivorship virtual visits completed from June 2020 to December 2023. In 2023, we reintroduced in-person survivorship visits at our main campus and still maintained the virtual option for those who desired it (Figure 3). There were positive informal survey responses regarding provider experiences related to quality of care, quality of communication, satisfaction, and desire for a continued virtual option going forward (Table 2). Collecting fees for service was not a barrier. We did not encounter insurance company refusal to pay due to the change in format or any preauthorization changes from the usual practice for in-person visits.

Completed Visits
Survivorship Clinic Provider Survey Results 2023
.
Discussion
Considering the changing landscape of healthcare delivery, we introduce here a novel virtual survivorship program which may help mitigate the late effects of morbidity and mortality among CCSs. We successfully completed 593 interdisciplinary virtual survivorship visits utilizing this model. Our experience aligned with positive aspects of virtual platforms previously reported, specifically, capacity, access to care, ability to address mental health, and desire for this option to continue.
The virtual model may be preferred for specific subsets of CCSs. Patients who were geographically distant, those with transportation challenges, or those who had access barriers seemed to benefit from our model. We also noticed uptake among technology-savvy young adults who were well engaged with their primary care providers (PCPs) but needed a consultation visit to update their screening guidelines plan. Some examples reported informally by families for preference of virtual visits included: young patients who struggled with the length of the visit, patients or caregivers with difficulty taking time off work for appointments or travel to appointments, cost of lodging or transport to appointments, navigating busy traffic in the metro area, posttraumatic stress response to being back in the hospital where treatment occurred, and seeing or hearing the distress of patients currently undergoing therapy. Patients verbalized that some of these benefits helped mitigate financial toxicity.
Benefits noted by providers included the ability to accomplish mental health screening, provide psychosocial support, and pursue clinical research study screening and recruitment. Relationships with the PCP were fostered through education about the survivors’ needs, engagement with physical examinations, and partnerships in completing local screening tests. Systemic successes included rapid mobilization of virtual care systems, acceptance by insurance companies for reimbursement, and high motivation of patients to accomplish the bulk of their care locally, which necessitated the involvement of the PCP and local hospitals/testing centers. Emergency reciprocal licensing agreements in multiple bordering states were quickly put into place, and virtual visits were permitted between our institution and patients residing in those states.
We found that real-time evaluation, flexibility, and adjustments were essential in developing the new virtual interdisciplinary survivorship model. Eliciting team members’ challenges and successes was important. We evolved methods and shifted as technology improved. Adjustments made during the first year included moving from Webex to Microsoft Teams for the virtual whiteboard and chat functions to allow shared editing privileges and the ability to save communications for later reference. The interpreter process also evolved and became linked to the EHR.
Our experience with the challenges of virtual platforms aligned with the following themes: limited physical examinations, technology disparities, and difficulty organizing off-site testing. For example, we found virtual visits were more challenging in another language. Orienting the family to set up and flow with an interpreter was time-consuming and, in some instances, did not go smoothly. Once connected, the interpreter was in the virtual room with us, but the absence of body language and visual cues was more evident in this scenario than with our English-speaking patients. Limited physical examination was another factor. We relied on PCPs to do a thorough examination and vision screening, and measure growth parameters after receiving a detailed letter from us about individualized late effect risks. Ancillary tests ordered locally required increased staff time to locate appropriate local testing centers, request results, have a provider review them, and deliver results to families. There were some families who required multiple reminders and yet did not complete the testing. For those patients, screening might have been better accomplished with an in-person visit.
Limitations
Limitations of our process change assessment include a lack of rigor in our evaluation tools. Although the survey lacked formal psychometric data such as reliability and validity measures, the findings provide insights for future improvements and research. Thus far we have only used attended visits as a surrogate of success. We have not yet performed a formal survey of patient experience or outcomes.
Limitations of the virtual model included abbreviated physical and dental examinations, limited ability to assess nonverbal cues, lack of personal connection, and privacy concerns in some patients’ homes. Though we did ask, we could not always see who else was in the room or within earshot. System challenges included unstable internet connections at the patient’s location, distracted patients completing the visit while running errands in the car, and noises/distractions in the home environment.
Next Steps
Future steps include study of how this model affects access to care, quality of clinical care, clinical outcomes, and satisfaction of patients and providers. Understanding the patient experience with rigorous outcome measures will be key to informing the next steps. Ultimately, we aim to one day determine how the model of virtual visits saves life years through adherence to evidence-based childhood cancer survivorship guidelines.
Conclusions
This interdisciplinary virtual model of survivorship care was feasible, sustainable, and accepted by survivorship providers. Feasibility was evidenced by comparable numbers of in-person prepandemic to virtual visits postpandemic. We sustained the same rate (over 93% of baseline in-person visits) of virtual visits over the following 2 years. Informal surveys revealed acceptance by providers.
Virtual models must be individualized with consideration of benefit/burden. Virtual models have the potential to increase access to care by reducing transportation barriers, minimizing the interference with work or school attendance, and lessening the financial impacts of in-person clinics. In our experience, provider and patient satisfaction was anecdotally high, and the number of our childhood cancer survivorship visits has been maintained, demonstrating acceptance even after the pandemic resolved.
Implications for Pediatric Hematology/Oncology Nursing
Expanding the model of survivorship care incorporating the tenets of pediatric oncology nursing requires broad knowledge, strong problem-solving, creativity, and compassion. Nurses can integrate principles of social determinants of health, equity, and access to care by advocating for virtual visits for survivors. Understanding the challenges faced by CCSs, nurses are key to finding novel ways to meet patients where they are.
Footnotes
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
