Abstract
Background
The purpose of this study was to build a risk prediction model to identify trauma patients at the time of injury who are at high risk for post-traumatic stress disorder (PTSD) 1 year later.
Methods
Patients 18+ with operative orthopedic trauma injuries were enrolled in prospective social determinants of health cohort. Data were collected through initial surveys, medical records at time of injury, and 1-year follow-up phone screenings. Univariate analysis examined associations between factors and PTSD at 1 year. The best fit multivariable logistic regression model led to a novel PTSD risk prediction tool based on weights assigned similar to the Charlson index methods.
Results
Of 329 enrolled patients, 87 (26%) completed follow-up surveys; 58% screened positive for chronic PTSD. The best fit model predicting PTSD included age, insurance, violent mechanism, and 2 acute stress screening questions (AUC .89). Using these parameters, the maximum possible TIPPS index was 19. Those with PTSD at 1 year had a mean TIPPS index of 12.9 ± 4.0, compared to 5.9 ± 4.2 for those who did not (P < .001).
Discussion
Traumatic injury often leads to PTSD, which can be predicted by a novel risk score incorporating age, insurance status, violent injury mechanism, and acute stress reaction symptoms. Stability in life and relationships with primary care physicians may be protective of PTSD.
Level of Evidence
Diagnostic level II.
Introduction
Acute traumatic injury has known psychological sequelae, notably post-traumatic stress disorder (PTSD). Post-traumatic stress disorder is largely described as “collateral morbidity” to acute trauma, with most of the interventional psychology work studied in episodic traumatic events such as war, torture, school shootings, terrorism, and natural disasters.1-3 For everyday trauma seen in centers across the world, probable PTSD rates range from 1.9% in Australian motor vehicle accident survivors 4 to 91% in violence victims. 5 Most studies range from 20 to 40%, and vary by patient population and type of traumatic injury. Post-traumatic stress disorder is often under-diagnosed and under-treated in trauma patients, with early care heavily directed towards regaining physical function and little emphasis on psychological recovery.6,7 Despite this imbalance in early care, mental health has been shown to be closely linked to a patient’s work status, general health, and overall satisfaction at 1-year following trauma. 8 By failing to diagnose and treat injury-related mental health conditions in trauma patients, recovery to good overall health status is compromised. 8
Various factors have been identified for predicting PTSD in trauma patients—but interestingly, injury severity is not reliably one of them.9-12 Rather, a patient’s internal processing of the trauma and on-going “perceived threats to life” has shown to more reliably predict the development of PTSD.10-14 In addition, patients experiencing significant pain and an early acute stress reaction have a higher risk of developing PTSD.12,15 Other risk factors for PTSD in trauma patients include: medical and financial problems, 10 a preexisting psychiatric disorder,10,16 a stabbing or violent/assault injury, 11 co-morbid medical disease, 14 and the anticipation of future problems during recovery. 13
Given the success of PTSD treatment if diagnosed early, 17 the ability to identify at-risk patients as early as possible is of great value to both the patient and health care system. Early PTSD intervention has the potential to improve patient outcomes by initiating treatment prior to the development of severe symptoms. Further, given that patients with stress disorders have been shown to incur 80% increase in the cost-of-care and hospital length of stay, early intervention may decrease the overall cost of trauma care. 18 The purpose of this study is to build a risk prediction model to identify trauma patients at the time of injury who are at high risk for PTSD 1 year later.
Materials & Methods
Data Collection
Data for this study were prospectively collected at an urban, Level 1 Trauma Center from 2018 to 2019. Patients 18 and older presenting with an operative orthopedic trauma injury were eligible for enrollment in Institutional Review Board-approved comprehensive social determinants of health study. Data at the time of injury were collected through an initial 325 question in-person survey, medical records, and the hospital’s trauma registry database. These factors included gender, race, age, tobacco history, relationship with the health care system, insurance status, injury mechanism, and injury severity score (ISS). The Screener and Opioid Assessment for Patients with Pain (SOAPP) and the Patient Health Questionnaire-2 (PHQ-2) were also included.19,20 Acute Stress Disorder was assessed at the time of initial admission using a validated 5-point PTSD criteria questionnaire (Primary Care PTSD Screen for DSM-5) at the time of injury. 21 Frailty scores were calculated through a 5-point modified frailty index (mFI-5) which incorporates congestive heart failure, diabetes, functionally dependent health status, hypertension requiring medication, and chronic obstructive pulmonary disease. 22 Distressed Community Index (DCI) was determined based on residential zip code. 23
One year later, study subjects underwent follow-up phone screening, including a reiteration of the 5-item validated questionnaire for PTSD. 21 A 1 year follow-up was used to capture patients who have persistent PTSD symptoms because this time frame is typical for a postoperative follow-up time point. Respondents screened positive for probable PTSD if they answered “yes” to any 3 of the 5 PTSD questions. The follow-up survey also collected information regarding patients’ on-going relationship with the health care system, community support, and financial, relational, and housing stability throughout the previous year.
Data Analysis
Patients were binarily grouped based on PTSD screening results. Univariate analysis examined associations between injury-related, personal, and community factors and probable PTSD at 1 year (≥3 factors on PTSD-5). Differences were evaluated using χ2, Fischer exact tests, t-tests, or Wilcoxon rank-sum tests, with a P-value < .05 considered significant. Several multivariable logistic regression models were then developed utilizing forward selection techniques, although nonsignificant parameters were incorporated if they exhibited synergistic effects on model performance. Regression models were assessed based on Akaike Information Criterion (AIC) and Area Under the Receiver Operator Characteristic (AUC).
After determination of the best fit model, a novel PTSD risk prediction model was designed by assigning weights to each parameter based on odds ratios, a technique widely used in the development of risk prediction algorithms to facilitate clinical implementation.24-27 In the current study, weights were assigned to each parameter based on methods outlined by Charlson et al 28 Specifically, parameters with odds ratios between 1.2 and 1.5 were assigned a weight of 1; those between 1.5 and 2.5 were assigned a weight of 2; ratios between 2.5 and 3.5 led to a weight of 3; and parameters with odds ratios of 6 or greater were assigned a weight of 6. Regression analysis was completed on a complete-case basis, with all incomplete cases excluded.
Additional univariate analyses were conducted to examine which factors at the time of injury were associated with loss to follow-up. Personal and injury-related variables were investigated between patients who responded to the follow-up vs those who did not. χ2, Fischer exact tests, t-tests, and Wilcoxon rank-sum tests were used to indicate significant differences between groups (P-value < .05). Data analyses were performed with R version 3.6.1 (2019-07-05). Copyright © 2019 The R Foundation for Statistical Computing. No external funding was obtained to complete this study.
Results
A total of 329 patients were enrolled, and 87 completed the 1-year follow-up survey. Patients who did not fully complete the PTSD screening within their follow-up were excluded, resulting in a final sample size of 84. The mean age of the follow-up respondents was 48 (±16) years, and 43 (52%) were male patients and 62 (74%) African American patients. Based on home address, 49% of the patients lived in a “distressed” or “at risk” community. 1 year following trauma, 58% of the follow-up respondents screened positive for probable chronic PTSD. Chronic PTSD is defined as PTSD symptoms lasting greater than 3 months.
Patient demographics and background information.
aAcute stress disorder = meeting PTSD criteria at time of initial trauma hospitalization.
bSOAPP = Screener and Opioid Assessment for Patients with Pain.
cPHQ-2 = Patient Health Questionnaire-2 (frequency of depressed mood and anhedonia).
dmFI-5 = 5-point modified frailty index (congestive heart failure, diabetes, functionally dependent health status, hypertension requiring medication, chronic obstructive pulmonary disease).
Logistic regression model development and assessment.
mFI-5: Modified 5-item frailty index, ISS: Injury severity score, DCI: Distressed community index, PHQ-2: Patient health questionnaire-2, SOAPP: Screener and opioid assessment for patients with pain, ASD: Acute stress disorder.

Traumatic injury post-traumatic stress disorder prediction score (TIPPS).
Loss to follow-up.
aAcute stress disorder =meeting PTSD criteria at time of initial trauma hospitalization
SOAPP = Screener and opioid assessment for patientswith pain
cPHQ-2 = Patient health questionnaire-2 (frequency of depressed mood and anhedonia)
dmFI-5 = 5-point modified frailty index (congestive heart failure, diabetes, functionally dependent health status, hypertension requiring medication, and chronic obstructive
Discussion
It is known that acute trauma can lead to chronic psychological problems, most notably PTSD. In this prospective, comprehensive social determinants of health study, we identified probable chronic PTSD in 58% of patients 1-year after trauma. We developed a novel risk score (TIPPS) from data obtained at the time of injury that highly predicted PTSD at 1-year (AUC .89). The TIPPS score incorporated patient age, insurance status, violent injury mechanism, and acute stress symptoms. In addition, stability in life (financial, relationship, and housing) as well as on-going engagement with the health care system (via PCP) appeared to be protective against having PTSD at 1-year. Early recognition of PTSD risk factors and referral for treatment by surgical teams can lead to improved physical and psychological recovery in trauma patients.
The TIPPS PTSD risk prediction tool can identify at-risk patients, enabling in-hospital referral for psychological treatment. Prior work outside of the United States have utilized other risk prediction models on small scales. One study of MVC victims in the United Kingdom found that predictors of PTSD at 1 year were rumination, persistent functional health problems, and negative interpretation of intrusion at 3 months. 10 Similarly, another British study screened trauma patients at a Major Trauma Center using a post-traumatic adjustment screen and found it to be predictive of PTSD 1, 3, and 6 months following trauma. 11 The United States is a socially, economically, and ethnically diverse country with varying rates of predisposition to psychological trauma—and as a result, early unbiased and objective diagnosis of co-morbid mental health conditions is imperative.
The Effects of PTSD on Trauma Recovery
Post-traumatic stress disorder in the aftermath of physical trauma has widespread negative effects—some physical, including in-hospital complications and even mortality. In addition, there are significant financial implications—with prolonged hospital lengths-of-stay and increased cost-of-care in trauma patients with PTSD. 18 Some effects are longer-lasting and are more difficult to quantify in the aftermath of trauma—including work status, disruption of personal relationships, financial difficulties, social dysfunction, and risk of recidivism. All of these negative effects place stress on the patient, society, and the health care system.
Post-traumatic stress disorder has been shown to contribute more toward general health at 6 months than physical function or injury severity. 8 Psychiatric impairment has been shown to affect the perception of pain and to prolong recovery. 6 Depression alone has been shown to be an independent risk factor for postoperative complications. 7 One study of patients with traumatic brain injuries noted higher mortality at 6 months unrelated to the primary diagnosis (including suicide, injury, and assault); mortality was substantially elevated in patients with a psychiatric or substance abuse co-morbidity. 29 Patients with assault injuries and PTSD are more likely to die by suicide. 30 Persistent physical and financial problems are more important in long-term trauma outcomes than the initial injury severity. 10 These may represent chronic stressors that exceed a patient’s ability to cope, making it more difficult for overall trauma recovery. The negative effect PTSD can have on physical recovery can be easily overlooked by surgeons who are often over-worked.
In addition to the physical consequences that psychiatric comorbidities have on recovery, many patients face social challenges. In the setting of organized or informal communal activities, 45% of trauma patients report social dysfunction at 6-12 months. 31 Persistent PTSD had an extremely close relationship with social dysfunction, with an odds ratio of 16.25. Psychiatric diagnosis also predicts trauma recidivism and unintentional injury. 32 Lastly, the undertreatment of post-traumatic psychiatric disorders has an overwhelming financial impact on the health care system with an estimated 80% increase in hospital LOS and cost-of-care for patients with stress disorders. 18
While the nuances of interpersonal violence are beyond the scope of this paper, it must be recognized that interpersonal violence is a well-recognized public health crisis. 33 In some particularly violent communities, on-going cycles of disadvantage, decreased community resilience, and intergenerational trauma are likely related to undiagnosed psychological trauma. A systemic review by Charlson et al 34 estimated that 68.6 million people in the United Nations are displaced by violence and conflict, the highest number since World War II. Roughly 20% of this post-traumatic population suffered from depression, PTSD, or anxiety. 34
Limitations of Current Care Delivery Models
Our current trauma care delivery model focuses heavily on physical recovery with limited attention directed toward early psychological recuperation following everyday trauma. One study of motor vehicle accidents and work-related injuries found only 18 of 113 (16%) patients with probable PTSD or other psychological problems received treatment for those conditions. 35 A similar study found that only 33% of trauma survivors with psychological illnesses following injury received mental health treatment, and of those with PTSD, only 47.7% received the appropriate treatment. 36
Recognizing antecedents of PTSD during the initial hospitalization can be challenging, making the need for systematic screening desirable. The hospital is a “safe” place for patients that is detached from their normal everyday life and is focused on physical recovery. This may set the tone for the patient to focus solely on their physical recuperation only to find themselves dealing with difficult psychological sequela when attempting to transition back into society. Though often overlooked by surgical teams, early identification of PTSD risk using a screening tool may help prioritize patients’ psychologic rehabilitation alongside their physical rehabilitation after acute trauma.
The Ideal Population-Based Whole Person Trauma Recovery Model
The current care model has made significant advances in physical treatment following trauma, but it must expand to incorporate psychological recovery. Bisson et al showed that early cognitive behavioral therapy in trauma patients presenting to the Emergency Department significantly decreased symptoms of PTSD at 13 months. 17 System-wide health care reform, as suggested by the World Health Organization (WHO), that addresses both new onset and pre-existing mental health disorders should be foundational to a comprehensive approach to caring for trauma patients. 37 Early supportive interventions, including both personalized psychological intervention, as well as those that engage families and communities are needed to address the complex needs diverse trauma populations.
Recent efforts have been made to address the need for mental health care in low resource settings. The WHO along with the UN High Commissioner for Refugees designed mhGAP Humanitarian Intervention Guide, 38 which addresses assessment and management of moderate and severe mental disorders in non-specialized settings. The WHO has also recently published Problem Management Plus, which provides guidance on psychological intervention for people exposed to adversity. 39 The Common Elements Treatment Approach (CETA) was developed to reduce the burden of mental health disorders globally in low resource settings by providing treatments for mental health disorders that can be implemented by non-mental health providers. 40 Lastly, the WHO has developed Self-Help Plus (SH+) as an intervention for managing stress and coping with adversity in low resource settings. 41 All of these interventions are directed towards decreasing the burden of mental health disease in a cost-effective manner for low resource settings. Findings from this study confirm that patients in low resource settings are at higher risk of mental health problems. Future trauma care models should direct efforts toward recognizing populations at risk of developing mental health disorders and implementing targeted interventions such as those mentioned above. Studies implementing this risk screening tool and various mental health interventions are needed to better understand potential health outcomes and cost savings in various populations of trauma patients.
Strengths and Weaknesses
This risk assessment tool was developed from data collected for a cross-sectional convenience sample of orthopedic patients at an urban level 1 trauma center assessing a comprehensive battery focused on social determinants of health. The level 1 trauma center serves patients with significant diversity of culture, race, education, and finances, and this survey is a cross-section of the population. The findings may be limited due to the 1 year follow-up rate of 26%, though this rate is similar to other reports of trauma patients. The sample includes a large proportion of under-resourced patients, and generalizability to other patient populations is not known. Additionally, this study focused on risk factors for orthopedic trauma patients and future studies may want to expand to all trauma patients. Through this study, we identified risk factors to poor follow-up including age, male gender, lack of PCP, and high SOAPP scores, which can hopefully inform strategies to improve follow-up in the future. Considering many factors correlated with loss to follow-up are the same as those that place patients at risk for PTSD, it is possible that with improved follow-up rates that the patient population would be represented differently and would present different risk factors for PTSD. Consequently, the current version of this scoring system may fail to capture a group of patients at risk for chronic PTSD. Future studies are needed to validate our risk assessment model prospectively and in various geographical regions. Future studies should also focus on targeting specific interventions that will be effective treatment options for patients at risk of developing PTSD.
Conclusions
In conclusion, chronic PTSD is common following acute traumatic injury and can be predicted in orthopedic trauma patients using a novel TIPPS risk score that incorporates age, insurance status, violent injury mechanism, and acute stress reaction symptoms. Stability in life (financial, relationship, and housing) and PCP involvement were also found to be independent predictors of developing PTSD. Previous literature has demonstrated the effectiveness of early treatment of PTSD and the negative effect that it has on a patient’s physical and psychological recovery. Post-traumatic stress disorder is underrecognized and undertreated; therefore a surgeons’ recognition of risk factors leading to early referral for treatment is important in patient’s physical and psychological recovery. With further validation the TIPPS risk score can be used to make this task easier for surgeons who are already burdened with high workloads.
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
