Abstract
Background
We aimed to identify factors associated with a significant reduction in SLE disease activity over 12 months assessed by the BILAG Index.
Methods
In an international SLE cohort, we studied patients from their ‘inception enrolment’ visit. We also defined an ‘active disease’ cohort of patients who had active disease similar to that needed for enrolment into clinical trials. Outcomes at 12 months were; Major Clinical Response (MCR: reduction to classic BILAG C in all domains, steroid dose of ≤7.5 mg and SLEDAI ≤ 4) and ‘Improvement’ (reduction to ≤1B score in previously active organs; no new BILAG A/B; stable or reduced steroid dose; no increase in SLEDAI). Univariate and multivariate logistic regression with Least Absolute Shrinkage and Selection Operator (LASSO) and cross-validation in randomly split samples were used to build prediction models.
Results
‘Inception enrolment’ (n = 1492) and ‘active disease’ (n = 924) patients were studied. Models for MCR performed well (ROC AUC = .777 and .732 in the inception enrolment and active disease cohorts, respectively). Models for Improvement performed poorly (ROC AUC = .574 in the active disease cohort). MCR in both cohorts was associated with anti-malarial use and inversely associated with active disease at baseline (BILAG or SLEDAI) scores, BILAG haematological A/B scores, higher steroid dose and immunosuppressive use.
Conclusion
Baseline predictors of response in SLE can help identify patients in clinic who are less likely to respond to standard therapy. They are also important as stratification factors when designing clinical trials in order to better standardize overall usual care response rates.
Background
Systemic Lupus Erythematosus (SLE) is a complex, multisystem autoimmune disease, associated with significant morbidity and mortality which carries a high socio-economic burden.1–4 Most therapies used are off-label and the efficacy of each is limited. 5 Several novel therapies are in development, however, optimal and cost-effective positioning of these in the drug treatment pathway poses major challenges. Precision medicine aims to identify patient endotypes that respond particularly well to a specific therapy and will be a vital step forward in the era of novel targeted therapies. The natural history of SLE is however also important to consider. Studying patients who respond well to current standard of care (SOC) will help to identify common (public) markers of an overall good outcome. These need to be understood and accounted for when assessing treatment-specific (private) response markers.
MASTERPLANS is an MRC-funded Precision Medicine consortium aiming to identify predictors of treatment response in SLE. Our consortium employed a series of BILAG-based definitions of Improvement and Major Clinical Response (MCR) to provide consistent outcome assessments across cohorts and trial populations.
Our hypothesis is that there are certain factors associated with improvement in SLE disease activity over time, in the setting of ‘usual care’. Using data from the Systemic Lupus International Collaborating Clinics (SLICC) Inception Cohort, we aimed to identify predictors of clinical response in an international SLE cohort. We also aimed to identify predictors of response in a subset of patients who had a level of disease activity similar to that required for entry into a clinical trial.
Methods
SLICC Inception Cohort
SLE patients were recruited into the SLICC Inception Cohort from 31 centres across Europe, Asia, North and Central America, from 1999 to 2011. Patients were recruited within 15 months of confirming ≥4 SLE ACR 1997 Updated classification criteria 6 and assessed at their local centre on an annual basis. Disease activity was recorded using the British Isles Lupus Assessment Group (BILAG) ‘classic’ index7,8 and the SLE Disease Activity Index 2000 (SLEDAI-2K). 9 The BILAG index is the principle scoring system used across the MASTERPLANS consortium studies.10,11 At each visit, patients also had organ damage assessed using the SLICC/American College of Rheumatology Damage Index(SDI). 12 In addition, information on therapy, demographic data, co-morbidities and routine laboratory tests were obtained. This The SLICC Inception Cohort study was approved by the University Health Network Research Institute research ethics committee, Toronto, Canada, and by the Institutional Research Ethics Boards of all participating centres in accordance with the Declaration of Helsinki’s guidelines for research in humans. All patients provided informed consent.
Outcomes
Across the MASTERPLANS consortium, two outcomes based on the BILAG ‘classic’ instrument were defined which reflect clinically meaningful reductions in disease activity,11,13 namely; 1) Major Clinical Response (MCR) was defined using the following criteria at 12 months following the index visit: a)Reduction in BILAG A and B scores to BILAG C, D or E in all domains b)Daily prednisolone (or prednisone or equivalent) dose of 7.5 mg or less c)SLEDAI-2K score of four or less 2) Improvement was defined using the following criteria at 12 months following the index visit: a)Reduction in BILAG A or B scores to no more than one BILAG B in previously active organ domains and no new BILAG organ domains (A or B score) involved. b)Reduced or stable prednisolone (or prednisone or equivalent) use, defined as: •Dose ≥ 20 mg at recruitment becomes ≤ 15 mg/day • Dose 10–20 mg at recruitment becomes ≤ 10 mg/day • Dose < 10 mg at recruitment dose not increase/day c)No increase in SLEDAI-2K score
Patient cohorts studied
From the SLICC Cohort, we identified two cohorts for analysis:
Inception enrolment visit cohort
All patients were assessed at their initial baseline visit. We examined the rates and predictors of achieving MCR at 12 months. We did not assess ‘improvement’ in this cohort as many patients did not have sufficiently active disease at cohort entry.
‘Active Disease’ cohort
We also identified from the whole SLICC cohort patients who had active disease, comparable to that used as entry criteria in many clinical trials. For each patient, we identified the first visit at which they had a minimum of one BILAG A or two BILAG B scores. This was defined at the index visit in the Active Disease cohort. In this subset, we examined the rates and predictors of achieving MCR and improvement at 12 months following the index visit.
Predictors of MCR or improvement
A number of potential predictive factors at the baseline visit were selected on the basis of evidence from other studies that have examined prognostic markers in SLE as well as their availability in the SLICC cohort. Predictors included were: 1. Demographics • Gender • Age at SLE diagnosis • Disease duration at baseline • Ethnicity/race • Location • Any post-secondary education (Yes/No) 2. Medication at baseline • Oral average prednisolone or equivalent dose (high dose >30 mg daily, medium dose 7.5–30 mg daily, low dose < 7.5 mg daily) • Pulse steroid use (Yes/No) • Anti-malarial use (Yes/No) • Immunosuppressant use (Yes/No) • Individual immunosuppressant and biologics agents) 3. Number of A or B scores in BILAG Index, the SLEDAI-2K and SDI scores at baseline 4. BILAG score A or B in individual organ systems 5. Presence of elevated anti-dsDNA antibodies (as defined by local laboratory parameters) 6. Presence of hypocomplementaemia (C3 and/or C4) (as defined by local laboratory parameters) 7. Presence of anti-phospholipid antibodies at enrolment
14
8. Co-morbidities: hypertension and diabetes mellitus 9. Lifestyle: alcohol consumption (units per week) and smoking status (current, previous and never) 10.SF-36: Mental Component and Physical Component Summary Scores (MCS and PCS)
15
Statistical analysis
Multivariate logistic regressions with shrinkage estimators, that is, least absolute shrinkage and selection operator (LASSO) and elastic net, were used to build multivariate prediction models. 16 Ten-fold cross-validation with 300 times of repeated random splitting was used; in total, 3000 prediction models were built. Each model used a training subsample of the data (9 folds in a specific data split), where the tuning parameters of LASSO and elastic net were selected by cross-validation. Predicted probabilities for the testing samples in the remaining fold were calculated. The predicted probabilities were then averaged across 300 replications (due to repeated random splitting) to generate a final predicted probability for each sample. The prediction performance of the models was summarized by area under Receiver Operating Characteristic (ROC) curves (AUC). We ranked the predictors by their frequencies of being chosen by LASSO among the 3000 models to provide an indication of the importance of the predictors. Additionally, random forests were used to check if there were interactions and non-linearity among the variables selected by LASSO in more than 50% of the fitted models. 17 Univariate logistic regression models were used to calculate the odd ratios of identified predictors to show the direction and strength of the associations. The analysis was conducted using SAS University edition and R (version 3.6.3).
Results
Characteristics of inception patient cohort with and without BILAG disease activity assessments available at the enrolment visit.
NB: For alcohol consumption, median and lower quartile are 0.
aAssays performed in Oklahoma Medical Research Foundation Laboratories of the late Dr Morris Reichlin (Dr JT Merrill): Lupus Anticoagulant assay performed using reagents from Rainbow Scientific, Windsor, CT. ELISA assays for anti-cardiolipin and anti-B2GPI used a cut-point as positive as >2 SD above the mean of 60 healthy controls. 14
Predictors of major clinical response at 12 months in the inception enrolment visit cohort
A total of 1469 patients were analysed of whom 412 (28%) met MCR at 12 months; 103 (7%) who had missing 12-months data could not be classified. Variable selection for factors that may contribute to prediction of MCR was performed using two shrinkage estimators (LASSO and elastic net) and both yielded similar results. Results for LASSO had an Area Under the Curve (AUC) = .777. Using the random forest approach with predictors that were selected by LASSO, we found a similar AUC (.773). Variables selected by LASSO in more than 50% of the prediction models were taken forward into logistic models to individually examine the strength and direction of associations of the chosen predictors.
Univariate odds ratios for predictors of major clinical response (selected by LASSO in 50% of the prediction models) in the inception enrolment visit cohort.
Predictors of MCR in an ‘Active Disease’ cohort
Characteristics of the active disease cohort at the first visit where the patients satisfied the active disease criteria (at least 1 A or 2 B in BILAG scores).
aFor alcohol consumption median, lower and upper quartile are all 0.
b8 Assays performed in Oklahoma Medical Research Foundation Laboratories of the late Dr Morris Reichlin (Dr JT Merrill): Lupus Anticoagulant assay performed using reagents from Rainbow Scientific, Windsor, CT. ELISA assays for anti-cardiolipin and anti-B2GPI used a cut-point as positive as >2SD above the mean of 60 healthy controls. 14
cFor oral prednisolone or equivalent dose, if study entry-criteria met at enrolment then average prednisolone or equivalent dose for the current course is stated and if study entry-criteria met at a follow-up visit then average prednisolone or equivalent dose since the last visit is stated.
Univariate odds ratios for predictors of major clinical response (selected by LASSO in 50% of the prediction models) in the active disease cohort.
Predictors of improvement in an active disease cohort
Univariate odds ratios for predictors of improvement (selected by LASSO in 50% of the prediction models) in the active disease cohort.
Summary of predictors associated with a lower or higher probability of achieving MCR in both the inception enrolment cohort and the active disease cohorts.
Discussion
Designing successful clinical trials in SLE remains a major challenge. It is also difficult to develop a precision medicine approach to position such new and existing treatments optimally in the clinic. To date, little is known about predictors of response/non-response to specific agents used to treat SLE. 18 Certain factors (public factors) are not specific to a single agent, rather, they are more markers of likelihood of clinical response in general. 19 Knowledge of such factors is needed to improve stratification/minimisation factors in trials and to improve predictive models for novel SLE therapies.
We assessed predictors of improvement and MCR in a large international lupus inception cohort recruited and managed in their individual centres according to local standards of care. We studied patients at cohort entry and, for the first time, we also identified a subset with active disease of a level similar to that which qualifies for entry to a clinical trial. This latter cohort simulated a trial population and widens the generalizability of our results.
For MCR, in both the inception cohort and the active disease cohort, similar factors predicted MCR and both models performed well with AUC of .777 and .732, respectively. Several factors identified in the inception enrolment visit group were not seen in the active disease subgroup. This may reflect, in part, limited numbers in the latter analysis (114/759 active vs 412/1469 patients at enrolment). Interestingly, the model for improvement contained similar factors but performed much less well (AUC = .574). Our definition of improvement reflects smaller changes in disease activity over time and may be less specific when considering clinical and biological determinants of outcomes compared to the more stringently defined MCR state.
Previous work from our group has also shown differences in outcomes according to race/ethnicity and location in SLE patients.20,21 In the current analysis, patients of African ancestry were less likely to achieve an MCR response in the inception cohort, and those of both African ancestry and Hispanic race/ethnicity were less likely to achieve improvement in the active disease cohort. This likely reflects the more aggressive disease and adverse clinical outcomes in these populations. 19 Interestingly, SLE patients in Europe were more likely to achieve MCR in the inception enrolment cohort. European location may represent a combination of environmental factors such as reduced exposure to sunlight, infections, environmental pollutants and occupational exposure, all of which have been implicated in the etiology and pathogenesis of SLE. 22 Moreover, the differences in provision of healthcare in the relevant countries in each location may also have influenced disease outcomes. Such differences are important to bear in mind in clinical practice as well as when designing and interpreting clinical trials. A number of trials have observed less marked differences in outcomes in European populations23–25 which also may reflect differences in baseline severity of disease and wider use of SOC medications in such patients.
We found a consistent negative association between achieving improvement and MCR in patients with higher disease activity (using both BILAG and SLEDAI). It has been noted in a number of clinical trials that higher disease activity is less likely to elicit a response in the SOC group and our data supports that observation. 26 The non-linear association with SLEDAI in the improvement group also suggests that higher levels of disease activity have a much stronger impact on the inability to achieve improvement with usual therapy. Taken together, these observations support the view that clinical trials of novel agents should recruit patients with higher levels of disease activity to provide better discrimination between active novel therapies and usual standard of care. 27 In routine clinical practice, it also emphasizes the challenges in getting patients with higher disease activity to low disease activity ‘states’ using conventional therapies.
Patients with pre-existing damage also have a lower likelihood of achieving MCR in the inception cohort. Evidence suggests that patients with higher disease activity are more likely to develop future damage.28,29 The presence of damage may, also reflect a more severe disease course that is less likely to respond to SOC. Whether damage may also confound the assessment of disease activity in large trials cannot be excluded.
HCQ is the anti-malarial most commonly used in the treatment of SLE and is effective in the reduction of disease flares, steroid dose
Our study has a number of limitations. We did not have a validation set in which to confirm our findings. However, we observed important similarities between predictors of MCR in the inception enrolment cohort and in the subset of patients in the active disease cohort. Other studies assessing different but similar ‘states’ such as Lupus Low Disease Activity and remission have found similar factors linked to those outcomes,38–41 providing some external validation of our findings. The need for further validation is also emphasized by our observations regarding smoking and alcohol consumption being associated with MCR in the inception cohort only. While these may be chance findings, others have found that moderate alcohol consumption may have a protective ‘anti-inflammatory’ in other autoimmune diseases such as rheumatoid arthritis. 42 The classic BILAG index was used in our study due to the availability of long-term classic BILAG data from 1999. Our findings will also need validating using the BILAG-2004 index, albeit the latter is also based on similar concepts to define A and B disease activity. In addition to HCQ, adherence is also an issue with other medications used in SLE and we did not have objective data on drug levels on which to comprehensively assess treatment adherence in this cohort. Finally, we recognize that we were only able to assess disease activity at the next annual review (12-month time-point) and so we will have missed fluctuations in disease activity that may have occurred within the 1-year period and before recruitment to the inception cohort. The active disease cohort analysis was however designed to mimic the typical ‘landmark’ analyses in most clinical trials and so does generalize to that situation. Moreover, the 12-month visit was not necessarily when immunosuppressant treatment was changed or steroid dose increased, and dosing was at the discretion of the physician. Patients could have therapies adjusted at any time during the study and we did not analyse whether they were still on the same therapy when response was assessed, as our aim was to assess the phenotype of responders rather than response to specific therapies. Future work will assess if these factors also predict more sustained achievement of such a state over several visits and not just at a single landmark time-point.
We have found a number of baseline factors associated with Improvement and Major Clinical Response over a 12-month period in SLE patients. Race/ethnicity and location all predict overall responses and patients with a higher burden of active disease, pre-existing damage and already taking immunosuppressive therapy were less likely to achieve a Major Clinical Response over 12 months on standard of care. In contrast, anti-malarial use predicted better responses. In the clinic, these factors help identify patients less likely to respond to standard therapies and provide additional evidence to emphasize ongoing adherence to anti-malarials to patients. Such factors are also important to consider as stratification factors, when designing clinical trials or precision medicine studies. Assessing and adjusting these factors when recruiting to clinical trials may help control ‘noise’ in the SOC arm and improve the likelihood of any effective new therapy to have a signal of response.
Lay summary
Little is known about factors that predict which patients with Systemic Lupus Erythematosus (SLE) respond well to usual treatments; such information is important when we design studies of new treatments for SLE. We used data from a large international SLE patient population to identify factors associated with a significant reduction in disease activity, regardless of treatment administered. Patients were divided into two groups: an ‘active disease’ group, where patients had disease activity similar to that usually required for entry into clinical trials, and an ‘inception enrolment visit’ group, where patients were assessed regardless of their initial level of disease activity.
We assessed patients who had a response (improvement) or a major response at 12 months. A total of 1492 patients were studied in the inception enrolment visit group and 924 in the ‘active disease’ group. We found a number of factors associated with a major response in both the inception enrolment and the active disease groups. A higher probability of major response was associated with anti-malarial use. A lower probability was seen in patients with higher overall disease activity as well as those where their blood cells were affected by SLE. Patients were also less likely to have a major response if they were already taking higher doses of steroids or taking immunosuppressive drugs at baseline.
All of these factors are important to consider when patients are being assessed in clinic as they help identify patients more or less likely to respond to standard therapies. When designing clinical trials in SLE, these factors also need to be balanced between the groups to improve the chances that a new drug might be shown to be effective.
Supplemental Material
Supplemental Material - Predictors of British Isles Lupus Assessment Group-based outcomes in patients with systemic lupus erythematosus: Analysis from the Systemic Lupus International Collaborating Clinics Inception Cohort
Supplemental Material for Predictors of British Isles Lupus Assessment Group-based outcomes in patients with systemic lupus erythematosus: Analysis from the Systemic Lupus International Collaborating Clinics Inception Cohort by Trixy David, Li Su, Yafeng Cheng, Caroline Gordon, Benjamin Parker, David Isenberg, John A Reynolds, Ian N Bruce, on behalf of the Systemic Lupus International Collaborating Clinics Consortium and MASTERPLANS Consortium in Lupus.
Footnotes
Declaration of conflicting interests
The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: INB has received grant support from GSK, Roche, Janssen, Astra Zeneca and UCB; consulting fees from AstraZeneca, Eli Lilly, GSK, Merck Serono and UCB; and was a speaker for AstraZeneca, GSK and UCB. CG has received personal fees for honoraria from consultancy work from the Centre for Disease Control, Astra-Zeneca, MGP, Sanofi and UCB, personal fees for speaker’s bureau from UCB, and an educational grant from UCB to Sandwell and West Birmingham Hospitals NHS Trust that have supported her research work. LS has received personal fees for statistical consultation for Nemysis Ltd. BP has received personal fees for honoraria from Roche, Astra-Zeneca, Abbvie, GSK, UCB, Fesenius Kabi, Lilly. YC: nil. TD: nil. JR: nil. DI: nil.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was funded by the Medical Research Council, grant MR/M01665X/1 “Maximizing SLE Therapeutic Potential by Application of Novel and Systemic Approaches (MASTERPLANS). INB is a National Institute for Health Research (NIHR) Senior Investigator Emeritus and is funded by the NIHR Manchester Biomedical Research Centre (NIHR203308). BP is supported by the NIHR Manchester Biomedical Research Centre (NIHR203308) and NIHR Manchester Clinical Research Facility (NIHR203956). The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.
Authors note
For the purpose of open access, the author has applied a Creative Commons Attribution (CC BY) licence to any Author Accepted Manuscript version arising from this submission.
The SLICC Consortium members are: John G. Hanly MD; Sang-Cheol Bae MD PhD MPH; Juanita Romero-Diaz MD MSc; Jorge Sanchez-Guerrero MD MSc; Sasha Bernatsky MD PhD; Ann E. Clarke MD MSc; Daniel J Wallace MD; Anisur Rahman MD PhD; Joan T. Merrill MD; Paul R. Fortin MD MPH; Dafna D. Gladman MD; Murray B. Urowitz MD; Michelle Petri MD MPH; Ellen M. Ginzler MD MPH; M.A. Dooley MD MPH; Rosalind Ramsey-Goldman MD DrPH; Susan Manzi MD MPH; Andreas Jonsen MD PhD; Graciela S. Alarcón MD MPH; Ronald F. van Vollenhoven MD; Cynthia Aranow MD; Meggan Mackay MD; Guillermo Ruiz-Irastorza MD; S. Sam Lim MD MPH; Murat Inanc MD; Kenneth C. Kalunian MD; Soren Jacobsen MD DMSc; Christine A. Peschken MD; Diane L. Kamen MD; Anca Askanase MD MPH.
The MASTERPLANS Consortium Members are: Ian N Bruce; Katherine Payne; Mark Lunt; Niels Peek; Nophar Geifman; Sean Gavan; Gillian Armitt; Patrick Doherty; Jennifer Prattley; Narges Azadbakht; Angela Papazian; Helen Le Sueur; Carmen Farrelly; Clare Richardson; Zunnaira Shabbir; Lauren Hewitt; Neil McHugh; Caroline Gordon; John Reynolds; Stephen Young; David Jayne; Vern Farewell; Li Su; Matthew Pickering; Elizabeth Lightstone; Alyssa Gilmore; Marina Botto; Timothy Vyse; David Lester Morris; D. D’Cruz; Edward Vital; Miriam Wittmann; Paul Emery; Michael Beresford; Christian Hedrich; Angela Midgley; Jenna Gritzfeld; Michael Ehrenstein; David Isenberg; Mariea Parvaz.
The MASTERPLANS Patient and Public Involvement Group members are: Jane Dunnage; Jane Batchelor; E. Holland; Pauline Upsall.
Correction (August 2023):
Article updated online to correct the consortium name to “Systemic Lupus International Collaborating Clinics (SLICC) Consortium” in the affiliations.
Supplemental Material
Supplemental material for this article is available online.
Appendix
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
