Longitudinal machine learning modeling of MS patient trajectories improves predictions of disability progression

Background and Objectives: Research in Multiple Sclerosis (MS) has recently focused on extracting knowledge from real-world clinical data sources. This type of data is more abundant than data produced during clinical trials and potentially more informative about real-world clinical practice. However, this comes at the cost of less curated and controlled data sets. In this work we aim to predict disability progression by optimally extracting information from longitudinal patient data in the real-world setting, with a special focus on the sporadic sampling problem. Methods: We use machine learning methods suited for patient trajectories modeling, such as recurrent neural networks and tensor factorization. A subset of 6682 patients from the MSBase registry is used. Results: We can predict disability progression of patients in a two-year horizon with an ROC-AUC of 0.85, which represents a 32% decrease in the ranking pair error (1-AUC) compared to reference methods using static clinical features. Conclusions: Compared to the models available in the literature, this work uses the most complete patient history for MS disease progression prediction and represents a step forward towards AI-assisted precision medicine in MS

Persistence on therapy and propensity matched outcome comparison of two subcutaneous interferon beta 1a dosages for multiple sclerosis

To compare treatment persistence between two dosages of interferon β-1a in a large observational multiple sclerosis registry and assess disease outcomes of first line MS treatment at these dosages using propensity scoring to adjust for baseline imbalance in disease characteristics. Treatment discontinuations were evaluated in all patients within the MSBase registry who commenced interferon β-1a SC thrice weekly (n = 4678). Furthermore, we assessed 2-year clinical outcomes in 1220 patients treated with interferon β-1a in either dosage (22 µg or 44 µg) as their first disease modifying agent, matched on propensity score calculated from pre-treatment demographic and clinical variables. A subgroup analysis was performed on 456 matched patients who also had baseline MRI variables recorded. Overall, 4054 treatment discontinuations were recorded in 3059 patients. The patients receiving the lower interferon dosage were more likely to discontinue treatment than those with the higher dosage (25% vs. 20% annual probability of discontinuation, respectively). This was seen in discontinuations with reasons recorded as “lack of efficacy” (3.3% vs. 1.7%), “scheduled stop” (2.2% vs. 1.3%) or without the reason recorded (16.7% vs. 13.3% annual discontinuation rate, 22 µg vs. 44 µg dosage, respectively). Propensity score was determined by treating centre and disability (score without MRI parameters) or centre, sex and number of contrast-enhancing lesions (score including MRI parameters). No differences in clinical outcomes at two years (relapse rate, time relapse-free and disability) were observed between the matched patients treated with either of the interferon dosages. Treatment discontinuations were more common in interferon β-1a 22 µg SC thrice weekly. However, 2-year clinical outcomes did not differ between patients receiving the different dosages, thus replicating in a registry dataset derived from “real-world” database the results of the pivotal randomised trial. Propensity score matching effectively minimised baseline covariate imbalance between two directly compared sub-populations from a large observational registry

Country, Sex, EDSS Change and Therapy Choice Independently Predict Treatment Discontinuation in Multiple Sclerosis and Clinically Isolated Syndrome

We conducted a prospective study, MSBASIS, to assess factors leading to first treatment discontinuation in patients with a clinically isolated syndrome (CIS) and early relapsing-remitting multiple sclerosis (RRMS). The MSBASIS Study, conducted by MSBase Study Group members, enrols patients seen from CIS onset, reporting baseline demographics, cerebral magnetic resonance imaging (MRI) features and Expanded Disability Status Scale (EDSS) scores. Follow-up visits report relapses, EDSS scores, and the start and end dates of MS-specific therapies. We performed a multivariable survival analysis to determine factors within this dataset that predict first treatment discontinuation. A total of 2314 CIS patients from 44 centres were followed for a median of 2.7 years, during which time 1247 commenced immunomodulatory drug (IMD) treatment. Ninety percent initiated IMD after a diagnosis of MS was confirmed, and 10% while still in CIS status. Over 40% of these patients stopped their first IMD during the observation period. Females were more likely to cease medication than males (HR 1.36, p = 0.003). Patients treated in Australia were twice as likely to cease their first IMD than patients treated in Spain (HR 1.98, p = 0.001). Increasing EDSS was associated with higher rate of IMD cessation (HR 1.21 per EDSS unit, p<0.001), and intramuscular interferon-β-1a (HR 1.38, p = 0.028) and subcutaneous interferon-β-1a (HR 1.45, p = 0.012) had higher rates of discontinuation than glatiramer acetate, although this varied widely in different countries. Onset cerebral MRI features, age, time to treatment initiation or relapse on treatment were not associated with IMD cessation. In this multivariable survival analysis, female sex, country of residence, EDSS change and IMD choice independently predicted time to first IMD cessation

Association of Initial Disease-Modifying Therapy With Later Conversion to Secondary Progressive Multiple Sclerosis.

IMPORTANCE: Within 2 decades of onset, 80% of untreated patients with relapsing-remitting multiple sclerosis (MS) convert to a phase of irreversible disability accrual termed secondary progressive MS. The association between disease-modifying treatments (DMTs), and this conversion has rarely been studied and never using a validated definition. OBJECTIVE: To determine the association between the use, the type of, and the timing of DMTs with the risk of conversion to secondary progressive MS diagnosed with a validated definition. DESIGN, SETTING, AND PARTICIPANTS: Cohort study with prospective data from 68 neurology centers in 21 countries examining patients with relapsing-remitting MS commencing DMTs (or clinical monitoring) between 1988-2012 with minimum 4 years' follow-up. EXPOSURES: The use, type, and timing of the following DMTs: interferon beta, glatiramer acetate, fingolimod, natalizumab, or alemtuzumab. After propensity-score matching, 1555 patients were included (last follow-up, February 14, 2017). MAIN OUTCOME AND MEASURE: Conversion to objectively defined secondary progressive MS. RESULTS: Of the 1555 patients, 1123 were female (mean baseline age, 35 years [SD, 10]). Patients initially treated with glatiramer acetate or interferon beta had a lower hazard of conversion to secondary progressive MS than matched untreated patients (HR, 0.71; 95% CI, 0.61-0.81; P < .001; 5-year absolute risk, 12% [49 of 407] vs 27% [58 of 213]; median follow-up, 7.6 years [IQR, 5.8-9.6]), as did fingolimod (HR, 0.37; 95% CI, 0.22-0.62; P < .001; 5-year absolute risk, 7% [6 of 85] vs 32% [56 of 174]; median follow-up, 4.5 years [IQR, 4.3-5.1]); natalizumab (HR, 0.61; 95% CI, 0.43-0.86; P = .005; 5-year absolute risk, 19% [16 of 82] vs 38% [62 of 164]; median follow-up, 4.9 years [IQR, 4.4-5.8]); and alemtuzumab (HR, 0.52; 95% CI, 0.32-0.85; P = .009; 5-year absolute risk, 10% [4 of 44] vs 25% [23 of 92]; median follow-up, 7.4 years [IQR, 6.0-8.6]). Initial treatment with fingolimod, alemtuzumab, or natalizumab was associated with a lower risk of conversion than initial treatment with glatiramer acetate or interferon beta (HR, 0.66; 95% CI, 0.44-0.99; P = .046); 5-year absolute risk, 7% [16 of 235] vs 12% [46 of 380]; median follow-up, 5.8 years [IQR, 4.7-8.0]). The probability of conversion was lower when glatiramer acetate or interferon beta was started within 5 years of disease onset vs later (HR, 0.77; 95% CI, 0.61-0.98; P = .03; 5-year absolute risk, 3% [4 of 120] vs 6% [2 of 38]; median follow-up, 13.4 years [IQR, 11-18.1]). When glatiramer acetate or interferon beta were escalated to fingolimod, alemtuzumab, or natalizumab within 5 years vs later, the HR was 0.76 (95% CI, 0.66-0.88; P < .001; 5-year absolute risk, 8% [25 of 307] vs 14% [46 of 331], median follow-up, 5.3 years [IQR], 4.6-6.1). CONCLUSIONS AND RELEVANCE: Among patients with relapsing-remitting MS, initial treatment with fingolimod, alemtuzumab, or natalizumab was associated with a lower risk of conversion to secondary progressive MS vs initial treatment with glatiramer acetate or interferon beta. These findings, considered along with these therapies' risks, may help inform decisions about DMT selection.This study was financially supported by National Health and Medical Research Council of Australia (fellowships 1140766 and 1080518, project grants 1129189 and 1083539), the University of Melbourne (Faculty of Medicine, Dentistry and Health Sciences research fellowship), a Next Generation Fellowship funded by the Grand Charity of the Freemason’s (recipient JWLB), and the MSBase 2017 Fellowship (recipient JWLB). Alemtuzumab studies done in Cambridge were supported by the NIHR Cambridge Biomedical Research Centre and the MS Society UK

Comparative effectiveness of autologous hematopoietic stem cell transplant vs fingolimod, natalizumab, and ocrelizumab in highly active relapsing-remitting multiple sclerosis

Importance: Autologous hematopoietic stem cell transplant (AHSCT) is available for treatment of highly active multiple sclerosis (MS). Objective: To compare the effectiveness of AHSCT vs fingolimod, natalizumab, and ocrelizumab in relapsing-remitting MS by emulating pairwise trials. Design, Setting, and Participants: This comparative treatment effectiveness study included 6 specialist MS centers with AHSCT programs and international MSBase registry between 2006 and 2021. The study included patients with relapsing-remitting MS treated with AHSCT, fingolimod, natalizumab, or ocrelizumab with 2 or more years study follow-up including 2 or more disability assessments. Patients were matched on a propensity score derived from clinical and demographic characteristics. Exposure: AHSCT vs fingolimod, natalizumab, or ocrelizumab. Main outcomes: Pairwise-censored groups were compared on annualized relapse rates (ARR) and freedom from relapses and 6-month confirmed Expanded Disability Status Scale (EDSS) score worsening and improvement. Results: Of 4915 individuals, 167 were treated with AHSCT; 2558, fingolimod; 1490, natalizumab; and 700, ocrelizumab. The prematch AHSCT cohort was younger and with greater disability than the fingolimod, natalizumab, and ocrelizumab cohorts; the matched groups were closely aligned. The proportion of women ranged from 65% to 70%, and the mean (SD) age ranged from 35.3 (9.4) to 37.1 (10.6) years. The mean (SD) disease duration ranged from 7.9 (5.6) to 8.7 (5.4) years, EDSS score ranged from 3.5 (1.6) to 3.9 (1.9), and frequency of relapses ranged from 0.77 (0.94) to 0.86 (0.89) in the preceding year. Compared with the fingolimod group (769 [30.0%]), AHSCT (144 [86.2%]) was associated with fewer relapses (ARR: mean [SD], 0.09 [0.30] vs 0.20 [0.44]), similar risk of disability worsening (hazard ratio [HR], 1.70; 95% CI, 0.91-3.17), and higher chance of disability improvement (HR, 2.70; 95% CI, 1.71-4.26) over 5 years. Compared with natalizumab (730 [49.0%]), AHSCT (146 [87.4%]) was associated with marginally lower ARR (mean [SD], 0.08 [0.31] vs 0.10 [0.34]), similar risk of disability worsening (HR, 1.06; 95% CI, 0.54-2.09), and higher chance of disability improvement (HR, 2.68; 95% CI, 1.72-4.18) over 5 years. AHSCT (110 [65.9%]) and ocrelizumab (343 [49.0%]) were associated with similar ARR (mean [SD], 0.09 [0.34] vs 0.06 [0.32]), disability worsening (HR, 1.77; 95% CI, 0.61-5.08), and disability improvement (HR, 1.37; 95% CI, 0.66-2.82) over 3 years. AHSCT-related mortality occurred in 1 of 159 patients (0.6%). Conclusion: In this study, the association of AHSCT with preventing relapses and facilitating recovery from disability was considerably superior to fingolimod and marginally superior to natalizumab. This study did not find evidence for difference in the effectiveness of AHSCT and ocrelizumab over a shorter available follow-up time

The Multiple Sclerosis Severity Score (MSSS) re-examined: EDSS rank stability in the MSBase dataset increases five years after onset of multiple sclerosis

Background: The Global Multiple Sclerosis Severity Score (MSSS) was devised as a comparative multiple sclerosis (MS) population disability assessment tool, to allow comparisons of relative disease severity at all EDSS levels for a given disease duration, using a single clinical assessment at a single point in time. It has been validated for use comparing disease progression in groups of patients but not in the clinical setting on an individual basis. Objective: To assess the stability of MSS scores in the MSBase dataset, a large multi-centre cohort study. Methods: Data was extracted on 4th of April 2008 from all centres with more than fifty cases. All cases satisfied the Poser criteria for definite MS or the McDonald criteria for MS. The duration of disease was categorized into 4 time periods: “0 year duration” being the 0-2.5 year interval, “5 year duration” being the 2.5-7.5 year interval, “10 year duration” being the 7.5-12.5 year interval and “15 year duration” being the 12.5-15 year interval. Cases with EDSS scores spanning the intervals 0-5 years, 5-10 years and 10 –15 years from disease onset were analysed. Cases were ranked within each interval and MSSS stability was assessed using Spearman rank-sum correlations and as the proportion of patients remaining within 15% of their original rank. Results: The dataset comprised 6100 cases and 38,683 complete EDSS scores from 25 clinical centres in 20 countries. Mean EDSS scores were 2.02 at 0 years, 2.67 at 5 years, 3.15 at 10 years and 3.49 at 15 years. Table 1 records number of cases, mean change in EDSS and Spearman rank-sum correlation between MSSS over the three time intervals. 58.3% of patients remained within 15% of their original MSSS in the 0-5 year interval, increasing to 68.8% in the 5-10 year interval and to 76.5% in the 10-15 year interval. Figure 1 demonstrates the change in rank of EDSS scores at 0 and 5 years, 5 and 10 years and 10 and 15 years.Conclusions: We have demonstrated an increasing rank correlation between median EDSS scores at 0 and 5 years (r=0.66), 5 and 10 years (r=0.80) and 10 and 15 years (r=0.88). We suggest that increasing rank stability is most likely due to less relapse and non-relapse related fluctuations of neurological signs detected in clinical examination with increasing disease duration. This study confirms the validity of the MSSS as a 5-year severity rank predictor in individual patients with MS in a clinical setting, particularly from 5 year disease duration onwards. Individual prognostic value is likely to be highest for individuals whose EDSS scores are less than 1.5 or greater than 2.5 at the time of assessment

Comparative Effectiveness and Cost-Effectiveness of Natalizumab and Fingolimod in Patients with Inadequate Response to Disease-Modifying Therapies in Relapsing-Remitting Multiple Sclerosis in the United Kingdom

Background: Patients with highly active relapsing-remitting multiple sclerosis inadequately responding to first-line therapies (interferon-based therapies, glatiramer acetate, dimethyl fumarate, and teriflunomide, known collectively as “BRACETD”) often switch to natalizumab or fingolimod. Objective: The aim was to estimate the comparative effectiveness of switching to natalizumab or fingolimod or within BRACETD using real-world data and to evaluate the cost-effectiveness of switching to natalizumab versus fingolimod using a United Kingdom (UK) third-party payer perspective. Methods: Real-world data were obtained from MSBase for patients relapsing on BRACETD in the year before switching to natalizumab or fingolimod or within BRACETD. Three-way-multinomial-propensity-score–matched cohorts were identified, and comparisons between treatment groups were conducted for annualised relapse rate (ARR) and 6-month–confirmed disability worsening (CDW6M) and improvement (CDI6M). Results were applied in a cost-effectiveness model over a lifetime horizon using a published Markov structure with health states based on the Expanded Disability Status Scale. Other model parameters were obtained from the UK MS Survey 2015, published literature, and publicly available UK sources. Results: The MSBase analysis found a significant reduction in ARR (rate ratio [RR]&nbsp;=&nbsp;0.64; 95% confidence interval [CI] 0.57–0.72; p&nbsp;&lt;&nbsp;0.001) and an increase in CDI6M (hazard ratio [HR]&nbsp;=&nbsp;1.67; 95% CI 1.30–2.15; p&nbsp;&lt;&nbsp;0.001) for switching to natalizumab compared with BRACETD. For switching to fingolimod, the reduction in ARR (RR&nbsp;=&nbsp;0.91; 95% CI 0.81–1.03; p&nbsp;=&nbsp;0.133) and increase in CDI6M (HR&nbsp;=&nbsp;1.30; 95% CI 0.99–1.72; p&nbsp;=&nbsp;0.058) compared with BRACETD were not significant. Switching to natalizumab was associated with a significant reduction in ARR (RR&nbsp;=&nbsp;0.70; 95% CI 0.62–0.79; p&nbsp;&lt;&nbsp;0.001) and an increase in CDI6M (HR&nbsp;=&nbsp;1.28; 95% CI 1.01–1.62; p&nbsp;=&nbsp;0.040) compared to switching to fingolimod. No evidence of difference in CDW6M was found between treatment groups. Natalizumab dominated (higher quality-adjusted life-years [QALYs] and lower costs) fingolimod in the base-case cost-effectiveness analysis (0.453 higher QALYs and £20,843 lower costs per patient). Results were consistent across sensitivity analyses. Conclusions: This novel real-world analysis suggests a clinical benefit for therapy escalation to natalizumab versus fingolimod based on comparative effectiveness results, translating to higher QALYs and lower costs for UK patients inadequately responding to BRACETD