Agreement of MSmetrix with established methods for measuring cross-sectional and longitudinal brain atrophy

Introduction Despite the recognized importance of atrophy in multiple sclerosis (MS), methods for its quantification have been mostly restricted to the research domain. Recently, a CE labelled and FDA approved MS-specific atrophy quantification method, MSmetrix, has become commercially available. Here we perform a validation of MSmetrix against established methods in simulated and in vivo MRI data. Methods Whole-brain and gray matter (GM) volume were measured with the cross-sectional pipeline of MSmetrix and compared to the outcomes of FreeSurfer (cross-sectional pipeline), SIENAX and SPM. For this comparison we investigated 20 simulated brain images, as well as in vivo data from 100 MS patients and 20 matched healthy controls. In fifty of the MS patients a second time point was available. In this subgroup, we additionally analyzed the whole-brain and GM volume change using the longitudinal pipeline of MSmetrix and compared the results with those of FreeSurfer (longitudinal pipeline) and SIENA. Results In the simulated data, SIENAX displayed the smallest average deviation compared with the reference whole-brain volume (+ 19.56 ± 10.34 mL), followed by MSmetrix (− 38.15 ± 17.77 mL), SPM (− 42.99 ± 17.12 mL) and FreeSurfer (− 78.51 ± 12.68 mL). A similar pattern was seen in vivo. Among the cross-sectional methods, Deming regression analyses revealed proportional errors particularly in MSmetrix and SPM. The mean difference percentage brain volume change (PBVC) was lowest between longitudinal MSmetrix and SIENA (+ 0.16 ± 0.91%). A strong proportional error was present between longitudinal percentage gray matter volume change (PGVC) measures of MSmetrix and FreeSurfer (slope = 2.48). All longitudinal methods were sensitive to the MRI hardware upgrade that occurred during the time of the study. Conclusion MSmetrix, FreeSurfer, FSL and SPM show differences in atrophy measurements, even at the whole-brain level, that are large compared to typical atrophy rates observed in MS. Especially striking are the proportional errors between methods. Cross-sectional MSmetrix behaved similarly to SPM, both in terms of mean volume difference as well as proportional error. Longitudinal MSmetrix behaved most similar to SIENA. Our results indicate that brain volume measurement and normalization from T1-weighted images remains an unsolved problem that requires much more attention

Comparing lesion segmentation methods in multiple sclerosis: Input from one manually delineated subject is sufficient for accurate lesion segmentation

PURPOSE: Accurate lesion segmentation is important for measurements of lesion load and atrophy in subjects with multiple sclerosis (MS). International MS lesion challenges show a preference of convolutional neural networks (CNN) strategies, such as nicMSlesions. However, since the software is trained on fairly homogenous training data, we aimed to test the performance of nicMSlesions in an independent dataset with manual and other automatic lesion segmentations to determine whether this method is suitable for larger, multi-center studies. METHODS: Manual lesion segmentation was performed in fourteen subjects with MS on sagittal 3D FLAIR images from a 3T GE whole-body scanner with 8-channel head coil. We compared five different categories of automated lesion segmentation methods for their volumetric and spatial agreement with manual segmentation: (i) unsupervised, untrained (LesionTOADS); (ii) supervised, untrained (LST-LPA and nicMSlesions with default settings); (iii) supervised, untrained with threshold adjustment (LST-LPA optimized for current data); (iv) supervised, trained with leave-one-out cross-validation on fourteen subjects with MS (nicMSlesions and BIANCA); and (v) supervised, trained on a single subject with MS (nicMSlesions). Volumetric accuracy was determined by the intra-class correlation coefficient (ICC) and spatial accuracy by Dice's similarity index (SI). Volumes and SI were compared between methods using repeated measures ANOVA or Friedman tests with post-hoc pairwise comparison. RESULTS: The best volumetric and spatial agreement with manual was obtained with the supervised and trained methods nicMSlesions and BIANCA (ICC absolute agreement > 0.968 and median SI > 0.643) and the worst with the unsupervised, untrained method LesionTOADS (ICC absolute agreement = 0.140 and median SI = 0.444). Agreement with manual in the single-subject network training of nicMSlesions was poor for input with low lesion volumes (i.e. two subjects with lesion volumes ≤ 3.0 ml). For the other twelve subjects, ICC varied from 0.593 to 0.973 and median SI varied from 0.535 to 0.606. In all cases, the single-subject trained nicMSlesions segmentations outperformed LesionTOADS, and in almost all cases it also outperformed LST-LPA. CONCLUSION: Input from only one subject to re-train the deep learning CNN nicMSlesions is sufficient for adequate lesion segmentation, with on average higher volumetric and spatial agreement with manual than obtained with the untrained methods LesionTOADS and LST-LPA

Upper cervical cord atrophy is independent of cervical cord lesion volume in early multiple sclerosis: A two-year longitudinal study

Background: Upper cervical cord atrophy and lesions have been shown to be associated with disease and disability progression already in early relapsing-remitting multiple sclerosis (RRMS). However, their longitudinal relationship remains unclear. Objective: To investigate the cross-sectional and longitudinal relation between focal T2 cervical cord lesion volume (CCLV) and regional and global mean upper cervical cord area (UCCA), and their relations with disability. Methods: Over a two-year interval, subjects with RRMS (n = 36) and healthy controls (HC, n = 16) underwent annual clinical and MRI examinations. UCCA and CCLV were obtained from C1 through C4 level. Linear mixed model analysis was performed to investigate the relation between UCCA, CCLV, and disability over time. Results: UCCA at baseline was significantly lower in RRMS subjects compared to HCs (p = 0.003), but did not decrease faster over time (p ≥ 0.144). UCCA and CCLV were independent of each other at any of the time points or cervical levels, and over time. Lower baseline UCCA, but not CCLV, was related to worsening of both upper and lower extremities function over time. Conclusion: UCCA and CCLV are independent from each other, both cross-sectionally and longitudinally, in early MS. Lower UCCA, but not CCLV, was related to increasing disability over time

Novel imaging phantom for accurate and robust measurement of brain atrophy rates using clinical MRI

Brain volume loss, or atrophy, has been proven to be an important characteristic of neurological diseases such as Alzheimer's disease and multiple sclerosis. To use atrophy rate as a reliable clinical biomarker and to increase statistical power in clinical treatment trials, measurement variability needs to be minimized. Among other sources, systematic differences between different MR scanners are suspected to contribute to this variability. In this study we developed and performed initial validation tests of an MR-compatible phantom and analysis software for robust and reliable evaluation of the brain volume loss. The phantom contained three inflatable models of brain structures, i.e. cerebral hemisphere, putamen, and caudate nucleus. Software to reliably quantify volumes form the phantom images was also developed. To validate the method, the phantom was imaged using 3D T1-weighted protocols at three clinical 3T MR scanners from different vendors. Calculated volume change from MRI was compared with the known applied volume change using ICC and mean absolute difference. As assessed by the ICC, the agreement between our developed software and the applied volume change for different structures ranged from 0.999-1 for hemisphere, 0.976-0.998 for putamen, and 0.985-0.999 for caudate nucleus. The mean absolute differences between measured and applied volume change were 109-332 μL for hemisphere, 2.9-11.9 μL for putamen, and 2.2-10.1 μL for caudate nucleus. This method offers a reliable and robust measurement of volume change using MR images and could potentially be used to standardize clinical measurement of atrophy rates

Opportunities for Understanding MS Mechanisms and Progression With MRI Using Large-Scale Data Sharing and Artificial Intelligence

Multiple sclerosis (MS) patients have heterogeneous clinical presentations, symptoms and progression over time, making MS difficult to assess and comprehend in vivo. The combination of large-scale data-sharing and artificial intelligence creates new opportunities for monitoring and understanding MS using magnetic resonance imaging (MRI).First, development of validated MS-specific image analysis methods can be boosted by verified reference, test and benchmark imaging data. Using detailed expert annotations, artificial intelligence algorithms can be trained on such MS-specific data. Second, understanding disease processes could be greatly advanced through shared data of large MS cohorts with clinical, demographic and treatment information. Relevant patterns in such data that may be imperceptible to a human observer could be detected through artificial intelligence techniques. This applies from image analysis (lesions, atrophy or functional network changes) to large multi-domain datasets (imaging, cognition, clinical disability, genetics, etc.).After reviewing data-sharing and artificial intelligence, this paper highlights three areas that offer strong opportunities for making advances in the next few years: crowdsourcing, personal data protection, and organized analysis challenges. Difficulties as well as specific recommendations to overcome them are discussed, in order to best leverage data sharing and artificial intelligence to improve image analysis, imaging and the understanding of MS