Shallow vs deep learning architectures for white matter lesion segmentation in the early stages of multiple sclerosis

In this work, we present a comparison of a shallow and a deep learning architecture for the automated segmentation of white matter lesions in MR images of multiple sclerosis patients. In particular, we train and test both methods on early stage disease patients, to verify their performance in challenging conditions, more similar to a clinical setting than what is typically provided in multiple sclerosis segmentation challenges. Furthermore, we evaluate a prototype naive combination of the two methods, which refines the final segmentation. All methods were trained on 32 patients, and the evaluation was performed on a pure test set of 73 cases. Results show low lesion-wise false positives (30%) for the deep learning architecture, whereas the shallow architecture yields the best Dice coefficient (63%) and volume difference (19%). Combining both shallow and deep architectures further improves the lesion-wise metrics (69% and 26% lesion-wise true and false positive rate, respectively).Comment: Accepted to the MICCAI 2018 Brain Lesion (BrainLes) worksho

Structure of laponite-styrene precursor dispersions for production of advanced polymer-clay nanocomposites

One method for production of polymer-clay nanocomposites involves dispersal of surface-modified clay in a polymerisable monomeric solvent, followed by fast in situ polymerisation. In order to tailor the properties of the final material we aim to control the dispersion state of the clay in the precursor solvent. Here, we study dispersions of surface-modified Laponite, a synthetic clay, in styrene via large-scale Monte-Carlo simulations and experimentally, using small angle X-ray and static light scattering. By tuning the effective interaction between simulated laponite particles we are able to reproduce the experimental scattering intensity patterns for this system, with good accuracy over a wide range of length scales. However, this agreement could only be obtained by introducing a permanent electrostatic dipole moment into the plane of each Laponite particle, which we explain in terms of the distribution of substituted metal atoms within each Laponite particle. This suggests that Laponite dispersions, and perhaps other clay suspensions, should display some of the structural characteristics of dipolar fluids. Our simulated structures show aggregation regimes ranging from networks of long chains to dense clusters of Laponite particles, and we also obtain some intriguing ‘globular’ clusters, similar to capsids. We see no indication of any ‘house-of-cards’ structures. The simulation that most closely matches experimental results indicates that gel-like networks are obtained in Laponite dispersions, which however appear optically clear and non-sedimenting over extended periods of time. This suggests it could be difficult to obtain truly isotropic equilibrium dispersion as a starting point for synthesis of advanced polymer-clay nanocomposites with controlled structures

Automated Detection of Cortical Lesions in Multiple Sclerosis Patients with 7T MRI

The automated detection of cortical lesions (CLs) in patients with multiple sclerosis (MS) is a challenging task that, despite its clinical relevance, has received very little attention. Accurate detection of the small and scarce lesions requires specialized sequences and high or ultra- high field MRI. For supervised training based on multimodal structural MRI at 7T, two experts generated ground truth segmentation masks of 60 patients with 2014 CLs. We implemented a simplified 3D U-Net with three resolution levels (3D U-Net-). By increasing the complexity of the task (adding brain tissue segmentation), while randomly dropping input channels during training, we improved the performance compared to the baseline. Considering a minimum lesion size of 0.75 μL, we achieved a lesion-wise cortical lesion detection rate of 67% and a false positive rate of 42%. However, 393 (24%) of the lesions reported as false positives were post-hoc confirmed as potential or definite lesions by an expert. This indicates the potential of the proposed method to support experts in the tedious process of CL manual segmentation

Multiple sclerosis cortical and WM lesion segmentation at 3T MRI: a deep learning method based on FLAIR and MP2RAGE.

The presence of cortical lesions in multiple sclerosis patients has emerged as an important biomarker of the disease. They appear in the earliest stages of the illness and have been shown to correlate with the severity of clinical symptoms. However, cortical lesions are hardly visible in conventional magnetic resonance imaging (MRI) at 3T, and thus their automated detection has been so far little explored. In this study, we propose a fully-convolutional deep learning approach, based on the 3D U-Net, for the automated segmentation of cortical and white matter lesions at 3T. For this purpose, we consider a clinically plausible MRI setting consisting of two MRI contrasts only: one conventional T2-weighted sequence (FLAIR), and one specialized T1-weighted sequence (MP2RAGE). We include 90 patients from two different centers with a total of 728 and 3856 gray and white matter lesions, respectively. We show that two reference methods developed for white matter lesion segmentation are inadequate to detect small cortical lesions, whereas our proposed framework is able to achieve a detection rate of 76% for both cortical and white matter lesions with a false positive rate of 29% in comparison to manual segmentation. Further results suggest that our framework generalizes well for both types of lesion in subjects acquired in two hospitals with different scanners

The Combined Quantification and Interpretation of Multiple Quantitative Magnetic Resonance Imaging Metrics Enlightens Longitudinal Changes Compatible with Brain Repair in Relapsing-Remitting Multiple Sclerosis Patients.

Quantitative and semi-quantitative MRI (qMRI) metrics provide complementary specificity and differential sensitivity to pathological brain changes compatible with brain inflammation, degeneration, and repair. Moreover, advanced magnetic resonance imaging (MRI) metrics with overlapping elements amplify the true tissue-related information and limit measurement noise. In this work, we combined multiple advanced MRI parameters to assess focal and diffuse brain changes over 2 years in a group of early-stage relapsing-remitting MS patients. Thirty relapsing-remitting MS patients with less than 5 years disease duration and nine healthy subjects underwent 3T MRI at baseline and after 2 years including T1, T2, T2* relaxometry, and magnetization transfer imaging. To assess longitudinal changes in normal-appearing (NA) tissue and lesions, we used analyses of variance and Bonferroni correction for multiple comparisons. Multivariate linear regression was used to assess the correlation between clinical outcome and multiparametric MRI changes in lesions and NA tissue. In patients, we measured a significant longitudinal decrease of mean T2 relaxation times in NA white matter (p = 0.005) and a decrease of T1 relaxation times in the pallidum (p < 0.05), which are compatible with edema reabsorption and/or iron deposition. No longitudinal changes in qMRI metrics were observed in controls. In MS lesions, we measured a decrease in T1 relaxation time (p-value < 2.2e-16) and a significant increase in MTR (p-value < 1e-6), suggesting repair mechanisms, such as remyelination, increased axonal density, and/or a gliosis. Last, the evolution of advanced MRI metrics-and not changes in lesions or brain volume-were correlated to motor and cognitive tests scores evolution (Adj-R(2) > 0.4, p < 0.05). In summary, the combination of multiple advanced MRI provided evidence of changes compatible with focal and diffuse brain repair at early MS stages as suggested by histopathological studies

Validating atlas-based lesion disconnectomics in multiple sclerosis: A retrospective multi-centric study.

The translational potential of MR-based connectivity modelling is limited by the need for advanced diffusion imaging, which is not part of clinical protocols for many diseases. In addition, where diffusion data is available, brain connectivity analyses rely on tractography algorithms which imply two major limitations. First, tracking algorithms are known to be sensitive to the presence of white matter lesions and therefore leading to interpretation pitfalls and poor inter-subject comparability in clinical applications such as multiple sclerosis. Second, tractography quality is highly dependent on the acquisition parameters of diffusion sequences, leading to a trade-off between acquisition time and tractography precision. Here, we propose an atlas-based approach to study the interplay between structural disconnectivity and lesions without requiring individual diffusion imaging. In a multi-centric setting involving three distinct multiple sclerosis datasets (containing both 1.5 T and 3 T data), we compare our atlas-based structural disconnectome computation pipeline to disconnectomes extracted from individual tractography and explore its clinical utility for reducing the gap between radiological findings and clinical symptoms in multiple sclerosis. Results using topological graph properties showed that overall, our atlas-based disconnectomes were suitable approximations of individual disconnectomes from diffusion imaging. Small-worldness was found to decrease for larger total lesion volumes thereby suggesting a loss of efficiency in brain connectivity of MS patients. Finally, the global efficiency of the created brain graph, combined with total lesion volume, allowed to stratify patients into subgroups with different clinical scores in all three cohorts

Evolution of Cortical and White Matter Lesion Load in Early-Stage Multiple Sclerosis: Correlation With Neuroaxonal Damage and Clinical Changes.

Introduction: Changes in cortical and white matter lesion (CL, WML) load are pivotal metrics to diagnose and monitor multiple sclerosis patients. Yet, the relationship between (i) changes in CL/WML load and disease progression and between (ii) changes in CL/WML load and neurodegeneration at early MS stages is not yet established. In this work, we have assessed the hypothesis that the combined CL and WML load as well as their 2-years evolution are surrogate markers of neurodegeneration and clinical progression at early MS stages. To achieve this goal, we have studied a group of RRMS patients and have investigated the impact of both CL and WML load on neuroaxonal damage as measured by serum neurofilament light chain (sNfL). Next, we have explored whether changes in CL/WML load over 2 years in the same cohort of early-MS are related to motor and cognitive changes. Methods: Thirty-two RRMS patients (<5 years disease duration) underwent: (i) 3T MRI for CL/WML detection and clinical assessment at baseline and 2-years follow-up; and (ii) baseline blood test for sNfL. The correlation between the number and volume of CL/WML and sNfL was assessed by using the Spearman's rank correlation coefficient and a generalized linear model (GLM). A GLM was also used to assess the relationship between (i) the number/volume of new, enlarged, resolved, shrunken, stable lesions and (ii) the difference in clinical scores between two time-points. Results: At baseline, sNfL levels correlated with both total CL count/volume (ρ = 0.6/0.7, Corr-P <0.017/Corr-P < 0.001) and with total WML count/volume (ρ = 0.6/0.6, Corr-P < 0.01 for both). Baseline sNfL levels also correlated with new WML count/volume (ρ = 0.6/0.5, Corr-P < 0.01/Corr-P < 0.05) but not with new CL. Longitudinal changes in CL and WML count and volume were significantly associated with (i) sustained attention, auditory information, processing speed and flexibility (p < 0.01), (ii) verbal memory (p < 0.01); (iii) verbal fluency (p < 0.05); and (iv) hand-motor function (p < 0.05). Discussion: Changes in cortical and white matter focal damage in early MS patients correlate with global neuroaxonal damage and is associated to cognitive performances

Longitudinal automated detection of white-matter and cortical lesions in relapsing-remitting multiple sclerosis

Magnetic Resonance Imaging(MRI) plays an important role for lesion assessment in early stages of Multiple Sclerosis(MS). This work aims at evaluating the performance of an automated tool for MS lesion detection, segmentation and tracking in longitudinal data, only for use in this research study. The method was tested with images acquired using both a "clinical" and an "advanced" imaging protocol for comparison. The validation was conducted in a cohort of thirty-two early MS patients through a ground truth obtained from manual segmentations by a neurologist and a radiologist. The use of the "advanced protocol" significantly improves lesion detection and classification in longitudinal analyses

RimNet: A deep 3D multimodal MRI architecture for paramagnetic rim lesion assessment in multiple sclerosis.

In multiple sclerosis (MS), the presence of a paramagnetic rim at the edge of non-gadolinium-enhancing lesions indicates perilesional chronic inflammation. Patients featuring a higher paramagnetic rim lesion burden tend to have more aggressive disease. The objective of this study was to develop and evaluate a convolutional neural network (CNN) architecture (RimNet) for automated detection of paramagnetic rim lesions in MS employing multiple magnetic resonance (MR) imaging contrasts. Imaging data were acquired at 3 Tesla on three different scanners from two different centers, totaling 124 MS patients, and studied retrospectively. Paramagnetic rim lesion detection was independently assessed by two expert raters on T2*-phase images, yielding 462 rim-positive (rim+) and 4857 rim-negative (rim-) lesions. RimNet was designed using 3D patches centered on candidate lesions in 3D-EPI phase and 3D FLAIR as input to two network branches. The interconnection of branches at both the first network blocks and the last fully connected layers favors the extraction of low and high-level multimodal features, respectively. RimNet's performance was quantitatively evaluated against experts' evaluation from both lesion-wise and patient-wise perspectives. For the latter, patients were categorized based on a clinically relevant threshold of 4 rim+ lesions per patient. The individual prediction capabilities of the images were also explored and compared (DeLong test) by testing a CNN trained with one image as input (unimodal). The unimodal exploration showed the superior performance of 3D-EPI phase and 3D-EPI magnitude images in the rim+/- classification task (AUC = 0.913 and 0.901), compared to the 3D FLAIR (AUC = 0.855, Ps < 0.0001). The proposed multimodal RimNet prototype clearly outperformed the best unimodal approach (AUC = 0.943, P < 0.0001). The sensitivity and specificity achieved by RimNet (70.6% and 94.9%, respectively) are comparable to those of experts at the lesion level. In the patient-wise analysis, RimNet performed with an accuracy of 89.5% and a Dice coefficient (or F1 score) of 83.5%. The proposed prototype showed promising performance, supporting the usage of RimNet for speeding up and standardizing the paramagnetic rim lesions analysis in MS