One-shot domain adaptation in multiple sclerosis lesion segmentation using convolutional neural networks

Automatic lesion segmentation; Convolutional neural networks; Multiple sclerosisSegmentació automàtica de les lesions ; Xarxes neuronals convolucionals; Esclerosi múltipleSegmentación automática de las lesiones ; Redes neuronales convolucionales; Esclerosis múltipleIn recent years, several convolutional neural network (CNN) methods have been proposed for the automated white matter lesion segmentation of multiple sclerosis (MS) patient images, due to their superior performance compared with those of other state-of-the-art methods. However, the accuracies of CNN methods tend to decrease significantly when evaluated on different image domains compared with those used for training, which demonstrates the lack of adaptability of CNNs to unseen imaging data. In this study, we analyzed the effect of intensity domain adaptation on our recently proposed CNN-based MS lesion segmentation method. Given a source model trained on two public MS datasets, we investigated the transferability of the CNN model when applied to other MRI scanners and protocols, evaluating the minimum number of annotated images needed from the new domain and the minimum number of layers needed to re-train to obtain comparable accuracy. Our analysis comprised MS patient data from both a clinical center and the public ISBI2015 challenge database, which permitted us to compare the domain adaptation capability of our model to that of other state-of-the-art methods. In both datasets, our results showed the effectiveness of the proposed model in adapting previously acquired knowledge to new image domains, even when a reduced number of training samples was available in the target dataset. For the ISBI2015 challenge, our one-shot domain adaptation model trained using only a single case showed a performance similar to that of other CNN methods that were fully trained using the entire available training set, yielding a comparable human expert rater performance. We believe that our experiments will encourage the MS community to incorporate its use in different clinical settings with reduced amounts of annotated data. This approach could be meaningful not only in terms of the accuracy in delineating MS lesions but also in the related reductions in time and economic costs derived from manual lesion labeling

Atlas-based segmentation of multiple sclerosis lesions in magnetic resonance imaging

This thesis deals with the segmentation of brain magnetic resonance imaging applied to multiple sclerosis patients. This disease is characterised by the presence of white matter lesions in this image modality. After a thorough analysis of the state-of-the-art on this topic, pointing out the importance of prior knowledge, and a subsequent review of atlas-based segmentation of brain imaging, we propose two different multiple sclerosis lesion segmentation pipelines based on the conclusions of these studies. The first one provides an initial tissue classification using a modified expectation-maximisation algorithm, which is later on refined with a lesion segmentation step based on thresholding and a regionwise false positive reduction approach. The second one focuses only on the segmentation of lesions and uses an ensemble classifier alongside a rich feature pool including image intensities, probabilistic atlas maps, an outlier map and contextual information. Both approaches are tested against a novel database comprising imaging data from three different hospitals with a variable lesion load per case. The evaluation, carried out in a quantitative and qualitative manner, includes a comparison and uses several metrics for detection and segmentation. The analysis of the results points out a better performance relative to state-of-the-art approaches, with a clear improvement on the first pipeline in terms of detection, and a clear improvement on the second pipeline in terms of segmentationAquesta tesi es centra en la segmentació de imatges de ressonància magnètica del cervell aplicada a pacients d'esclerosi múltiple. Aquesta malaltia es caracteritza per l'aparició de lesions de matèria blanca, visibles en aquesta modalitat d'imatge. Després d'un anàlisi exhaustiu de l'estat de l'art en aquest tòpic, remarcant la importància de la informació prèvia, i també de la segmentació basada en atles del cervell, proposem dues estratègies diferents per a la segmentació de lesions basades en les conclusions d'ambdós estudis. La primera proporciona una classificació inicial dels teixits mitjançant una extensió de l'algorisme d'esperança-maximització, que es refina posteriorment amb un procés de segmentació de les lesions basat en una binarització inicial i una conseqüent estratègia de reducció de falsos positius a nivell de regió. La segona proposta es focalitza bàsicament en la segmentació de lesions i utilitza una combinació de classificadors febles entrenats amb un ric conjunt de característiques que inclou imatges d'intensitat, mapes probabilístics provinents d'un atles, un mapa d'intensitats atípiques i informació contextual. Ambdues estratègies han estat provades amb una nova base de dades formada per imatges de tres hospitals diferents amb diferent càrrega lesional per cas. L'avaluació d'aquestes proves, que s'ha dut a terme de forma quantitativa i qualitativa, inclou una comparativa i utilitza diferents mètriques de detecció i segmentació. L'anàlisi d'aquests resultats apunta a un millor rendiment relatiu a l'estat de l'art actual, amb una millor detecció per part de la primera estratègia i una millor segmentació per part de la segon

A pipeline approach with spatial information for segmenting multiple sclerosis lesions on brain magnetic resonance imaging

Conventional magnetic resonance imaging (MRI) techniques are highly sensitive to detect multiple sclerosis (MS) plaques, enabling a quantitative assessment of inflammatory activity and lesion load. In quantitative analysis of focal lesions, manual or semi-automated segmentations have been widely used to compute the total number of lesions and the total lesion volume. These techniques, however, are both challenging and time-consuming, being also prone to intra-observer and inter-observer variability. Our aim is to develop an automated approach to segment brain tissues and MS lesions from brain MRI images. The goal is to reduce the user interaction and to provide an objective tool that eliminates the inter- and intra-observer variability. To this end, and based on the recent methods developed by Souplet et al. 2008 and de Boer et al. 2005, we propose a novel pipeline which includes the following steps: bias correction, skull stripping, atlas registration, tissue classification, and lesion segmentation. After the initial pre-processing steps, a MRI scan is automatically segmented into 4 classes: white matter (WM), grey matter (GM), cerebrospinal fluid (CSF) and partial volume. An expectation maximization method which fits a multivariate Gaussian mixture model to T1-w, T2-w and PD-w images is used for this purpose. Based on the obtained tissue masks and using the estimated GM mean and variance, we apply an intensity threshold to the FLAIR image, which provides the lesion segmentation. With the aim of improving this initial result, spatial information coming from the neighboring tissue labels is used to refine the final lesion segmentation

Evaluating the effects of white matter multiple sclerosis lesions on the volume estimation of 6 brain tissue segmentation methods

BACKGROUND AND PURPOSE: The accuracy of automatic tissue segmentation methods can be affected by the presence of hypointense white matter lesions during the tissue segmentation process. Our aim was to evaluate the impact of MS white matter lesions on the brain tissue measurements of 6 well-known segmentation techniques. These include straightforward techniques such as Artificial Neural Network and fuzzy C-means as well as more advanced techniques such as the Fuzzy And Noise Tolerant Adaptive Segmentation Method, fMRI of the Brain Automated Segmentation Tool, SPM5, and SPM8. MATERIALS AND METHODS: Thirty T1-weighted images from patients with MS from 3 different scanners were segmented twice, first including white matter lesions and then masking the lesions before segmentation and relabeling as WM afterward. The differences in total tissue volume and tissue volume outside the lesion regions were computed between the images by using the 2 methodologies. RESULTS: Total gray matter volume was overestimated by all methods when lesion volume increased. The tissue volume outside the lesion regions was also affected by white matter lesions with differences up to 20 cm3 on images with a high lesion load (≈50 cm3). SPM8 and Fuzzy And Noise Tolerant Adaptive Segmentation Method were the methods less influenced by white matter lesions, whereas the effect of white matter lesions was more prominent on fuzzy C-means and the fMRI of the Brain Automated Segmentation Tool. CONCLUSIONS: Although lesions were removed after segmentation to avoid their impact on tissue segmentation, the methods still overestimated GM tissue in most cases. This finding is especially relevant because on images with high lesion load, this bias will most likely distort actual tissue atrophy measurements