8 research outputs found
One-shot domain adaptation in multiple sclerosis lesion segmentation using convolutional neural networks
In recent years, several convolutional neural network (CNN) methods have been
proposed for the automated white matter lesion segmentation of multiple
sclerosis (MS) patient images, due to their superior performance compared with
those of other state-of-the-art methods. However, the accuracies of CNN methods
tend to decrease significantly when evaluated on different image domains
compared with those used for training, which demonstrates the lack of
adaptability of CNNs to unseen imaging data. In this study, we analyzed the
effect of intensity domain adaptation on our recently proposed CNN-based MS
lesion segmentation method. Given a source model trained on two public MS
datasets, we investigated the transferability of the CNN model when applied to
other MRI scanners and protocols, evaluating the minimum number of annotated
images needed from the new domain and the minimum number of layers needed to
re-train to obtain comparable accuracy. Our analysis comprised MS patient data
from both a clinical center and the public ISBI2015 challenge database, which
permitted us to compare the domain adaptation capability of our model to that
of other state-of-the-art methods. For the ISBI2015 challenge, our one-shot
domain adaptation model trained using only a single image showed a performance
similar to that of other CNN methods that were fully trained using the entire
available training set, yielding a comparable human expert rater performance.
We believe that our experiments will encourage the MS community to incorporate
its use in different clinical settings with reduced amounts of annotated data.
This approach could be meaningful not only in terms of the accuracy in
delineating MS lesions but also in the related reductions in time and economic
costs derived from manual lesion labeling
Multi-branch Convolutional Neural Network for Multiple Sclerosis Lesion Segmentation
In this paper, we present an automated approach for segmenting multiple
sclerosis (MS) lesions from multi-modal brain magnetic resonance images. Our
method is based on a deep end-to-end 2D convolutional neural network (CNN) for
slice-based segmentation of 3D volumetric data. The proposed CNN includes a
multi-branch downsampling path, which enables the network to encode information
from multiple modalities separately. Multi-scale feature fusion blocks are
proposed to combine feature maps from different modalities at different stages
of the network. Then, multi-scale feature upsampling blocks are introduced to
upsize combined feature maps to leverage information from lesion shape and
location. We trained and tested the proposed model using orthogonal plane
orientations of each 3D modality to exploit the contextual information in all
directions. The proposed pipeline is evaluated on two different datasets: a
private dataset including 37 MS patients and a publicly available dataset known
as the ISBI 2015 longitudinal MS lesion segmentation challenge dataset,
consisting of 14 MS patients. Considering the ISBI challenge, at the time of
submission, our method was amongst the top performing solutions. On the private
dataset, using the same array of performance metrics as in the ISBI challenge,
the proposed approach shows high improvements in MS lesion segmentation
compared with other publicly available tools.Comment: This paper has been accepted for publication in NeuroImag
One-shot domain adaptation in multiple sclerosis lesion segmentation using convolutional neural networks
Automatic lesion segmentation; Convolutional neural networks; Multiple sclerosisSegmentació automà tica de les lesions ; Xarxes neuronals convolucionals; Esclerosi múltipleSegmentación automática de las lesiones ; Redes neuronales convolucionales; Esclerosis múltipleIn recent years, several convolutional neural network (CNN) methods have been proposed for the automated white matter lesion segmentation of multiple sclerosis (MS) patient images, due to their superior performance compared with those of other state-of-the-art methods. However, the accuracies of CNN methods tend to decrease significantly when evaluated on different image domains compared with those used for training, which demonstrates the lack of adaptability of CNNs to unseen imaging data. In this study, we analyzed the effect of intensity domain adaptation on our recently proposed CNN-based MS lesion segmentation method. Given a source model trained on two public MS datasets, we investigated the transferability of the CNN model when applied to other MRI scanners and protocols, evaluating the minimum number of annotated images needed from the new domain and the minimum number of layers needed to re-train to obtain comparable accuracy. Our analysis comprised MS patient data from both a clinical center and the public ISBI2015 challenge database, which permitted us to compare the domain adaptation capability of our model to that of other state-of-the-art methods. In both datasets, our results showed the effectiveness of the proposed model in adapting previously acquired knowledge to new image domains, even when a reduced number of training samples was available in the target dataset. For the ISBI2015 challenge, our one-shot domain adaptation model trained using only a single case showed a performance similar to that of other CNN methods that were fully trained using the entire available training set, yielding a comparable human expert rater performance. We believe that our experiments will encourage the MS community to incorporate its use in different clinical settings with reduced amounts of annotated data. This approach could be meaningful not only in terms of the accuracy in delineating MS lesions but also in the related reductions in time and economic costs derived from manual lesion labeling