Multi-branch Convolutional Neural Network for Multiple Sclerosis Lesion Segmentation

In this paper, we present an automated approach for segmenting multiple sclerosis (MS) lesions from multi-modal brain magnetic resonance images. Our method is based on a deep end-to-end 2D convolutional neural network (CNN) for slice-based segmentation of 3D volumetric data. The proposed CNN includes a multi-branch downsampling path, which enables the network to encode information from multiple modalities separately. Multi-scale feature fusion blocks are proposed to combine feature maps from different modalities at different stages of the network. Then, multi-scale feature upsampling blocks are introduced to upsize combined feature maps to leverage information from lesion shape and location. We trained and tested the proposed model using orthogonal plane orientations of each 3D modality to exploit the contextual information in all directions. The proposed pipeline is evaluated on two different datasets: a private dataset including 37 MS patients and a publicly available dataset known as the ISBI 2015 longitudinal MS lesion segmentation challenge dataset, consisting of 14 MS patients. Considering the ISBI challenge, at the time of submission, our method was amongst the top performing solutions. On the private dataset, using the same array of performance metrics as in the ISBI challenge, the proposed approach shows high improvements in MS lesion segmentation compared with other publicly available tools.Comment: This paper has been accepted for publication in NeuroImag

Deep grey matter volumetry as a function of age using a semi-automatic qMRI algorithm

Quantitative Magnetic Resonance has become more and more accepted for clinical trial in many fields. This technique not only can generate qMRI maps (such as T1/T2/PD) but also can be used for further postprocessing including segmentation of brain and characterization of different brain tissue. Another main application of qMRI is to measure the volume of the brain tissue such as the deep Grey Matter (dGM). The deep grey matter serves as the brain's "relay station" which receives and sends inputs between the cortical brain regions. An abnormal volume of the dGM is associated with certain diseases such as Fetal Alcohol Spectrum Disorders (FASD). The goal of this study is to investigate the effect of age on the volume change of the dGM using qMRI. Thirteen patients (mean age= 26.7 years old and age range from 0.5 to 72.5 years old) underwent imaging at a 1.5T MR scanner. Axial images of the entire brain were acquired with the mixed Turbo Spin-echo (mixed -TSE) pulse sequence. The acquired mixed-TSE images were transferred in DICOM format image for further analysis using the MathCAD 2001i software (Mathsoft, Cambridge, MA). Quantitative T1 and T2-weighted MR images were generated. The image data sets were further segmented using the dual-space clustering segmentation. Then volume of the dGM matter was calculated using a pixel counting algorithm and the spectrum of the T1/T2/PD distribution were also generated. Afterwards, the dGM volume of each patient was calculated and plotted on scatter plot. The mean volume of the dGM, standard deviation, and range were also calculated. The result shows that volume of the dGM is 47.5 ±5.3ml (N=13) which is consistent with former studies. The polynomial tendency line generated based on scatter plot shows that the volume of the dGM gradually increases with age at early age and reaches the maximum volume around the age of 20, and then it starts to decrease gradually in adulthood and drops much faster in elderly age. This result may help scientists to understand more about the aging of the brain and it can also be used to compare with the results from former studies using different techniques

Simultaneous lesion and neuroanatomy segmentation in Multiple Sclerosis using deep neural networks

Segmentation of both white matter lesions and deep grey matter structures is an important task in the quantification of magnetic resonance imaging in multiple sclerosis. Typically these tasks are performed separately: in this paper we present a single segmentation solution based on convolutional neural networks (CNNs) for providing fast, reliable segmentations of multimodal magnetic resonance images into lesion classes and normal-appearing grey- and white-matter structures. We show substantial, statistically significant improvements in both Dice coefficient and in lesion-wise specificity and sensitivity, compared to previous approaches, and agreement with individual human raters in the range of human inter-rater variability. The method is trained on data gathered from a single centre: nonetheless, it performs well on data from centres, scanners and field-strengths not represented in the training dataset. A retrospective study found that the classifier successfully identified lesions missed by the human raters. Lesion labels were provided by human raters, while weak labels for other brain structures (including CSF, cortical grey matter, cortical white matter, cerebellum, amygdala, hippocampus, subcortical GM structures and choroid plexus) were provided by Freesurfer 5.3. The segmentations of these structures compared well, not only with Freesurfer 5.3, but also with FSL-First and Freesurfer 6.0