Deep Neural Network with l2-norm Unit for Brain Lesions Detection

Automated brain lesions detection is an important and very challenging clinical diagnostic task because the lesions have different sizes, shapes, contrasts, and locations. Deep Learning recently has shown promising progress in many application fields, which motivates us to apply this technology for such important problem. In this paper, we propose a novel and end-to-end trainable approach for brain lesions classification and detection by using deep Convolutional Neural Network (CNN). In order to investigate the applicability, we applied our approach on several brain diseases including high and low-grade glioma tumor, ischemic stroke, Alzheimer diseases, by which the brain Magnetic Resonance Images (MRI) have been applied as an input for the analysis. We proposed a new operating unit which receives features from several projections of a subset units of the bottom layer and computes a normalized l2-norm for next layer. We evaluated the proposed approach on two different CNN architectures and number of popular benchmark datasets. The experimental results demonstrate the superior ability of the proposed approach.Comment: Accepted for presentation in ICONIP-201

Uncovering convolutional neural network decisions for diagnosing multiple sclerosis on conventional MRI using layer-wise relevance propagation

Machine learning-based imaging diagnostics has recently reached or even superseded the level of clinical experts in several clinical domains. However, classification decisions of a trained machine learning system are typically non-transparent, a major hindrance for clinical integration, error tracking or knowledge discovery. In this study, we present a transparent deep learning framework relying on convolutional neural networks (CNNs) and layer-wise relevance propagation (LRP) for diagnosing multiple sclerosis (MS). MS is commonly diagnosed utilizing a combination of clinical presentation and conventional magnetic resonance imaging (MRI), specifically the occurrence and presentation of white matter lesions in T2-weighted images. We hypothesized that using LRP in a naive predictive model would enable us to uncover relevant image features that a trained CNN uses for decision-making. Since imaging markers in MS are well-established this would enable us to validate the respective CNN model. First, we pre-trained a CNN on MRI data from the Alzheimer's Disease Neuroimaging Initiative (n = 921), afterwards specializing the CNN to discriminate between MS patients and healthy controls (n = 147). Using LRP, we then produced a heatmap for each subject in the holdout set depicting the voxel-wise relevance for a particular classification decision. The resulting CNN model resulted in a balanced accuracy of 87.04% and an area under the curve of 96.08% in a receiver operating characteristic curve. The subsequent LRP visualization revealed that the CNN model focuses indeed on individual lesions, but also incorporates additional information such as lesion location, non-lesional white matter or gray matter areas such as the thalamus, which are established conventional and advanced MRI markers in MS. We conclude that LRP and the proposed framework have the capability to make diagnostic decisions of..

Applications of Deep Learning Techniques for Automated Multiple Sclerosis Detection Using Magnetic Resonance Imaging: A Review

Multiple Sclerosis (MS) is a type of brain disease which causes visual, sensory, and motor problems for people with a detrimental effect on the functioning of the nervous system. In order to diagnose MS, multiple screening methods have been proposed so far; among them, magnetic resonance imaging (MRI) has received considerable attention among physicians. MRI modalities provide physicians with fundamental information about the structure and function of the brain, which is crucial for the rapid diagnosis of MS lesions. Diagnosing MS using MRI is time-consuming, tedious, and prone to manual errors. Research on the implementation of computer aided diagnosis system (CADS) based on artificial intelligence (AI) to diagnose MS involves conventional machine learning and deep learning (DL) methods. In conventional machine learning, feature extraction, feature selection, and classification steps are carried out by using trial and error; on the contrary, these steps in DL are based on deep layers whose values are automatically learn. In this paper, a complete review of automated MS diagnosis methods performed using DL techniques with MRI neuroimaging modalities is provided. Initially, the steps involved in various CADS proposed using MRI modalities and DL techniques for MS diagnosis are investigated. The important preprocessing techniques employed in various works are analyzed. Most of the published papers on MS diagnosis using MRI modalities and DL are presented. The most significant challenges facing and future direction of automated diagnosis of MS using MRI modalities and DL techniques are also provided

DeepLesionBrain: Towards a broader deep-learning generalization for multiple sclerosis lesion segmentation

Recently, segmentation methods based on Convolutional Neural Networks (CNNs) showed promising performance in automatic Multiple Sclerosis (MS) lesions segmentation. These techniques have even outperformed human experts in controlled evaluation conditions such as Longitudinal MS Lesion Segmentation Challenge (ISBI Challenge). However state-of-the-art approaches trained to perform well on highly-controlled datasets fail to generalize on clinical data from unseen datasets. Instead of proposing another improvement of the segmentation accuracy, we propose a novel method robust to domain shift and performing well on unseen datasets, called DeepLesionBrain (DLB). This generalization property results from three main contributions. First, DLB is based on a large group of compact 3D CNNs. This spatially distributed strategy ensures a robust prediction despite the risk of generalization failure of some individual networks. Second, DLB includes a new image quality data augmentation to reduce dependency to training data specificity (e.g., acquisition protocol). Finally, to learn a more generalizable representation of MS lesions, we propose a hierarchical specialization learning (HSL). HSL is performed by pre-training a generic network over the whole brain, before using its weights as initialization to locally specialized networks. By this end, DLB learns both generic features extracted at global image level and specific features extracted at local image level. DLB generalization was validated in cross-dataset experiments on MSSEG'16, ISBI challenge, and in-house datasets. During experiments, DLB showed higher segmentation accuracy, better segmentation consistency and greater generalization performance compared to state-of-the-art methods. Therefore, DLB offers a robust framework well-suited for clinical practice

A Survey on Deep Learning in Medical Image Analysis

Deep learning algorithms, in particular convolutional networks, have rapidly become a methodology of choice for analyzing medical images. This paper reviews the major deep learning concepts pertinent to medical image analysis and summarizes over 300 contributions to the field, most of which appeared in the last year. We survey the use of deep learning for image classification, object detection, segmentation, registration, and other tasks and provide concise overviews of studies per application area. Open challenges and directions for future research are discussed.Comment: Revised survey includes expanded discussion section and reworked introductory section on common deep architectures. Added missed papers from before Feb 1st 201

Automated detection of brain abnormalities in neonatal hypoxia ischemic injury from MR images.

We compared the efficacy of three automated brain injury detection methods, namely symmetry-integrated region growing (SIRG), hierarchical region splitting (HRS) and modified watershed segmentation (MWS) in human and animal magnetic resonance imaging (MRI) datasets for the detection of hypoxic ischemic injuries (HIIs). Diffusion weighted imaging (DWI, 1.5T) data from neonatal arterial ischemic stroke (AIS) patients, as well as T2-weighted imaging (T2WI, 11.7T, 4.7T) at seven different time-points (1, 4, 7, 10, 17, 24 and 31 days post HII) in rat-pup model of hypoxic ischemic injury were used to assess the temporal efficacy of our computational approaches. Sensitivity, specificity, and similarity were used as performance metrics based on manual ('gold standard') injury detection to quantify comparisons. When compared to the manual gold standard, automated injury location results from SIRG performed the best in 62% of the data, while 29% for HRS and 9% for MWS. Injury severity detection revealed that SIRG performed the best in 67% cases while 33% for HRS. Prior information is required by HRS and MWS, but not by SIRG. However, SIRG is sensitive to parameter-tuning, while HRS and MWS are not. Among these methods, SIRG performs the best in detecting lesion volumes; HRS is the most robust, while MWS lags behind in both respects

Regional hippocampal vulnerability in early multiple sclerosis: a dynamic pathological spreading from dentate gyrus to CA1

"This is the peer reviewed version of the following article: Planche, V., Koubiyr, I., Romero, J. E., Manjon, J. V., Coupé, P., Deloire, M., ... & Tourdias, T. (2018). Regional hippocampal vulnerability in early multiple sclerosis: Dynamic pathological spreading from dentate gyrus to CA 1. Human brain mapping, 39(4), 1814-1824., which has been published in final form at https://doi.org/10.1002/hbm.23970. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving."[EN] Background: Whether hippocampal subfields are differentially vulnerable at the earliest stages of multiple sclerosis (MS) and how this impacts memory performance is a current topic of debate. Method: We prospectively included 56 persons with clinically isolated syndrome (CIS) suggestive of MS in a 1-year longitudinal study, together with 55 matched healthy controls at baseline. Participants were tested for memory performance and scanned with 3T MRI to assess the volume of 5 distinct hippocampal subfields using automatic segmentation techniques. Results: At baseline, CA4/dentate gyrus was the only hippocampal subfield with a volume significantly smaller than controls (p < .01). After one year, CA4/dentate gyrus atrophy worsened (-6.4%, p < .0001) and significant CA1 atrophy appeared (both in the stratum-pyramidale and the stratum radiatum-lacunosum-moleculare, -5.6%, p < .001 and -6.2%, p < .01, respectively). CA4/dentate gyrus volume at baseline predicted CA1 volume one year after CIS (R-2 = 0.44 to 0.47, p < .001, with age, T2 lesion-load, and global brain atrophy as covariates). The volume of CA4/dentate gyrus at baseline was associated with MS diagnosis during follow-up, independently of T2-lesion load and demographic variables (p < .05). Whereas CA4/dentate gyrus volume was not correlated with memory scores at baseline, CA1 atrophy was an independent correlate of episodic verbal memory performance one year after CIS (beta = 0.87, p < .05). Conclusion: The hippocampal degenerative process spread from dentate gyrus to CA1 at the earliest stage of MS. This dynamic vulnerability is associated with MS diagnosis after CIS and will ultimately impact hippocampal-dependent memory performance.ARSEP Foundation; Bordeaux University Hospital; TEVA Laboratories; French Agence Nationale de la Recherche, Grant/Award Numbers: ANR-10-LABX-57, ANR-10-LABX-43, ANR-10-IDEX-03-02, ANR-10-COHO-002; UPV, Grant/Award Numbers: UPV2016-0099, TIN2013-43457-R; Ministerio de Economia y competitividadPlanche, V.; Koubiyr, I.; Romero Gómez, JE.; Manjón Herrera, JV.; Coupe, P.; Deloire, M.; Dousset, V.... (2018). Regional hippocampal vulnerability in early multiple sclerosis: a dynamic pathological spreading from dentate gyrus to CA1. Human Brain Mapping. 39(4):1814-1824. https://doi.org/10.1002/hbm.23970S18141824394Avants, B. B., Tustison, N. J., Song, G., Cook, P. A., Klein, A., & Gee, J. C. (2011). A reproducible evaluation of ANTs similarity metric performance in brain image registration. NeuroImage, 54(3), 2033-2044. doi:10.1016/j.neuroimage.2010.09.025Bakker, A., Kirwan, C. B., Miller, M., & Stark, C. E. L. (2008). Pattern Separation in the Human Hippocampal CA3 and Dentate Gyrus. Science, 319(5870), 1640-1642. doi:10.1126/science.1152882Coupé, P., Manjón, J. V., Chamberland, M., Descoteaux, M., & Hiba, B. (2013). Collaborative patch-based super-resolution for diffusion-weighted images. NeuroImage, 83, 245-261. doi:10.1016/j.neuroimage.2013.06.030De Stefano, N., Airas, L., Grigoriadis, N., Mattle, H. P., O’Riordan, J., Oreja-Guevara, C., … Kieseier, B. C. (2014). Clinical Relevance of Brain Volume Measures in Multiple Sclerosis. CNS Drugs, 28(2), 147-156. doi:10.1007/s40263-014-0140-zDu, A. T., Schuff, N., Kramer, J. H., Ganzer, S., Zhu, X. P., Jagust, W. J., … Weiner, M. W. (2004). Higher atrophy rate of entorhinal cortex than hippocampus in AD. Neurology, 62(3), 422-427. doi:10.1212/01.wnl.0000106462.72282.90Dutta, R., Chang, A., Doud, M. K., Kidd, G. J., Ribaudo, M. V., Young, E. A., … Trapp, B. D. (2011). Demyelination causes synaptic alterations in hippocampi from multiple sclerosis patients. Annals of Neurology, 69(3), 445-454. doi:10.1002/ana.22337De Flores, R., La Joie, R., & Chételat, G. (2015). Structural imaging of hippocampal subfields in healthy aging and Alzheimer’s disease. Neuroscience, 309, 29-50. doi:10.1016/j.neuroscience.2015.08.033Fraser, M. A., Shaw, M. E., & Cherbuin, N. (2015). A systematic review and meta-analysis of longitudinal hippocampal atrophy in healthy human ageing. NeuroImage, 112, 364-374. doi:10.1016/j.neuroimage.2015.03.035Frisoni, G. B., Ganzola, R., Canu, E., Rub, U., Pizzini, F. B., Alessandrini, F., … Thompson, P. M. (2008). Mapping local hippocampal changes in Alzheimer’s disease and normal ageing with MRI at 3 Tesla. Brain, 131(12), 3266-3276. doi:10.1093/brain/awn280Gold, S. M., Kern, K. C., O’Connor, M.-F., Montag, M. J., Kim, A., Yoo, Y. S., … Sicotte, N. L. (2010). Smaller Cornu Ammonis 2–3/Dentate Gyrus Volumes and Elevated Cortisol in Multiple Sclerosis Patients with Depressive Symptoms. Biological Psychiatry, 68(6), 553-559. doi:10.1016/j.biopsych.2010.04.025Habbas, S., Santello, M., Becker, D., Stubbe, H., Zappia, G., Liaudet, N., … Volterra, A. (2015). Neuroinflammatory TNFα Impairs Memory via Astrocyte Signaling. Cell, 163(7), 1730-1741. doi:10.1016/j.cell.2015.11.023Hulst, H. E., Schoonheim, M. M., Van Geest, Q., Uitdehaag, B. M., Barkhof, F., & Geurts, J. J. (2015). Memory impairment in multiple sclerosis: Relevance of hippocampal activation and hippocampal connectivity. Multiple Sclerosis Journal, 21(13), 1705-1712. doi:10.1177/1352458514567727Jack, C. R., Petersen, R. C., Xu, Y., O’Brien, P. C., Smith, G. E., Ivnik, R. J., … Kokmen, E. (2000). Rates of hippocampal atrophy correlate with change in clinical status in aging and AD. Neurology, 55(4), 484-490. doi:10.1212/wnl.55.4.484Jack, C. R., Barkhof, F., Bernstein, M. A., Cantillon, M., Cole, P. E., DeCarli, C., … Foster, N. L. (2011). Steps to standardization and validation of hippocampal volumetry as a biomarker in clinical trials and diagnostic criterion for Alzheimer’s disease. Alzheimer’s & Dementia, 7(4), 474-485.e4. doi:10.1016/j.jalz.2011.04.007Kerchner, G. A., Bernstein, J. D., Fenesy, M. C., Deutsch, G. K., Saranathan, M., Zeineh, M. M., & Rutt, B. K. (2013). Shared Vulnerability of Two Synaptically-Connected Medial Temporal Lobe Areas to Age and Cognitive Decline: A Seven Tesla Magnetic Resonance Imaging Study. Journal of Neuroscience, 33(42), 16666-16672. doi:10.1523/jneurosci.1915-13.2013La Joie, R., Fouquet, M., Mézenge, F., Landeau, B., Villain, N., Mevel, K., … Chételat, G. (2010). Differential effect of age on hippocampal subfields assessed using a new high-resolution 3T MR sequence. NeuroImage, 53(2), 506-514. doi:10.1016/j.neuroimage.2010.06.024Longoni, G., Rocca, M. A., Pagani, E., Riccitelli, G. C., Colombo, B., Rodegher, M., … Filippi, M. (2013). Deficits in memory and visuospatial learning correlate with regional hippocampal atrophy in MS. Brain Structure and Function, 220(1), 435-444. doi:10.1007/s00429-013-0665-9Manjón, J. V., & Coupé, P. (2016). volBrain: An Online MRI Brain Volumetry System. Frontiers in Neuroinformatics, 10. doi:10.3389/fninf.2016.00030Manjón, J. V., Coupé, P., Martí-Bonmatí, L., Collins, D. L., & Robles, M. (2009). Adaptive non-local means denoising of MR images with spatially varying noise levels. Journal of Magnetic Resonance Imaging, 31(1), 192-203. doi:10.1002/jmri.22003Manjón, J. V., Eskildsen, S. F., Coupé, P., Romero, J. E., Collins, D. L., & Robles, M. (2014). Nonlocal Intracranial Cavity Extraction. International Journal of Biomedical Imaging, 2014, 1-11. doi:10.1155/2014/820205Maruszak, A., & Thuret, S. (2014). Why looking at the whole hippocampus is not enough—a critical role for anteroposterior axis, subfield and activation analyses to enhance predictive value of hippocampal changes for Alzheimer’s disease diagnosis. Frontiers in Cellular Neuroscience, 8. doi:10.3389/fncel.2014.00095Miller, D. H., Chard, D. T., & Ciccarelli, O. (2012). Clinically isolated syndromes. The Lancet Neurology, 11(2), 157-169. doi:10.1016/s1474-4422(11)70274-5Morra, J. H., Tu, Z., Apostolova, L. G., Green, A. E., Avedissian, C., … Madsen, S. K. (2009). Automated 3D mapping of hippocampal atrophy and its clinical correlates in 400 subjects with Alzheimer’s disease, mild cognitive impairment, and elderly controls. Human Brain Mapping, 30(9), 2766-2788. doi:10.1002/hbm.20708Ny�l, L. G., & Udupa, J. K. (1999). On standardizing the MR image intensity scale. Magnetic Resonance in Medicine, 42(6), 1072-1081. doi:10.1002/(sici)1522-2594(199912)42:63.0.co;2-mPapadopoulos, D., Dukes, S., Patel, R., Nicholas, R., Vora, A., & Reynolds, R. (2009). Substantial Archaeocortical Atrophy and Neuronal Loss in Multiple Sclerosis. Brain Pathology, 19(2), 238-253. doi:10.1111/j.1750-3639.2008.00177.xPérez-Miralles, F., Sastre-Garriga, J., Tintoré, M., Arrambide, G., Nos, C., Perkal, H., … Montalban, X. (2013). Clinical impact of early brain atrophy in clinically isolated syndromes. Multiple Sclerosis Journal, 19(14), 1878-1886. doi:10.1177/1352458513488231Planche, V., Ruet, A., Coupé, P., Lamargue-Hamel, D., Deloire, M., Pereira, B., … Tourdias, T. (2016). Hippocampal microstructural damage correlates with memory impairment in clinically isolated syndrome suggestive of multiple sclerosis. Multiple Sclerosis Journal, 23(9), 1214-1224. doi:10.1177/1352458516675750Planche, V., Panatier, A., Hiba, B., Ducourneau, E.-G., Raffard, G., Dubourdieu, N., … Tourdias, T. (2017). Selective dentate gyrus disruption causes memory impairment at the early stage of experimental multiple sclerosis. Brain, Behavior, and Immunity, 60, 240-254. doi:10.1016/j.bbi.2016.11.010Planche, V., Ruet, A., Charré-Morin, J., Deloire, M., Brochet, B., & Tourdias, T. (2017). Pattern separation performance is decreased in patients with early multiple sclerosis. Brain and Behavior, 7(8), e00739. doi:10.1002/brb3.739Polman, C. H., Reingold, S. C., Banwell, B., Clanet, M., Cohen, J. A., Filippi, M., … Wolinsky, J. S. (2011). Diagnostic criteria for multiple sclerosis: 2010 Revisions to the McDonald criteria. Annals of Neurology, 69(2), 292-302. doi:10.1002/ana.22366Rocca, M. A., Longoni, G., Pagani, E., Boffa, G., Colombo, B., Rodegher, M., … Filippi, M. (2015). In vivo evidence of hippocampal dentate gyrus expansion in multiple sclerosis. Human Brain Mapping, 36(11), 4702-4713. doi:10.1002/hbm.22946Romero, J. E., Coupe, P., & Manjón, J. V. (2016). High Resolution Hippocampus Subfield Segmentation Using Multispectral Multiatlas Patch-Based Label Fusion. Lecture Notes in Computer Science, 117-124. doi:10.1007/978-3-319-47118-1_15Romero, J. E., Coupé, P., & Manjón, J. V. (2017). HIPS: A new hippocampus subfield segmentation method. NeuroImage, 163, 286-295. doi:10.1016/j.neuroimage.2017.09.049Schmidt, P., Gaser, C., Arsic, M., Buck, D., Förschler, A., Berthele, A., … Mühlau, M. (2012). An automated tool for detection of FLAIR-hyperintense white-matter lesions in Multiple Sclerosis. NeuroImage, 59(4), 3774-3783. doi:10.1016/j.neuroimage.2011.11.032Sicotte, N. L., Kern, K. C., Giesser, B. S., Arshanapalli, A., Schultz, A., Montag, M., … Bookheimer, S. Y. (2008). Regional hippocampal atrophy in multiple sclerosis. Brain, 131(4), 1134-1141. doi:10.1093/brain/awn030Small, S. A. (2014). Isolating Pathogenic Mechanisms Embedded within the Hippocampal Circuit through Regional Vulnerability. Neuron, 84(1), 32-39. doi:10.1016/j.neuron.2014.08.030Stark, S. M., Yassa, M. A., Lacy, J. W., & Stark, C. E. L. (2013). A task to assess behavioral pattern separation (BPS) in humans: Data from healthy aging and mild cognitive impairment. Neuropsychologia, 51(12), 2442-2449. doi:10.1016/j.neuropsychologia.2012.12.014Thompson, P. M., Hayashi, K. M., de Zubicaray, G. I., Janke, A. L., Rose, S. E., Semple, J., … Toga, A. W. (2004). Mapping hippocampal and ventricular change in Alzheimer disease. NeuroImage, 22(4), 1754-1766. doi:10.1016/j.neuroimage.2004.03.040Tustison, N. J., Avants, B. B., Cook, P. A., Yuanjie Zheng, Egan, A., Yushkevich, P. A., & Gee, J. C. (2010). N4ITK: Improved N3 Bias Correction. IEEE Transactions on Medical Imaging, 29(6), 1310-1320. doi:10.1109/tmi.2010.2046908Wang, L., Swank, J. S., Glick, I. E., Gado, M. H., Miller, M. I., Morris, J. C., & Csernansky, J. G. (2003). Changes in hippocampal volume and shape across time distinguish dementia of the Alzheimer type from healthy aging☆. NeuroImage, 20(2), 667-682. doi:10.1016/s1053-8119(03)00361-6West, M. ., Coleman, P. ., Flood, D. ., & Troncoso, J. . (1994). Differences in the pattern of hippocampal neuronal loss in normal ageing and Alzheimer’s disease. The Lancet, 344(8925), 769-772. doi:10.1016/s0140-6736(94)92338-8Winterburn, J. L., Pruessner, J. C., Chavez, S., Schira, M. M., Lobaugh, N. J., Voineskos, A. N., & Chakravarty, M. M. (2013). A novel in vivo atlas of human hippocampal subfields using high-resolution 3T magnetic resonance imaging. NeuroImage, 74, 254-265. doi:10.1016/j.neuroimage.2013.02.003Wisse, L. E. M., Daugherty, A. M., Olsen, R. K., Berron, D., Carr, V. A., … Stark, C. E. L. (2016). A harmonized segmentation protocol for hippocampal and parahippocampal subregions: Why do we need one and what are the key goals? Hippocampus, 27(1), 3-11. doi:10.1002/hipo.22671Yushkevich, P. A., Amaral, R. S. C., Augustinack, J. C., Bender, A. R., Bernstein, J. D., Boccardi, M., … Zeineh, M. M. (2015). Quantitative comparison of 21 protocols for labeling hippocampal subfields and parahippocampal subregions in in vivo MRI: Towards a harmonized segmentation protocol. NeuroImage, 111, 526-541. doi:10.1016/j.neuroimage.2015.01.00