Brain Tumor Segmentation with Deep Neural Networks

In this paper, we present a fully automatic brain tumor segmentation method based on Deep Neural Networks (DNNs). The proposed networks are tailored to glioblastomas (both low and high grade) pictured in MR images. By their very nature, these tumors can appear anywhere in the brain and have almost any kind of shape, size, and contrast. These reasons motivate our exploration of a machine learning solution that exploits a flexible, high capacity DNN while being extremely efficient. Here, we give a description of different model choices that we've found to be necessary for obtaining competitive performance. We explore in particular different architectures based on Convolutional Neural Networks (CNN), i.e. DNNs specifically adapted to image data. We present a novel CNN architecture which differs from those traditionally used in computer vision. Our CNN exploits both local features as well as more global contextual features simultaneously. Also, different from most traditional uses of CNNs, our networks use a final layer that is a convolutional implementation of a fully connected layer which allows a 40 fold speed up. We also describe a 2-phase training procedure that allows us to tackle difficulties related to the imbalance of tumor labels. Finally, we explore a cascade architecture in which the output of a basic CNN is treated as an additional source of information for a subsequent CNN. Results reported on the 2013 BRATS test dataset reveal that our architecture improves over the currently published state-of-the-art while being over 30 times faster

Modeling Brain Circuitry over a Wide Range of Scales

If we are ever to unravel the mysteries of brain function at its most fundamental level, we will need a precise understanding of how its component neurons connect to each other. Electron Microscopes (EM) can now provide the nanometer resolution that is needed to image synapses, and therefore connections, while Light Microscopes (LM) see at the micrometer resolution required to model the 3D structure of the dendritic network. Since both the topology and the connection strength are integral parts of the brain's wiring diagram, being able to combine these two modalities is critically important. In fact, these microscopes now routinely produce high-resolution imagery in such large quantities that the bottleneck becomes automated processing and interpretation, which is needed for such data to be exploited to its full potential. In this paper, we briefly review the Computer Vision techniques we have developed at EPFL to address this need. They include delineating dendritic arbors from LM imagery, segmenting organelles from EM, and combining the two into a consistent representation

Doctor of Philosophy

dissertationMagnetic Resonance (MR) is a relatively risk-free and flexible imaging modality that is widely used for studying the brain. Biophysical and chemical properties of brain tissue are captured by intensity measurements in T1W (T1-Weighted) and T2W (T2-Weighted) MR scans. Rapid maturational processes taking place in the infant brain manifest as changes in co{\tiny }ntrast between white matter and gray matter tissue classes in these scans. However, studies based on MR image appearance face severe limitations due to the uncalibrated nature of MR intensity and its variability with respect to changing conditions of scan. In this work, we develop a method for studying the intensity variations between brain white matter and gray matter that are observed during infant brain development. This method is referred to by the acronym WIVID (White-gray Intensity Variation in Infant Development). WIVID is computed by measuring the Hellinger Distance of separation between intensity distributions of WM (White Matter) and GM (Gray Matter) tissue classes. The WIVID measure is shown to be relatively stable to interscan variations compared with raw signal intensity and does not require intensity normalization. In addition to quantification of tissue appearance changes using the WIVID measure, we test and implement a statistical framework for modeling temporal changes in this measure. WIVID contrast values are extracted from MR scans belonging to large-scale, longitudinal, infant brain imaging studies and modeled using the NLME (Nonlinear Mixed Effects) method. This framework generates a normative model of WIVID contrast changes with time, which captures brain appearance changes during neurodevelopment. Parameters from the estimated trajectories of WIVID contrast change are analyzed across brain lobes and image modalities. Parameters associated with the normative model of WIVID contrast change reflect established patterns of region-specific and modality-specific maturational sequences. We also detect differences in WIVID contrast change trajectories between distinct population groups. These groups are categorized based on sex and risk/diagnosis for ASD (Autism Spectrum Disorder). As a result of this work, the usage of the proposed WIVID contrast measure as a novel neuroimaging biomarker for characterizing tissue appearance is validated, and the clinical potential of the developed framework is demonstrated