HeMIS: Hetero-Modal Image Segmentation

We introduce a deep learning image segmentation framework that is extremely robust to missing imaging modalities. Instead of attempting to impute or synthesize missing data, the proposed approach learns, for each modality, an embedding of the input image into a single latent vector space for which arithmetic operations (such as taking the mean) are well defined. Points in that space, which are averaged over modalities available at inference time, can then be further processed to yield the desired segmentation. As such, any combinatorial subset of available modalities can be provided as input, without having to learn a combinatorial number of imputation models. Evaluated on two neurological MRI datasets (brain tumors and MS lesions), the approach yields state-of-the-art segmentation results when provided with all modalities; moreover, its performance degrades remarkably gracefully when modalities are removed, significantly more so than alternative mean-filling or other synthesis approaches.Comment: Accepted as an oral presentation at MICCAI 201

Neonatal White Matter Maturation Is Associated With Infant Language Development

Background: While neonates have no sophisticated language skills, the neural basis for acquiring this function is assumed to already be present at birth. Receptive language is measurable by 6 months of age and meaningful speech production by 10-18 months of age. Fiber tracts supporting language processing include the corpus callosum (CC), which plays a key role in the hemispheric lateralization of language; the left arcuate fasciculus (AF), which is associated with syntactic processing; and the right AF, which plays a role in prosody and semantics. We examined if neonatal maturation of these fiber tracts is associated with receptive language development at 12 months of age. Methods: Diffusion-weighted imaging (DWI) was performed in 86 infants at 26.6 ± 12.2 days post-birth. Receptive language was assessed via the MacArthur-Bates Communicative Development Inventory at 12 months of age. Tract-based fractional anisotropy (FA) was determined using the NA-MIC atlas-based fiber analysis toolkit. Associations between neonatal regional FA, adjusted for gestational age at birth and age at scan, and language development at 12 months of age were tested using ANOVA models. Results: After multiple comparisons correction, higher neonatal FA was positively associated with receptive language at 12 months of age within the genu (p < 0.001), rostrum (p < 0.001), and tapetum (p < 0.001) of the CC and the left fronto-parietal AF (p = 0.008). No significant clusters were found in the right AF. Conclusion: Microstructural development of the CC and the AF in the newborn is associated with receptive language at 12 months of age, demonstrating that interindividual variation in white matter microstructure is relevant for later language development, and indicating that the neural foundation for language processing is laid well ahead of the majority of language acquisition. This suggests that some origins of impaired language development may lie in the intrauterine and potentially neonatal period of life. Understanding how interindividual differences in neonatal brain maturity relate to the acquisition of function, particularly during early development when the brain is in an unparalleled window of plasticity, is key to identifying opportunities for harnessing neuroplasticity in health and disease

Shallow vs deep learning architectures for white matter lesion segmentation in the early stages of multiple sclerosis

In this work, we present a comparison of a shallow and a deep learning architecture for the automated segmentation of white matter lesions in MR images of multiple sclerosis patients. In particular, we train and test both methods on early stage disease patients, to verify their performance in challenging conditions, more similar to a clinical setting than what is typically provided in multiple sclerosis segmentation challenges. Furthermore, we evaluate a prototype naive combination of the two methods, which refines the final segmentation. All methods were trained on 32 patients, and the evaluation was performed on a pure test set of 73 cases. Results show low lesion-wise false positives (30%) for the deep learning architecture, whereas the shallow architecture yields the best Dice coefficient (63%) and volume difference (19%). Combining both shallow and deep architectures further improves the lesion-wise metrics (69% and 26% lesion-wise true and false positive rate, respectively).Comment: Accepted to the MICCAI 2018 Brain Lesion (BrainLes) worksho

Role of deep learning in infant brain MRI analysis

Deep learning algorithms and in particular convolutional networks have shown tremendous success in medical image analysis applications, though relatively few methods have been applied to infant MRI data due numerous inherent challenges such as inhomogenous tissue appearance across the image, considerable image intensity variability across the first year of life, and a low signal to noise setting. This paper presents methods addressing these challenges in two selected applications, specifically infant brain tissue segmentation at the isointense stage and presymptomatic disease prediction in neurodevelopmental disorders. Corresponding methods are reviewed and compared, and open issues are identified, namely low data size restrictions, class imbalance problems, and lack of interpretation of the resulting deep learning solutions. We discuss how existing solutions can be adapted to approach these issues as well as how generative models seem to be a particularly strong contender to address them

Exercise Regulation of Marrow Adipose Tissue

Despite association with low bone density and skeletal fractures, marrow adipose tissue (MAT) remains poorly understood. The marrow adipocyte originates from the mesenchymal stem cell (MSC) pool that also gives rise to osteoblasts, chondrocytes, and myocytes, among other cell types. To date, the presence of MAT has been attributed to preferential biasing of MSC into the adipocyte rather than osteoblast lineage, thus negatively impacting bone formation. Here, we focus on understanding the physiology of MAT in the setting of exercise, dietary interventions, and pharmacologic agents that alter fat metabolism. The beneficial effect of exercise on musculoskeletal strength is known: exercise induces bone formation, encourages growth of skeletally supportive tissues, inhibits bone resorption, and alters skeletal architecture through direct and indirect effects on a multiplicity of cells involved in skeletal adaptation. MAT is less well studied due to the lack of reproducible quantification techniques. In recent work, osmium-based 3D quantification shows a robust response of MAT to both dietary and exercise intervention in that MAT is elevated in response to high-fat diet and can be suppressed following daily exercise. Exercise-induced bone formation correlates with suppression of MAT, such that exercise effects might be due to either calorie expenditure from this depot or from mechanical biasing of MSC lineage away from fat and toward bone, or a combination thereof. Following treatment with the anti-diabetes drug rosiglitazone – a PPARγ-agonist known to increase MAT and fracture risk – mice demonstrate a fivefold higher femur MAT volume compared to the controls. In addition to preventing MAT accumulation in control mice, exercise intervention significantly lowers MAT accumulation in rosiglitazone-treated mice. Importantly, exercise induction of trabecular bone volume is unhindered by rosiglitazone. Thus, despite rosiglitazone augmentation of MAT, exercise significantly suppresses MAT volume and induces bone formation. That exercise can both suppress MAT volume and increase bone quantity, notwithstanding the skeletal harm induced by rosiglitazone, underscores exercise as a powerful regulator of bone remodeling, encouraging marrow stem cells toward the osteogenic lineage to fulfill an adaptive need for bone formation. Thus, exercise represents an effective strategy to mitigate the deleterious effects of overeating and iatrogenic etiologies on bone and fat

3D time series analysis of cell shape using Laplacian approaches

Background: Fundamental cellular processes such as cell movement, division or food uptake critically depend on cells being able to change shape. Fast acquisition of three-dimensional image time series has now become possible, but we lack efficient tools for analysing shape deformations in order to understand the real three-dimensional nature of shape changes. Results: We present a framework for 3D+time cell shape analysis. The main contribution is three-fold: First, we develop a fast, automatic random walker method for cell segmentation. Second, a novel topology fixing method is proposed to fix segmented binary volumes without spherical topology. Third, we show that algorithms used for each individual step of the analysis pipeline (cell segmentation, topology fixing, spherical parameterization, and shape representation) are closely related to the Laplacian operator. The framework is applied to the shape analysis of neutrophil cells. Conclusions: The method we propose for cell segmentation is faster than the traditional random walker method or the level set method, and performs better on 3D time-series of neutrophil cells, which are comparatively noisy as stacks have to be acquired fast enough to account for cell motion. Our method for topology fixing outperforms the tools provided by SPHARM-MAT and SPHARM-PDM in terms of their successful fixing rates. The different tasks in the presented pipeline for 3D+time shape analysis of cells can be solved using Laplacian approaches, opening the possibility of eventually combining individual steps in order to speed up computations

FADTTSter: Accelerating hypothesis testing with functional analysis of diffusion tensor tract statistics

Functional Analysis of Diffusion Tensor Tract Statistics (FADTTS) is a toolbox for analysis of white matter (WM) fiber tracts. It allows associating diffusion properties along major WM bundles with a set of covariates of interest, such as age, diagnostic status and gender, and the structure of the variability of these WM tract properties. However, to use this toolbox, a user must have an intermediate knowledge in scripting languages (MATLAB). FADTTSter was created to overcome this issue and make the statistical analysis accessible to any non-technical researcher. FADTTSter is actively being used by researchers at the University of North Carolina. FADTTSter guides non-technical users through a series of steps including quality control of subjects and fibers in order to setup the necessary parameters to run FADTTS. Additionally, FADTTSter implements interactive charts for FADTTS' outputs. This interactive chart enhances the researcher experience and facilitates the analysis of the results. FADTTSter's motivation is to improve usability and provide a new analysis tool to the community that complements FADTTS. Ultimately, by enabling FADTTS to a broader audience, FADTTSter seeks to accelerate hypothesis testing in neuroimaging studies involving heterogeneous clinical data and diffusion tensor imaging. This work is submitted to the Biomedical Applications in Molecular, Structural, and Functional Imaging conference. The source code of this application is available in NITRC

CIVILITY: Cloud based interactive visualization of tractography brain connectome

Cloud based Interactive Visualization of Tractography Brain Connectome (CIVILITY) is an interactive visualization tool of brain connectome in the cloud. This application submits tasks to remote computing grids were the CIVILITY-tractography pipeline is deployed. The application will list the running tasks for the user and once a task is completed the brain connectome is visualized using Hierarchical Edge Bundling. The analysis pipeline uses FSL tools (bedpostx and probtrackx2) to generate a triangular matrix indicating the connectivity strength between different regions in the brain. This work is motivated by medical applications in which expensive computational tasks such as brain connectivity is needed and to provide a state of the art visualization tool of Brain Connectome. This work does not contribute any novelty with respect to the visualization methodology, is rather a new resource for the neuroimaging community. This work is submitted to the SPIE Biomedical Applications in Molecular, Structural, and Functional Imaging conference. The source code of this application is available in NITRC

Multi-object model-based multi-atlas segmentation for rodent brains using dense discrete correspondences

The delineation of rodent brain structures is challenging due to low-contrast multiple cortical and subcortical organs that are closely interfacing to each other. Atlas-based segmentation has been widely employed due to its ability to delineate multiple organs at the same time via image registration. The use of multiple atlases and subsequent label fusion techniques has further improved the robustness and accuracy of atlas-based segmentation. However, the accuracy of atlas-based segmentation is still prone to registration errors; for example, the segmentation of in vivo MR images can be less accurate and robust against image artifacts than the segmentation of post mortem images. In order to improve the accuracy and robustness of atlas-based segmentation, we propose a multi-object, model-based, multi-atlas segmentation method. We first establish spatial correspondences across atlases using a set of dense pseudo-landmark particles. We build a multi-object point distribution model using those particles in order to capture inter- and intra- subject variation among brain structures. The segmentation is obtained by fitting the model into a subject image, followed by label fusion process. Our result shows that the proposed method resulted in greater accuracy than comparable segmentation methods, including a widely used ANTs registration tool