Frameworks to Investigate Robustness and Disease Characterization/Prediction Utility of Time-Varying Functional Connectivity State Profiles of the Human Brain at Rest

Neuroimaging technologies aim at delineating the highly complex structural and functional organization of the human brain. In recent years, several unimodal as well as multimodal analyses of structural MRI (sMRI) and functional MRI (fMRI) neuroimaging modalities, leveraging advanced signal processing and machine learning based feature extraction algorithms, have opened new avenues in diagnosis of complex brain syndromes and neurocognitive disorders. Generically regarding these neuroimaging modalities as filtered, complimentary insights of brain’s anatomical and functional organization, multimodal data fusion efforts could enable more comprehensive mapping of brain structure and function. Large scale functional organization of the brain is often studied by viewing the brain as a complex, integrative network composed of spatially distributed, but functionally interacting, sub-networks that continually share and process information. Such whole-brain functional interactions, also referred to as patterns of functional connectivity (FC), are typically examined as levels of synchronous co-activation in the different functional networks of the brain. More recently, there has been a major paradigm shift from measuring the whole-brain FC in an oversimplified, time-averaged manner to additional exploration of time-varying mechanisms to identify the recurring, transient brain configurations or brain states, referred to as time-varying FC state profiles in this dissertation. Notably, prior studies based on time-varying FC approaches have made use of these relatively lower dimensional fMRI features to characterize pathophysiology and have also been reported to relate to demographic characterization, consciousness levels and cognition. In this dissertation, we corroborate the efficacy of time-varying FC state profiles of the human brain at rest by implementing statistical frameworks to evaluate their robustness and statistical significance through an in-depth, novel evaluation on multiple, independent partitions of a very large rest-fMRI dataset, as well as extensive validation testing on surrogate rest-fMRI datasets. In the following, we present a novel data-driven, blind source separation based multimodal (sMRI-fMRI) data fusion framework that uses the time-varying FC state profiles as features from the fMRI modality to characterize diseased brain conditions and substantiate brain structure-function relationships. Finally, we present a novel data-driven, deep learning based multimodal (sMRI-fMRI) data fusion framework that examines the degree of diagnostic and prognostic performance improvement based on time-varying FC state profiles as features from the fMRI modality. The approaches developed and tested in this dissertation evince high levels of robustness and highlight the utility of time-varying FC state profiles as potential biomarkers to characterize, diagnose and predict diseased brain conditions. As such, the findings in this work argue in favor of the view of FC investigations of the brain that are centered on time-varying FC approaches, and also highlight the benefits of combining multiple neuroimaging data modalities via data fusion

Machine Learning for Multiclass Classification and Prediction of Alzheimer\u27s Disease

Alzheimer\u27s disease (AD) is an irreversible neurodegenerative disorder and a common form of dementia. This research aims to develop machine learning algorithms that diagnose and predict the progression of AD from multimodal heterogonous biomarkers with a focus placed on the early diagnosis. To meet this goal, several machine learning-based methods with their unique characteristics for feature extraction and automated classification, prediction, and visualization have been developed to discern subtle progression trends and predict the trajectory of disease progression. The methodology envisioned aims to enhance both the multiclass classification accuracy and prediction outcomes by effectively modeling the interplay between the multimodal biomarkers, handle the missing data challenge, and adequately extract all the relevant features that will be fed into the machine learning framework, all in order to understand the subtle changes that happen in the different stages of the disease. This research will also investigate the notion of multitasking to discover how the two processes of multiclass classification and prediction relate to one another in terms of the features they share and whether they could learn from one another for optimizing multiclass classification and prediction accuracy. This research work also delves into predicting cognitive scores of specific tests over time, using multimodal longitudinal data. The intent is to augment our prospects for analyzing the interplay between the different multimodal features used in the input space to the predicted cognitive scores. Moreover, the power of modality fusion, kernelization, and tensorization have also been investigated to efficiently extract important features hidden in the lower-dimensional feature space without being distracted by those deemed as irrelevant. With the adage that a picture is worth a thousand words, this dissertation introduces a unique color-coded visualization system with a fully integrated machine learning model for the enhanced diagnosis and prognosis of Alzheimer\u27s disease. The incentive here is to show that through visualization, the challenges imposed by both the variability and interrelatedness of the multimodal features could be overcome. Ultimately, this form of visualization via machine learning informs on the challenges faced with multiclass classification and adds insight into the decision-making process for a diagnosis and prognosis

Automated detection of Alzheimer disease using MRI images and deep neural networks- A review

Early detection of Alzheimer disease is crucial for deploying interventions and slowing the disease progression. A lot of machine learning and deep learning algorithms have been explored in the past decade with the aim of building an automated detection for Alzheimer. Advancements in data augmentation techniques and advanced deep learning architectures have opened up new frontiers in this field, and research is moving at a rapid speed. Hence, the purpose of this survey is to provide an overview of recent research on deep learning models for Alzheimer disease diagnosis. In addition to categorizing the numerous data sources, neural network architectures, and commonly used assessment measures, we also classify implementation and reproducibility. Our objective is to assist interested researchers in keeping up with the newest developments and in reproducing earlier investigations as benchmarks. In addition, we also indicate future research directions for this topic.Comment: 22 Pages, 5 Figures, 7 Table

Deep Interpretability Methods for Neuroimaging

Brain dynamics are highly complex and yet hold the key to understanding brain function and dysfunction. The dynamics captured by resting-state functional magnetic resonance imaging data are noisy, high-dimensional, and not readily interpretable. The typical approach of reducing this data to low-dimensional features and focusing on the most predictive features comes with strong assumptions and can miss essential aspects of the underlying dynamics. In contrast, introspection of discriminatively trained deep learning models may uncover disorder-relevant elements of the signal at the level of individual time points and spatial locations. Nevertheless, the difficulty of reliable training on high-dimensional but small-sample datasets and the unclear relevance of the resulting predictive markers prevent the widespread use of deep learning in functional neuroimaging. In this dissertation, we address these challenges by proposing a deep learning framework to learn from high-dimensional dynamical data while maintaining stable, ecologically valid interpretations. The developed model is pre-trainable and alleviates the need to collect an enormous amount of neuroimaging samples to achieve optimal training. We also provide a quantitative validation module, Retain and Retrain (RAR), that can objectively verify the higher predictability of the dynamics learned by the model. Results successfully demonstrate that the proposed framework enables learning the fMRI dynamics directly from small data and capturing compact, stable interpretations of features predictive of function and dysfunction. We also comprehensively reviewed deep interpretability literature in the neuroimaging domain. Our analysis reveals the ongoing trend of interpretability practices in neuroimaging studies and identifies the gaps that should be addressed for effective human-machine collaboration in this domain. This dissertation also proposed a post hoc interpretability method, Geometrically Guided Integrated Gradients (GGIG), that leverages geometric properties of the functional space as learned by a deep learning model. With extensive experiments and quantitative validation on MNIST and ImageNet datasets, we demonstrate that GGIG outperforms integrated gradients (IG), which is considered to be a popular interpretability method in the literature. As GGIG is able to identify the contours of the discriminative regions in the input space, GGIG may be useful in various medical imaging tasks where fine-grained localization as an explanation is beneficial

Development of Gaussian Learning Algorithms for Early Detection of Alzheimer\u27s Disease

Alzheimer’s disease (AD) is the most common form of dementia affecting 10% of the population over the age of 65 and the growing costs in managing AD are estimated to be $259 billion, according to data reported in the 2017 by the Alzheimer\u27s Association. Moreover, with cognitive decline, daily life of the affected persons and their families are severely impacted. Taking advantage of the diagnosis of AD and its prodromal stage of mild cognitive impairment (MCI), an early treatment may help patients preserve the quality of life and slow the progression of the disease, even though the underlying disease cannot be reversed or stopped. This research aims to develop Gaussian learning algorithms, natural language processing (NLP) techniques, and mathematical models to effectively delineate the MCI participants from the cognitively normal (CN) group, and identify the most significant brain regions and patterns of changes associated with the progression of AD. The focus will be placed on the earliest manifestations of the disease (early MCI or EMCI) to plan for effective curative/therapeutic interventions and protocols. Multiple modalities of biomarkers have been found to be significantly sensitive in assessing the progression of AD. In this work, several novel multimodal classification frameworks based on proposed Gaussian Learning algorithms are created and applied to neuroimaging data. Classification based on the combination of structural magnetic resonance imaging (MRI), positron emission tomography (PET), and cerebrospinal fluid (CSF) biomarkers is seen as the most reliable approach for high-accuracy classification. Additionally, changes in linguistic complexity may provide complementary information for the diagnosis and prognosis of AD. For this research endeavor, an NLP-oriented neuropsychological assessment is developed to automatically analyze the distinguishing characteristics of text data in MCI group versus those in CN group. Early findings suggest significant linguistic differences between CN and MCI subjects in terms of word usage, vocabulary, recall, fragmented sentences. In summary, the results obtained indicate a high potential of the neuroimaging-based classification and NLP-oriented assessment to be utilized as a practically computer aided diagnosis system for classification and prediction of AD and its prodromal stages. Future work will ultimately focus on early signs of AD that could help in the planning of curative and therapeutic intervention to slow the progression of the disease

DEEP-AD: The deep learning model for diagnostic classification and prognostic prediction of alzheimer's disease

In terms of context, the aim of this dissertation is to aid neuroradiologists in their clinical judgment regarding the early detection of AD by using DL. To that aim, the system design research methodology is suggested in this dissertation for achieving three goals. The first goal is to investigate the DL models that have performed well at identifying patterns associated with AD, as well as the accuracy so far attained, limitations, and gaps. A systematic review of the literature (SLR) revealed a shortage of empirical studies on the early identification of AD through DL. In this regard, thirteen empirical studies were identified and examined. We concluded that three-dimensional (3D) DL models have been generated far less often and that their performance is also inadequate to qualify them for clinical trials. The second goal is to provide the neuroradiologist with the computer-interpretable information they need to analyze neuroimaging biomarkers. Given this context, the next step in this dissertation is to find the optimum DL model to analyze neuroimaging biomarkers. It has been achieved in two steps. In the first step, eight state-of-the-art DL models have been implemented by training from scratch using end-to-end learning (E2EL) for two binary classification tasks (AD vs. CN and AD vs. stable MCI) and compared by utilizing MRI scans from the publicly accessible datasets of neuroimaging biomarkers. Comparative analysis is carried out by utilizing efficiency-effects graphs, comprehensive indicators, and ranking mechanisms. For the training of the AD vs. sMCI task, the EfficientNet-B0 model gets the highest value for the comprehensive indicator and has the fewest parameters. DenseNet264 performed better than the others in terms of evaluation matrices, but since it has the most parameters, it costs more to train. For the AD vs. CN task by DenseNet264, we achieved 100% accuracy for training and 99.56% accuracy for testing. However, the classification accuracy was still only 82.5% for the AD vs. sMCI task. In the second step, fusion of transfer learning (TL) with E2EL is applied to train the EfficientNet-B0 for the AD vs. sMCI task, which achieved 95.29% accuracy for training and 93.10% accuracy for testing. Additionally, we have also implemented EfficientNet-B0 for the multiclass AD vs. CN vs. sMCI classification task with E2EL to be used in ensemble of models and achieved 85.66% training accuracy and 87.38% testing accuracy. To evaluate the model’s robustness, neuroradiologists must validate the implemented model. As a result, the third goal of this dissertation is to create a tool that neuroradiologists may use at their convenience. To achieve this objective, this dissertation proposes a web-based application (DEEP-AD) that has been created by making an ensemble of Efficient-Net B0 and DenseNet 264 (based on the contribution of goal 2). The accuracy of a DEEP-AD prototype has undergone repeated evaluation and improvement. First, we validated 41 subjects of Spanish MRI datasets (acquired from HT Medica, Madrid, Spain), achieving an accuracy of 82.90%, which was later verified by neuroradiologists. The results of these evaluation studies showed the accomplishment of such goals and relevant directions for future research in applied DL for the early detection of AD in clinical settings.En términos de contexto, el objetivo de esta tesis es ayudar a los neurorradiólogos en su juicio clínico sobre la detección precoz de la AD mediante el uso de DL. Para ello, en esta tesis se propone la metodología de investigación de diseño de sistemas para lograr tres objetivos. El segundo objetivo es proporcionar al neurorradiólogo la información interpretable por ordenador que necesita para analizar los biomarcadores de neuroimagen. Dado este contexto, el siguiente paso en esta tesis es encontrar el modelo DL óptimo para analizar biomarcadores de neuroimagen. Esto se ha logrado en dos pasos. En el primer paso, se han implementado ocho modelos DL de última generación mediante entrenamiento desde cero utilizando aprendizaje de extremo a extremo (E2EL) para dos tareas de clasificación binarias (AD vs. CN y AD vs. MCI estable) y se han comparado utilizando escaneos MRI de los conjuntos de datos de biomarcadores de neuroimagen de acceso público. El análisis comparativo se lleva a cabo utilizando gráficos de efecto-eficacia, indicadores exhaustivos y mecanismos de clasificación. Para el entrenamiento de la tarea AD vs. sMCI, el modelo EfficientNet-B0 obtiene el valor más alto para el indicador exhaustivo y tiene el menor número de parámetros. DenseNet264 obtuvo mejores resultados que los demás en términos de matrices de evaluación, pero al ser el que tiene más parámetros, su entrenamiento es más costoso. Para la tarea AD vs. CN de DenseNet264, conseguimos una accuracy del 100% en el entrenamiento y del 99,56% en las pruebas. Sin embargo, la accuracy de la clasificación fue sólo del 82,5% para la tarea AD vs. sMCI. En el segundo paso, se aplica la fusión del aprendizaje por transferencia (TL) con E2EL para entrenar la EfficientNet-B0 para la tarea AD vs. sMCI, que alcanzó una accuracy del 95,29% en el entrenamiento y del 93,10% en las pruebas. Además, también hemos implementado EfficientNet-B0 para la tarea de clasificación multiclase AD vs. CN vs. sMCI con E2EL para su uso en conjuntos de modelos y hemos obtenido una accuracy de entrenamiento del 85,66% y una precisión de prueba del 87,38%. Para evaluar la solidez del modelo, los neurorradiólogos deben validar el modelo implementado. Como resultado, el tercer objetivo de esta disertación es crear una herramienta que los neurorradiólogos puedan utilizar a su conveniencia. Para lograr este objetivo, esta disertación propone una aplicación basada en web (DEEP-AD) que ha sido creada haciendo un ensemble de Efficient-Net B0 y DenseNet 264 (basado en la contribución del objetivo 2). La accuracy del prototipo DEEP-AD ha sido sometida a repetidas evaluaciones y mejoras. En primer lugar, validamos 41 sujetos de conjuntos de datos de MRI españoles (adquiridos de HT Medica, Madrid, España), logrando una accuracy del 82,90%, que posteriormente fue verificada por neurorradiólogos. Los resultados de estos estudios de evaluación mostraron el cumplimiento de dichos objetivos y las direcciones relevantes para futuras investigaciones en DL, aplicada en la detección precoz de la AD en entornos clínicos.Escuela de DoctoradoDoctorado en Tecnologías de la Información y las Telecomunicacione

Univariate and multivariate pattern analysis of preterm subjects: a multimodal neuroimaging study

Background: Widespread lasting functional connectivity (FC) and brain volume changes in cortices and subcortices after premature birth have been researched in recent studies. However, the relationship remains unclear between spontaneously slow blood oxygen dependent level (BOLD) fluctuations and gray matter volume (GMV) changes in specific brain areas, such as temporal insular cortices, and whether classification methods based on MRI could be successfully applied to the identification of preterm individuals. In this thesis I hypothesized that in prematurely born adults 1. Ongoing neural excitability and brain activity, as estimated by regional functional connectivity of resting state functional MRI (rs-fMRI) is accompanied with altered low-frequency fluctuations and neonatal complications; 2. Altered regional functional connectivity is connected with superimposed cerebral structural reductions; and 3. multivariate neuroanatomical and functional brain patterns could be treated as features to identify preterm subjects from term subjects individually. Methods: To investigate these hypotheses, the principal results of structural alterations were measured with voxel-based morphometry (VBM), while rs-fMRI outcomes were estimated with amplitude of low-frequency fluctuations (ALFF) in analysis with ninety-four very preterm/very low birth weight (VP/VLBW) and ninety-two full-term (FT) born young adults. Results: The results of the thesis support the hypotheses by showing that, in univariate results, first in VP/VLBW grownups, ALFF was decreased in the left lateral temporal cortices no matter with global signal regression, and this reduction was closely associated with neonatal complications and cognitive variables. Second overlapped brain regions were found between reduced ALFF and reduced brain volumes in the left temporal cortices, and positively associated with each other, demonstrating a potential relationship between VBM and ALFF in this brain area. In multimodal multivariate pattern recognition analysis (MVPA), the gray matter volume (GMV) classifier displayed a higher accuracy (80.7%) contrast with the ALFF classifier (77.4%). The late fusion of GMV and ALFF did not outperform single GMV modality classification by reaching 80.4% accuracy. Moderator analysis from both rs-fMRI and structural MRI (sMRI) uncovered that the neuro-prematurity performance was predominantly determined by neonatal complications. Conclusions: In conclusion, these outcomes exhibit the long term effects of premature labour on lateral temporal cortices, which changed in both ongoing BOLD fluctuations and decreased cerebral structural volumes. This thesis further provided evidence that multivariate pattern analysis such as support vector machine (SVM) may identify imaging-based biomarkers and reliably detect signatures of preterm birth

Univariate and multivariate pattern analysis of preterm subjects: a multimodal neuroimaging study

Background: Widespread lasting functional connectivity (FC) and brain volume changes in cortices and subcortices after premature birth have been researched in recent studies. However, the relationship remains unclear between spontaneously slow blood oxygen dependent level (BOLD) fluctuations and gray matter volume (GMV) changes in specific brain areas, such as temporal insular cortices, and whether classification methods based on MRI could be successfully applied to the identification of preterm individuals. In this thesis I hypothesized that in prematurely born adults 1. Ongoing neural excitability and brain activity, as estimated by regional functional connectivity of resting state functional MRI (rs-fMRI) is accompanied with altered low-frequency fluctuations and neonatal complications; 2. Altered regional functional connectivity is connected with superimposed cerebral structural reductions; and 3. multivariate neuroanatomical and functional brain patterns could be treated as features to identify preterm subjects from term subjects individually. Methods: To investigate these hypotheses, the principal results of structural alterations were measured with voxel-based morphometry (VBM), while rs-fMRI outcomes were estimated with amplitude of low-frequency fluctuations (ALFF) in analysis with ninety-four very preterm/very low birth weight (VP/VLBW) and ninety-two full-term (FT) born young adults. Results: The results of the thesis support the hypotheses by showing that, in univariate results, first in VP/VLBW grownups, ALFF was decreased in the left lateral temporal cortices no matter with global signal regression, and this reduction was closely associated with neonatal complications and cognitive variables. Second overlapped brain regions were found between reduced ALFF and reduced brain volumes in the left temporal cortices, and positively associated with each other, demonstrating a potential relationship between VBM and ALFF in this brain area. In multimodal multivariate pattern recognition analysis (MVPA), the gray matter volume (GMV) classifier displayed a higher accuracy (80.7%) contrast with the ALFF classifier (77.4%). The late fusion of GMV and ALFF did not outperform single GMV modality classification by reaching 80.4% accuracy. Moderator analysis from both rs-fMRI and structural MRI (sMRI) uncovered that the neuro-prematurity performance was predominantly determined by neonatal complications. Conclusions: In conclusion, these outcomes exhibit the long term effects of premature labour on lateral temporal cortices, which changed in both ongoing BOLD fluctuations and decreased cerebral structural volumes. This thesis further provided evidence that multivariate pattern analysis such as support vector machine (SVM) may identify imaging-based biomarkers and reliably detect signatures of preterm birth