Content based retrieval of PET neurological images

Medical image management has posed challenges to many researchers, especially when the images have to be indexed and retrieved using their visual content that is meaningful to clinicians. In this study, an image retrieval system has been developed for 3D brain PET (Position emission tomography) images. It has been found that PET neurological images can be retrieved based upon their diagnostic status using only data pertaining to their content, and predominantly the visual content. During the study PET scans are spatially normalized, using existing techniques, and their visual data is quantified. The mid-sagittal-plane of each individual 3D PET scan is found and then utilized in the detection of abnormal asymmetries, such as tumours or physical injuries. All the asymmetries detected are referenced to the Talairarch and Tournoux anatomical atlas. The Cartesian co- ordinates in Talairarch space, of detected lesion, are employed along with the associated anatomical structure(s) as the indices within the content based image retrieval system. The anatomical atlas is then also utilized to isolate distinct anatomical areas that are related to a number of neurodegenerative disorders. After segmentation of the anatomical regions of interest algorithms are applied to characterize the texture of brain intensity using Gabor filters and to elucidate the mean index ratio of activation levels. These measurements are combined to produce a single feature vector that is incorporated into the content based image retrieval system. Experimental results on images with known diagnoses show that physical lesions such as head injuries and tumours can be, to a certain extent, detected correctly. Images with correctly detected and measured lesion are then retrieved from the database of images when a query pertains to the measured locale. Images with neurodegenerative disorder patterns have been indexed and retrieved via texture-based features. Retrieval accuracy is increased, for images from patients diagnosed with dementia, by combining the texture feature and mean index ratio value

DEEP-AD: The deep learning model for diagnostic classification and prognostic prediction of alzheimer's disease

In terms of context, the aim of this dissertation is to aid neuroradiologists in their clinical judgment regarding the early detection of AD by using DL. To that aim, the system design research methodology is suggested in this dissertation for achieving three goals. The first goal is to investigate the DL models that have performed well at identifying patterns associated with AD, as well as the accuracy so far attained, limitations, and gaps. A systematic review of the literature (SLR) revealed a shortage of empirical studies on the early identification of AD through DL. In this regard, thirteen empirical studies were identified and examined. We concluded that three-dimensional (3D) DL models have been generated far less often and that their performance is also inadequate to qualify them for clinical trials. The second goal is to provide the neuroradiologist with the computer-interpretable information they need to analyze neuroimaging biomarkers. Given this context, the next step in this dissertation is to find the optimum DL model to analyze neuroimaging biomarkers. It has been achieved in two steps. In the first step, eight state-of-the-art DL models have been implemented by training from scratch using end-to-end learning (E2EL) for two binary classification tasks (AD vs. CN and AD vs. stable MCI) and compared by utilizing MRI scans from the publicly accessible datasets of neuroimaging biomarkers. Comparative analysis is carried out by utilizing efficiency-effects graphs, comprehensive indicators, and ranking mechanisms. For the training of the AD vs. sMCI task, the EfficientNet-B0 model gets the highest value for the comprehensive indicator and has the fewest parameters. DenseNet264 performed better than the others in terms of evaluation matrices, but since it has the most parameters, it costs more to train. For the AD vs. CN task by DenseNet264, we achieved 100% accuracy for training and 99.56% accuracy for testing. However, the classification accuracy was still only 82.5% for the AD vs. sMCI task. In the second step, fusion of transfer learning (TL) with E2EL is applied to train the EfficientNet-B0 for the AD vs. sMCI task, which achieved 95.29% accuracy for training and 93.10% accuracy for testing. Additionally, we have also implemented EfficientNet-B0 for the multiclass AD vs. CN vs. sMCI classification task with E2EL to be used in ensemble of models and achieved 85.66% training accuracy and 87.38% testing accuracy. To evaluate the model’s robustness, neuroradiologists must validate the implemented model. As a result, the third goal of this dissertation is to create a tool that neuroradiologists may use at their convenience. To achieve this objective, this dissertation proposes a web-based application (DEEP-AD) that has been created by making an ensemble of Efficient-Net B0 and DenseNet 264 (based on the contribution of goal 2). The accuracy of a DEEP-AD prototype has undergone repeated evaluation and improvement. First, we validated 41 subjects of Spanish MRI datasets (acquired from HT Medica, Madrid, Spain), achieving an accuracy of 82.90%, which was later verified by neuroradiologists. The results of these evaluation studies showed the accomplishment of such goals and relevant directions for future research in applied DL for the early detection of AD in clinical settings.En términos de contexto, el objetivo de esta tesis es ayudar a los neurorradiólogos en su juicio clínico sobre la detección precoz de la AD mediante el uso de DL. Para ello, en esta tesis se propone la metodología de investigación de diseño de sistemas para lograr tres objetivos. El segundo objetivo es proporcionar al neurorradiólogo la información interpretable por ordenador que necesita para analizar los biomarcadores de neuroimagen. Dado este contexto, el siguiente paso en esta tesis es encontrar el modelo DL óptimo para analizar biomarcadores de neuroimagen. Esto se ha logrado en dos pasos. En el primer paso, se han implementado ocho modelos DL de última generación mediante entrenamiento desde cero utilizando aprendizaje de extremo a extremo (E2EL) para dos tareas de clasificación binarias (AD vs. CN y AD vs. MCI estable) y se han comparado utilizando escaneos MRI de los conjuntos de datos de biomarcadores de neuroimagen de acceso público. El análisis comparativo se lleva a cabo utilizando gráficos de efecto-eficacia, indicadores exhaustivos y mecanismos de clasificación. Para el entrenamiento de la tarea AD vs. sMCI, el modelo EfficientNet-B0 obtiene el valor más alto para el indicador exhaustivo y tiene el menor número de parámetros. DenseNet264 obtuvo mejores resultados que los demás en términos de matrices de evaluación, pero al ser el que tiene más parámetros, su entrenamiento es más costoso. Para la tarea AD vs. CN de DenseNet264, conseguimos una accuracy del 100% en el entrenamiento y del 99,56% en las pruebas. Sin embargo, la accuracy de la clasificación fue sólo del 82,5% para la tarea AD vs. sMCI. En el segundo paso, se aplica la fusión del aprendizaje por transferencia (TL) con E2EL para entrenar la EfficientNet-B0 para la tarea AD vs. sMCI, que alcanzó una accuracy del 95,29% en el entrenamiento y del 93,10% en las pruebas. Además, también hemos implementado EfficientNet-B0 para la tarea de clasificación multiclase AD vs. CN vs. sMCI con E2EL para su uso en conjuntos de modelos y hemos obtenido una accuracy de entrenamiento del 85,66% y una precisión de prueba del 87,38%. Para evaluar la solidez del modelo, los neurorradiólogos deben validar el modelo implementado. Como resultado, el tercer objetivo de esta disertación es crear una herramienta que los neurorradiólogos puedan utilizar a su conveniencia. Para lograr este objetivo, esta disertación propone una aplicación basada en web (DEEP-AD) que ha sido creada haciendo un ensemble de Efficient-Net B0 y DenseNet 264 (basado en la contribución del objetivo 2). La accuracy del prototipo DEEP-AD ha sido sometida a repetidas evaluaciones y mejoras. En primer lugar, validamos 41 sujetos de conjuntos de datos de MRI españoles (adquiridos de HT Medica, Madrid, España), logrando una accuracy del 82,90%, que posteriormente fue verificada por neurorradiólogos. Los resultados de estos estudios de evaluación mostraron el cumplimiento de dichos objetivos y las direcciones relevantes para futuras investigaciones en DL, aplicada en la detección precoz de la AD en entornos clínicos.Escuela de DoctoradoDoctorado en Tecnologías de la Información y las Telecomunicacione

Content based retrieval of PET neurological images

Medical image management has posed challenges to many researchers, especially when the images have to be indexed and retrieved using their visual content that is meaningful to clinicians. In this study, an image retrieval system has been developed for 3D brain PET (Position emission tomography) images. It has been found that PET neurological images can be retrieved based upon their diagnostic status using only data pertaining to their content, and predominantly the visual content. During the study PET scans are spatially normalized, using existing techniques, and their visual data is quantified. The mid-sagittal-plane of each individual 3D PET scan is found and then utilized in the detection of abnormal asymmetries, such as tumours or physical injuries. All the asymmetries detected are referenced to the Talairarch and Tournoux anatomical atlas. The Cartesian co- ordinates in Talairarch space, of detected lesion, are employed along with the associated anatomical structure(s) as the indices within the content based image retrieval system. The anatomical atlas is then also utilized to isolate distinct anatomical areas that are related to a number of neurodegenerative disorders. After segmentation of the anatomical regions of interest algorithms are applied to characterize the texture of brain intensity using Gabor filters and to elucidate the mean index ratio of activation levels. These measurements are combined to produce a single feature vector that is incorporated into the content based image retrieval system. Experimental results on images with known diagnoses show that physical lesions such as head injuries and tumours can be, to a certain extent, detected correctly. Images with correctly detected and measured lesion are then retrieved from the database of images when a query pertains to the measured locale. Images with neurodegenerative disorder patterns have been indexed and retrieved via texture-based features. Retrieval accuracy is increased, for images from patients diagnosed with dementia, by combining the texture feature and mean index ratio value.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Data fusion of complementary information from parietal and occipital event related potentials for early diagnosis of Alzheimer\u27s disease

The number of the elderly population affected by Alzheimer\u27s disease is rapidly rising. The need to find an accurate, inexpensive, and non-intrusive procedure that can be made available to community healthcare providers for the early diagnosis of Alzheimer\u27s disease is becoming an increasingly urgent public health concern. Several recent studies have looked at analyzing electroencephalogram signals through the use of many signal processing techniques. While their methods show great promise, the final outcome of these studies has been largely inconclusive. The inherent difficulty of the problem may be the cause of this outcome, but most likely it is due to the inefficient use of the available information, as many of these studies have used only a single EEG source for the analysis. In this contribution, data from the event related potentials of 19 available electrodes of the EEG are analyzed. These signals are decomposed into different frequency bands using multiresolution wavelet analysis. Two data fusion approaches are then investigated: i.) concatenating features before presenting them to a classification algorithm with the expectation of creating a more informative feature space, and ii.) generating multiple classifiers each trained with a different combination of features obtained from various stimuli, electrode, and frequency bands. The classifiers are then combined through the weighted majority vote, product and sum rule combination schemes. The results indicate that a correct diagnosis performance of over 80% can be obtained by combining data primarily from parietal and occipital lobe electrodes. The performance significantly exceeds that reported from community clinic physicians, despite their access to the outcomes of longitudinal monitoring of the patients

Neurobiological mechanisms of hallucinations in schizophrenia

All perception is a construct of the brain. Yet occasionally, sensory constructions emerge without origin in the physical world and are experienced as hallucinations. Hallucinations occur transdiagnostically, cross-culturally, and in all sensory modalities. They are common in people with schizophrenia, presenting in 60-80% of patients. Despite over 20 years of active neuroimaging research on hallucinations, the neural systems supporting these anomalous perceptual experiences remain disputed. This dissertation investigates the neurobiology of hallucinations, integrating research across structural and functional magnetic resonance imaging (MRI) to elucidate how hallucinations, chiefly in the context of schizophrenia, are supported by the brain, drawing on MRI indices of neurodevelopment. I introduce the phenomenon of hallucinations and motivate the utility of MRI for studying hallucinations. Considering their prevalence in other medical conditions, I conduct a meta-analysis and systematic review of the structural brain basis of hallucinations across diagnoses, primarily schizophrenia spectrum disorders and Parkinson’s disease. This illustrated distinct neuroanatomical organizations of grey matter associated with hallucinations that occur in neurodevelopmental compared to neurodegenerative disorders, which I hypothesise constitute at least two distinct mechanisms. Focussing on the neurodevelopmental mechanism characterized by fronto-temporal and insular grey matter reductions, I turn to the contribution of cortical sulcation, a product of second and third trimester neurodevelopmental processes, which has been robustly implicated in schizophrenia pathology, and, more recently, in hallucinations. Sulcal patterns derived from structural MRI provide a proxy in adulthood for early brain development. I studied two independent datasets of patients with schizophrenia who underwent clinical assessment and 3T MRI from the United Kingdom and Shanghai, China, stratified into those with and without hallucinations, and healthy controls from Shanghai. I first replicate the finding that left hemisphere paracingulate sulcus (PCS) length is reduced in patients who experience hallucinations, then demonstrate similar associations for superior temporal sulcus depth. Length and depth alterations occurred with focal deviations in sulcal geometry. The interindividual and interhemispheric variability of the PCS necessitated the development of semi-automated methods to characterize its morphology and validation to a manual protocol. I used structural covariance networks of the local gyrification index to investigate how specific sulcal deviations relate to global neurodevelopmental coordination, demonstrating that hallucinations correspond to increased covariance within and between salience and auditory networks. Hypothesizing structure-function relationships, I analyse resting-state functional MRI data from the same datasets described, finding significant interactions between PCS length and hallucinations status, but no main effects. There were no effects of hallucination status on salience and auditory network connectivity or in graph theoretical measures of connectivity, suggesting that resting-state connectivity is not a trait marker for hallucinations. Together, the discovery of neurodevelopmental alterations contributing to hallucinations provides mechanistic insight into the pathological consequences of prenatal origins. The interaction of sulcal alterations and hallucination status are associated with connectivity, which may have a role in the pathophysiology of hallucinations. I provide clear predictions and recommendations for future research.Gates Cambridge Scholarshi

Brain networks involved in decision making: an electroencephalography and magnetic resonance imaging study

Executive function describes high-level cognitive-abilities including planning, decision-making, set switching and response inhibition. Impairments of the executive functions in disease states may be subtle but can greatly reduce the quality of life and independence. The overarching theme of this project was to investigate the network of brain regions that are needed to support executive function. This was undertaken using a two-fold approach: one, to apply network analysis to resting state functional Magnetic Resonance Imaging (rs-fMRI) and Diffusion Tensor Imaging (DTI) data in order to describe how differences in morphometry and connectivity correlate to executive function differences of individuals with Mild Cognitive Impairment (MCI), and two, to describe the brain networks involved in one form of executive function, decision-making under uncertain conditions, in young, healthy individuals. Impaired decision-making can dramatically impact day-to-day functioning and understanding the underlying network of regions that support this task can provide a target for future intervention studies. Data from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) were used in the studies of MCI. Individuals were grouped by their executive abilities. A regions-of-interest approach was used to parcel and label various brain regions and a network of connections was constructed out of these regions. Differences between the networks were then compared between the MCI subjects with good and poor executive functions. Those with high executive abilities showed decreased functional network connectivity and increased structural network connectivity. The second arm of these studies was based an original decision-making paradigm that was used to compare of networks involved in decision-making at times of uncertainty in healthy young individuals using both electroencephalography (EEG) and task-based functional magnetic resonance imaging (fMRI). Overall we found greater network connectivity in the uncertain condition of the task than in the certain condition. This suggests that with increased uncertainty comes increased organized connectivity. Taken together, the results of this study re-iterate the notion that cognition depends upon the efficient communication between a network of brain regions rather than on isolated regions. They also highlight the importance of having a well-defined network of nodes and connections for optimal executive functioning

Decision-based data fusion of complementary features for the early diagnosis of Alzheimer\u27s disease

As the average life expectancy increases, particularly in developing countries, the prevalence of Alzheimer\u27s disease (AD), which is the most common form of dementia worldwide, has increased dramatically. As there is no cure to stop or reverse the effects of AD, the early diagnosis and detection is of utmost concern. Recent pharmacological advances have shown the ability to slow the progression of AD; however, the efficacy of these treatments is dependent on the ability to detect the disease at the earliest stage possible. Many patients are limited to small community clinics, by geographic and/or financial constraints. Making diagnosis possible at these clinics through an accurate, inexpensive, and noninvasive tool is of great interest. Many tools have been shown to be effective at the early diagnosis of AD. Three in particular are focused upon in this study: event-related potentials (ERPs) in electroencephalogram (EEG) recordings, magnetic resonance imaging (MRI), as well as positron emission tomography (PET). These biomarkers have been shown to contain diagnostically useful information regarding the development of AD in an individual. The combination of these biomarkers, if they provide complementary information, can boost overall diagnostic accuracy of an automated system. EEG data acquired from an auditory oddball paradigm, along with volumetric T2 weighted MRI data and PET imagery representative of metabolic glucose activity in the brain was collected from a cohort of 447 patients, along with other biomarkers and metrics relating to neurodegenerative disease. This study in particular focuses on AD versus control diagnostic ability from the cohort, in addition to AD severity analysis. An assortment of feature extraction methods were employed to extract diagnostically relevant information from raw data. EEG signals were decomposed into frequency bands of interest hrough the discrete wavelet transform (DWT). MRI images were reprocessed to provide volumetric representations of specific regions of interest in the cranium. The PET imagery was segmented into regions of interest representing glucose metabolic rates within the brain. Multi-layer perceptron neural networks were used as the base classifier for the augmented stacked generalization algorithm, creating three overall biomarker experts for AD diagnosis. The features extracted from each biomarker were used to train classifiers on various subsets of the cohort data; the decisions from these classifiers were then combined to achieve decision-based data fusion. This study found that EEG, MRI and PET data each hold complementary information for the diagnosis of AD. The use of all three in tandem provides greater diagnostic accuracy than using any single biomarker alone. The highest accuracy obtained through the EEG expert was 86.1 ±3.2%, with MRI and PET reaching 91.1 +3.2% and 91.2 ±3.9%, respectively. The maximum diagnostic accuracy of these systems averaged 95.0 ±3.1% when all three biomarkers were combined through the decision fusion algorithm described in this study. The severity analysis for AD showed similar results, with combination performance exceeding that of any biomarker expert alone