Multiple classifier fusion and optimization for automatic focal cortical dysplasia detection on magnetic resonance images

In magnetic resonance (MR) images, detection of focal cortical dysplasia (FCD) lesion as a main pathological cue of epilepsy is challenging because of the variability in the presentation of FCD lesions. Existing algorithms appear to have sufficient sensitivity in detecting lesions but also generate large numbers of false-positive (FP) results. In this paper, we propose a multiple classifier fusion and optimization schemes to automatically detect FCD lesions in MR images with reduced FPs through constructing an objective function based on the F-score. Thus, the proposed scheme obtains an improved tradeoff between minimizing FPs and maximizing true positives. The optimization is achieved by incorporating the genetic algorithm into the work scheme. Hence, the contribution of weighting coefficients to different classifications can be effectively determined. The resultant optimized weightings are applied to fuse the classification results. A set of six typical FCD features and six corresponding Z-score maps are evaluated through the mean F-score from multiple classifiers for each feature. From the experimental results, the proposed scheme can automatically detect FCD lesions in 9 out of 10 patients while correctly classifying 31 healthy controls. The proposed scheme acquires a lower FP rate and a higher F-score in comparison with two state-of-the-art methods

Clinical Value of Machine Learning in the Automated Detection of Focal Cortical Dysplasia Using Quantitative Multimodal Surface-Based Features

Objective: To automatically detect focal cortical dysplasia (FCD) lesion by combining quantitative multimodal surface-based features with machine learning and to assess its clinical value.Methods: Neuroimaging data and clinical information for 74 participants (40 with histologically proven FCD type II) was retrospectively included. The morphology, intensity and function-based features characterizing FCD lesions were calculated vertex-wise on each cortical surface and fed to an artificial neural network. The classifier performance was quantitatively and qualitatively assessed by performing statistical analysis and conventional visual analysis.Results: The accuracy, sensitivity, specificity of the neural network classifier based on multimodal surface-based features were 70.5%, 70.0%, and 69.9%, respectively, which outperformed the unimodal classifier. There was no significant difference in the detection rate of FCD subtypes (Pearson’s Chi-Square = 0.001, p = 0.970). Cohen’s kappa score between automated detection outcomes and post-surgical resection region was 0.385 (considered as fair).Conclusion: Automated machine learning with multimodal surface features can provide objective and intelligent detection of FCD lesion in pre-surgical evaluation and can assist the surgical strategy. Furthermore, the optimal parameters, appropriate surface features and efficient algorithm are worth exploring

A Patch-Wise Generative Adversarial Network for PET-MR Image Generation with Feature Attribution for Detection of Focal Cortical Dysplasia

Tese de mestrado integrado, Engenharia Biomédica e Biofísica (Engenharia Clínica e Instrumentação Médica) Universidade de Lisboa, Faculdade de Ciências, 2022More than 50 million people worldwide suffer from epilepsy with a third of those being diagnosed with drug-resistant epilepsy where the seizures cannot be treated through pharmacotherapy. In these cases, surgical removal of the epileptic brain tissue in patients is presented as an effective solution for treatment. However, for surgery success, it is vital that the accurate location of epileptic regions in the brain are known. Neuroimaging, specifically magnetic resonance imaging (MRI) and positron emission tomography (PET), commonly are the doctor’s allies in identifying these lesions’ locations responsible for the seizures. Focal cortical dysplasias (FCDs) are the most common type of cortical lesions respon sible for drug-resistant epilepsy in children. These lesions have highly heterogeneous masses, occur in different brain regions and result in different levels of visibility, corresponding to the second most in tractable type of lesion in adults with epilepsy. Moreover, among drug-resistant epilepsy cases, a third of these lesions cannot be correctly identified by neuroimaging experts, resulting in unsuccessful surgical planning and consequently ineffective treatment for patients. Recently, Generative Adversarial Networks (GANs) have demonstrated their value in neuroimaging anomaly detection. Therefore, this work pro poses the application of two different GAN methods – WGAN and CycleGAN - for anomaly detection of FCDs, in PET-MRI data of epileptic patients. A 3D patch-basis anomaly detection approach was therefore developed, inspired by previous works, to detect FCDs location by deconfounding acquisition noise and normal cortical variabilities in PET-MR brain scans of epilepsy patients. Therefore, the GAN models applied two different approaches for lesion detection: detection through reconstruction (WGAN) and detection through translation (CycleGAN). Moreover, the combination of PET and MR modalities was studied and compared to training the networks with individual imaging modalities instead. Through the results, it was possible to understand and correct some issues GAN models have when training with multimodal 3D data. However, both methods for anomaly detection were able to detect diseased brain areas in patients with very visible FCDs, although failing to identify them in patients with very subtle lesions. Recent studies will be briefly discussed in the conclusion, which propose new approaches and architectures for multimodality training, with great potential to improve the performance of the networks for anomaly detection in future works

Cortical Morphology and MRI Signal Intensity Analysis in Paediatric Epilepsy

Epilepsy encompasses a great variety of aetiologies, and as such is not a single disease but a group of diseases characterised by unprovoked seizures.The primary aim of the work presented in this thesis was to use multimodal structural imaging to improve understanding of epilepsy related brain pathology, both the epileptogenic lesions themselves and extralesional pathology, in order to improve pre-surgical planning in medicationresistant epilepsy and improve understanding of the underlying pathogenic mechanisms. The work focuses on 2 epilepsy aetiologies: focal cortical dysplasia (FCD) (chapters 2 and 3) and mesial temporal lobe epilepsy (chapters 4 & 5). Chapter 2 of this thesis develops surface-based, structural MRI post-processing techniques that can be applied to clinical T1 and FLAIR images to complement current MRI-based diagnosis of focal cortical dysplasias. Chapter 3 uses the features developed in Chapter 2 within a machine learning framework to automatically detect FCDs, obtaining 73% sensitivity using a neural network. Chapter 4 develops an in vivo method to explore neocortical gliosis in adults with TLE, while Chapter 5 applies this method to a paediatric cohort. Finally, the concluding chapter discusses contributions, main limitations and outlines options for future research

Focal cortical dysplasia: a practical guide for neurologists

Focal cortical dysplasia (FCD) is a malformation of cortical development characterised by disruption of cortical cytoarchitecture. Classification of FCDs subtypes has initially been based on correlation of the histopathology with relevant clinical, electroencephalographic and neuroimaging features. A recently proposed classification update recommends a multilayered, genotype-phenotype approach, integrating findings from histopathology, genetic analysis of resected tissue and presurgical MRI. FCDs are caused either by single somatic activating mutations in MTOR pathway genes or by double-hit inactivating mutations with a constitutional and a somatic loss-of-function mutation in repressors of the signalling pathway. Mild malformation with oligodendroglial hyperplasia in epilepsy is caused by somatic pathogenic SLC35A2 mutations. FCDs most often present with drug-resistant focal epilepsy or epileptic encephalopathy. Most patients respond to surgical treatment. The use of mechanistic target of rapamycin inhibitors may complement the surgical approach. Treatment approaches and outcomes have improved with advances in neuroimaging, neurophysiology and genetics, although predictors of treatment response have only been determined in part

Multimodal image analysis of the human brain

Gedurende de laatste decennia heeft de snelle ontwikkeling van multi-modale en niet-invasieve hersenbeeldvorming technologieën een revolutie teweeg gebracht in de mogelijkheid om de structuur en functionaliteit van de hersens te bestuderen. Er is grote vooruitgang geboekt in het beoordelen van hersenschade door gebruik te maken van Magnetic Reconance Imaging (MRI), terwijl Elektroencefalografie (EEG) beschouwd wordt als de gouden standaard voor diagnose van neurologische afwijkingen. In deze thesis focussen we op de ontwikkeling van nieuwe technieken voor multi-modale beeldanalyse van het menselijke brein, waaronder MRI segmentatie en EEG bronlokalisatie. Hierdoor voegen we theorie en praktijk samen waarbij we focussen op twee medische applicaties: (1) automatische 3D MRI segmentatie van de volwassen hersens en (2) multi-modale EEG-MRI data analyse van de hersens van een pasgeborene met perinatale hersenschade. We besteden veel aandacht aan de verbetering en ontwikkeling van nieuwe methoden voor accurate en ruisrobuuste beeldsegmentatie, dewelke daarna succesvol gebruikt worden voor de segmentatie van hersens in MRI van zowel volwassen als pasgeborenen. Daarenboven ontwikkelden we een geïntegreerd multi-modaal methode voor de EEG bronlokalisatie in de hersenen van een pasgeborene. Deze lokalisatie wordt gebruikt voor de vergelijkende studie tussen een EEG aanval bij pasgeborenen en acute perinatale hersenletsels zichtbaar in MRI

A Framework for Evaluating Cortical Architectural Anomalies in Temporal Lobe Epilepsy Patients

Focal cortical dysplasia (FCD) are localized regions of malformed cerebral cortex that are frequently associated with drug-resistant epilepsy. Currently, there is a lack of research towards providing quantitative methods for characterizing minor abnormalities in cortical architecture, hindering efforts to determine whether removal affects surgical outcome, and define potential imaging correlates. In our work, we have developed a tool to extract relevant features associated with cortical architectural abnormalities that can deal with artifacts including cortical layer distortions and morphological differences caused by cortical folding effects, and processing artifacts due to improper sectioning. This framework was applied to detect abnormalities across multiple subjects and slides using an unsupervised anomaly detection algorithm. Our results suggest that the technique is able to identify anomalies that correspond to visually-identifiable histological abnormalities. The frequency of abnormalities was found to differ among patients; however, the clinical significance of these findings is yet to be investigated

Interictal Network Dynamics in Paediatric Epilepsy Surgery

Epilepsy is an archetypal brain network disorder. Despite two decades of research elucidating network mechanisms of disease and correlating these with outcomes, the clinical management of children with epilepsy does not readily integrate network concepts. For example, network measures are not used in presurgical evaluation to guide decision making or surgical management plans. The aim of this thesis was to investigate novel network frameworks from the perspective of a clinician, with the explicit aim of finding measures that may be clinically useful and translatable to directly benefit patient care. We examined networks at three different scales, namely macro (whole brain diffusion MRI), meso (subnetworks from SEEG recordings) and micro (single unit networks) scales, consistently finding network abnormalities in children being evaluated for or undergoing epilepsy surgery. This work also provides a path to clinical translation, using frameworks such as IDEAL to robustly assess the impact of these new technologies on management and outcomes. The thesis sets up a platform from which promising computational technology, that utilises brain network analyses, can be readily translated to benefit patient care

The spatio-temporal mapping of epileptic networks: Combination of EEG–fMRI and EEG source imaging

Simultaneous EEG–fMRI acquisitions in patients with epilepsy often reveal distributed patterns of Blood Oxygen Level Dependant (BOLD) change correlated with epileptiform discharges. We investigated if electrical source imaging (ESI) performed on the interictal epileptiform discharges (IED) acquired during fMRI acquisition could be used to study the dynamics of the networks identified by the BOLD effect, thereby avoiding the limitations of combining results from separate recordings. Nine selected patients (13 IED types identified) with focal epilepsy underwent EEG–fMRI. Statistical analysis was performed using SPM5 to create BOLD maps. ESI was performed on the IED recorded during fMRI acquisition using a realistic head model (SMAC) and a distributed linear inverse solution (LAURA). ESI could not be performed in one case. In 10/12 remaining studies, ESI at IED onset (ESIo) was anatomically close to one BOLD cluster. Interestingly, ESIo was closest to the positive BOLD cluster with maximal statistical significance in only 4/12 cases and closest to negative BOLD responses in 4/12 cases. Very small BOLD clusters could also have clinical relevance in some cases. ESI at later time frame (ESIp) showed propagation to remote sources co-localised with other BOLD clusters in half of cases. In concordant cases, the distance between maxima of ESI and the closest EEG–fMRI cluster was less than 33 mm, in agreement with previous studies. We conclude that simultaneous ESI and EEG–fMRI analysis may be able to distinguish areas of BOLD response related to initiation of IED from propagation areas. This combination provides new opportunities for investigating epileptic networks

Quantitative MRI correlates of hippocampal and neocortical pathology in intractable temporal lobe epilepsy

Intractable or drug-resistant epilepsy occurs in over 30% of epilepsy patients, with many of these patients undergoing surgical excision of the affected brain region to achieve seizure control. Advances in MRI have the potential to improve surgical treatment of epilepsy through improved identification and delineation of lesions. However, validation is currently needed to investigate histopathological correlates of these new imaging techniques. The purpose of this work is to investigate histopathological correlates of quantitative relaxometry and DTI from hippocampal and neocortical specimens of intractable TLE patients. To achieve this goal I developed and evaluated a pipeline for histology to in-vivo MRI image registration, which finds dense spatial correspondence between both modalities. This protocol was divided in two steps whereby sparsely sectioned histology from temporal lobe specimens was first registered to the intermediate ex-vivo MRI which is then registered to the in-vivo MRI, completing a pipeline for histology to in-vivo MRI registration. When correlating relaxometry and DTI with neuronal density and morphology in the temporal lobe neocortex, I found T1 to be a predictor of neuronal density in the neocortical GM and demonstrated that employing multi-parametric MRI (combining T1 and FA together) provided a significantly better fit than each parameter alone in predicting density of neurons. This work was the first to relate in-vivo T1 and FA values to the proportion of neurons in GM. When investigating these quantitative multimodal parameters with histological features within the hippocampal subfields, I demonstrated that MD correlates with neuronal density and size, and can act as a marker for neuron integrity within the hippocampus. More importantly, this work was the first to highlight the potential of subfield relaxometry and diffusion parameters (mainly T2 and MD) as well as volumetry in predicting the extent of cell loss per subfield pre-operatively, with a precision so far unachievable. These results suggest that high-resolution quantitative MRI sequences could impact clinical practice for pre-operative evaluation and prediction of surgical outcomes of intractable epilepsy