Artificial Intelligence for the Detection of Focal Cortical Dysplasia: Challenges in Translating Algorithms into Clinical Practice

Focal cortical dysplasias (FCDs) are malformations of cortical development and one of the most common pathologies causing pharmacoresistant focal epilepsy. Resective neurosurgery yields high success rates, especially if the full extent of the lesion is correctly identified and completely removed. The visual assessment of magnetic resonance imaging does not pinpoint the FCD in 30%–50% of cases, and half of all patients with FCD are not amenable to epilepsy surgery, partly because the FCD could not be sufficiently localized. Computational approaches to FCD detection are an active area of research, benefitting from advancements in computer vision. Automatic FCD detection is a significant challenge and one of the first clinical grounds where the application of artificial intelligence may translate into an advance for patients' health. The emergence of new methods from the combination of health and computer sciences creates novel challenges. Imaging data need to be organized into structured, well-annotated datasets and combined with other clinical information, such as histopathological subtypes or neuroimaging characteristics. Algorithmic output, that is, model prediction, requires a technically correct evaluation with adequate metrics that are understandable and usable for clinicians. Publication of code and data is necessary to make research accessible and reproducible. This critical review introduces the field of automatic FCD detection, explaining underlying medical and technical concepts, highlighting its challenges and current limitations, and providing a perspective for a novel research environment

Multiple classifier fusion and optimization for automatic focal cortical dysplasia detection on magnetic resonance images

In magnetic resonance (MR) images, detection of focal cortical dysplasia (FCD) lesion as a main pathological cue of epilepsy is challenging because of the variability in the presentation of FCD lesions. Existing algorithms appear to have sufficient sensitivity in detecting lesions but also generate large numbers of false-positive (FP) results. In this paper, we propose a multiple classifier fusion and optimization schemes to automatically detect FCD lesions in MR images with reduced FPs through constructing an objective function based on the F-score. Thus, the proposed scheme obtains an improved tradeoff between minimizing FPs and maximizing true positives. The optimization is achieved by incorporating the genetic algorithm into the work scheme. Hence, the contribution of weighting coefficients to different classifications can be effectively determined. The resultant optimized weightings are applied to fuse the classification results. A set of six typical FCD features and six corresponding Z-score maps are evaluated through the mean F-score from multiple classifiers for each feature. From the experimental results, the proposed scheme can automatically detect FCD lesions in 9 out of 10 patients while correctly classifying 31 healthy controls. The proposed scheme acquires a lower FP rate and a higher F-score in comparison with two state-of-the-art methods

Histological Quantification in Temporal Lobe Epilepsy

Approximately 30 percent of epilepsy patients suffer from refractory temporal lobe epilepsy which is commonly treated with resection of the epileptogenic tissue. However, surgical treatment presents many challenges in locating the epileptogenic focus and thus not all patients become seizure-free following surgery. Advances in techniques can lead to improved localization of the epileptogenic zone and may be validated by correlating MRI with neuropathology of the excised cortical tissue. Focal cortical dysplasias are a neuropathological group of cortical malformations that are often found in cases of refractory epilepsy, however, they are subtle and difficult to quantify. The purpose of this research is to employ histology image analysis techniques to better characterize these abnormalities at the neuronal and laminar level, allowing for correlative MRI-histology studies and improved lesion detection in medically intractable TLE

Robust and Generalisable Segmentation of Subtle Epilepsy-causing Lesions: a Graph Convolutional Approach

Focal cortical dysplasia (FCD) is a leading cause of drug-resistant focal epilepsy, which can be cured by surgery. These lesions are extremely subtle and often missed even by expert neuroradiologists. "Ground truth" manual lesion masks are therefore expensive, limited and have large inter-rater variability. Existing FCD detection methods are limited by high numbers of false positive predictions, primarily due to vertex- or patch-based approaches that lack whole-brain context. Here, we propose to approach the problem as semantic segmentation using graph convolutional networks (GCN), which allows our model to learn spatial relationships between brain regions. To address the specific challenges of FCD identification, our proposed model includes an auxiliary loss to predict distance from the lesion to reduce false positives and a weak supervision classification loss to facilitate learning from uncertain lesion masks. On a multi-centre dataset of 1015 participants with surface-based features and manual lesion masks from structural MRI data, the proposed GCN achieved an AUC of 0.74, a significant improvement against a previously used vertex-wise multi-layer perceptron (MLP) classifier (AUC 0.64). With sensitivity thresholded at 67%, the GCN had a specificity of 71% in comparison to 49% when using the MLP. This improvement in specificity is vital for clinical integration of lesion-detection tools into the radiological workflow, through increasing clinical confidence in the use of AI radiological adjuncts and reducing the number of areas requiring expert review.Comment: accepted at MICCAI 202

Multimodal image analysis of the human brain

Gedurende de laatste decennia heeft de snelle ontwikkeling van multi-modale en niet-invasieve hersenbeeldvorming technologieën een revolutie teweeg gebracht in de mogelijkheid om de structuur en functionaliteit van de hersens te bestuderen. Er is grote vooruitgang geboekt in het beoordelen van hersenschade door gebruik te maken van Magnetic Reconance Imaging (MRI), terwijl Elektroencefalografie (EEG) beschouwd wordt als de gouden standaard voor diagnose van neurologische afwijkingen. In deze thesis focussen we op de ontwikkeling van nieuwe technieken voor multi-modale beeldanalyse van het menselijke brein, waaronder MRI segmentatie en EEG bronlokalisatie. Hierdoor voegen we theorie en praktijk samen waarbij we focussen op twee medische applicaties: (1) automatische 3D MRI segmentatie van de volwassen hersens en (2) multi-modale EEG-MRI data analyse van de hersens van een pasgeborene met perinatale hersenschade. We besteden veel aandacht aan de verbetering en ontwikkeling van nieuwe methoden voor accurate en ruisrobuuste beeldsegmentatie, dewelke daarna succesvol gebruikt worden voor de segmentatie van hersens in MRI van zowel volwassen als pasgeborenen. Daarenboven ontwikkelden we een geïntegreerd multi-modaal methode voor de EEG bronlokalisatie in de hersenen van een pasgeborene. Deze lokalisatie wordt gebruikt voor de vergelijkende studie tussen een EEG aanval bij pasgeborenen en acute perinatale hersenletsels zichtbaar in MRI

Interpretable surface-based detection of focal cortical dysplasias:a Multi-centre Epilepsy Lesion Detection study

One outstanding challenge for machine learning in diagnostic biomedical imaging is algorithm interpretability. A key application is the identification of subtle epileptogenic focal cortical dysplasias (FCDs) from structural MRI. FCDs are difficult to visualize on structural MRI but are often amenable to surgical resection. We aimed to develop an open-source, interpretable, surface-based machine-learning algorithm to automatically identify FCDs on heterogeneous structural MRI data from epilepsy surgery centres worldwide. The Multi-centre Epilepsy Lesion Detection (MELD) Project collated and harmonized a retrospective MRI cohort of 1015 participants, 618 patients with focal FCD-related epilepsy and 397 controls, from 22 epilepsy centres worldwide. We created a neural network for FCD detection based on 33 surface-based features. The network was trained and cross-validated on 50% of the total cohort and tested on the remaining 50% as well as on 2 independent test sites. Multidimensional feature analysis and integrated gradient saliencies were used to interrogate network performance. Our pipeline outputs individual patient reports, which identify the location of predicted lesions, alongside their imaging features and relative saliency to the classifier. On a restricted 'gold-standard' subcohort of seizure-free patients with FCD type IIB who had T1 and fluid-attenuated inversion recovery MRI data, the MELD FCD surface-based algorithm had a sensitivity of 85%. Across the entire withheld test cohort the sensitivity was 59% and specificity was 54%. After including a border zone around lesions, to account for uncertainty around the borders of manually delineated lesion masks, the sensitivity was 67%. This multicentre, multinational study with open access protocols and code has developed a robust and interpretable machine-learning algorithm for automated detection of focal cortical dysplasias, giving physicians greater confidence in the identification of subtle MRI lesions in individuals with epilepsy

Advanced Magnetic Resonance Imaging and Quantitative Analysis Approaches in Patients with Refractory Focal Epilepsy

Background Epilepsy has a high prevalence of 1%, which makes it the most common serious neurological disorder. The most difficult to treat type of epilepsy is temporal lobe epilepsy (TLE) with its most commonly associated lesion being hippocampal sclerosis (HS). About 30-50% of all patients undergoing resective surgery of epileptogenic tissue continue to have seizures postoperatively. Indication for this type of surgery is only given when lesions are clearly visible on magnetic resonance images (MRI). About 30% of all patients with focal epilepsy do not show an underlying structural lesion upon qualitative neuroradiological MRI assessment (MRI-negative). Objectives The work presented in this thesis uses MRI data to quantitatively investigate structural differences between brains of patients with focal epilepsy and healthy controls using automated imaging preprocessing and analysis methods. Methods All patients studied in this thesis had electrophysiological evidence of focal epilepsy, and underwent routine clinical MRI prior to participation in this study. There were two datasets and both included a cohort of age-matched controls: (i) Patients with TLE and associated HS who later underwent selective amygdalahippocampectomy (cohort 1) and (ii) MRI-negative patients with medically refractory focal epilepsy (cohort 2). The participants received high- resolution routine clinical MRI as well as additional sequences for gray and white matter (GM/WM) structural imaging. A neuroradiologist reviewed all images prior to analysis. Hippocampal subfield volume and automated tractography analysis was performed in patients with TLE and HS and related to post-surgical outcomes, while images of MRI- negative patients were analyzed using voxel-based morphometry (VBM) and manual/automated tractography. All studies were designed to detect quantitative differences between patients and controls, except for the hippocampal subfield analysis as control data was not available and comparisons were limited to patients with persistent postoperative seizures and those without. Results 1. Automated hippocampal subfield analysis (cohort 1): The high-resolution hippocampal subfield segmentation technique cannot establish a link between hippocampal subfield volume loss and post-surgical outcome. Ipsilateral and contralateral hippocampal subfield volumes did not correlate with clinical variables such as duration of epilepsy and age of onset of epilepsy. 2. Automated WM diffusivity analysis (cohort 1): Along-the-tract analysis showed that ipsilateral tracts of patients with right/left TLE and HS were more extensively affected than contralateral tracts and the affected regions within tracts could be specified. The extent of hippocampal atrophy (HA) was not related to (i) the diffusion alterations of temporal lobe tracts or (ii) clinical characteristics of patients, whereas diffusion alterations of ipsilateral temporal lobe tracts were significantly related to age at onset of epilepsy, duration of epilepsy and epilepsy burden.Patients without any postoperative seizure symptoms (excellent outcomes) had more ipsilaterally distributed WM tract diffusion alterations than patients with persistent postoperative seizures (poorer outcomes), who were affected bilaterally. 3. Automated epileptogenic lesion detection (cohort 2): Comparison of individual patients against the controls revealed that focal cortical dysplasia (FCD) can be detected automatically using statistical thresholds. All sites of dysplasia reported at the start of the study were detected using this technique. Two additional sites in two different patients, which had previously escaped neuroradiological assessment, could be identified. When taking these statistical results into account during re-assessment of the dedicated epilepsy research MRI, the expert neuroradiologist was able to confirm these as lesions. 4. Manual and automated WM diffusion tensor imaging (DTI) analysis (cohort 2): The analysis of consistency across approaches revealed a moderate to good agreement between extracted tract shape, morphology and space and a strong correlation between diffusion values extracted with both methods. While whole-tract DTI-metrics determined using Automated Fiber Quantification (AFQ) revealed correlations with clinical variables such as age of onset and duration of epilepsy, these correlations were not found using the manual technique. The manual approach revealed more differences than AFQ in group comparisons of whole-tract DTI-metrics. Along-the-tract analysis provided within AFQ gave a more detailed description of localized diffusivity changes along tracts, which correlated with clinical variables such as age of onset and epilepsy duration. Conclusions While hippocampal subfield volume loss in patients with TLE and HS was not related with any clinical variables or to post-surgical outcomes, WM tract diffusion alterations were more bilaterally distributed in patients with persistent postoperative seizures, compared to patients with excellent outcomes. This may indicate that HS as an initial precipitating injury is not affected by clinical features of the disorder and automated hippocampal subfield mapping based on MRI is not sufficient to stratify patients according to outcome. Presence of persisting seizures may depend on other pathological processes such as seizure propagation through WM tracts and WM integrity. Automated and time-efficient three-dimensional voxel-based analysis may complement conventional visual assessments in patients with MRI-negative focal epilepsy and help to identify FCDs escaping routine neuroradiological assessment. Furthermore, automated along-the-tract analysis may identify widespread abnormal diffusivity and correlations between WM integrity loss and clinical variables in patients with MRI-negative epilepsy. However, automated WM tract analysis may differ from results obtained with manual methods and therefore caution should be exercised when using automated techniques

A Framework for Evaluating Cortical Architectural Anomalies in Temporal Lobe Epilepsy Patients

Focal cortical dysplasia (FCD) are localized regions of malformed cerebral cortex that are frequently associated with drug-resistant epilepsy. Currently, there is a lack of research towards providing quantitative methods for characterizing minor abnormalities in cortical architecture, hindering efforts to determine whether removal affects surgical outcome, and define potential imaging correlates. In our work, we have developed a tool to extract relevant features associated with cortical architectural abnormalities that can deal with artifacts including cortical layer distortions and morphological differences caused by cortical folding effects, and processing artifacts due to improper sectioning. This framework was applied to detect abnormalities across multiple subjects and slides using an unsupervised anomaly detection algorithm. Our results suggest that the technique is able to identify anomalies that correspond to visually-identifiable histological abnormalities. The frequency of abnormalities was found to differ among patients; however, the clinical significance of these findings is yet to be investigated

Automated detection of focal cortical dysplasia type II with surface-based magnetic resonance imaging postprocessing and machine learning

Objective Focal cortical dysplasia (FCD) is a major pathology in patients undergoing surgical resection to treat pharmacoresistant epilepsy. Magnetic resonance imaging (MRI) postprocessing methods may provide essential help for detection of FCD. In this study, we utilized surface‐based MRI morphometry and machine learning for automated lesion detection in a mixed cohort of patients with FCD type II from 3 different epilepsy centers. Methods Sixty‐one patients with pharmacoresistant epilepsy and histologically proven FCD type II were included in the study. The patients had been evaluated at 3 different epilepsy centers using 3 different MRI scanners. T1‐volumetric sequence was used for postprocessing. A normal database was constructed with 120 healthy controls. We also included 35 healthy test controls and 15 disease test controls with histologically confirmed hippocampal sclerosis to assess specificity. Features were calculated and incorporated into a nonlinear neural network classifier, which was trained to identify lesional cluster. We optimized the threshold of the output probability map from the classifier by performing receiver operating characteristic (ROC) analyses. Success of detection was defined by overlap between the final cluster and the manual labeling. Performance was evaluated using k‐fold cross‐validation. Results The threshold of 0.9 showed optimal sensitivity of 73.7% and specificity of 90.0%. The area under the curve for the ROC analysis was 0.75, which suggests a discriminative classifier. Sensitivity and specificity were not significantly different for patients from different centers, suggesting robustness of performance. Correct detection rate was significantly lower in patients with initially normal MRI than patients with unequivocally positive MRI. Subgroup analysis showed the size of the training group and normal control database impacted classifier performance. Significance Automated surface‐based MRI morphometry equipped with machine learning showed robust performance across cohorts from different centers and scanners. The proposed method may be a valuable tool to improve FCD detection in presurgical evaluation for patients with pharmacoresistant epilepsy