Imaging Informatics and the Human Brain Project: the Role of Structure, Review

(no abstract

Computer-Assisted Planning and Robotics in Epilepsy Surgery

Epilepsy is a severe and devastating condition that affects ~1% of the population. Around 30% of these patients are drug-refractory. Epilepsy surgery may provide a cure in selected individuals with drug-resistant focal epilepsy if the epileptogenic zone can be identified and safely resected or ablated. Stereoelectroencephalography (SEEG) is a diagnostic procedure that is performed to aid in the delineation of the seizure onset zone when non-invasive investigations are not sufficiently informative or discordant. Utilizing a multi-modal imaging platform, a novel computer-assisted planning (CAP) algorithm was adapted, applied and clinically validated for optimizing safe SEEG trajectory planning. In an initial retrospective validation study, 13 patients with 116 electrodes were enrolled and safety parameters between automated CAP trajectories and expert manual plans were compared. The automated CAP trajectories returned statistically significant improvements in all of the compared clinical metrics including overall risk score (CAP 0.57 +/- 0.39 (mean +/- SD) and manual 1.00 +/- 0.60, p < 0.001). Assessment of the inter-rater variability revealed there was no difference in external expert surgeon ratings. Both manual and CAP electrodes were rated as feasible in 42.8% (42/98) of cases. CAP was able to provide feasible electrodes in 19.4% (19/98), whereas manual planning was able to generate a feasible electrode in 26.5% (26/98) when the alternative generation method was not feasible. Based on the encouraging results from the retrospective analysis a prospective validation study including an additional 125 electrodes in 13 patients was then undertaken to compare CAP to expert manual plans from two neurosurgeons. The manual plans were performed separately and blindly from the CAP. Computer-generated trajectories were found to carry lower risks scores (absolute difference of 0.04 mm (95% CI = -0.42-0.01), p = 0.04) and were subsequently implanted in all cases without complication. The pipeline has been fully integrated into the clinical service and has now replaced manual SEEG planning at our institution. Further efforts were then focused on the distillation of optimal entry and target points for common SEEG trajectories and applying machine learning methods to develop an active learning algorithm to adapt to individual surgeon preferences. Thirty-two patients were prospectively enrolled in the study. The first 12 patients underwent prospective CAP planning and implantation following the pipeline outlined in the previous study. These patients were used as a training set and all of the 108 electrodes after successful implantation were normalized to atlas space to generate ‘spatial priors’, using a K-Nearest Neighbour (K-NN) classifier. A subsequent test set of 20 patients (210 electrodes) were then used to prospectively validate the spatial priors. From the test set, 78% (123/157) of the implanted trajectories passed through both the entry and target spatial priors defined from the training set. To improve the generalizability of the spatial priors to other neurosurgical centres undertaking SEEG and to take into account the potential for changing institutional practices, an active learning algorithm was implemented. The K-NN classifier was shown to dynamically learn and refine the spatial priors. The progressive refinement of CAP SEEG planning outlined in this and previous studies has culminated in an algorithm that not only optimizes the surgical heuristics and risk scores related to SEEG planning but can also learn from previous experience. Overall, safe and feasible trajectory schema were returning in 30% of the time required for manual SEEG planning. Computer-assisted planning was then applied to optimize laser interstitial thermal therapy (LITT) trajectory planning, which is a minimally invasive alternative to open mesial temporal resections, focal lesion ablation and anterior 2/3 corpus callosotomy. We describe and validate the first CAP algorithm for mesial temporal LITT ablations for epilepsy treatment. Twenty-five patients that had previously undergone LITT ablations at a single institution and with a median follow up of 2 years were included. Trajectory parameters for the CAP algorithm were derived from expert consensus to maximize distance from vasculature and ablation of the amygdalohippocampal complex, minimize collateral damage to adjacent brain structures whilst avoiding transgression of the ventricles and sulci. Trajectory parameters were also optimized to reduce the drilling angle to the skull and overall catheter length. Simulated cavities attributable to the CAP trajectories were calculated using a 5-15 mm ablation diameter. In comparison to manually planned and implemented LITT trajectories,CAP resulted in a significant increase in the percentage ablation of the amygdalohippocampal complex (manual 57.82 +/- 15.05% (mean +/- S.D.) and unablated medial hippocampal head depth (manual 4.45 +/- 1.58 mm (mean +/- S.D.), CAP 1.19 +/- 1.37 (mean +/- S.D.), p = 0.0001). As LITT ablation of the mesial temporal structures is a novel procedure there are no established standards for trajectory planning. A data-driven machine learning approach was, therefore, applied to identify hitherto unknown CAP trajectory parameter combinations. All possible combinations of planning parameters were calculated culminating in 720 unique combinations per patient. Linear regression and random forest machine learning algorithms were trained on half of the data set (3800 trajectories) and tested on the remaining unseen trajectories (3800 trajectories). The linear regression and random forest methods returned good predictive accuracies with both returning Pearson correlations of ρ = 0.7 and root mean squared errors of 0.13 and 0.12 respectively. The machine learning algorithm revealed that the optimal entry points were centred over the junction of the inferior occipital, middle temporal and middle occipital gyri. The optimal target points were anterior and medial translations of the centre of the amygdala. A large multicenter external validation study of 95 patients was then undertaken comparing the manually planned and implemented trajectories, CAP trajectories targeting the centre of the amygdala, the CAP parameters derived from expert consensus and the CAP trajectories utilizing the machine learning derived parameters. Three external blinded expert surgeons were then selected to undertake feasibility ratings and preference rankings of the trajectories. CAP generated trajectories result in a significant improvement in many of the planning metrics, notably the risk score (manual 1.3 +/- 0.1 (mean +/- S.D.), CAP 1.1 +/- 0.2 (mean +/- S.D.), p<0.000) and overall ablation of the amygdala (manual 45.3 +/- 22.2 % (mean +/- S.D.), CAP 64.2 +/- 20 % (mean +/- S.D.), p<0.000). Blinded external feasibility ratings revealed that manual trajectories were less preferable than CAP planned trajectories with an estimated probability of being ranked 4th (lowest) of 0.62. Traditional open corpus callosotomy requires a midline craniotomy, interhemispheric dissection and disconnection of the rostrum, genu and body of the corpus callosum. In cases where drop attacks persist a completion corpus callosotomy to disrupt the remaining fibres in the splenium is then performed. The emergence of LITT technology has raised the possibility of being able to undertake this procedure in a minimally invasive fashion and without the need for a craniotomy using two or three individual trajectories. Early case series have shown LITT anterior two-thirds corpus callosotomy to be safe and efficacious. Whole-brain probabilistic tractography connectomes were generated utilizing 3-Tesla multi-shell imaging data and constrained spherical deconvolution (CSD). Two independent blinded expert neurosurgeons with experience of performing the procedure using LITT then planned the trajectories in each patient following their current clinical practice. Automated trajectories returned a significant reduction in the risk score (manual 1.3 +/- 0.1 (mean +/- S.D.), CAP 1.1 +/- 0.1 (mean +/- S.D.), p<0.000). Finally, we investigate the different methods of surgical implantation for SEEG electrodes. As an initial study, a systematic review and meta-analysis of the literature to date were performed. This revealed a wide variety of implantation methods including traditional frame-based, frameless, robotic and custom-3D printed jigs were being used in clinical practice. Of concern, all comparative reports from institutions that had changed from one implantation method to another, such as following the introduction of robotic systems, did not undertake parallel-group comparisons. This suggests that patients may have been exposed to risks associated with learning curves and potential harms related to the new device until the efficacy was known. A pragmatic randomized control trial of a novel non-CE marked robotic trajectory guidance system (iSYS1) was then devised. Before clinical implantations began a series of pre-clinical investigations utilizing 3D printed phantom heads from previously implanted patients was performed to provide pilot data and also assess the surgical learning curve. The surgeons had comparatively little clinical experience with the new robotic device which replicates the introduction of such novel technologies to clinical practice. The study confirmed that the learning curve with the iSYS1 devices was minimal and the accuracies and workflow were similar to the conventional manual method. The randomized control trial represents the first of its kind for stereotactic neurosurgical procedures. Thirty-two patients were enrolled with 16 patients randomized to the iSYS1 intervention arm and 16 patients to the manual implantation arm. The intervention allocation was concealed from the patients. The surgical and research team could be not blinded. Trial management, independent data monitoring and trial steering committees were convened at four points doing the trial (after every 8 patients implanted). Based on the high level of accuracy required for both methods, the main distinguishing factor would be the time to achieve the alignment to the prespecified trajectory. The primary outcome for comparison, therefore, was the time for individual SEEG electrode implantation. Secondary outcomes included the implantation accuracy derived from the post-operative CT scan, infection, intracranial haemorrhage and neurological deficit rates. Overall, 32 patients (328 electrodes) completed the trial (16 in each intervention arm) and the baseline demographics were broadly similar between the two groups. The time for individual electrode implantation was significantly less with the iSYS1 device (median of 3.36 (95% CI 5.72 to 7.07) than for the PAD group (median of 9.06 minutes (95% CI 8.16 to 10.06), p=0.0001). Target point accuracy was significantly greater with the PAD (median of 1.58 mm (95% CI 1.38 to 1.82) compared to the iSYS1 (median of 1.16 mm (95% CI 1.01 to 1.33), p=0.004). The difference between the target point accuracies are not clinically significant for SEEG but may have implications for procedures such as deep brain stimulation that require higher placement accuracy. All of the electrodes achieved their respective intended anatomical targets. In 12 of 16 patients following robotic implantations, and 10 of 16 following manual PAD implantations a seizure onset zone was identified and resection recommended. The aforementioned systematic review and meta-analysis were updated to include additional studies published during the trial duration. In this context, the iSYS1 device entry and target point accuracies were similar to those reported in other published studies of robotic devices including the ROSA, Neuromate and iSYS1. The PAD accuracies, however, outperformed the previously published results for other frameless stereotaxy methods. In conclusion, the presented studies report the integration and validation of a complex clinical decision support software into the clinical neurosurgical workflow for SEEG planning. The stereotactic planning platform was further refined by integrating machine learning techniques and also extended towards optimisation of LITT trajectories for ablation of mesial temporal structures and corpus callosotomy. The platform was then used to seamlessly integrate with a novel trajectory planning software to effectively and safely guide the implantation of the SEEG electrodes. Through a single-blinded randomised control trial, the ISYS1 device was shown to reduce the time taken for individual electrode insertion. Taken together, this work presents and validates the first fully integrated stereotactic trajectory planning platform that can be used for both SEEG and LITT trajectory planning followed by surgical implantation through the use of a novel trajectory guidance system

Personalized computational models of deep brain stimulation

University of Minnesota Ph.D. dissertation. December 2016. Major: Biomedical Engineering. Advisor: Matthew Johnson. 1 computer file (PDF); xii, 138 pages.Deep brain stimulation (DBS) therapy is used for managing symptoms associated with a growing number of neurological disorders. One of the primary challenges with delivering this therapy, however, continues to be accurate neurosurgical targeting of the DBS lead electrodes and post-operative programming of the stimulation settings. Two approaches for addressing targeting have been advanced in recent years. These include novel DBS lead designs with more electrodes and computational models that can predict cellular modulation during DBS. Here, we developed a personalized computational modeling framework to (1) thoroughly investigate the electrode design parameter space for current and future DBS array designs, (2) generate and evaluate machine learning feature sets for semi-automated programming of DBS arrays, (3) study the influence of model parameters in predicting behavioral and electrophysiological outcomes of DBS in a preclinical animal model of Parkinson’s disease, and (4) evaluate feasibility of a novel endovascular targeting approach to delivering DBS therapy in humans. These studies show how independent current controlled stimulation with advanced machine learning algorithms can negate the need for highly dense electrode arrays to shift, steer, and sculpt regions of modulation within the brain. Additionally, these studies show that while advanced and personalized computational models of DBS can predict many of the behavioral and electrophysiological outcomes of DBS, there are remaining inconsistencies that suggest there are additional physiological mechanisms of DBS that are not yet well understood. Finally, the results show how computational models can be beneficial for prospective development of novel approaches to neuromodulation prior to large-scale preclinical and clinical studies

Computerized Analysis of Magnetic Resonance Images to Study Cerebral Anatomy in Developing Neonates

The study of cerebral anatomy in developing neonates is of great importance for the understanding of brain development during the early period of life. This dissertation therefore focuses on three challenges in the modelling of cerebral anatomy in neonates during brain development. The methods that have been developed all use Magnetic Resonance Images (MRI) as source data. To facilitate study of vascular development in the neonatal period, a set of image analysis algorithms are developed to automatically extract and model cerebral vessel trees. The whole process consists of cerebral vessel tracking from automatically placed seed points, vessel tree generation, and vasculature registration and matching. These algorithms have been tested on clinical Time-of- Flight (TOF) MR angiographic datasets. To facilitate study of the neonatal cortex a complete cerebral cortex segmentation and reconstruction pipeline has been developed. Segmentation of the neonatal cortex is not effectively done by existing algorithms designed for the adult brain because the contrast between grey and white matter is reversed. This causes pixels containing tissue mixtures to be incorrectly labelled by conventional methods. The neonatal cortical segmentation method that has been developed is based on a novel expectation-maximization (EM) method with explicit correction for mislabelled partial volume voxels. Based on the resulting cortical segmentation, an implicit surface evolution technique is adopted for the reconstruction of the cortex in neonates. The performance of the method is investigated by performing a detailed landmark study. To facilitate study of cortical development, a cortical surface registration algorithm for aligning the cortical surface is developed. The method first inflates extracted cortical surfaces and then performs a non-rigid surface registration using free-form deformations (FFDs) to remove residual alignment. Validation experiments using data labelled by an expert observer demonstrate that the method can capture local changes and follow the growth of specific sulcus

Using deep learning for an automatic detection and classification of the vascular bifurcations along the Circle of Willis

Most of the intracranial aneurysms (ICA) occur on a specific portion of the cerebral vascular tree named the Circle of Willis (CoW). More particularly, they mainly arise onto fifteen of the major arterial bifurcations constituting this circular structure. Hence, for an efficient and timely diagnosis it is critical to develop some methods being able to accurately recognize each Bifurcation of Interest (BoI). Indeed, an automatic extraction of the bifurcations presenting the higher risk of developing an ICA would offer the neuroradiologists a quick glance at the most alarming areas. Due to the recent efforts on Artificial Intelligence, Deep Learning turned out to be the best performing technology for many pattern recognition tasks. Moreover, various methods have been particularly designed for medical image analysis purposes. This study intends to assist the neuroradiologists to promptly locate any bifurcation presenting a high risk of ICA occurrence. It can be seen as a Computer Aided Diagnosis scheme, where the Artificial Intelligence facilitates the access to the regions of interest within the MRI. In this work, we propose a method for a fully automatic detection and recognition of the bifurcations of interest forming the Circle of Willis. Several neural networks architectures have been tested, and we thoroughly evaluate the bifurcation recognition rate

Development and application of a human cortical brain atlas on MRI considering phylogeny = Développement et emploi d’un atlas du cortex cérébral humain réalisé sur IRM et tenant compte de la phylogénie

Le cortex cérébral est une structure en couches complexe qui remplit différents types de fonctions. Au cours de l’histoire des neurosciences, plusieurs atlas corticaux ont été développés pour classifier différentes régions du cortex en tant que zones aux caractéristiques structurelles ou fonctionnelles communes, afin d'étudier et de quantifier les changements aux états sain et pathologique. Cependant, il n'existe pas d'atlas suivant une approche phylogénétique, c'est-à-dire, basée sur les critères d'évolution communs. Ce mémoire présente les étapes de création d'un nouvel atlas dans un modèle d’imagerie par résonance magnétique (IRM) en espace standard (pseudo-Talairach) : le PAN-Atlas, basé sur l'origine phylogénétique commune de chaque zone corticale, et son application sur des scans d’IRM de dix individus pour évaluer sa performance. D’abord, nous avons regroupé les différentes régions corticales en cinq régions d'intérêt (RdI) d'origine phylogénétique connue (archicortex, paléocortex, périarchicortex, proïsocortex, isocortex ou néocortex) sur la base de protocoles de segmentation validés histologiquement par d'autres groupes de chercheurs. Puis, nous avons segmenté ces régions manuellement sur le modèle d’IRM cérébrale moyen MNI-ICBM 2009c, en formant des masques. Par la suite, on a utilisé un pipeline multi-étapes de traitement des images pour réaliser le recalage des masques de notre atlas aux scans pondérés T1 de dix participants sains, en obtenant ainsi des masques automatiques pour chaque RdI. Les masques automatiques ont été évalués après une correction manuelle par le biais de l’indice Dice-kappa, qui quantifie la colocalisation des voxels de chaque masque automatique vs. le masque corrigé manuellement. L’indice a montré une très bonne à excellente performance de notre atlas. Cela a permis l’évaluation et comparaison des volumes corticales de chaque région et la quantification des valeurs de transfert de magnétisation (ITM), qui sont sensibles à la quantité de myéline présente dans le tissu. Ce travail montre que la division régionale du cortex en IRM avec une approche phylogénétique est réalisable à l'aide de notre PAN-Atlas en espace standard et que les masques peuvent être utilisés pour différents types de quantifications, comme les volumes corticaux, ou l’estimation des valeurs de ITM. Notre atlas pourrait éventuellement servir à évaluer les différences entre personnes saines et celles atteintes par des maladies neurodégénératives ou d’autres maladies neurologiques.The cerebral cortex is a complex layered structure that performs different types of functions. Throughout the history of neuroscience, several cortical atlases have been developed to classify/divide different regions of the cortex into areas with common structural or functional characteristics, to then study and quantify changes in healthy and pathological states. However, to date, there is no atlas following a phylogenetic approach, i.e. based on the common evolution criteria. This thesis presents the steps of creation of a new atlas corresponding to a standard MRI template: the PAN-Atlas, based on the common phylogenetic origin of each cortical zone, and its application on MRI scans of ten healthy participants to assess its performance. First, we grouped the different cortical regions into five regions of interest (ROI) of known phylogenetic origin (archicortex, paleocortex, periarchicortex, proisocortex, isocortex or neocortex) based on MRI protocols previously validated through histology by other groups of researchers. Then, we manually segmented these ROIs on the MNI-ICBM 2009c average brain MRI template, creating corresponding masks. We then used a multi-step image processing pipeline to register the atlas’ masks to T1 weighted images of ten healthy participants, generating automatic masks for each scan. The accuracy of these automatic atlas’ masks was assessed after manual correction using Dice-kappa similarity index, to quantify the colocalization of the automatic vs. the manually corrected masks. The Dice-kappa values showed a very good to excellent performance of the automatic atlas’ masks. This allowed the evaluation and comparison of cortical volumes of each ROI, as well as the quantification of magnetization transfer ratio (MTR) values, which are sensitive to myelin content. This work shows that the division of the cortex on MRI following a phylogenetic approach is feasible using our PAN Atlas, and that the masks of the atlas can be used to perform different types of quantifications, such as the ones presented here (cortical volume and MTR per ROI). Our atlas could similarly be used to assess differences between the cortex of healthy individuals and people affected by neurodegenerative diseases and other neurological disorders

Quantitative predictions of cerebral arterial labeling employing neural network ensemble orchestrate precise investigation in brain frailty of cerebrovascular disease

학위논문(석사) -- 서울대학교대학원 : 자연과학대학 협동과정 뇌과학전공, 2023. 2. 김상윤서우근(공동지도교수).Identifying the cerebral arterial branches is essential for undertaking a computational approach to cerebrovascular imaging. However, the complexity and inter-individual differences involved in this process have not been thoroughly studied. We used machine learning to examine the anatomical profile of the cerebral arterial tree. The method is less sensitive to inter-subject and cohort-wise anatomical variations and exhibits robust performance with an unprecedented in-depth vessel range. We applied machine learning algorithms to disease-free healthy control subjects (n = 42), patients with stroke with intracranial atherosclerosis (ICAS) (n = 46), and patients with stroke mixed with the existing controls (n = 69). We trained and tested 70% and 30% of each study cohort, respectively, incorporating spatial coordinates and geometric vessel feature vectors. Cerebral arterial images were analyzed based on the segmentation-stacking method using magnetic resonance angiography. We precisely classified the cerebral arteries across the exhaustive scope of vessel components using advanced geometric characterization, redefinition of vessel unit conception, and post-processing algorithms. We verified that the neural network ensemble, with multiple joint models as the combined predictor, classified all vessel component types independent of inter-subject variations in cerebral arterial anatomy. The validity of the categorization performance of the model was tested, considering the control, ICAS, and control-blended stroke cohorts, using the area under the receiver operating characteristic (ROC) curve and precision-recall curve. The classification accuracy rarely fell outside each images 90–99% scope, independent of cohort-dependent cerebrovascular structural variations. The classification ensemble was calibrated with high overall area rates under the ROC curve of 0.99–1.00 [0.97–1.00] in the test set across various study cohorts. Identifying an all-inclusive range of vessel components across controls, ICAS, and stroke patients, the accuracy rates of the prediction were: internal carotid arteries, 91–100%; middle cerebral arteries, 82–98%; anterior cerebral arteries, 88–100%; posterior cerebral arteries, 87–100%; and collections of superior, anterior inferior, and posterior inferior cerebellar arteries, 90–99% in the chunk-level classification. Using a voting algorithm on the queued classified vessel factors and anatomically post-processing the automatically classified results intensified quantitative prediction performance. We employed stochastic clustering and deep neural network ensembles. Machine intelligence-assisted prediction of vessel structure allowed us to personalize quantitative predictions of various types of cerebral arterial structures, contributing to precise and efficient decisions regarding cerebrovascular disease.CHAPTER 1. AUTOMATED IN-DEPTH CEREBRAL ARTERIAL LABELING USING CEREBROVASCULAR VASCULATURE REFRAMING AND DEEP NEURAL NETWORKS 8 1.1. INTRODUCTION 8 1.2.1. Study design and subjects 9 1.2.2. Imaging preparation 11 1.2.2.1. Magnetic resonance machine 11 1.2.2.2. Magnetic resonance sequence 11 1.2.2.3. Region growing 11 1.2.2.4. Feature extraction 11 1.2.3. Reframing hierarchical cerebrovasculature 12 1.2.4. Classification method development 14 1.2.4.1. Two-step modeling 14 1.2.4.2. Validation 16 1.2.4.3. Statistics 16 1.2.4.4. Data availability 16 1.3. RESULTS 16 1.3.1. Subject characteristics 16 1.3.2. Vascular component characteristics 21 1.3.3. Testing the appropriateness of the reframed vascular structure 24 1.3.4. Step 1 modeling: chunk 24 1.3.5. Step 2 modeling: branch 26 1.3.6. Vascular morphological features according to the vascular risk factors 31 1.3.7. The profiles of geometric feature vectors weighted on deep neural networks 31 1.4. DISCUSSION 35 1.4.1. The role of neural networks in this study 36 1.4.2. Paradigm-shifting vascular unit reframing 36 1.4.3. Limitations and future directions 37 1.5. CONCLUSIONS 38 1.6. ACKNOWLEDGEMENTS 38 1.7. FUNDING 39 BIBLIOGRAPHY 40석