An automated pipeline for constructing personalized virtual brains from multimodal neuroimaging data

AbstractLarge amounts of multimodal neuroimaging data are acquired every year worldwide. In order to extract high-dimensional information for computational neuroscience applications standardized data fusion and efficient reduction into integrative data structures are required. Such self-consistent multimodal data sets can be used for computational brain modeling to constrain models with individual measurable features of the brain, such as done with The Virtual Brain (TVB). TVB is a simulation platform that uses empirical structural and functional data to build full brain models of individual humans. For convenient model construction, we developed a processing pipeline for structural, functional and diffusion-weighted magnetic resonance imaging (MRI) and optionally electroencephalography (EEG) data. The pipeline combines several state-of-the-art neuroinformatics tools to generate subject-specific cortical and subcortical parcellations, surface-tessellations, structural and functional connectomes, lead field matrices, electrical source activity estimates and region-wise aggregated blood oxygen level dependent (BOLD) functional MRI (fMRI) time-series. The output files of the pipeline can be directly uploaded to TVB to create and simulate individualized large-scale network models that incorporate intra- and intercortical interaction on the basis of cortical surface triangulations and white matter tractograpy. We detail the pitfalls of the individual processing streams and discuss ways of validation. With the pipeline we also introduce novel ways of estimating the transmission strengths of fiber tracts in whole-brain structural connectivity (SC) networks and compare the outcomes of different tractography or parcellation approaches. We tested the functionality of the pipeline on 50 multimodal data sets. In order to quantify the robustness of the connectome extraction part of the pipeline we computed several metrics that quantify its rescan reliability and compared them to other tractography approaches. Together with the pipeline we present several principles to guide future efforts to standardize brain model construction. The code of the pipeline and the fully processed data sets are made available to the public via The Virtual Brain website (thevirtualbrain.org) and via github (https://github.com/BrainModes/TVB-empirical-data-pipeline). Furthermore, the pipeline can be directly used with High Performance Computing (HPC) resources on the Neuroscience Gateway Portal (http://www.nsgportal.org) through a convenient web-interface

Modeling brain dynamics in brain tumor patients using the virtual brain

Presurgical planning for brain tumor resection aims at delineating eloquent tissue in the vicinity of the lesion to spare during surgery. To this end, noninvasive neuroimaging techniques such as functional MRI and diffusion-weighted imaging fiber tracking are currently employed. However, taking into account this information is often still insufficient, as the complex nonlinear dynamics of the brain impede straightforward prediction of functional outcome after surgical intervention. Large-scale brain network modeling carries the potential to bridge this gap by integrating neuroimaging data with biophysically based models to predict collective brain dynamics. As a first step in this direction, an appropriate computational model has to be selected, after which suitable model parameter values have to be determined. To this end, we simulated large-scale brain dynamics in 25 human brain tumor patients and 11 human control participants using The Virtual Brain, an open-source neuroinformatics platform. Local and global model parameters of the Reduced Wong-Wang model were individually optimized and compared between brain tumor patients and control subjects. In addition, the relationship between model parameters and structural network topology and cognitive performance was assessed. Results showed (1) significantly improved prediction accuracy of individual functional connectivity when using individually optimized model parameters; (2) local model parameters that can differentiate between regions directly affected by a tumor, regions distant from a tumor, and regions in a healthy brain; and (3) interesting associations between individually optimized model parameters and structural network topology and cognitive performance

Bridging structure and function with brain network modeling

High-throughput neuroimaging technology enables rapid acquisition of vast amounts of structural and functional data on multiple spatial and temporal scales. While novel methods to extract information from these data are continuously developed, there is no principled approach for the systematic integration of distinct experimental results into a common theoretical framework, yet. The central result of this dissertation is a biophysically-based framework for brain network modeling that links structural and functional data across scales and modalities and integrates them with dynamical systems theory. Specifically, the publications in this thesis i. introduce an automated pipeline that extracts structural and functional information from multimodal imaging data to construct and constrain brain models, ii. link whole-brain models with empirical EEG-fMRI (simultaneous electroencephalography and functional magnetic resonance imaging) data to integrate neural signals with simulated activity, iii. propose a framework for reverse-engineering neurophysiological dynamics and mechanisms underlying commonly observed features of neural activity, iv. document a software module that makes users acquainted with theory and practice of brain modeling, v. associate aging with structural and functional connectivity and vi. examine how parcellation size and short-range connectivity affect model dynamics. Taken together, these results form a novel approach that enables reverse-engineering of neurophysiological processes and mechanisms on the basis of biophysically-based brain models.Zusammenfassung Hochdurchsatzverfahren zur neuronalen Bildgebung ermöglichen die schnelle Erfassung großer Mengen an strukturellen und funktionellen Daten über verschiedenen räumlichen und zeitlichen Skalen. Obwohl ständig neue Methoden zur Verarbeitung der in diesen Daten enthaltenen Informationen entwickelt werden gibt es bisher kein systematisches Verfahren um experimentelle Ergebnisse in einem gemeinsamen theoretischen Rahmenwerk zu integrieren und zu verknüpfen. Das Hauptergebnis dieser Dissertation ist ein biophysikalisch basiertes Gehirn- Netzwerkmodell das strukturelle und funktionelle Daten über verschiedene Skalen und Modalitäten hinweg verknüpft und mit dynamischer Systemtheorie vereint. Die hier zusammengefassten Publikationen i. stellen eine automatische Software-Pipeline vor die strukturelle und funktionelle Informationen aus multimodalen Bilddaten extrahiert um Gehirnmodelle zu konstruieren und zu parametrisieren, ii. verknüpfen Ganzhi rnmodel le mi t empi r i schen EEG- fMRT ( s imul tane Elektroenzephalographie und funktionelle Magnetresonanztomographie) Daten um neuronale Signale mit simulierter Aktivität zu integrieren, iii. schlagen ein Rahmenwerk vor um neurophysiologische Dynamiken und Mechanismen die häufig beobachteten Eigenschaften neuronaler Aktivität zu Grunde liegen zu rekonstruieren, iv. dokumentieren ein Software-Modul das Benutzer mit Theorie und Praxis der Gehirnmodellierung vertraut macht, v. assoziieren Alterungsprozesse mit struktureller und funktioneller Konnektivität und vi. untersuchen wie Gehirn-Parzellierung und lokale Konnektivität die Modelldynamik beeinflussen. Zusammengenommen ergibt sich ein neuartiges Verfahren das die Rekonstruktion neurophysiologischer Prozesse und Mechanismen ermöglicht und mit dessen Hilfe neuronale Aktivität auf verschiedenen räumlichen und zeitlichen Skalen anhand biophysikalisch basierter Modelle vorhersagt werden kann

metastability and its dynamical cortical core

In the human brain, spontaneous activity during resting state consists of rapid transitions between functional network states over time but the underlying mechanisms are not understood. We use connectome based computational brain network modeling to reveal fundamental principles of how the human brain generates large-scale activity observable by noninvasive neuroimaging. We used structural and functional neuroimaging data to construct whole- brain models. With this novel approach, we reveal that the human brain during resting state operates at maximum metastability, i.e. in a state of maximum network switching. In addition, we investigate cortical heterogeneity across areas. Optimization of the spectral characteristics of each local brain region revealed the dynamical cortical core of the human brain, which is driving the activity of the rest of the whole brain. Brain network modelling goes beyond correlational neuroimaging analysis and reveals non-trivial network mechanisms underlying non-invasive observations. Our novel findings significantly pertain to the important role of computational connectomics in understanding principles of brain function

A Neuroimaging Web Interface for Data Acquisition, Processing and Visualization of Multimodal Brain Images

Structural and functional brain images are generated as essential modalities for medical experts to learn about the different functions of the brain. These images are typically visually inspected by experts. Many software packages are available to process medical images, but they are complex and difficult to use. The software packages are also hardware intensive. As a consequence, this dissertation proposes a novel Neuroimaging Web Services Interface (NWSI) as a series of processing pipelines for a common platform to store, process, visualize and share data. The NWSI system is made up of password-protected interconnected servers accessible through a web interface. The web-interface driving the NWSI is based on Drupal, a popular open source content management system. Drupal provides a user-based platform, in which the core code for the security and design tools are updated and patched frequently. New features can be added via modules, while maintaining the core software secure and intact. The webserver architecture allows for the visualization of results and the downloading of tabulated data. Several forms are ix available to capture clinical data. The processing pipeline starts with a FreeSurfer (FS) reconstruction of T1-weighted MRI images. Subsequently, PET, DTI, and fMRI images can be uploaded. The Webserver captures uploaded images and performs essential functionalities, while processing occurs in supporting servers. The computational platform is responsive and scalable. The current pipeline for PET processing calculates all regional Standardized Uptake Value ratios (SUVRs). The FS and SUVR calculations have been validated using Alzheimer\u27s Disease Neuroimaging Initiative (ADNI) results posted at Laboratory of Neuro Imaging (LONI). The NWSI system provides access to a calibration process through the centiloid scale, consolidating Florbetapir and Florbetaben tracers in amyloid PET images. The interface also offers onsite access to machine learning algorithms, and introduces new heat maps that augment expert visual rating of PET images. NWSI has been piloted using data and expertise from Mount Sinai Medical Center, the 1Florida Alzheimer’s Disease Research Center (ADRC), Baptist Health South Florida, Nicklaus Children\u27s Hospital, and the University of Miami. All results were obtained using our processing servers in order to maintain data validity, consistency, and minimal processing bias

The Importance of Cerebellar Connectivity on Simulated Brain Dynamics

The brain shows a complex multiscale organization that prevents a direct understanding of how structure, function and dynamics are correlated. To date, advances in neural modeling offer a unique opportunity for simulating global brain dynamics by embedding empirical data on different scales in a mathematical framework. The Virtual Brain (TVB) is an advanced data-driven model allowing to simulate brain dynamics starting from individual subjects’ structural and functional connectivity obtained, for example, from magnetic resonance imaging (MRI). The use of TVB has been limited so far to cerebral connectivity but here, for the first time, we have introduced cerebellar nodes and interconnecting tracts to demonstrate the impact of cerebro-cerebellar loops on brain dynamics. Indeed, the matching between the empirical and simulated functional connectome was significantly improved when including the cerebro-cerebellar loops. This positive result should be considered as a first step, since issues remain open about the best strategy to reconstruct effective structural connectivity and the nature of the neural mass or mean-field models generating local activity in the nodes. For example, signal processing is known to differ remarkably between cortical and cerebellar microcircuits. Tackling these challenges is expected to further improve the predictive power of functional brain activity simulations, using TVB or other similar tools, in explaining not just global brain dynamics but also the role of cerebellum in determining brain states in physiological conditions and in the numerous pathologies affecting the cerebro-cerebellar loop

Subject specificity of the correlation between large-scale structural and functional connectivity

Structural connectivity (SC), the physical pathways connecting regions in the brain, and functional connectivity (FC), the temporal coactivations, are known to be tightly linked. However, the nature of this relationship is still not understood. In the present study, we examined this relation more closely in six separate human neuroimaging datasets with different acquisition and preprocessing methods. We show that using simple linear associations, the relation between an individual’s SC and FC is not subject specific for five of the datasets. Subject specificity of SC-FC fit is achieved only for one of the six datasets, the multimodal Glasser Human Connectome Project (HCP) parcellated dataset. We show that subject specificity of SC-FC correspondence is limited across datasets due to relatively small variability between subjects in SC compared with the larger variability in FC. We present evidence that, in most standard datasets, the subject variation in structural connectivity (SC) may be too weak to be reflected in the functional connectivity (FC) variability. However, subject specificity of SC-FC can be captured via fine, multimodally parcellated data because of greater SC variability across subjects. Nonetheless, SC and FC each show a large component that is common across subjects, which sets limitations on the extent of SC-FC subject specificity. Implications of these findings for personalized medicine should be considered. Namely, attention to the quality of processing and parcellation methods is critical for furthering our understanding of the relationship between individual SC and FC

Linking Molecular Pathways and Large-Scale Computational Modeling to Assess Candidate Disease Mechanisms and Pharmacodynamics in Alzheimer's Disease

Introduction: While the prevalence of neurodegenerative diseases associated with dementia such as Alzheimer's disease (AD) increases, our knowledge on the underlying mechanisms, outcome predictors, or therapeutic targets is limited. In this work, we demonstrate how computational multi-scale brain modeling links phenomena of different scales and therefore identifies potential disease mechanisms leading the way to improved diagnostics and treatment. Methods: The Virtual Brain (TVB; thevirtualbrain.org) neuroinformatics platform allows standardized large-scale structural connectivity-based simulations of whole brain dynamics. We provide proof of concept for a novel approach that quantitatively links the effects of altered molecular pathways onto neuronal population dynamics. As a novelty, we connect chemical compounds measured with positron emission tomography (PET) with neural function in TVB addressing the phenomenon of hyperexcitability in AD related to the protein amyloid beta (Abeta). We construct personalized virtual brains based on an averaged healthy connectome and individual PET derived distributions of Abeta in patients with mild cognitive impairment (MCI, N = 8) and Alzheimer's Disease (AD, N = 10) and in age-matched healthy controls (HC, N = 15) using data from ADNI-3 data base (http://adni.loni.usc.edu). In the personalized virtual brains, individual Abeta burden modulates regional Excitation-Inhibition balance, leading to local hyperexcitation with high Abeta loads. We analyze simulated regional neural activity and electroencephalograms (EEG). Results: Known empirical alterations of EEG in patients with AD compared to HCs were reproduced by simulations. The virtual AD group showed slower frequencies in simulated local field potentials and EEG compared to MCI and HC groups. The heterogeneity of the Abeta load is crucial for the virtual EEG slowing which is absent for control models with homogeneous Abeta distributions. Slowing phenomena primarily affect the network hubs, independent of the spatial distribution of Abeta. Modeling the N-methyl-D-aspartate (NMDA) receptor antagonism of memantine in local population models, reveals potential functional reversibility of the observed large-scale alterations (reflected by EEG slowing) in virtual AD brains. Discussion: We demonstrate how TVB enables the simulation of systems effects caused by pathogenetic molecular candidate mechanisms in human virtual brains