Concurrent fNIRS and EEG for brain function investigation: A systematic, methodology-focused review

Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) stand as state-of-the-art techniques for non-invasive functional neuroimaging. On a unimodal basis, EEG has poor spatial resolution while presenting high temporal resolution. In contrast, fNIRS offers better spatial resolution, though it is constrained by its poor temporal resolution. One important merit shared by the EEG and fNIRS is that both modalities have favorable portability and could be integrated into a compatible experimental setup, providing a compelling ground for the development of a multimodal fNIRS-EEG integration analysis approach. Despite a growing number of studies using concurrent fNIRS-EEG designs reported in recent years, the methodological reference of past studies remains unclear. To fill this knowledge gap, this review critically summarizes the status of analysis methods currently used in concurrent fNIRS-EEG studies, providing an up-to-date overview and guideline for future projects to conduct concurrent fNIRS-EEG studies. A literature search was conducted using PubMed and Web of Science through 31 August 2021. After screening and qualification assessment, 92 studies involving concurrent fNIRS-EEG data recordings and analyses were included in the final methodological review. Specifically, three methodological categories of concurrent fNIRS-EEG data analyses, including EEG-informed fNIRS analyses, fNIRS-informed EEG analyses, and parallel fNIRS-EEG analyses, were identified and explained with detailed description. Finally, we highlighted current challenges and potential directions in concurrent fNIRS-EEG data analyses in future research

Understanding the Role of Dynamics in Brain Networks: Methods, Theory and Application

The brain is inherently a dynamical system whose networks interact at multiple spatial and temporal scales. Understanding the functional role of these dynamic interactions is a fundamental question in neuroscience. In this research, we approach this question through the development of new methods for characterizing brain dynamics from real data and new theories for linking dynamics to function. We perform our study at two scales: macro (at the level of brain regions) and micro (at the level of individual neurons). In the first part of this dissertation, we develop methods to identify the underlying dynamics at macro-scale that govern brain networks during states of health and disease in humans. First, we establish an optimization framework to actively probe connections in brain networks when the underlying network dynamics are changing over time. Then, we extend this framework to develop a data-driven approach for analyzing neurophysiological recordings without active stimulation, to describe the spatiotemporal structure of neural activity at different timescales. The overall goal is to detect how the dynamics of brain networks may change within and between particular cognitive states. We present the efficacy of this approach in characterizing spatiotemporal motifs of correlated neural activity during the transition from wakefulness to general anesthesia in functional magnetic resonance imaging (fMRI) data. Moreover, we demonstrate how such an approach can be utilized to construct an automatic classifier for detecting different levels of coma in electroencephalogram (EEG) data. In the second part, we study how ongoing function can constraint dynamics at micro-scale in recurrent neural networks, with particular application to sensory systems. Specifically, we develop theoretical conditions in a linear recurrent network in the presence of both disturbance and noise for exact and stable recovery of dynamic sparse stimuli applied to the network. We show how network dynamics can affect the decoding performance in such systems. Moreover, we formulate the problem of efficient encoding of an afferent input and its history in a nonlinear recurrent network. We show that a linear neural network architecture with a thresholding activation function is emergent if we assume that neurons optimize their activity based on a particular cost function. Such an architecture can enable the production of lightweight, history-sensitive encoding schemes

Functional Imaging Connectome of the Human Brain and its Associations with Biological and Behavioral Characteristics

Functional connectome of the human brain explores the temporal associations of different brain regions. Functional connectivity (FC) measures derived from resting state functional magnetic resonance imaging (rfMRI) characterize the brain network at rest and studies have shown that rfMRI FC is closely related to individual subject\u27s biological and behavioral measures. In this thesis we investigate a large rfMRI dataset from the Human Connectome Project (HCP) and utilize statistical methods to facilitate the understanding of fundamental FC-behavior associations of the human brain. Our studies include reliability analysis of FC statistics, demonstration of FC spatial patterns, and predictive analysis of individual biological and behavioral measures using FC features. Covering both static and dynamic FC (sFC and dFC) characterizations, the baseline FC patterns in healthy young adults are illustrated. Predictive analyses demonstrate that individual biological and behavioral measures, such as gender, age, fluid intelligence and language scores, can be predicted using FC. While dFC by itself performs worse than sFC in prediction accuracy, if appropriate parameters and models are utilized, adding dFC features to sFC can significantly increase the predictive power. Results of this thesis contribute to the understanding of the neural underpinnings of individual biological and behavioral differences in the human brain

Network-based brain computer interfaces: principles and applications

Brain-computer interfaces (BCIs) make possible to interact with the external environment by decoding the mental intention of individuals. BCIs can therefore be used to address basic neuroscience questions but also to unlock a variety of applications from exoskeleton control to neurofeedback (NFB) rehabilitation. In general, BCI usability critically depends on the ability to comprehensively characterize brain functioning and correctly identify the user s mental state. To this end, much of the efforts have focused on improving the classification algorithms taking into account localized brain activities as input features. Despite considerable improvement BCI performance is still unstable and, as a matter of fact, current features represent oversimplified descriptors of brain functioning. In the last decade, growing evidence has shown that the brain works as a networked system composed of multiple specialized and spatially distributed areas that dynamically integrate information. While more complex, looking at how remote brain regions functionally interact represents a grounded alternative to better describe brain functioning. Thanks to recent advances in network science, i.e. a modern field that draws on graph theory, statistical mechanics, data mining and inferential modelling, scientists have now powerful means to characterize complex brain networks derived from neuroimaging data. Notably, summary features can be extracted from these networks to quantitatively measure specific organizational properties across a variety of topological scales. In this topical review, we aim to provide the state-of-the-art supporting the development of a network theoretic approach as a promising tool for understanding BCIs and improve usability

Contributions to the study of Austism Spectrum Brain conectivity

164 p.Autism Spectrum Disorder (ASD) is a largely prevalent neurodevelopmental condition with a big social and economical impact affecting the entire life of families. There is an intense search for biomarkers that can be assessed as early as possible in order to initiate treatment and preparation of the family to deal with the challenges imposed by the condition. Brain imaging biomarkers have special interest. Specifically, functional connectivity data extracted from resting state functional magnetic resonance imaging (rs-fMRI) should allow to detect brain connectivity alterations. Machine learning pipelines encompass the estimation of the functional connectivity matrix from brain parcellations, feature extraction and building classification models for ASD prediction. The works reported in the literature are very heterogeneous from the computational and methodological point of view. In this Thesis we carry out a comprehensive computational exploration of the impact of the choices involved while building these machine learning pipelines

Building a Science of Individual Differences from fMRI

To date, fMRI research has been concerned primarily with evincing generic principles of brain function through averaging data from multiple subjects. Given rapid developments in both hardware and analysis tools, the field is now poised to study fMRI-derived measures in individual subjects, and to relate these to psychological traits or genetic variations. We discuss issues of validity, reliability and statistical assessment that arise when the focus shifts to individual subjects and that are applicable also to other imaging modalities. We emphasize that individual assessment of neural function with fMRI presents specific challenges and necessitates careful consideration of anatomical and vascular between-subject variability as well as sources of within-subject variability

Inhibitory mechanisms for visual learning in the human brain

Identifying targets in cluttered scenes is critical for our interactions in complex environments. Our visual system is challenged to both detect elusive targets that we may want to avoid or chase and discriminate between targets that are highly similar. These tasks require our visual system to become an expert at detecting distinctive features that help us differentiate between indistinguishable targets. As the human brain is trained on this type of visual tasks, we observe changes in its function that correspond to improved performance. We use functional brain imaging, to measure learning-dependent modulations of brain activation and investigate the processes that mediate functional brain plasticity. I propose that dissociable brain mechanisms are engaged when detecting targets in clutter vs. discriminating between highly similar targets: for the former, background clutter needs to be suppressed for the target to be recognised, whereas for the latter, neurons are tuned to respond to fine differences. Although GABAergic inhibition is known to suppress redundant neuronal populations and tune neuronal representations, its role in visual learning remains largely unexplored. Here, I propose that GABAergic inhibition plays an important role in visual plasticity through training on these tasks. The purpose of my PhD is to investigate the inhibitory mechanisms that mediate visual perceptual learning; in particular, learning to detect patterns in visual clutter and discriminate between highly similar patterns. I show that BOLD signals as measured by functional Magnetic Resonance Imaging (fMRI) do not differentiate between the two proposed mechanisms. In contrast, Magnetic Resonance Spectroscopy (MRS) provides strong evidence for the distinct involvement of GABAergic inhibition in visual plasticity. Further, my findings show GABA changes during the time-course of learning providing evidence for a distinct role of GABA in learning-dependent plasticity across different brain regions involved in visual learning. Finally, I test the causal link between inhibitory contributions and visual plasticity using a brain stimulation intervention that perturbs the excitation-inhibition balance in the visual cortex and facilitates learning

A Novel Synergistic Model Fusing Electroencephalography and Functional Magnetic Resonance Imaging for Modeling Brain Activities

Study of the human brain is an important and very active area of research. Unraveling the way the human brain works would allow us to better understand, predict and prevent brain related diseases that affect a significant part of the population. Studying the brain response to certain input stimuli can help us determine the involved brain areas and understand the mechanisms that characterize behavioral and psychological traits. In this research work two methods used for the monitoring of brain activities, Electroencephalography (EEG) and functional Magnetic Resonance (fMRI) have been studied for their fusion, in an attempt to bridge together the advantages of each one. In particular, this work has focused in the analysis of a specific type of EEG and fMRI recordings that are related to certain events and capture the brain response under specific experimental conditions. Using spatial features of the EEG we can describe the temporal evolution of the electrical field recorded in the scalp of the head. This work introduces the use of Hidden Markov Models (HMM) for modeling the EEG dynamics. This novel approach is applied for the discrimination of normal and progressive Mild Cognitive Impairment patients with significant results. EEG alone is not able to provide the spatial localization needed to uncover and understand the neural mechanisms and processes of the human brain. Functional Magnetic Resonance imaging (fMRI) provides the means of localizing functional activity, without though, providing the timing details of these activations. Although, at first glance it is apparent that the strengths of these two modalities, EEG and fMRI, complement each other, the fusion of information provided from each one is a challenging task. A novel methodology for fusing EEG spatiotemporal features and fMRI features, based on Canonical Partial Least Squares (CPLS) is presented in this work. A HMM modeling approach is used in order to derive a novel feature-based representation of the EEG signal that characterizes the topographic information of the EEG. We use the HMM model in order to project the EEG data in the Fisher score space and use the Fisher score to describe the dynamics of the EEG topography sequence. The correspondence between this new feature and the fMRI is studied using CPLS. This methodology is applied for extracting features for the classification of a visual task. The results indicate that the proposed methodology is able to capture task related activations that can be used for the classification of mental tasks. Extensions on the proposed models are examined along with future research directions and applications

Identifying Changes of Functional Brain Networks using Graph Theory

This thesis gives an overview on how to estimate changes in functional brain networks using graph theoretical measures. It explains the assessment and definition of functional brain networks derived from fMRI data. More explicitly, this thesis provides examples and newly developed methods on the measurement and visualization of changes due to pathology, external electrical stimulation or ongoing internal thought processes. These changes can occur on long as well as on short time scales and might be a key to understanding brain pathologies and their development. Furthermore, this thesis describes new methods to investigate and visualize these changes on both time scales and provides a more complete picture of the brain as a dynamic and constantly changing network.:1 Introduction 1.1 General Introduction 1.2 Functional Magnetic Resonance Imaging 1.3 Resting-state fMRI 1.4 Brain Networks and Graph Theory 1.5 White-Matter Lesions and Small Vessel Disease 1.6 Transcranial Direct Current Stimulation 1.7 Dynamic Functional Connectivity 2 Publications 2.1 Resting developments: a review of fMRI post-processing methodologies for spontaneous brain activity 2.2 Early small vessel disease affects fronto-parietal and cerebellar hubs in close correlation with clinical symptoms - A resting-state fMRI study 2.3 Dynamic modulation of intrinsic functional connectivity by transcranial direct current stimulation 2.4 Three-dimensional mean-shift edge bundling for the visualization of functional connectivity in the brain 2.5 Dynamic network participation of functional connectivity hubs assessed by resting-state fMRI 3 Summary 4 Bibliography 5. Appendix 5.1 Erklärung über die eigenständige Abfassung der Arbeit 5.2 Curriculum vitae 5.3 Publications 5.4 Acknowledgement