Brain Computer Interfaces and Emotional Involvement: Theory, Research, and Applications

This reprint is dedicated to the study of brain activity related to emotional and attentional involvement as measured by Brain–computer interface (BCI) systems designed for different purposes. A BCI system can translate brain signals (e.g., electric or hemodynamic brain activity indicators) into a command to execute an action in the BCI application (e.g., a wheelchair, the cursor on the screen, a spelling device or a game). These tools have the advantage of having real-time access to the ongoing brain activity of the individual, which can provide insight into the user’s emotional and attentional states by training a classification algorithm to recognize mental states. The success of BCI systems in contemporary neuroscientific research relies on the fact that they allow one to “think outside the lab”. The integration of technological solutions, artificial intelligence and cognitive science allowed and will allow researchers to envision more and more applications for the future. The clinical and everyday uses are described with the aim to invite readers to open their minds to imagine potential further developments

Simultaneous intracranial EEG and fMRI of interictal epileptic discharges in humans

Simultaneous scalp EEG–fMRI measurements allow the study of epileptic networks and more generally, of the coupling between neuronal activity and haemodynamic changes in the brain. Intracranial EEG (icEEG) has greater sensitivity and spatial specificity than scalp EEG but limited spatial sampling. We performed simultaneous icEEG and functional MRI recordings in epileptic patients to study the haemodynamic correlates of intracranial interictal epileptic discharges (IED). Two patients undergoing icEEG with subdural and depth electrodes as part of the presurgical assessment of their pharmaco-resistant epilepsy participated in the study. They were scanned on a 1.5 T MR scanner following a strict safety protocol. Simultaneous recordings of fMRI and icEEG were obtained at rest. IED were subsequently visually identified on icEEG and their fMRI correlates were mapped using a general linear model (GLM). On scalp EEG–fMRI recordings performed prior to the implantation, no IED were detected. icEEG–fMRI was well tolerated and no adverse health effect was observed. intra-MR icEEG was comparable to that obtained outside the scanner. In both cases, significant haemodynamic changes were revealed in relation to IED, both close to the most active electrode contacts and at distant sites. In one case, results showed an epileptic network including regions that could not be sampled by icEEG, in agreement with findings from magneto-encephalography, offering some explanation for the persistence of seizures after surgery. Hence, icEEG–fMRI allows the study of whole-brain human epileptic networks with unprecedented sensitivity and specificity. This could help improve our understanding of epileptic networks with possible implications for epilepsy surgery

A Review on EEG Signals Based Emotion Recognition

Emotion recognition has become a very controversial issue in brain-computer interfaces (BCIs). Moreover, numerous studies have been conducted in order to recognize emotions. Also, there are several important definitions and theories about human emotions. In this paper we try to cover important topics related to the field of emotion recognition. We review several studies which are based on analyzing electroencephalogram (EEG) signals as a biological marker in emotion changes. Considering low cost, good time and spatial resolution, EEG has become very common and is widely used in most BCI applications and studies. First, we state some theories and basic definitions related to emotions. Then some important steps of an emotion recognition system like different kinds of biologic measurements (EEG, electrocardiogram [EEG], respiration rate, etc), offline vs online recognition methods, emotion stimulation types and common emotion models are described. Finally, the recent and most important studies are reviewed

The human connectome project for disordered emotional states: Protocol and rationale for a research domain criteria study of brain connectivity in young adult anxiety and depression

Available online 5 March 2020.Through the Human Connectome Project (HCP) our understanding of the functional connectome of the healthy brain has been dramatically accelerated. Given the pressing public health need, we must increase our understanding of how connectome dysfunctions give rise to disordered mental states. Mental disorders arising from high levels of negative emotion or from the loss of positive emotional experience affect over 400 million people globally. Such states of disordered emotion cut across multiple diagnostic categories of mood and anxiety disorders and are compounded by accompanying disruptions in cognitive function. Not surprisingly, these forms of psychopathology are the leading cause of disability worldwide. The Research Domain Criteria (RDoC) initiative spearheaded by NIMH offers a framework for characterizing the relations among connectome dysfunctions, anchored in neural circuits and phenotypic profiles of behavior and self-reported symptoms. Here, we report on our Connectomes Related to Human Disease protocol for integrating an RDoC framework with HCP protocols to characterize connectome dysfunctions in disordered emotional states, and present quality control data from a representative sample of participants. We focus on three RDoC domains and constructs most relevant to depression and anxiety: 1) loss and acute threat within the Negative Valence System (NVS) domain; 2) reward valuation and responsiveness within the Positive Valence System (PVS) domain; and 3) working memory and cognitive control within the Cognitive System (CS) domain. For 29 healthy controls, we present preliminary imaging data: functional magnetic resonance imaging collected in the resting state and in tasks matching our constructs of interest (“Emotion”, “Gambling” and “Continuous Performance” tasks), as well as diffusion-weighted imaging. All functional scans demonstrated good signal-to-noise ratio. Established neural networks were robustly identified in the resting state condition by independent component analysis. Processing of negative emotional faces significantly activated the bilateral dorsolateral prefrontal and occipital cortices, fusiform gyrus and amygdalae. Reward elicited a response in the bilateral dorsolateral prefrontal, parietal and occipital cortices, and in the striatum. Working memory was associated with activation in the dorsolateral prefrontal, parietal, motor, temporal and insular cortices, in the striatum and cerebellum. Diffusion tractography showed consistent profiles of fractional anisotropy along known white matter tracts. We also show that results are comparable to those in a matched sample from the HCP Healthy Young Adult data release. These preliminary data provide the foundation for acquisition of 250 subjects who are experiencing disordered emotional states. When complete, these data will be used to develop a neurobiological model that maps connectome dysfunctions to specific behaviors and symptoms.This work was supported by the National Institutes of Health [grant number U01MH109985 under PAR-14-281]

SEARCHING NEUROIMAGING BIOMARKERS IN MENTAL DISORDERS WITH GRAPH AND MULTIMODAL FUSION ANALYSIS OF FUNCTIONAL CONNECTIVITY

Mental disorders such as schizophrenia (SZ), bipolar (BD), and major depression disorders (MDD) can cause severe symptoms and life disruption. They share some symptoms, which can pose a major clinical challenge to their differentiation. Objective biomarkers based on neuroimaging may help to improve diagnostic accuracy and facilitate optimal treatment for patients. Over the last decades, non-invasive in-vivo neuroimaging techniques such as magnetic resonance imaging (MRI) have been increasingly applied to measure structure and function in human brains. With functional MRI (fMRI) or structural MRI (sMRI), studies have identified neurophysiological deficits in patients’ brain from different perspective. Functional connectivity (FC) analysis is an approach that measures functional integration in brains. By assessing the temporal coherence of the hemodynamic activity among brain regions, FC is considered capable of characterizing the large-scale integrity of neural activity. In this work, we present two data analysis frameworks for biomarker detection on brain imaging with FC, 1) graph analysis of FC and 2) multimodal fusion analysis, to better understand the human brain. Graph analysis reveals the interaction among brain regions based on graph theory, while the multimodal fusion framework enables us to utilize the strength of different imaging modalities through joint analysis. Four applications related to FC using these frameworks were developed. First, FC was estimated using a model-based approach, and revealed altered the small-world network structure in SZ. Secondly, we applied graph analysis on functional network connectivity (FNC) to differentiate BD and MDD during resting-state. Thirdly, two functional measures, FNC and fractional amplitude of low frequency fluctuations (fALFF), were spatially overlaid to compare the FC and spatial alterations in SZ. And finally, we utilized a multimodal fusion analysis framework, multi-set canonical correlation analysis + joint independent component analysis (mCCA+jICA) to link functional and structural abnormalities in BD and MDD. We also evaluated the accuracy of predictive diagnosis through classifiers generated on the selected features. In summary, via the two frameworks, our work has made several contributions to advance FC analysis, which improves our understanding of underlying brain function and structure, and our findings may be ultimately useful for the development of biomarkers of mental disease