Brain Computer Interfaces and Emotional Involvement: Theory, Research, and Applications

This reprint is dedicated to the study of brain activity related to emotional and attentional involvement as measured by Brain–computer interface (BCI) systems designed for different purposes. A BCI system can translate brain signals (e.g., electric or hemodynamic brain activity indicators) into a command to execute an action in the BCI application (e.g., a wheelchair, the cursor on the screen, a spelling device or a game). These tools have the advantage of having real-time access to the ongoing brain activity of the individual, which can provide insight into the user’s emotional and attentional states by training a classification algorithm to recognize mental states. The success of BCI systems in contemporary neuroscientific research relies on the fact that they allow one to “think outside the lab”. The integration of technological solutions, artificial intelligence and cognitive science allowed and will allow researchers to envision more and more applications for the future. The clinical and everyday uses are described with the aim to invite readers to open their minds to imagine potential further developments

Social and Affective Neuroscience of Everyday Human Interaction

This Open Access book presents the current state of the art knowledge on social and affective neuroscience based on empirical findings. This volume is divided into several sections first guiding the reader through important theoretical topics within affective neuroscience, social neuroscience and moral emotions, and clinical neuroscience. Each chapter addresses everyday social interactions and various aspects of social interactions from a different angle taking the reader on a diverse journey. The last section of the book is of methodological nature. Basic information is presented for the reader to learn about common methodologies used in neuroscience alongside advanced input to deepen the understanding and usability of these methods in social and affective neuroscience for more experienced readers

Social and Affective Neuroscience of Everyday Human Interaction

This Open Access book presents the current state of the art knowledge on social and affective neuroscience based on empirical findings. This volume is divided into several sections first guiding the reader through important theoretical topics within affective neuroscience, social neuroscience and moral emotions, and clinical neuroscience. Each chapter addresses everyday social interactions and various aspects of social interactions from a different angle taking the reader on a diverse journey. The last section of the book is of methodological nature. Basic information is presented for the reader to learn about common methodologies used in neuroscience alongside advanced input to deepen the understanding and usability of these methods in social and affective neuroscience for more experienced readers

Systems Dynamics of the Anterior Cingulate Cortex and Hippocampus in Behavioral Switching, Spatial Working Memory, and Disease

The electrophysiological properties of the hippocampus (HC) and anterior cingulate cortex (ACC) are the central focus of research on learning, memory, and neurological disease. Previous research has shown that HC is essential for forming new memories, spatial navigation, and temporal processing. While the function of ACC, located within the medial prefrontal cortex, remains controversial, it has a role in long-term memory recall, processing pain, monitoring current state, learning, schema updates, and information integrations. Interactions between the ACC and HC occur during social memory, spatial working memory performance, and long-term memory recall. Notably, the HC and ACC are among the first brain areas to exhibit changes relating to neurological diseases such as Alzheimer’s disease (AD). The two core pathologies of AD are beta-amyloid plaques and neurofibrillary tangles, but recently a third pathology has been identified as chronic neuroinflammation. Neuroinflammation is commonly observed in neurological diseases but can also occur in prolonged hyperglycemia and type II diabetes (DM2). Interestingly, DM2 is associated with impaired cognition, which manifests in learning, memory, and spatial processing deficits. DM2 is quite common in the United States, and patients with DM2 are more than twice as likely to be diagnosed with AD later in life. This dissertation focuses on three experiments that aim to identify normal brain states across animal species in learning, diseases, and genetic alterations. First, we applied learning algorithms to the state space of neuronal ensembles in the ACC while animals updated their predictions on reward frequency. Next, we investigate how reduced GABAb receptors on neuroglia impair hippocampal and neural system communication. Lastly, we utilized a rodent model of DM2 to examine if alterations in the ACC- hippocampal network are similar to changes found in the early stages of AD. These studies represent the findings from numerous experimental approaches across multiple neuroscience laboratories

Machine Learning Methods with Noisy, Incomplete or Small Datasets

In many machine learning applications, available datasets are sometimes incomplete, noisy or affected by artifacts. In supervised scenarios, it could happen that label information has low quality, which might include unbalanced training sets, noisy labels and other problems. Moreover, in practice, it is very common that available data samples are not enough to derive useful supervised or unsupervised classifiers. All these issues are commonly referred to as the low-quality data problem. This book collects novel contributions on machine learning methods for low-quality datasets, to contribute to the dissemination of new ideas to solve this challenging problem, and to provide clear examples of application in real scenarios

Social and Affective Neuroscience of Embodiment

Embodiment has been discussed in the context of social, affective, and cognitive psychology, and also in the investigations of neuroscience in order to understand the relationship between biological mechanisms, body and cognitive, and social and affective processes. New theoretical models have been presented by researchers considering not only the sensory–motor interaction and the environment but also biological mechanisms regulating homeostasis and neural processes (Tsakiris M, Q J Exp Psychol 70(4):597–609, 2017). Historically, the body and the mind were comprehended as separate entities. The body was considered to function as a machine, responsible for providing sensory information to the mind and executing its commands. The mind, however, would process information in an isolated way, similar to a computer (Pecher D, Zwaan RA, Grounding cognition: the role of perception and action in memory, language, and thinking. Cambridge University Press, 2005). This mind and body perspective (Marmeleira J, Duarte Santos G, Percept Motor Skills 126, 2019; Marshall PJ, Child Dev Perspect 10(4):245–250, 2016), for many years, was the basis for studies in social and cognitive areas, in neuroscience, and clinical psychology

Facial EMG – Investigating the Interplay of Facial Muscles and Emotions

This chapter provides information about facial electromyography (EMG) as a method of investigating emotions and affect, including examples of application and methods for analysis. This chapter begins with a short introduction to emotion theory followed by an operationalisation of facial emotional expressions as an underlying requirement for their study using facial EMG. This chapter ends by providing practical information on the use of facial EMG

Deep Learning for Embedding and Integrating Multimodal Biomedical Data

Biomedical data is being generated in extremely high throughput and high dimension by technologies in areas ranging from single-cell genomics, proteomics, and transcriptomics (cytometry, single-cell RNA and ATAC sequencing) to neuroscience and cognition (fMRI and PET) to pharmaceuticals (drug perturbations and interactions). These new and emerging technologies and the datasets they create give an unprecedented view into the workings of their respective biological entities. However, there is a large gap between the information contained in these datasets and the insights that current machine learning methods can extract from them. This is especially the case when multiple technologies can measure the same underlying biological entity or system. By separately analyzing the same system but from different views gathered by different data modalities, patterns are left unobserved if they only emerge from the multi-dimensional joint representation of all of the modalities together. Through an interdisciplinary approach that emphasizes active collaboration with data domain experts, my research has developed models for data integration, extracting important insights through the joint analysis of varied data sources. In this thesis, I discuss models that address this task of multi-modal data integration, especially generative adversarial networks (GANs) and autoencoders (AEs). My research has been focused on using both of these models in a generative way for concrete problems in cutting-edge scientific applications rather than the exclusive focus on the generation of high-resolution natural images. The research in this thesis is united around ideas of building models that can extract new knowledge from scientific data inaccessible to currently existing methods

Using Unsupervised Learning Methods to Analyse Magnetic Resonance Imaging (MRI) Scans for the Detection of Alzheimer’s Disease

Background: Alzheimer’s disease (AD) is the most common cause of dementia, characterised by behavioural and cognitive impairment. The manual diagnosis of AD by doctors is time-consuming and can be ineffective, so machine learning methods are increasingly being proposed to diagnose AD in many recent studies. Most research developing machine learning algorithms to diagnose AD use supervised learning to classify magnetic resonance imaging (MRI) scans. However, supervised learning requires a considerable volume of labelled data and MRI scans are difficult to label. The aim of this thesis was therefore to use unsupervised learning methods to differentiate between MRI scans from people who were cognitively normal (CN), people with mild cognitive impairment (MCI), and people with AD. Objectives: This study applied a statistical method and unsupervised learning methods to discriminate scans from (1) people with CN and with AD; (2) people with stable mild cognitive impairment (sMCI) and with progressive mild cognitive impairment (pMCI); (3) people with CN and with pMCI, using a limited number of labelled structural MRI scans. Methods: Two-sample t-tests were used to detect the regions of interest (ROIs) between each of the two groups (CN vs. AD; sMCI vs. pMCI; CN vs. pMCI), and then an unsupervised learning neural network was employed to extract features from the regions. Finally, a clustering algorithm was implemented to discriminate between each of the two groups based on the extracted features. The approach was tested on baseline brain structural MRI scans from 715 individuals from the Alzheimer’s Disease Neuroimaging Initiative (ADNI), of which 231 were CN, 198 had AD, 152 had sMCI, and 134 were pMCI. The results were evaluated by calculating the overall accuracy, the sensitivity, specificity, and positive and negative predictive values. Results: The abnormal regions around the lower parts of the limbic system were indicated as AD-relevant regions based on the two-sample t-test (p<0.001), and the proposed method yielded an overall accuracy of 0.842 for discriminating between CN and AD, an overall accuracy of 0.672 for discriminating between sMCI and pMCI, and an overall accuracy of 0.776 for discriminating between CN and pMCI. Conclusion: The study combined statistical and unsupervised learning methods to identify scans of people with different stages of AD. This method can detect AD-relevant regions and could be used to accurately diagnose stages of AD; it has the advantage that it does not require large amounts of labelled MRI scans. The performances of the three discriminations were all comparable to those of previous state-of-the-art studies. The research in this thesis could be implemented in the future to help in the automatic diagnosis of AD and provide a basis for diagnosing sMCI and pMCI

Brain State Decoding Based on fMRI Using Semisupervised Sparse Representation Classifications

Multivariate classification techniques have been widely applied to decode brain states using functional magnetic resonance imaging (fMRI). Due to variabilities in fMRI data and the limitation of the collection of human fMRI data, it is not easy to train an efficient and robust supervised-learning classifier for fMRI data. Among various classification techniques, sparse representation classifier (SRC) exhibits a state-of-the-art classification performance in image classification. However, SRC has rarely been applied to fMRI-based decoding. This study aimed to improve SRC using unlabeled testing samples to allow it to be effectively applied to fMRI-based decoding. We proposed a semisupervised-learning SRC with an average coefficient (semiSRC-AVE) method that performed the classification using the average coefficient of each class instead of the reconstruction error and selectively updated the training dataset using new testing data with high confidence to improve the performance of SRC. Simulated and real fMRI experiments were performed to investigate the feasibility and robustness of semiSRC-AVE. The results of the simulated and real fMRI experiments showed that semiSRC-AVE significantly outperformed supervised learning SRC with an average coefficient (SRC-AVE) method and showed better performance than the other three semisupervised learning methods