Neurophysiological Assessment of Affective Experience

In the field of Affective Computing the affective experience (AX) of the user during the interaction with computers is of great interest. The automatic recognition of the affective state, or emotion, of the user is one of the big challenges. In this proposal I focus on the affect recognition via physiological and neurophysiological signals. Long‐standing evidence from psychophysiological research and more recently from research in affective neuroscience suggests that both, body and brain physiology, are able to indicate the current affective state of a subject. However, regarding the classification of AX several questions are still unanswered. The principal possibility of AX classification was repeatedly shown, but its generalisation over different task contexts, elicitating stimuli modalities, subjects or time is seldom addressed. In this proposal I will discuss a possible agenda for the further exploration of physiological and neurophysiological correlates of AX over different elicitation modalities and task contexts

Acute tryptophan depletion attenuates conscious appraisal of social emotional signals in healthy female volunteers

Rationale: Acute tryptophan depletion (ATD) decreases levels of central serotonin. ATD thus enables the cognitive effects of serotonin to be studied, with implications for the understanding of psychiatric conditions, including depression. Objective: To determine the role of serotonin in conscious (explicit) and unconscious/incidental processing of emotional information. Materials and methods: A randomized, double-blind, cross-over design was used with 15 healthy female participants. Subjective mood was recorded at baseline and after 4 h, when participants performed an explicit emotional face processing task, and a task eliciting unconscious processing of emotionally aversive and neutral images presented subliminally using backward masking. Results: ATD was associated with a robust reduction in plasma tryptophan at 4 h but had no effect on mood or autonomic physiology. ATD was associated with significantly lower attractiveness ratings for happy faces and attenuation of intensity/arousal ratings of angry faces. ATD also reduced overall reaction times on the unconscious perception task, but there was no interaction with emotional content of masked stimuli. ATD did not affect breakthrough perception (accuracy in identification) of masked images. Conclusions: ATD attenuates the attractiveness of positive faces and the negative intensity of threatening faces, suggesting that serotonin contributes specifically to the appraisal of the social salience of both positive and negative salient social emotional cues. We found no evidence that serotonin affects unconscious processing of negative emotional stimuli. These novel findings implicate serotonin in conscious aspects of active social and behavioural engagement and extend knowledge regarding the effects of ATD on emotional perception

An interoceptive predictive coding model of conscious presence

We describe a theoretical model of the neurocognitive mechanisms underlying conscious presence and its disturbances. The model is based on interoceptive prediction error and is informed by predictive models of agency, general models of hierarchical predictive coding and dopaminergic signaling in cortex, the role of the anterior insular cortex (AIC) in interoception and emotion, and cognitive neuroscience evidence from studies of virtual reality and of psychiatric disorders of presence, specifically depersonalization/derealization disorder. The model associates presence with successful suppression by top-down predictions of informative interoceptive signals evoked by autonomic control signals and, indirectly, by visceral responses to afferent sensory signals. The model connects presence to agency by allowing that predicted interoceptive signals will depend on whether afferent sensory signals are determined, by a parallel predictive-coding mechanism, to be self-generated or externally caused. Anatomically, we identify the AIC as the likely locus of key neural comparator mechanisms. Our model integrates a broad range of previously disparate evidence, makes predictions for conjoint manipulations of agency and presence, offers a new view of emotion as interoceptive inference, and represents a step toward a mechanistic account of a fundamental phenomenological property of consciousness

Neuroanatomical substrates for the volitional regulation of heart rate

The control of physiological arousal can assist in the regulation of emotional state. A subset cortical and subcortical brain regions are implicated in autonomic control of bodily arousal during emotional behaviors. Here, we combined human functional neuroimaging with autonomic monitoring to identify neural mechanisms that support the volitional regulation of heart rate, a process that may be assisted by visual feedback. During functional magnetic resonance imaging (fMRI), 15 healthy adults performed an experimental task in which they were prompted voluntarily to increase or decrease cardiovascular arousal (heart rate) during true, false, or absent visual feedback. Participants achieved appropriate changes in heart rate, without significant modulation of respiratory rate, and were overall not influenced by the presence of visual feedback. Increased activity in right amygdala, striatum and brainstem occurred when participants attempted to increase heart rate. In contrast, activation of ventrolateral prefrontal and parietal cortices occurred when attempting to decrease heart rate. Biofeedback enhanced activity within occipito-temporal cortices, but there was no significant interaction with task conditions. Activity in regions including pregenual anterior cingulate and ventral striatum reflected the magnitude of successful task performance, which was negatively related to subclinical anxiety symptoms. Measured changes in respiration correlated with posterior insula activation and heart rate, at a more lenient threshold, change correlated with insula, caudate, and midbrain activity. Our findings highlight a set of brain regions, notably ventrolateral prefrontal cortex, supporting volitional control of cardiovascular arousal. These data are relevant to understanding neural substrates supporting interaction between intentional and interoceptive states related to anxiety, with implications for biofeedback interventions, e.g., real-time fMRI, that target emotional regulation

Big data analytics:Computational intelligence techniques and application areas

Big Data has significant impact in developing functional smart cities and supporting modern societies. In this paper, we investigate the importance of Big Data in modern life and economy, and discuss challenges arising from Big Data utilization. Different computational intelligence techniques have been considered as tools for Big Data analytics. We also explore the powerful combination of Big Data and Computational Intelligence (CI) and identify a number of areas, where novel applications in real world smart city problems can be developed by utilizing these powerful tools and techniques. We present a case study for intelligent transportation in the context of a smart city, and a novel data modelling methodology based on a biologically inspired universal generative modelling approach called Hierarchical Spatial-Temporal State Machine (HSTSM). We further discuss various implications of policy, protection, valuation and commercialization related to Big Data, its applications and deployment

Emotions in context: examining pervasive affective sensing systems, applications, and analyses

Pervasive sensing has opened up new opportunities for measuring our feelings and understanding our behavior by monitoring our affective states while mobile. This review paper surveys pervasive affect sensing by examining and considering three major elements of affective pervasive systems, namely; “sensing”, “analysis”, and “application”. Sensing investigates the different sensing modalities that are used in existing real-time affective applications, Analysis explores different approaches to emotion recognition and visualization based on different types of collected data, and Application investigates different leading areas of affective applications. For each of the three aspects, the paper includes an extensive survey of the literature and finally outlines some of challenges and future research opportunities of affective sensing in the context of pervasive computing

Interoceptive inference, emotion, and the embodied self

The concept of the brain as a prediction machine has enjoyed a resurgence in the context of the Bayesian brain and predictive coding approaches within cognitive science. To date, this perspective has been applied primarily to exteroceptive perception (e.g., vision, audition), and action. Here, I describe a predictive, inferential perspective on interoception: ‘interoceptive inference’ conceives of subjective feeling states (emotions) as arising from actively-inferred generative (predictive) models of the causes of interoceptive afferents. The model generalizes ‘appraisal’ theories that view emotions as emerging from cognitive evaluations of physiological changes, and it sheds new light on the neurocognitive mechanisms that underlie the experience of body ownership and conscious selfhood in health and in neuropsychiatric illness

A LightGBM-Based EEG Analysis Method for Driver Mental States Classification

Fatigue driving can easily lead to road traffic accidents and bring great harm to individuals and families. Recently, electroencephalography- (EEG-) based physiological and brain activities for fatigue detection have been increasingly investigated. However, how to find an effective method or model to timely and efficiently detect the mental states of drivers still remains a challenge. In this paper, we combine common spatial pattern (CSP) and propose a light-weighted classifier, LightFD, which is based on gradient boosting framework for EEG mental states identification. ,e comparable results with traditional classifiers, such as support vector machine (SVM), convolutional neural network (CNN), gated recurrent unit (GRU), and large margin nearest neighbor (LMNN), show that the proposed model could achieve better classification performance, as well as the decision efficiency. Furthermore, we also test and validate that LightFD has better transfer learning performance in EEG classification of driver mental states. In summary, our proposed LightFD classifier has better performance in real-time EEG mental state prediction, and it is expected to have broad application prospects in practical brain-computer interaction (BCI)

Good news or bad news, which do you want first? The importance of the sequence and organization of Information for financial decision-making: a neuro-electrical imaging study

Investment decisions are largely based on the information investors received from the target firm. Thaler introduced the hedonic editing framework, in which suggests that integration/segregation of information influence individual's perceived value. Meanwhile, when evaluating the evidence and information in a sequence, order effect and biases have been found to have an impact in various areas. In this research, the influence of the Organization of Information (Integration vs. Segregation) and the Sequence of Information (Negative-Positive order vs. Positive-Negative order) on individual's investment decision-making both at the behavioral level (decision) and neurometrix level (measured by an individual's emotion and Approach Withdraw tendency) was assessed for the three groups of information: a piece of Big Positive Information and a piece of Small Negative Information, a piece of Big Negative Information and a piece of Small Positive Information, and a piece of Small Negative information. The behavioral results, which are an individual's final investment decision, were consistent for all three scenarios. In general, individuals will invest more/retire less when receiving two pieces of information in a Negative-Positive order. However, the neurometric results (Emotional Index, Approach Withdraw Index and results from LORETA) show differences among information groups. An effect of the Sequence of Information and the Organization of Information was found for the different scenarios. The results suggest that in the scenarios that involve large-scale information, the organization of information (Integration vs. Segregation) influences the emotion and Approach Withdraw tendency. The results of this investigation should provide insight for effective communication of information, especially when large-scale information is involved