Deep fusion of multi-channel neurophysiological signal for emotion recognition and monitoring

How to fuse multi-channel neurophysiological signals for emotion recognition is emerging as a hot research topic in community of Computational Psychophysiology. Nevertheless, prior feature engineering based approaches require extracting various domain knowledge related features at a high time cost. Moreover, traditional fusion method cannot fully utilise correlation information between different channels and frequency components. In this paper, we design a hybrid deep learning model, in which the 'Convolutional Neural Network (CNN)' is utilised for extracting task-related features, as well as mining inter-channel and inter-frequency correlation, besides, the 'Recurrent Neural Network (RNN)' is concatenated for integrating contextual information from the frame cube sequence. Experiments are carried out in a trial-level emotion recognition task, on the DEAP benchmarking dataset. Experimental results demonstrate that the proposed framework outperforms the classical methods, with regard to both of the emotional dimensions of Valence and Arousal

Emotions Detection based on a Single-electrode EEG Device

The study of emotions using multiple channels of EEG represents a widespread practice in the field of research related to brain computer interfaces (Brain Computer Interfaces). To date, few studies have been reported in the literature with a reduced number of channels, which when used in the detection of emotions present results that are less accurate than the rest. To detect emotions using an EEG channel and the data obtained is useful for classifying emotions with an accuracy comparable to studies in which there is a high number of channels, is of particular interest in this research framework. This article uses the Neurosky Maindwave device; which has a single electrode to acquire the EEG signal, Matlab software and IBM SPSS Modeler; which process and classify the signals respectively. The accuracy obtained in the detection of emotions in relation to the economic resources of the hardware dedicated to the acquisition of EEG signal is remarkable

Emotional Brain-Computer Interfaces

Research in Brain-computer interface (BCI) has significantly increased during the last few years. In addition to their initial role as assisting devices for the physically challenged, BCIs are now proposed for a wider range of applications. As in any HCI application, BCIs can also benefit from adapting their operation to the emotional state of the user. BCIs have the advantage of having access to brain activity which can provide signicant insight into the user's emotional state. This information can be utilized in two manners. 1) Knowledge of the inuence of the emotional state on brain activity patterns can allow the BCI to adapt its recognition algorithms, so that the intention of the user is still correctly interpreted in spite of signal deviations induced by the subject's emotional state. 2) The ability to recognize emotions can be used in BCIs to provide the user with more natural ways of controlling the BCI through affective modulation. Thus, controlling a BCI by recollecting a pleasant memory can be possible and can potentially lead to higher information transfer rates.\ud These two approaches of emotion utilization in BCI are elaborated in detail in this paper in the framework of noninvasive EEG based BCIs

Discovering Gender Differences in Facial Emotion Recognition via Implicit Behavioral Cues

We examine the utility of implicit behavioral cues in the form of EEG brain signals and eye movements for gender recognition (GR) and emotion recognition (ER). Specifically, the examined cues are acquired via low-cost, off-the-shelf sensors. We asked 28 viewers (14 female) to recognize emotions from unoccluded (no mask) as well as partially occluded (eye and mouth masked) emotive faces. Obtained experimental results reveal that (a) reliable GR and ER is achievable with EEG and eye features, (b) differential cognitive processing especially for negative emotions is observed for males and females and (c) some of these cognitive differences manifest under partial face occlusion, as typified by the eye and mouth mask conditions.Comment: To be published in the Proceedings of Seventh International Conference on Affective Computing and Intelligent Interaction.201

Review of different strategies for coordinative planning of multi-agent systems

Agent-based systems have been widely examined in the literature for various type of tasks. Within this examination, various strategies and modeling have been employed. Several surveys and reviews have been depicted in the literature regarding agent-based systems. However, minimal efforts have been made in the context of feature extraction and feature selection. This paper aims to review the strategies used for feature extraction and selection agentbased systems. In terms of the nature of agent communications, this paper tackles two types, centralized and decentralized. In terms of the workflow, this paper tackles three types, including coordinative, collaborative and emergent-based systems. Finally, a discussion is presented comparing the strategies and the frequent use of the strategies in the literature. Based on this review, most of feature extraction agent-based systems rely on either coordinating or emergent-based strategies, while feature selection agent-based systems rely on collaborative strategies. However, there are several aspects that we can consider to be classify agent-based strategies. This review develops a classification scheme for systems used for specific tasks, including feature extraction and feature selection