Personalized Automatic Estimation of Self-reported Pain Intensity from Facial Expressions

Pain is a personal, subjective experience that is commonly evaluated through visual analog scales (VAS). While this is often convenient and useful, automatic pain detection systems can reduce pain score acquisition efforts in large-scale studies by estimating it directly from the participants' facial expressions. In this paper, we propose a novel two-stage learning approach for VAS estimation: first, our algorithm employs Recurrent Neural Networks (RNNs) to automatically estimate Prkachin and Solomon Pain Intensity (PSPI) levels from face images. The estimated scores are then fed into the personalized Hidden Conditional Random Fields (HCRFs), used to estimate the VAS, provided by each person. Personalization of the model is performed using a newly introduced facial expressiveness score, unique for each person. To the best of our knowledge, this is the first approach to automatically estimate VAS from face images. We show the benefits of the proposed personalized over traditional non-personalized approach on a benchmark dataset for pain analysis from face images.Comment: Computer Vision and Pattern Recognition Conference, The 1st International Workshop on Deep Affective Learning and Context Modelin

The role of the cerebellum in unconsciuos and conscious processing of emotions: a review

Studies from the past three decades have demonstrated that there is cerebellar involvement in the emotional domain. Emotional processing in humans requires both unconscious and conscious mechanisms. A significant amount of evidence indicates that the cerebellum is one of the cerebral structures that subserve emotional processing, although conflicting data have been reported on its function in unconscious and conscious mechanisms. This review discusses the available clinical, neuroimaging and neurophysiological data on this issue. We also propose a model in which the cerebellum acts as a mediator between the internal state and external environment for the unconscious and conscious levels of emotional processing

Facial expression of pain: an evolutionary account.

This paper proposes that human expression of pain in the presence or absence of caregivers, and the detection of pain by observers, arises from evolved propensities. The function of pain is to demand attention and prioritise escape, recovery, and healing; where others can help achieve these goals, effective communication of pain is required. Evidence is reviewed of a distinct and specific facial expression of pain from infancy to old age, consistent across stimuli, and recognizable as pain by observers. Voluntary control over amplitude is incomplete, and observers can better detect pain that the individual attempts to suppress rather than amplify or simulate. In many clinical and experimental settings, the facial expression of pain is incorporated with verbal and nonverbal vocal activity, posture, and movement in an overall category of pain behaviour. This is assumed by clinicians to be under operant control of social contingencies such as sympathy, caregiving, and practical help; thus, strong facial expression is presumed to constitute and attempt to manipulate these contingencies by amplification of the normal expression. Operant formulations support skepticism about the presence or extent of pain, judgments of malingering, and sometimes the withholding of caregiving and help. To the extent that pain expression is influenced by environmental contingencies, however, "amplification" could equally plausibly constitute the release of suppression according to evolved contingent propensities that guide behaviour. Pain has been largely neglected in the evolutionary literature and the literature on expression of emotion, but an evolutionary account can generate improved assessment of pain and reactions to it

Neuroelectrical Correlates of Trustworthiness and Dominance Judgments Related to the Observation of Political Candidates

The present research investigates the neurophysiological activity elicited by fast observations of faces of real candidates during simulated political elections. We used simultaneous recording of electroencephalographic (EEG) signals as well as galvanic skin response (GSR) and heart rate (HR) as measurements of central and autonomic nervous systems. Twenty healthy subjects were asked to give judgments on dominance, trustworthiness, and a preference of vote related to the politicians’ faces. We used high-resolution EEG techniques to map statistical differences of power spectral density (PSD) cortical activity onto a realistic head model as well as partial directed coherence (PDC) and graph theory metrics to estimate the functional connectivity networks and investigate the role of cortical regions of interest (ROIs). Behavioral results revealed that judgment of dominance trait is the most predictive of the outcome of the simulated elections. Statistical comparisons related to PSD and PDC values highlighted an asymmetry in the activation of frontal cortical areas associated with the valence of the judged trait as well as to the probability to cast the vote. Overall, our results highlight the existence of cortical EEG features which are correlated with the prediction of vote and with the judgment of trustworthy and dominant faces

Neuroelectrical correlates of trustworthiness and dominance judgments related to the observation of political candidates

The present research investigates the neurophysiological activity elicited by fast observations of faces of real candidates during simulated political elections. We used simultaneous recording of electroencephalographic (EEG) signals as well as galvanic skin response (GSR) and heart rate (HR) as measurements of central and autonomic nervous systems. Twenty healthy subjects were asked to give judgments on dominance, trustworthiness, and a preference of vote related to the politicians' faces. We used high-resolution EEG techniques to map statistical differences of power spectral density (PSD) cortical activity onto a realistic head model as well as partial directed coherence (PDC) and graph theory metrics to estimate the functional connectivity networks and investigate the role of cortical regions of interest (ROIs). Behavioral results revealed that judgment of dominance trait is the most predictive of the outcome of the simulated elections. Statistical comparisons related to