Mapping Abstract Visual Feedback to a Dimensional Model of Emotion

Recent HCI research has looked at conveying emotions through non-visual modalities, such as vibrotactile and thermal feedback. However, emotion is primarily conveyed through visual signals, and so this research aims to support the design of emotional visual feedback. We adapt and extend the design of the "pulsing amoeba" [29], and measure the emotion conveyed through the abstract visual designs. It is a first step towards more holistic multimodal affective feedback combining visual, auditory and tactile stimuli. An online survey garnered valence and arousal ratings of 32 stimuli that varied in colour, contour, pulse size and pulse speed. The results support previous research but also provide new findings and highlight the effects of each individual visual parameter on perceived emotion. We present a mapping of all stimulus combinations onto the common two-dimensional valence-arousal model of emotion

Multi-Moji: Combining Thermal, Vibrotactile and Visual Stimuli to Expand the Affective Range of Feedback

This paper explores the combination of multiple concurrent modalities for conveying emotional information in HCI: temperature, vibration and abstract visual displays. Each modality has been studied individually, but can only convey a limited range of emotions within two-dimensional valencearousal space. This paper is the first to systematically combine multiple modalities to expand the available affective range. Three studies were conducted: Study 1 measured the emotionality of vibrotactile feedback by itself; Study 2 measured the perceived emotional content of three bimodal combinations: vibrotactile + thermal, vibrotactile + visual and visual + thermal. Study 3 then combined all three modalities. Results show that combining modalities increases the available range of emotional states, particularly in the problematic top-right and bottom-left quadrants of the dimensional model. We also provide a novel lookup resource for designers to identify stimuli to convey a range of emotions

The priming effect of point-light display (PLD) animations on the ratings of valence in neutral faces

The study of human emotions is a wide topic involving different fields of study and from which countless disciplines might benefit, among them human computer interaction (HCI) and affective computing. Understanding the processes behind production, mediation and consumption of emotions via technology might increase the affective bandwidth of HCI and, as a result, improve various products and services in information and communication technologies (ICT) and in computer-mediated communication (CMC). This thesis investigates face perception and mediation of emotional information to the users via abstract and compact graphical visualizations designed in a form of point-light display (PLD) animations. Two PLD animations consisting of a number of moving dots with different location and direction of movement were utilized in the study. One of the animations represented a face smiling while the other represented a face frowning. Earlier studies have demonstrated a potential of such PLD design in affecting emotional ratings of the users. Further investigation is needed to examine whether PLD animations have an effect and can influence the response to another stimulus. Therefore, in this work priming paradigm is used as a research method to study the implicit memory effect that PLD animations might have on the valence ratings of neutral faces (photographs). 29 participants were asked to rate the valence of neutral faces shortly presented (100 ms) after PLD aminations using a 0-6 rating scale. Moreover, participants were asked whether they perceived faces and facial expressions from the PLD animations. Results showed that participants perceived faces and facial expressions (smile and frown) from the PLD animations. On the other hand, paired sample t-test found no significant effect from the PLD animations on the valence ratings of neutral faces. The results obtained might be explained by the limitations of the experimental tasks, the rating scale implemented and the length of the PLD animations. The thesis discusses the results and suggests possible improvements to the weaknesses observed in the current design

Emotional Reactions to Point-Light Display Animations

Emotional reactions to basic, artificial, yet carefully controllable point-light displays (PLDs) were investigated with ratings of valence, arousal, approachability and dominance. PLDs were varied by movement location (upper and lower) and intensity (10°, 20° and 30° angular change) for angular upward and downward movements. Half of participants (N =28) were told that PLDs were related to face while to other half nothing was hinted. Results showed that 20° and 30° angle lower location upward movements were rated as significantly more pleasant, relaxing and approachable than corresponding upper location downward movements. Informed participants rated 20° and 30° angle lower movements as significantly more controllable than corresponding upper movements. Results are important from many perspectives, like for understanding human perceptual mechanisms. When using PLDs only a small amount of information needs to be transmitted. This enables low bandwidth requirements. As PLD visualizations are simple, there is no need for high-definition displays.acceptedVersionPeer reviewe