The perception of emotion in artificial agents

Given recent technological developments in robotics, artificial intelligence and virtual reality, it is perhaps unsurprising that the arrival of emotionally expressive and reactive artificial agents is imminent. However, if such agents are to become integrated into our social milieu, it is imperative to establish an understanding of whether and how humans perceive emotion in artificial agents. In this review, we incorporate recent findings from social robotics, virtual reality, psychology, and neuroscience to examine how people recognize and respond to emotions displayed by artificial agents. First, we review how people perceive emotions expressed by an artificial agent, such as facial and bodily expressions and vocal tone. Second, we evaluate the similarities and differences in the consequences of perceived emotions in artificial compared to human agents. Besides accurately recognizing the emotional state of an artificial agent, it is critical to understand how humans respond to those emotions. Does interacting with an angry robot induce the same responses in people as interacting with an angry person? Similarly, does watching a robot rejoice when it wins a game elicit similar feelings of elation in the human observer? Here we provide an overview of the current state of emotion expression and perception in social robotics, as well as a clear articulation of the challenges and guiding principles to be addressed as we move ever closer to truly emotional artificial agents

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

Touch as a sense of force

The aim of this paper is to give a description of the objects of the sense of touch. Those objects, it is argued, are forces, rather than flesh deformation, solidity or weight. Tangible forces, basically tensions and pressures, are construed as symmetric and non-spatially reducible causal relations. Two consequences are drawn: first, the perception of heat and cold falls outside the sense of touch; second, muscular sense (together with a large part of proprioception) falls inside the sense of touch

Touching virtual humans: Haptic responses reveal the emotional impact of affective agents

Interpersonal touch is critical for social-emotional development and presents a powerful modality for communicating emotions. Virtual agents of the future could capitalize on touch to establish social bonds with humans and facilitate cooperation in virtual reality (VR). We studied whether the emotional expression of a virtual agent would affect the way humans touch the agent. Participants were asked to hold a pressure-sensing tube presented as the agent's arm in VR. Upon seeing the agent's emotional expression change, participants briefly squeezed the arm. The effect of emotional expressions on affective state was measured using self-reported valence and arousal as well as physiology-based indices. Onset, duration, and intensity of the squeeze were recorded to examine the haptic responses. Emotional expression of agents affected squeeze intensity and duration through changes in emotional perception and experience. Haptic responses may thus provide an implicit measure of persons' experience towards their virtual companion.Peer reviewe

EEG Korrelate und Gedächtnisleistungen bei spontanen fazialen Selbstberührungen

Die Beschreibung spontaner Berührungen des eigenen Körpers findet sich bereits in der psychologischen Forschungsliteratur der 1930er Jahre. Das spontane Berühren des eigenen Gesichts tritt Studien zufolge häufiger auf als das spontane Berühren anderer Körperteile. Trotz jahrzehntelanger Forschung sowie aktueller Präsenz des Themas im Zusammenhang mit der COVID-19-Pandemie, sind zentrale Fragen zu Auslösemechanismen und psychophysiologischen Funktionen von spontanen fazialen Selbstberührungen bislang unbeantwortet. Die vorliegende Dissertation liefert anhand neurophysiologischer sowie behavioraler Daten neue Erkenntnisse zu Funktionen von spontanen fazialen Selbstberührungen und trägt damit zur Weiterentwicklung der Theorie dieses Verhaltens bei

Clay: Qualities, Benefits, and Therapeutic Applications A Literature Review

Clay is ubiquitous. It is uniquely durable and plastic. It is a substance sourced from the earth that has been manipulated in numerous ways and used for a variety of purposes for thousands of years. Despite this, art therapy research is heavily focused on art making using two-dimensional materials. Research is lacking regarding the use of clay as a medium in art therapy. This literature review revealed many therapeutic benefits and qualities about clay. These qualities include increasing mood in psychiatric patients, increasing progress in self-development for patients with schizophrenia, increasing self-expression with older adults, and healing from trauma. This literature review intends to present relevant research on the unique characteristics of clay as a material used throughout history, the sensory processing of clay and the various ways clay can be used throughout art therapy as an effective treatment tool

Shared User Interfaces of Physiological Data: Systematic Review of Social Biofeedback Systems and Contexts in HCI

As an emerging interaction paradigm, physiological computing is increasingly being used to both measure and feed back information about our internal psychophysiological states. While most applications of physiological computing are designed for individual use, recent research has explored how biofeedback can be socially shared between multiple users to augment human-human communication. Reflecting on the empirical progress in this area of study, this paper presents a systematic review of 64 studies to characterize the interaction contexts and effects of social biofeedback systems. Our findings highlight the importance of physio-temporal and social contextual factors surrounding physiological data sharing as well as how it can promote social-emotional competences on three different levels: intrapersonal, interpersonal, and task-focused. We also present the Social Biofeedback Interactions framework to articulate the current physiological-social interaction space. We use this to frame our discussion of the implications and ethical considerations for future research and design of social biofeedback interfaces.Comment: [Accepted version, 32 pages] Clara Moge, Katherine Wang, and Youngjun Cho. 2022. Shared User Interfaces of Physiological Data: Systematic Review of Social Biofeedback Systems and Contexts in HCI. In CHI Conference on Human Factors in Computing Systems (CHI'22), ACM, https://doi.org/10.1145/3491102.351749

Method Development: Dance/Movement Psychotherapy to Address Substance Use Disorder in Cultural Appalachia

Arts-based-embodied research was used to investigate the potential effectiveness of Dance Movement Psychotherapy methods to treat substance use disorder from a trauma-informed and cultural approach, based on subjective/objective findings of the writer. Residents of diverse demographics, aged 26-59, within the cultural region volunteered to attend one or more of the three workshops offered. Methods were created based on theoretical, historical, and clinical research and implemented through workshops with the intent to promote community, self-expression, empathy, and creativity-all beneficial traits for on-going mental/physical health recovery and resiliency. Movement observation and participant feedback indicated overall increased awareness and deeper knowing of self and other, reduced feelings of physical/mental stress, and renewed confidence and curiosity. Discoveries supported embodied, arts-based research to reflect and process new knowledge to develop and implement future dance/movement psychotherapy research and future applications in the treatment and on-going recovery of persons with substance use disorder in the Appalachian cultural region

Bringing the Body Into Art Therapy: The Use of Touch and Body Awareness in Creative Healing

The focus on the use of healing touch and body awareness in art therapy is critically lacking. Despite the research supporting the use of body-oriented techniques in clinical therapy, there is little research related to this use specifically in art therapy. Research reveals that healing touch and body awareness can be instrumental in healing trauma, if done with the proper training and boundaries in place. The first form of attachment and comfort for children is that of touch. Therefore, it is imperative to acknowledge the power of touch and body awareness when healing from traumatic experiences. The purpose of this literature review is to explore some of the reasons as to why this disconnect exists in westernized art therapy, and to begin to build a bridge between psyche and soma in the clinical art therapy setting. Through multiple avenues of literature, the use of touch and body awareness to inform art therapy treatment was found to be highly effective at engaging with suppressed traumatic experiences and in supporting the healing from said experiences. This literature review aims to present relevant research on the history of touch and body awareness, the neurobiology of trauma and trauma healing, additional bodyoriented techniques, the body-based aspects of art therapy, and specific body-focused art therapy directives