Social touch in human–computer interaction

Touch is our primary non-verbal communication channel for conveying intimate emotions and as such essential for our physical and emotional wellbeing. In our digital age, human social interaction is often mediated. However, even though there is increasing evidence that mediated touch affords affective communication, current communication systems (such as videoconferencing) still do not support communication through the sense of touch. As a result, mediated communication does not provide the intense affective experience of co-located communication. The need for ICT mediated or generated touch as an intuitive way of social communication is even further emphasized by the growing interest in the use of touch-enabled agents and robots for healthcare, teaching, and telepresence applications. Here, we review the important role of social touch in our daily life and the available evidence that affective touch can be mediated reliably between humans and between humans and digital agents. We base our observations on evidence from psychology, computer science, sociology, and neuroscience with focus on the first two. Our review shows that mediated affective touch can modulate physiological responses, increase trust and affection, help to establish bonds between humans and avatars or robots, and initiate pro-social behavior. We argue that ICT mediated or generated social touch can (a) intensify the perceived social presence of remote communication partners and (b) enable computer systems to more effectively convey affective information. However, this research field on the crossroads of ICT and psychology is still embryonic and we identify several topics that can help to mature the field in the following areas: establishing an overarching theoretical framework, employing better research methodologies, developing basic social touch building blocks, and solving specific ICT challenges

The multisensory body revealed through its cast shadows

One key issue when conceiving the body as a multisensory object is how the cognitive system integrates visible instances of the self and other bodies with one\u2019s own somatosensory processing, to achieve self-recognition and body ownership. Recent research has strongly suggested that shadows cast by our own body have a special status for cognitive processing, directing attention to the body in a fast and highly specific manner. The aim of the present article is to review the most recent scientific contributions addressing how body shadows affect both sensory/perceptual and attentional processes. The review examines three main points: (1) body shadows as a special window to investigate the construction of multisensory body perception; (2) experimental paradigms and related findings; (3) open questions and future trajectories. The reviewed literature suggests that shadows cast by one\u2019s own body promote binding between personal and extrapersonal space and elicit automatic orienting of attention toward the bodypart casting the shadow. Future research should address whether the effects exerted by body shadows are similar to those observed when observers are exposed to other visual instances of their body. The results will further clarify the processes underlying the merging of vision and somatosensation when creating body representations

Chapter 13 Haptic Creatures

Collaborations between entertainment industries and artificial intelligence researchers in Japan have since the mid-1990s produced a growing interest in modeling affect and emotion for use in mass-produced social robots. Robot producers and marketers reason that such robot companions can provide comfort, healing (iyashi), and intimacy in light of attenuating social bonds and increased socioeconomic stress characteristic of Japanese society since the collapse of the country’s bubble economy in the early 1990s. While many of these robots with so-called “artificial emotional intelligence” are equipped with rudimentary capacities to “read” predefined human emotion through such mechanisms as facial expression recognition, a new category of companion robots are more experimental. These robots do not interpret human emotion through affect-sensing software but rather invite human-robot interaction through affectively pleasing forms of haptic feedback. These new robots are called haptic creatures: robot companions designed to deliver a sense of comforting presence through a combination of animated movements and healing touch. Integrating historical analysis with ethnographic interviews with new users of these robots, and focusing in particular on the cat-like cushion robot Qoobo, this chapter argues that while companion robots are designed in part to understand specific human emotions, haptic creatures are created as experimental devices that can generate new and unexpected pleasures of affective care unique to human-robot relationships. It suggests that this distinction is critical for understanding and evaluating how corporations seek to use human-robot affect as a means to deliver care to consumers while also researching and building new markets for profit maximization

Identifying with the Beautiful: Facial attractiveness effects on unisensory and multisensory self-other distinction

People tend to evaluate their own traits and abilities favourably and such favourable self-perceptions extend to attractiveness. However, the exact mechanism underlying this self-enhancement bias remains unclear and one possibility could be the identification with attractive others through blurring of self-other boundaries. Across two experiments, we used the enfacement illusion to investigate the effect of the attractiveness of others in the multisensory perception of the self. In a first experiment (N=35), participants were stroked on the cheek while looking at an attractive vs. non-attractive face being stroked on the cheek in synchrony or asynchrony. In the second experiment (N=35), two new faces were used and spatial incοngruency was introduced as a control condition. The results showed that increased ratings of attractiveness of an unfamiliar face lead to blurring of self-other boundaries, allowing the identification of our psychological self with another's physical self, and specifically their face, and this seems to be unrelated to perceived own attractiveness. The effect of facial attractiveness on face ownership showed dissociable mechanisms, with multisensory integration modulating the effect on similarity but not identification, an effect that may be purely based on vision. Overall, our findings suggest that others’ attractiveness may lead to positive distortions of the self, identifying with the more rather than less attractive others. This research provides a psychophysical starting point for studying the impact of others' attractiveness on how we perceive the self, which can be particularly important for individuals with malleable, embodied self-other boundaries and body image disturbances

Social touch and human development.

Social touch is a powerful force in human development, shaping social reward, attachment, cognitive, communication, and emotional regulation from infancy and throughout life. In this review, we consider the question of how social touch is defined from both bottom-up and top-down perspectives. In the former category, there is a clear role for the C-touch (CT) system, which constitutes a unique submodality that mediates affective touch and contrasts with discriminative touch. Top-down factors such as culture, personal relationships, setting, gender, and other contextual influences are also important in defining and interpreting social touch. The critical role of social touch throughout the lifespan is considered, with special attention to infancy and young childhood, a time during which social touch and its neural, behavioral, and physiological contingencies contribute to reinforcement-based learning and impact a variety of developmental trajectories. Finally, the role of social touch in an example of disordered development -autism spectrum disorder-is reviewed

Somatic ABC's: A Theoretical Framework for Designing, Developing and Evaluating the Building Blocks of Touch-Based Information Delivery

abstract: Situations of sensory overload are steadily becoming more frequent as the ubiquity of technology approaches reality--particularly with the advent of socio-communicative smartphone applications, and pervasive, high speed wireless networks. Although the ease of accessing information has improved our communication effectiveness and efficiency, our visual and auditory modalities--those modalities that today's computerized devices and displays largely engage--have become overloaded, creating possibilities for distractions, delays and high cognitive load; which in turn can lead to a loss of situational awareness, increasing chances for life threatening situations such as texting while driving. Surprisingly, alternative modalities for information delivery have seen little exploration. Touch, in particular, is a promising candidate given that it is our largest sensory organ with impressive spatial and temporal acuity. Although some approaches have been proposed for touch-based information delivery, they are not without limitations including high learning curves, limited applicability and/or limited expression. This is largely due to the lack of a versatile, comprehensive design theory--specifically, a theory that addresses the design of touch-based building blocks for expandable, efficient, rich and robust touch languages that are easy to learn and use. Moreover, beyond design, there is a lack of implementation and evaluation theories for such languages. To overcome these limitations, a unified, theoretical framework, inspired by natural, spoken language, is proposed called Somatic ABC's for Articulating (designing), Building (developing) and Confirming (evaluating) touch-based languages. To evaluate the usefulness of Somatic ABC's, its design, implementation and evaluation theories were applied to create communication languages for two very unique application areas: audio described movies and motor learning. These applications were chosen as they presented opportunities for complementing communication by offloading information, typically conveyed visually and/or aurally, to the skin. For both studies, it was found that Somatic ABC's aided the design, development and evaluation of rich somatic languages with distinct and natural communication units.Dissertation/ThesisPh.D. Computer Science 201

Embodied Precision : Intranasal Oxytocin Modulates Multisensory Integration

© 2018 Massachusetts Institute of Technology.Multisensory integration processes are fundamental to our sense of self as embodied beings. Bodily illusions, such as the rubber hand illusion (RHI) and the size-weight illusion (SWI), allow us to investigate how the brain resolves conflicting multisensory evidence during perceptual inference in relation to different facets of body representation. In the RHI, synchronous tactile stimulation of a participant's hidden hand and a visible rubber hand creates illusory body ownership; in the SWI, the perceived size of the body can modulate the estimated weight of external objects. According to Bayesian models, such illusions arise as an attempt to explain the causes of multisensory perception and may reflect the attenuation of somatosensory precision, which is required to resolve perceptual hypotheses about conflicting multisensory input. Recent hypotheses propose that the precision of sensorimotor representations is determined by modulators of synaptic gain, like dopamine, acetylcholine, and oxytocin. However, these neuromodulatory hypotheses have not been tested in the context of embodied multisensory integration. The present, double-blind, placebo-controlled, crossover study ( N = 41 healthy volunteers) aimed to investigate the effect of intranasal oxytocin (IN-OT) on multisensory integration processes, tested by means of the RHI and the SWI. Results showed that IN-OT enhanced the subjective feeling of ownership in the RHI, only when synchronous tactile stimulation was involved. Furthermore, IN-OT increased an embodied version of the SWI (quantified as estimation error during a weight estimation task). These findings suggest that oxytocin might modulate processes of visuotactile multisensory integration by increasing the precision of top-down signals against bottom-up sensory input.Peer reviewedFinal Accepted Versio

Identifying with the beautiful: Facial attractiveness effects on unisensory and multisensory self-other distinction

People tend to evaluate their own traits and abilities favourably and such favourable self-perceptions extend to attractiveness. However, the exact mechanism underlying this self-enhancement bias remains unclear. One possibility could be the identification with attractive others through blurring of self–other boundaries. Across two experiments, we used the enfacement illusion to investigate the effect of others’ attractiveness in the multisensory perception of the self. In Experiment 1 (N = 35), participants received synchronous or asynchronous interpersonal visuo-tactile stimulation with an attractive and non-attractive face. In Experiment 2 (N = 35), two new faces were used and spatial incongruency was introduced as a control condition. The results showed that increased ratings of attractiveness of an unfamiliar face lead to blurring of self–other boundaries, allowing the identification of our psychological self with another’s physical self and specifically their face, and this seems to be unrelated to perceived own attractiveness. The effect of facial attractiveness on face ownership showed dissociable mechanisms, with multisensory integration modulating the effect on similarity but not identification, an effect that may be purely based on vision. Overall, our findings suggest that others’ attractiveness may lead to positive distortions of the self. This research provides a psychophysical starting point for studying the impact of others’ attractiveness on self-face recognition, which can be particularly important for individuals with malleable, embodied self–other boundaries and body image disturbances