Instant messaging on handhelds: an affective gesture approach

Text communication can be perceived as lacking in chat spontaneity, or plastic, due to medium limitations during interaction. A form of text messaging, Instant Messaging (IM), is now on the uptake, even on mobile handhelds. This paper presents results of using affective gesture to rubberise IM chat in order to improve synchronous communication spontaneity. The experimental design makes use of a text-only IM tool, running on handhelds, built with the Session Initiation Protocol (SIP) and the SIP Instant Messaging and Presence Leveraging Extensions (SIMPLE). The tool was developed with a novel user-defined hotkey – a one-click context menu that fast-tracks the creation and transmission of text-gestures and emoticons. A hybrid quantitative and qualitative approach was taken in order to enable data triangulation. Data collected from user trials affirms that the affective gesture hotkey facility improves chat responsiveness, thus enhancing chat spontaneity.Telkom, Cisco, THRI

Social touch in human–computer interaction

Touch is our primary non-verbal communication channel for conveying intimate emotions and as such essential for our physical and emotional wellbeing. In our digital age, human social interaction is often mediated. However, even though there is increasing evidence that mediated touch affords affective communication, current communication systems (such as videoconferencing) still do not support communication through the sense of touch. As a result, mediated communication does not provide the intense affective experience of co-located communication. The need for ICT mediated or generated touch as an intuitive way of social communication is even further emphasized by the growing interest in the use of touch-enabled agents and robots for healthcare, teaching, and telepresence applications. Here, we review the important role of social touch in our daily life and the available evidence that affective touch can be mediated reliably between humans and between humans and digital agents. We base our observations on evidence from psychology, computer science, sociology, and neuroscience with focus on the first two. Our review shows that mediated affective touch can modulate physiological responses, increase trust and affection, help to establish bonds between humans and avatars or robots, and initiate pro-social behavior. We argue that ICT mediated or generated social touch can (a) intensify the perceived social presence of remote communication partners and (b) enable computer systems to more effectively convey affective information. However, this research field on the crossroads of ICT and psychology is still embryonic and we identify several topics that can help to mature the field in the following areas: establishing an overarching theoretical framework, employing better research methodologies, developing basic social touch building blocks, and solving specific ICT challenges

Technology for Bonding in Human-Animal Interaction

This workshop focuses on the use and influence of technology on human-animal bonding, and how to facilitate them with technology. We explore the elements and characteristics of human-animal bonding, and how technology is connected to emotions and bonding between the human and the animal. We are particularly interested in animal's experiences, emotions, and welfare in bonding. The workshop facilitates discussion, creates a framework to support design activities, identifies future research themes, and creates ideas on facilitating the mutual bonding in human-animal interaction. The main focus is on dogs, but workshop aims is to pave way for further investigations and research with other domestic animals, such as cats, horses, and rabbits

Affective Medicine: a review of Affective Computing efforts in Medical Informatics

Background: Affective computing (AC) is concerned with emotional interactions performed with and through computers. It is defined as “computing that relates to, arises from, or deliberately influences emotions”. AC enables investigation and understanding of the relation between human emotions and health as well as application of assistive and useful technologies in the medical domain. Objectives: 1) To review the general state of the art in AC and its applications in medicine, and 2) to establish synergies between the research communities of AC and medical informatics. Methods: Aspects related to the human affective state as a determinant of the human health are discussed, coupled with an illustration of significant AC research and related literature output. Moreover, affective communication channels are described and their range of application fields is explored through illustrative examples. Results: The presented conferences, European research projects and research publications illustrate the recent increase of interest in the AC area by the medical community. Tele-home healthcare, AmI, ubiquitous monitoring, e-learning and virtual communities with emotionally expressive characters for elderly or impaired people are few areas where the potential of AC has been realized and applications have emerged. Conclusions: A number of gaps can potentially be overcome through the synergy of AC and medical informatics. The application of AC technologies parallels the advancement of the existing state of the art and the introduction of new methods. The amount of work and projects reviewed in this paper witness an ambitious and optimistic synergetic future of the affective medicine field

Radically Relational: Using Textiles As A Platform To Develop Methods For Embodied Design Processes

This position paper builds on textiles as a metaphor to explore the experiential knowledge observed through embodied design processes. In order to build understanding, we have tailored our tools and methods to support our explorations so far. As literature shows articulating our sensory experiences with materials is a challenging task. In order to support our investigations, in this paper we present a reflection on our diverse approaches to introduce tools that support us in interrogating how designers relate with materials, particularly textiles, and use their sensorial body to experience them during the creative process. We build on our previous research that identified relevant embodied process to textile selection, and reflect on how we have explored how sensing technology can augment and empower each of these phases, to support the design process. We conclude by discussing the learning outcomes from introducing such tools, in order to reflect on the future of our research

Touch Technology in Affective Human, Robot, Virtual-Human Interactions: A Survey

Given the importance of affective touch in human interactions, technology designers are increasingly attempting to bring this modality to the core of interactive technology. Advances in haptics and touch-sensing technology have been critical to fostering interest in this area. In this survey, we review how affective touch is investigated to enhance and support the human experience with or through technology. We explore this question across three different research areas to highlight their epistemology, main findings, and the challenges that persist. First, we review affective touch technology through the human–computer interaction literature to understand how it has been applied to the mediation of human–human interaction and its roles in other human interactions particularly with oneself, augmented objects/media, and affect-aware devices. We further highlight the datasets and methods that have been investigated for automatic detection and interpretation of affective touch in this area. In addition, we discuss the modalities of affective touch expressions in both humans and technology in these interactions. Second, we separately review how affective touch has been explored in human–robot and real-human–virtual-human interactions where the technical challenges encountered and the types of experience aimed at are different. We conclude with a discussion of the gaps and challenges that emerge from the review to steer research in directions that are critical for advancing affective touch technology and recognition systems. In our discussion, we also raise ethical issues that should be considered for responsible innovation in this growing area

The influence of scent on virtual reality experiences: The role of aroma-content congruence

We live in a multisensory world. Our experiences are constructed by the stimulation of all our senses. Nevertheless, digital interactions are mainly based on audiovisual elements, while other sensory stimuli have been less explored. Virtual reality (VR) is a sensory-enabling technology that facilitates the integration of sensory inputs to enhance multisensory digital experiences. This study analyzes how the addition of ambient scent to a VR experience affects digital pre-experiences in a service context (tourism). Results from a laboratory experiment confirmed that embodied VR devices, together with pleasant and congruent ambient scents, enhance sensory stimulation, which directly (and indirectly through ease of imagination) influence affective and behavioral reactions. These enriched multisensory experiences strengthen the link between the affective and conative images of destinations. We make recommendations for researchers and service providers with ambitions to deliver ambient scents, especially those congruent with displayed content, to enhance the sensorialization of digital VR experiences

Touching the Future: The Effects of Gesture-Based Interaction on Virtual Product Experience

With the popularity of touchscreen tablets and gesture control devices, the role of touch in online consumer behavior has become increasingly important. This study aims to investigate how sense of touch evoked by various interaction modes (i.e., mouse-driven interaction, touchscreen gesture interaction and mid-air gesture interaction) influences virtual product experience. Drawing on Feelings-as-Information Theory and Cognitive-Affective Framework in virtual product experience, we propose that sense of touch could influence consumer purchase intention by reducing product uncertainty and improving product attachment; furthermore, these effects are contingent on product characteristics, i.e., importance of product haptics and product valence. Accordingly, two lab experiments are designed. Potential theoretical contributions, practical implications as well as future research directions are discussed