Connecting Couples in Long-Distance Relationships : Towards Unconventional Computer-Mediated Emotional Communication Systems

The number of couples who find themselves in a long-distance relationship (LDR) is increasing for a wide range of reasons, such as overseas employment, academic pursuits, military duty, and similar circumstances. With the myriad of communication channels enabled by the low cost and ubiquity of computer-mediated communication technologies, couples in LDRs are able to stay in touch with each other around the globe. However, recent studies have revealed that the mainstream communication tools are inadequate to support the full spectrum of communication needed in intimate relationships. Emotional communication is one of the fundamental needs in close relationships, as it forms an important part of intimacy. This dissertation argues that there is a gap between what is known about LDR couples’ needs in research and what has been implemented for them in practice. The aim of this work is to bridge this gap by mediating emotional communication through unconventional user interfaces that use interaction solutions outside of the scope of their conventional use, with a particular focus on couples who sustain a committed LDR. Here, taking research through design as a core approach, a variety of qualitative methods were employed to seek answers to the research questions. This dissertation includes eight case studies, each of which is dedicated to answering its corresponding research question(s). Study I presents a systematic literature review which explored the current state of the art and identified the design opportunities. Study II introduces a series of co-design activities with five couples in LDRs to reveal the needs and challenges of users in an LDR. Studies III and IV propose two functional prototypes for unconventional communication systems to connect couples in LDRs. Study V showcases 12 design concepts of wearables created by the participants to support their own LDR. Study VI describes how four low-resolution prototypes created for mediating LDRs by the participants in the workshop would be used in real-world contexts. Studies VII and VIII each present a novel design tool to be used as a scaffold when designing communication systems for supporting LDRs: specifically, a conceptual design framework and a card-based design toolkit. This dissertation contributes new knowledge to the field of human-computer interaction through design interventions. It showcases a spectrum of practices which can be seen as a first step towards mediating emotional communication for couples in LDRs using unconventional communication systems. The findings comprise theoretical and empirical insights—derived from the eight case studies in which the author identified design opportunities and design considerations—relating to how couples in LDRs can be better supported by unconventional computer-mediated emotional communication systems

Social touch in human–computer interaction

Touch is our primary non-verbal communication channel for conveying intimate emotions and as such essential for our physical and emotional wellbeing. In our digital age, human social interaction is often mediated. However, even though there is increasing evidence that mediated touch affords affective communication, current communication systems (such as videoconferencing) still do not support communication through the sense of touch. As a result, mediated communication does not provide the intense affective experience of co-located communication. The need for ICT mediated or generated touch as an intuitive way of social communication is even further emphasized by the growing interest in the use of touch-enabled agents and robots for healthcare, teaching, and telepresence applications. Here, we review the important role of social touch in our daily life and the available evidence that affective touch can be mediated reliably between humans and between humans and digital agents. We base our observations on evidence from psychology, computer science, sociology, and neuroscience with focus on the first two. Our review shows that mediated affective touch can modulate physiological responses, increase trust and affection, help to establish bonds between humans and avatars or robots, and initiate pro-social behavior. We argue that ICT mediated or generated social touch can (a) intensify the perceived social presence of remote communication partners and (b) enable computer systems to more effectively convey affective information. However, this research field on the crossroads of ICT and psychology is still embryonic and we identify several topics that can help to mature the field in the following areas: establishing an overarching theoretical framework, employing better research methodologies, developing basic social touch building blocks, and solving specific ICT challenges

Design for Sharing Emotional Touches during Phone Calls: A Quantitative Evaluation of Four Tactile Representations

Background As the importance of mobile phones as an emotional communication medium is growing, non-verbal behaviors such as facial expressions, touching behaviors and gestures ought to be considered to enhance phone conversations. Among various non-verbal signals, we focus on sharing specific touches that could be used for exchanging contextual and emotional cues. Along with this, to make the new phone conversation involving touching more natural, we consider maintaining natural audio conversation with phones by keeping the receiver on the ear and the transmitter on the mouth while holding the phone to the cheek. Methods In this paper, we focus on investigating ways to deliver four touches: pat, slap, tickle and kiss with sound and tactile feedback while holding the phone to the cheek as in typical phone calls. The interaction technique is called CheekTouch, and it is based on enabling users to share touches by representing finger gestures on one phone screen to the other party???s cheek using a vibrotactile display and sound stimulations. We asked the 30 students who participated to put the device on their cheek and wear earphones, and we provided them with 24 different stimulations. Results An evaluation was conducted to propose the most appropriate type of stimulation to deliver a pat, slap, tickle and kiss using CheekTouch. We showed that the best way to deliver a pat was to use a vibrotactile display combined with sound; however, a tickle was best delivered with only the vibrotactile display. A kiss and slap, on the other hand, were best delivered when there was only sound. Conclusions Considering the trends in sharing delicate emotions during phone-mediated communications, it is significant to investigate ways to convey touches during phone conversations beyond sharing visual emoticons. Here, we focused on findings ways to pat, slap, tickle and kiss by using existing phone technologies (vibrotactile motors and sound). Through the quantitative evaluation of those four touches, we discovered which stimulation type is best for delivering each of the touches. The results do not show whether those touches can deliver emotions, however, we believe CheekTouch and the findings from the evaluation can be used for sharing different types of non-verbal signals during audio-based phone conversations and enable further studies in the field of remote tactile interaction.clos

Technology to reduce social isolation and loneliness

Large numbers of individuals, many of them senior citizens, live in social isolation. This typically leads to loneliness, depression, and vulnerability, and subsequently to other negative health consequences. We report on research focused on understanding the communication needs of people in environments associated with social isolation and loneliness, and how technology facilitates social connection. Our work consists of successive iterations of field studies and technology prototype design, deployment, and analysis. Particular attention is paid to seniors in retirement communities and in long-term care settings (nursing homes). We present design implications for technology to enable seniors' social connections, the "InTouch" prototype that satisfies most of the implications, and a report on one older adult's experience of InTouch

Multi-Moji: Combining Thermal, Vibrotactile and Visual Stimuli to Expand the Affective Range of Feedback

This paper explores the combination of multiple concurrent modalities for conveying emotional information in HCI: temperature, vibration and abstract visual displays. Each modality has been studied individually, but can only convey a limited range of emotions within two-dimensional valencearousal space. This paper is the first to systematically combine multiple modalities to expand the available affective range. Three studies were conducted: Study 1 measured the emotionality of vibrotactile feedback by itself; Study 2 measured the perceived emotional content of three bimodal combinations: vibrotactile + thermal, vibrotactile + visual and visual + thermal. Study 3 then combined all three modalities. Results show that combining modalities increases the available range of emotional states, particularly in the problematic top-right and bottom-left quadrants of the dimensional model. We also provide a novel lookup resource for designers to identify stimuli to convey a range of emotions

Interdisciplinary Insights for Digital Touch Communication

Communication is increasingly moving beyond ‘ways of seeing’ to ‘ways of feeling’. This Open Access book provides social design insights and implications for HCI research and design exploring digitally mediated touch communication. It offers a socially orientated map to help navigate the complex social landscape of digitally mediated touch for communication: from everyday touch-screens, tangibles, wearables, haptics for virtual reality, to the tactile internet of skin. Drawing on literature reviews, new case-study vignettes, and exemplars of digital touch, the book examines the major social debates provoked by digital touch, and investigates social themes central to the communicative potential and societal consequences of digital touch: · Communication environments, capacities and practices · Norms associations and expectations · Presence, absence and connection · Social imaginaries of digital touch · Digital touch ethics and values The book concludes with a discussion of the significance of social understanding and methods in the context of Interdisciplinary collaborations to explore touch, towards the design of digital touch communication, ‘ways of feeling’, that are useable, appropriate, ethical and socially aware

Somatic ABC's: A Theoretical Framework for Designing, Developing and Evaluating the Building Blocks of Touch-Based Information Delivery

abstract: Situations of sensory overload are steadily becoming more frequent as the ubiquity of technology approaches reality--particularly with the advent of socio-communicative smartphone applications, and pervasive, high speed wireless networks. Although the ease of accessing information has improved our communication effectiveness and efficiency, our visual and auditory modalities--those modalities that today's computerized devices and displays largely engage--have become overloaded, creating possibilities for distractions, delays and high cognitive load; which in turn can lead to a loss of situational awareness, increasing chances for life threatening situations such as texting while driving. Surprisingly, alternative modalities for information delivery have seen little exploration. Touch, in particular, is a promising candidate given that it is our largest sensory organ with impressive spatial and temporal acuity. Although some approaches have been proposed for touch-based information delivery, they are not without limitations including high learning curves, limited applicability and/or limited expression. This is largely due to the lack of a versatile, comprehensive design theory--specifically, a theory that addresses the design of touch-based building blocks for expandable, efficient, rich and robust touch languages that are easy to learn and use. Moreover, beyond design, there is a lack of implementation and evaluation theories for such languages. To overcome these limitations, a unified, theoretical framework, inspired by natural, spoken language, is proposed called Somatic ABC's for Articulating (designing), Building (developing) and Confirming (evaluating) touch-based languages. To evaluate the usefulness of Somatic ABC's, its design, implementation and evaluation theories were applied to create communication languages for two very unique application areas: audio described movies and motor learning. These applications were chosen as they presented opportunities for complementing communication by offloading information, typically conveyed visually and/or aurally, to the skin. For both studies, it was found that Somatic ABC's aided the design, development and evaluation of rich somatic languages with distinct and natural communication units.Dissertation/ThesisPh.D. Computer Science 201