What does touch tell us about emotions in touchscreen-based gameplay?

This is the post-print version of the Article. The official published version can be accessed from the link below - Copyright @ 2012 ACM. It is posted here by permission of ACM for your personal use. Not for redistribution.Nowadays, more and more people play games on touch-screen mobile phones. This phenomenon raises a very interesting question: does touch behaviour reflect the player’s emotional state? If possible, this would not only be a valuable evaluation indicator for game designers, but also for real-time personalization of the game experience. Psychology studies on acted touch behaviour show the existence of discriminative affective profiles. In this paper, finger-stroke features during gameplay on an iPod were extracted and their discriminative power analysed. Based on touch-behaviour, machine learning algorithms were used to build systems for automatically discriminating between four emotional states (Excited, Relaxed, Frustrated, Bored), two levels of arousal and two levels of valence. The results were very interesting reaching between 69% and 77% of correct discrimination between the four emotional states. Higher results (~89%) were obtained for discriminating between two levels of arousal and two levels of valence

Tactile Interactions with a Humanoid Robot : Novel Play Scenario Implementations with Children with Autism

Acknowledgments: This work has been partially supported by the European Commission under contract number FP7-231500-ROBOSKIN. Open Access: This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.The work presented in this paper was part of our investigation in the ROBOSKIN project. The project has developed new robot capabilities based on the tactile feedback provided by novel robotic skin, with the aim to provide cognitive mechanisms to improve human-robot interaction capabilities. This article presents two novel tactile play scenarios developed for robot-assisted play for children with autism. The play scenarios were developed against specific educational and therapeutic objectives that were discussed with teachers and therapists. These objectives were classified with reference to the ICF-CY, the International Classification of Functioning – version for Children and Youth. The article presents a detailed description of the play scenarios, and case study examples of their implementation in HRI studies with children with autism and the humanoid robot KASPAR.Peer reviewedFinal Published versio

Smartphones

Many of the research approaches to smartphones actually regard them as more or less transparent points of access to other kinds of communication experiences. That is, rather than considering the smartphone as something in itself, the researchers look at how individuals use the smartphone for their communicative purposes, whether these be talking, surfing the web, using on-line data access for off-site data sources, downloading or uploading materials, or any kind of interaction with social media. They focus not so much on the smartphone itself but on the activities that people engage in with their smartphones

Creative idea exploration within the structure of a guiding framework : the card brainstorming game

I present a card brainstorming exercise that transforms a conceptual tangible interaction framework into a tool for creative dialogue and discuss the experiences made in using it. Ten sessions with this card game demonstrate the frameworks' versatility and utility. Observation and participant feedback highlight the value of a provocative question format and of the metaphor of a card game

The experience of enchantment in human-computer interaction

Improving user experience is becoming something of a rallying call in human–computer interaction but experience is not a unitary thing. There are varieties of experiences, good and bad, and we need to characterise these varieties if we are to improve user experience. In this paper we argue that enchantment is a useful concept to facilitate closer relationships between people and technology. But enchantment is a complex concept in need of some clarification. So we explore how enchantment has been used in the discussions of technology and examine experiences of film and cell phones to see how enchantment with technology is possible. Based on these cases, we identify the sensibilities that help designers design for enchantment, including the specific sensuousness of a thing, senses of play, paradox and openness, and the potential for transformation. We use these to analyse digital jewellery in order to suggest how it can be made more enchanting. We conclude by relating enchantment to varieties of experience.</p

Touchomatic: interpersonal touch gaming in the wild

Direct touch between people is a key element of social behaviour. Recently a number of researchers have explored games which sense aspects of such interpersonal touch to control interaction with a multiplayer computer game. In this paper, we describe a long term, in-the-wild study of a two-player arcade game which is controlled by gentle touching between the body parts of two players. We ran the game in a public videogame arcade for a year, and present a thematic analysis of 27 hours of gameplay session videos, organized under three top level themes: control of the system, interpersonal interaction within the game, and social interaction around the game. In addition, we provide a quantitative analysis of observed demographic differences in interpersonal touch behaviour. Finally, we use these results to present four design recommendations for use of interpersonal touch in games

Trends in virtual reality technologies for the learning patient

NextMed convened the Medicine Meets Virtual Reality 22 (MMVR 22) conference in 2016. Since 1992, the conference has brought together a diverse group of researchers to share creative solutions for the evolving challenge of integrating virtual reality tools into medical education. Virtual reality (VR) and its enabling technologies utilize hardware and software to simulate environments and encounters where users can interact and learn. The MMVR 22 symposium proceedings contain projects that support a variety of learners: medical students, practitioners, soldiers, and patients. This report will contemplate the trends in virtual reality technologies for patients navigating their medical and healthcare learning. The learning patient seeks more than intervention; they seek prevention. From virtual humans and environments to motion sensors and haptic devices, patients are surrounded by increasingly rich and transformative data-driven tools. Applied data enables VR applications to simulate experience, predict health outcomes, and motivate new behavior. The MMVR 22 presents investigations into the usability of wearable devices, the efficacy of avatar inclusion, and the viability of multi-player gaming. With increasing need for individualized and scalable programming, only committed open source efforts will align instructional designers, technology integrators, trainers, and clinicians. Curriculum and InstructionCurriculum and Instructio

Organizational Probes:Exploring Playful Interactions in Work Environment

Playfulness, with non-intrusive elements, can be considered a useful resource for enhancing social awareness and community building within work organizations. Taking inspirations from the cultural probes approach, we developed organizational probes as a set of investigation tools that could provide useful information about employees’ everyday playful experiences within their work organizations. In an academic work environment, we applied our organizational probes over a period of three weeks. Based on the collected data we developed two design concepts for playful technologies in work environments

Affective issues in learning technologies: emotional responses to technology and technology's role in supporting socio-emotional skills

This paper focuses on some of the author's research studies over the past thirty years and places these in a wider context to reflect on research into affective issues in learning technologies over this period, and to consider whether and how the issues uncovered by research have changed as technologies have developed over time. Three issues are given particular attention: firstly the reasons for learners' use or lack of use of technologies for their learning; secondly adult learners' attitudes towards using technology for learning and thirdly how technology might support socio-emotional development and expression in children. The discussion of these issues is framed by two of the author's research projects. For the first two issues this is an early study of students' perceptions and attitudes towards using computers for tutorial learning in 1980. The factors that influenced the students' use of the computer tutorials are discussed (including access, assessment and anxiety about using computers) and also the extent to which some of these factors persist for many learners using (or not using) technologies today. The discussion of the third issue draws on a series of studies conducted in the 1990s to investigate whether educational technology could support children and young people's emotional expression and communication and development of socio-emotional skills. Finally the paper considers how these kinds of issues have been taken forward and how they are represented in contemporary research and suggests that trust is an important factor in using learning technologies

Affective issues in learning technologies: emotional responses to technology and technology's role in supporting socio-emotional skills

This paper focuses on some of the author's research studies over the past thirty years and places these in a wider context to reflect on research into affective issues in learning technologies over this period, and to consider whether and how the issues uncovered by research have changed as technologies have developed over time. Three issues are given particular attention: firstly the reasons for learners' use or lack of use of technologies for their learning; secondly adult learners' attitudes towards using technology for learning and thirdly how technology might support socio-emotional development and expression in children. The discussion of these issues is framed by two of the author's research projects. For the first two issues this is an early study of students' perceptions and attitudes towards using computers for tutorial learning in 1980. The factors that influenced the students' use of the computer tutorials are discussed (including access, assessment and anxiety about using computers) and also the extent to which some of these factors persist for many learners using (or not using) technologies today. The discussion of the third issue draws on a series of studies conducted in the 1990s to investigate whether educational technology could support children and young people's emotional expression and communication and development of socio-emotional skills. Finally the paper considers how these kinds of issues have been taken forward and how they are represented in contemporary research and suggests that trust is an important factor in using learning technologies