Serious Game Evaluation as a Meta-game

Purpose – This paper aims to briefly outline the seamless evaluation approach and its application during an evaluation of ORIENT, a serious game aimed at young adults. Design/methodology/approach – In this paper, the authors detail a unobtrusive, embedded evaluation approach that occurs within the game context, adding value and entertainment to the player experience whilst accumulating useful data for the development team. Findings – The key result from this study was that during the “seamless evaluation” approach, users were unaware that they had been participating in an evaluation, with instruments enhancing rather than detracting from the in-role game experience. Practical implications – This approach, seamless evaluation, was devised in response to player expectations, perspectives and requirements, recognising that in the evaluation of games the whole process of interaction including its evaluation must be enjoyable and fun for the user. Originality/value – Through using seamless evaluation, the authors created an evaluation completely embedded within the “magic circle” of an in-game experience that added value to the user experience whilst also yielding relevant results for the development team

From Non-human to Human: Adult's and Children's Perceptions of Agents Varying in Humanness

While most interface agents have been designed from an adult perspective, the present paper compares adults’ and children’s views of agents that vary in their degree of humanness. Four synthetic characters ranging in appearance from non-human to very human (blob, cat, cartoon, human) were presented to adult and children perceivers and were evaluated with respect to their cognitive and emotional abilities. The visual appearance significantly influenced participants’ ratings in both age groups. However, the pattern of results was more differentiated for adult perceivers as a function of the human-likeness of the character. The findings suggest that children may rely less on human-like features in inferring agents’ capabilities which are judged along simpler cognitive and social dimensions. Implications for the design of artificial agents are discussed

Interactive Radio: A New Platform for Calm Computing

Interactive radio is proposed as a platform for Weiser's calm computing vision. An evaluation of CereProc's MyMyRadio is presented as a case study to highlight the potential and challenges of an interactive radio approach: the difficulty of transitioning between passive and active modes of interaction, and the challenge of designing such services. The evaluation showed: 1) A higher workload for MyMyRadio for active tasks compared to default applications (e.g. Facebook app); 2) No significant difference in workload for passive tasks (e.g. listening to audio rendered RSS updates vs Browser app); 3) A higher workload when listening to music within MyMyRadio vs iTunes; and 4) A preference for RSS feed content compared to content from social media. We conclude by discussing the potential of interactive radio as a platform for pervasive eyes-free services

Prediction and Realisation of Conversational Characteristics by Utilising Spontaneous Speech for Unit Selection

Unit selection speech synthesis has reached high levels of naturalness and intelligibility for neutral read aloud speech. However, synthetic speech generated using neutral read aloud data lacks all the attitude, intention and spontaneity associated with everyday conversations. Unit selection is heavily data dependent and thus in order to simulate human conversational speech, or create synthetic voices for believable virtual characters, we need to utilise speech data with examples of how people talk rather than how people read. In this paper we included carefully selected utterances from spontaneous conversational speech in a unit selection voice. Using this voice and by automatically predicting type and placement of lexical fillers and filled pauses we can synthesise utterances with conversational characteristics. A perceptual listening test showed that it is possible to make synthetic speech sound more conversational without degrading naturalness

Improving conversational dynamics with reactive speech synthesis

The active exchange of ideas and/or information is a crucial feature of human-human conversation. Yet it is a skill that present-day ‘conversational’ interfaces are lacking, which effectively hampers the dynamics of interaction and makes it feel artificial. In this paper, we present a reactive speech synthesis system that can handle user’s interruptions. Initial results of evaluation of our interactive experiment indicate that participants prefer a reactive system to a non-reactive one. Based on participants’ feedback, we suggest potential applications for reactive speech synthesis systems (i.e. interactive tutor and adventure game) and propose further interactive user experiments to evaluate them. We anticipate that the reactive system can offer more engaging and dynamic interaction and improve user experience by making it feel more like a natural human-human conversation

Inter-cultural differences in response to a computer-based anti-bullying intervention

Background and purpose: Many holistic anti-bullying interventions have been attempted, with mixed success, while little work has been done to promote a 'self-help' approach to victimisation. The rise of the ICT curriculum and computer support in schools now allows for approaches that benefit from technology to be implemented. This study evaluates the cross-cultural effects of a computer-based anti-bullying intervention on primary school-aged children's knowledge about bullying and relevant coping strategies. Programme description: FearNot! is an interactive computer-based virtual learning environment designed for use as an anti-bullying intervention. It includes interactive virtual agents who assume the most common participant roles found in episodes of bullying. FearNot! was used by children over three consecutive weeks to allow its effectiveness to be evaluated in a longitudinal in situ programme. Sample: Two comparable samples were drawn from the UK and Germany. In the UK, 651 participants (aged 8-11) were recruited from primary schools in Hertfordshire, Coventry and Warwickshire, whereas the 535 German participants (aged 7-10) were sourced from Grundschulen in the Bayern and Hessen regions. Because of lack of parental consent, late joiners and absences/missing responses, data from 908 participants (UK 493; Germany 415) were analysed. Design and methods: A quasi-experimental, pre/post-tests control group design employed pre-published and bespoke questionnaires to collect data. Descriptive and inferential analyses were conducted. Results: UK students possessed higher coping strategy knowledge scores than German participants, but German children's scores improved over time and as a result of the FearNot! intervention. Conclusions: Overall, while not effective at increasing children's coping strategy knowledge in this study, the FearNot! intervention could prove a useful classroom tool to approach the issue of bullying as part of a wider initiative. Cultural differences at baseline and reactions to the intervention are discussed

Designing Interactions with Multilevel Auditory Displays in Mobile Audio-Augmented Reality

Auditory interfaces offer a solution to the problem of effective eyes-free mobile interactions. In this article, we investigate the use of multilevel auditory displays to enable eyes-free mobile interaction with indoor location-based information in non-guided audio-augmented environments. A top-level exocentric sonification layer advertises information in a gallery-like space. A secondary interactive layer is used to evaluate three different conditions that varied in the presentation (sequential versus simultaneous) and spatialisation (non-spatialised versus egocentric/exocentric spatialisation) of multiple auditory sources. Our findings show that (1) participants spent significantly more time interacting with spatialised displays; (2) using the same design for primary and interactive secondary display (simultaneous exocentric) showed a negative impact on the user experience, an increase in workload and substantially increased participant movement; and (3) the other spatial interactive secondary display designs (simultaneous egocentric, sequential egocentric, and sequential exocentric) showed an increase in time spent stationary but no negative impact on the user experience, suggesting a more exploratory experience. A follow-up qualitative and quantitative analysis of user behaviour support these conclusions. These results provide practical guidelines for designing effective eyes-free interactions for far richer auditory soundscapes