From ‘hands up’ to ‘hands on’: harnessing the kinaesthetic potential of educational gaming

Traditional approaches to distance learning and the student learning journey have focused on closing the gap between the experience of off-campus students and their on-campus peers. While many initiatives have sought to embed a sense of community, create virtual learning environments and even build collaborative spaces for team-based assessment and presentations, they are limited by technological innovation in terms of the types of learning styles they support and develop. Mainstream gaming development – such as with the Xbox Kinect and Nintendo Wii – have a strong element of kinaesthetic learning from early attempts to simulate impact, recoil, velocity and other environmental factors to the more sophisticated movement-based games which create a sense of almost total immersion and allow untethered (in a technical sense) interaction with the games’ objects, characters and other players. Likewise, gamification of learning has become a critical focus for the engagement of learners and its commercialisation, especially through products such as the Wii Fit. As this technology matures, there are strong opportunities for universities to utilise gaming consoles to embed levels of kinaesthetic learning into the student experience – a learning style which has been largely neglected in the distance education sector. This paper will explore the potential impact of these technologies, to broadly imagine the possibilities for future innovation in higher education

Towards 3-D Sound: Spatial Presence and the Space Vacuum

This chapter demonstrates the evolution of relationships between sound design and music in cinematic representations of the interstellar space vacuum. Mera provides a framework for understanding how audiences believe they are physically present in the represented environment and argues that, in the late 2000s, we move towards three-dimensional (3-D) sound, an aesthetic and technical extension of the superfield and the ultrafield as defined by Chion and Kerins, respectively. 3-D Sound’s primary characteristic is the emancipation of music from a fixed sound-stage spatialization, resulting in greater fluidity between sound design and music. This chapter examines the relationship between two types of spatial presence, articulating both the audience’s suspension of disbelief within a film’s narrative world and the spatial presence of sound and music within a multichannel cinema environme

Evaluating Audience Engagement of an Immersive Performance on a Virtual Stage

Presenting theatrical performances in virtual reality (VR) has been an active area of research since the early 2000\u27s. VR provides a unique form of storytelling, which is made possible through the use of physically and digitally distributed 3D worlds. We describe a methodology for determining audience engagement in a virtual theatre performance. We use a combination of galvanic skin response (GSR) data, self-reported positive and negative affect schedule (PANAS), post-viewing reflection, and a think aloud method to assess user reaction to the virtual reality experience. In this study, we combine the implicit physiological data from GSR with explicit user feedback to produce a holistic metric for assessing immersion. Although the study evaluated a particular artistic work, the methodology of the study provides a foundation for conducting similar research. The combination of PANAS, self reflection, and the think aloud in conjunction with GSR data constitutes a novel approach in the study of live performance in virtual reality. The approach is also extendable to include other implicit measures such as pulse rate, blood pressure, or eye tracking. Our case study compares the experience of viewing the performance on a computer monitor to viewing with a head mounted display. Results showed statistically significant differences based on viewing platform in the PANAS self-report metric, as well as GSR measurements. Feedback obtained via the think aloud and reflection analysis also emphasized qualitative differences between the two viewing scenarios

Pervasive and standalone computing: The perceptual effects of variable multimedia quality.

The introduction of multimedia on pervasive and mobile communication devices raises a number of perceptual quality issues, however, limited work has been done examining the 3-way interaction between use of equipment, quality of perception and quality of service. Our work measures levels of informational transfer (objective) and user satisfaction (subjective)when users are presented with multimedia video clips at three different frame rates, using four different display devices, simulating variation in participant mobility. Our results will show that variation in frame-rate does not impact a user’s level of information assimilation, however, does impact a users’ perception of multimedia video ‘quality’. Additionally, increased visual immersion can be used to increase transfer of video information, but can negatively affect the users’ perception of ‘quality’. Finally, we illustrate the significant affect of clip-content on the transfer of video, audio and textual information, placing into doubt the use of purely objective quality definitions when considering multimedia presentations

Sonic interactions in virtual environments

This book tackles the design of 3D spatial interactions in an audio-centered and audio-first perspective, providing the fundamental notions related to the creation and evaluation of immersive sonic experiences. The key elements that enhance the sensation of place in a virtual environment (VE) are: Immersive audio: the computational aspects of the acoustical-space properties of Virutal Reality (VR) technologies Sonic interaction: the human-computer interplay through auditory feedback in VE VR systems: naturally support multimodal integration, impacting different application domains Sonic Interactions in Virtual Environments will feature state-of-the-art research on real-time auralization, sonic interaction design in VR, quality of the experience in multimodal scenarios, and applications. Contributors and editors include interdisciplinary experts from the fields of computer science, engineering, acoustics, psychology, design, humanities, and beyond. Their mission is to shape an emerging new field of study at the intersection of sonic interaction design and immersive media, embracing an archipelago of existing research spread in different audio communities and to increase among the VR communities, researchers, and practitioners, the awareness of the importance of sonic elements when designing immersive environments