Creating immersive, play-anywhere handheld augmented reality stories, through remote user testing

Abstract

This thesis outlines new instances of Extended Reality (XR) stories as well as associated user studies with them, to create more immersive story experiences delivered at a user’s choice of location through a mobile phone. This extends prior work on Location Based Experiences (LBEs), which have typically been designed to offer a game or story at a pre-determined location. A play-anywhere experience offers potential to open up LBEs to a wider audience, as well as to those may prefer to take part individually or closer to home, such attitude shifts becoming increasingly more common. The current research adopted an in the wild approach combining practice, studies and theory, with most user data being collected remotely. Each story application developed is subsequently referred to as an app, with each app offering a bespoke story incorporating Augmented Reality (AR) features, to better bring users’ location inline with the narrative. Testing the apps across various locations matched their intended use, and resulted in new guidelines for both incorporating AR into such LBEs, as well as for conducting remote user studies. A final app offered a site-specific curated story, with all study participants taking part under similar conditions at the same location, the ability to observe them using the app providing additional insights. The story apps used available local map data alongside Handheld Augmented Reality (HAR), to overlay interactable virtual objects on top of the physical environment, and visible on the phone’s display. Guidelines from related methodologies were used to better allow for the variety of factors that might influence different users’ immersion and engagement. These included the implementation of the AR features, the story itself, real world activity, and personal preferences including onboarding requirements. The approach taken contributed a reverse methodology to a lot of related research, that would typically begin with laboratory testing before moving to public spaces. User studies with the five mobile apps contributed guidelines for such experiences, that could benefit both practitioners and researchers in related fields. In the later case, a need was identified to develop new research tools specifically suited to the subtleties of handheld play-anywhere LBEs, such issues explored within the apps tested. The guidelines identified for offering more effective XR LBEs were also implemented in the creation of a new open source Unity project, called Map Story Engine. This offers a tool to test new features, as well as providing a fully customisable template for practitioners to author their own play-anywhere HAR stories and games

    Similar works