Analyzing the Impact of Spatio-Temporal Sensor Resolution on Player Experience in Augmented Reality Games

Along with automating everyday tasks of human life, smartphones have become one of the most popular devices to play video games on due to their interactivity. Smartphones are embedded with various sensors which enhance their ability to adopt new new interaction techniques for video games. These integrated sen- sors, such as motion sensors or location sensors, make the device able to adopt new interaction techniques that enhance usability. However, despite their mobility and embedded sensor capacity, smartphones are limited in processing power and display area compared to desktop computer consoles. When it comes to evaluat- ing Player Experience (PX), players might not have as compelling an experience because the rich graphics environments that a desktop computer can provide are absent on a smartphone. A plausible alternative in this regard can be substituting the virtual game world with a real world game board, perceived through the device camera by rendering the digital artifacts over the camera view. This technology is widely known as Augmented Reality (AR). Smartphone sensors (e.g. GPS, accelerometer, gyro-meter, compass) have enhanced the capability for deploying Augmented Reality technology. AR has been applied to a large number of smartphone games including shooters, casual games, or puzzles. Because AR play environments are viewed through the camera, rendering the digital artifacts consistently and accurately is crucial because the digital characters need to move with respect to sensed orientation, then the accelerometer and gyroscope need to provide su ciently accurate and precise readings to make the game playable. In particular, determining the pose of the camera in space is vital as the appropriate angle to view the rendered digital characters are determined by the pose of the camera. This defines how well the players will be able interact with the digital game characters. Depending in the Quality of Service (QoS) of these sensors, the Player Experience (PX) may vary as the rendering of digital characters are affected by noisy sensors causing a loss of registration. Confronting such problem while developing AR games is di cult in general as it requires creating wide variety of game types, narratives, input modalities as well as user-testing. Moreover, current AR games developers do not have any specific guidelines for developing AR games, and concrete guidelines outlining the tradeoffs between QoS and PX for different genres and interaction techniques are required. My dissertation provides a complete view (a taxonomy) of the spatio-temporal sensor resolution depen- dency of the existing AR games. Four user experiments have been conducted and one experiment is proposed to validate the taxonomy and demonstrate the differential impact of sensor noise on gameplay of different genres of AR games in different aspect of PX. This analysis is performed in the context of a novel instru- mentation technology, which allows the controlled manipulation of QoS on position and orientation sensors. The experimental outcome demonstrated how the QoS of input sensor noise impacts the PX differently while playing AR game of different genre and the key elements creating this differential impact are - the input modality, narrative and game mechanics. Later, concrete guidelines are derived to regulate the sensor QoS as complete set of instructions to develop different genres or AR games

A Framework for Research in Gamified Mobile Guide Applications using Embodied Conversational Agents (ECAs)

Mobile Guides are mobile applications that provide players with local and location-based services (LBS), such as navigation assistance, where and when they need them most. Advances in mobile technologies in recent years have enabled the gamification of these applications, opening up new opportunities to transfer education and culture through game play. However, adding traditional game elements such as PBLs (points, badges, and leaderboards) alone cannot ensure that the intended learning outcomes will be met, as the player’s cognitive resources are shared between the application and the surrounding environment. This distribution of resources prevents players from easily immersing themselves into the educational scenario. Adding artificial conversational characters (ECAs) that simulate the social norms found in real-life human-to-human guide scenarios has the potential to address this problem and improve the player’s experience and learning of cultural narratives [1]. Although significant progress has been made towards creating game-like mobile guides with ECAs ([2], [3]), there is still a lack of a unified framework that enables researchers and practitioners to investigate the potential effects of such applications to players and how to approach the concepts of player experience, cognitive accessibility and usability in this context. This paper presents a theoretically-well supported research framework consisted of four key components: differences in players, different features of the gamified task, aspects of how the ECA looks, sound or behaves and different mobile environments. Furthermore, it provides based on this framework a working definition of what player experience, cognitive accessibility and usability are in the context of game-like mobile guide applications. Finally, a synthesis of the results of six empirical studies conducted within this research framework is discussed and a series of design guidelines for the effective gamification of mobile guide applications using ECAs are presented. Results show that an ECA can positively affect the quality of the player’s experience, but it did not elicit better player retention of cultural narratives and navigation of routes

Augmented reality in mathematics: Enhancing pupils’ everyday school lives

This article presents findings from a study focused on using technology as a learning tool in education. Educational research on game-based learning argues that technology-based learning tools effectively enhance learning and memory. Augmented reality (AR) technology is attracting significant attention; its importance will continue to increase as new learning environments are exploited and new possibilities for promoting flexible and playful learning are revealed. This study investigated pupils’ experiences with an AR application by comparing experiences and reflections from pupils who learned mathematics using the Wittario game-based learning application with pupils exposed to more traditional instructional methods. 72 pupils in 5th and 6th grade, divided into three different test groups, and 5 teachers were interviewed. The study revealed that the application provided more subjectoriented interactions, and pupils expressed a high level of motivation and peer affiliation when using the application. Our findings, therefore, reveal that using the application, especially when facilitating tasks that involve peer collaboration and interaction with a specter of features available, contributes to a positive learning environment. Also uncovered was that the teacher’s presence and positioning of the activity in a pedagogical context are essential to this process.publishedVersio

Multimodal augmented reality tangible gaming

This paper presents tangible augmented reality gaming environment that can be used to enhance entertainment using a multimodal tracking interface. Players can interact using different combinations between a pinch glove, a Wiimote, a six-degrees-of-freedom tracker, through tangible ways as well as through I/O controls. Two tabletop augmented reality games have been designed and implemented including a racing game and a pile game. The goal of the augmented reality racing game is to start the car and move around the track without colliding with either the wall or the objects that exist in the gaming arena. Initial evaluation results showed that multimodal-based interaction games can be beneficial in gaming. Based on these results, an augmented reality pile game was implemented with goal of completing a circuit of pipes (from a starting point to an end point on a grid). Initial evaluation showed that tangible interaction is preferred to keyboard interaction and that tangible games are much more enjoyable

A serious game for raising air pollution awareness in children

Air pollution has been one of the most discussed topics in the world in the last years, due to its effects on the atmosphere of our planet and our health overall. Currently, over 2.6 billion people are exposed to indoor air pollution, which tells us that efforts are needed to raise people’s awareness about air pollution. The use of serious games and gamification of apps have raised people’s perception, but these effects end up being short-term. This work presents “Problemas no Ar”, a game developed in Unity about air pollution where the player’s goal is to control a character tasked to monitor indoor and outdoor air pollution with sensors in several city zones. While playing, children are expected to learn the possible causes of pollution in each zone and, this way, the game attempts to promote pro-environmental behaviours. This game allows educators to configure the problems that the player has to solve. Pre- and post-surveys about air pollution were elaborated to evaluate perception of twenty students of an elementary school before and after playing the game. Participants’ gameplay experience was also evaluated through a usability score. Results show that the game provided some significant positive effects on participants’ perception. In terms of usability scores, the mean value was 75 out of 100, a value that is acceptable.A poluição atmosférica tem sido um dos temas mais discutidos no mundo nos últimos anos, o que está a afetar a atmosfera do nosso planeta e a nossa saúde em geral. Mais de 2.6 mil milhões de pessoas no mundo sofrem de poluição do ar interior dentro das suas casas, isto diz-nos que são necessários esforços para aumentar a consciência das pessoas sobre a poluição do ar. A utilização de jogos sérios e a gamificação de aplicações têm aumentado a perceção das pessoas, mas estes efeitos acabam por ser de curto prazo. Este trabalho apresenta "Problemas no Ar", um jogo desenvolvido em Unity sobre poluição atmosférica onde o objetivo do jogador é monitorizar a poluição atmosférica interior e exterior com sensores dispostos por várias zonas urbanas e aprender as possíveis causas da poluição em cada zona, tentando promover comportamentos pró-ambientais nas crianças. Este jogo permite que educadores consigam configurar os problemas que o jogador tem de resolver. Questionários pré- e pós- jogo sobre a poluição do ar foram elaborados para avaliar a perceção de vinte alunos do ensino básico antes e depois de jogar o jogo, a pontuação de usabilidade do jogo também foi medida. Os resultados mostram que o jogo teve efeitos positivos na perceção dos participantes, alguns itens foram significativos, outros não tão significativos. Em termos de usabilidade do jogo, o valor médio foi de 75 de 100, o que é aceitável

The Hitchhiker’s Guide to the Metaverse

Non peer reviewe

Exploring the use of smart glasses, gesture control, and environmental data in augmented reality games

Abstract. In the last decade, augmented reality has become a popular trend. Big corporations like Microsoft, Facebook, and Google started to invest in augmented reality because they saw the potential that it has especially with the rising of the consumer version of the head mounted displays such as Microsoft’s HoloLens and the ODG’s R7. However, there is a gap in the knowledge about the interaction with such devices since they are fairly new and an average consumer cannot yet afford them due to their relatively high prices. In this thesis, the Ghost Hunters game is described. The game is a mobile augmented reality pervasive game that uses the environment light data to charge the in-game “goggles”. The game has two different versions, a smartphone and smart glasses version. The Ghost Hunters game was implemented for exploring the use of two different types of interactions methods, buttons and natural hand gestures for both smartphones and smart glasses. In addition to that, the thesis sought to explore the use of ambient light in augmented reality games. First, the thesis defines the essential concepts related to games and augmented reality based on the literature and then describes the current state of the art of pervasive games and smart glasses. Second, both the design and implementation of the Ghost Hunters game are described in detail. Afterwards, the three rounds of field trials that were conducted to investigate the suitability of the two previously mentioned interaction methods are described and discussed. The findings suggest that smart glasses are more immersive than smartphones in context of pervasive AR games. Moreover, prior AR experience has a significant positive impact on the immersion of smart glasses users. Similarly, males were more immersed in the game than females. Hand gestures were proven to be more usable than the buttons on both devices. However, the interaction method did not affect the game engagement at all, but surprisingly it did affect the way users perceive the UI with smart glasses. Users that used the physical buttons were more likely to notice the UI elements than the users who used the hand gestures