Biometric storyboards: a games user research approach for improving qualitative evaluations of player experience

Developing video games is an iterative and demanding process. It is difficult to achieve the goal of most video games — to be enjoyable, engaging and to create revenue for game developers — because of many hard-to-evaluate factors, such as the different ways players can interact with the game. Understanding how players behave during gameplay is of vital importance to developers and can be uncovered in user tests as part of game development. This can help developers to identify and resolve any potential problem areas before release, leading to a better player experience and possibly higher game review scores and sales. However, traditional user testing methods were developed for function and efficiency oriented applications. Hence, many traditional user testing methods cannot be applied in the same way for video game evaluation. This thesis presents an investigation into the contributions of physiological measurements in user testing within games user research (GUR). GUR specifically studies the interaction between a game and users (players) with the aim to provide feedback for developers to help them to optimise the game design of their title. An evaluation technique called Biometric Storyboards is developed, which visualises the relationships between game events, player feedback and changes in a player’s physiological state. Biometric Storyboards contributes to the field of human-computer interaction and GUR in three important areas: (1) visualising mixedmeasures of player experience, (2) deconstructing game design by analysing game events and pace, (3) incremental improvement of classic user research techniques (such as interviews and physiological measurements). These contributions are described in practical case studies, interviews with game developers and laboratory experiments. The results show this evaluation approach can enable games user researchers to increase the plausibility and persuasiveness of their reports and facilitate developers to better deliver their design goals. Biometric Storyboards is not aimed at replacing existing methods, but to extend them with mixed methods visualisations, to provide powerful tools for games user researchers and developers to better understand and communicate player needs, interactions and experiences. The contributions of this thesis are directly applicable for user researchers and game developers, as well as for researchers in user experience evaluation in entertainment systems

Innlevelse i dataspill gjennom direkte manipulasjon og hyperstruktur : en analyse av ’Knights of the Old Republic’

This master thesis addresses issues concerning the user experience of playing computer games. It focuses on direct manipulation and hyper structure to see how these two interaction paradigms are utilized in computer games to create the experience of immersion for the user. The goal of the thesis is to answer the questions of “what creates immersion in computer games with regards to the user interface?” and “how does ‘Knights of the Old Republic’ use direct manipulation an hyper structure to create immersion?”. The analysis is done by using Jakob Nilesen’s method ‘heuristic evaluation’, an informal usability analysis. Heuristics are worked out by joining Nilesen’s original heuristics with theory about what creates immersion. The analysis is then carried out by applying these heuristics on the computer game ‘Knights of the Old Republic’. Theory of direct manipulation and hyper structure are then connected to the findings of the analysis, to see how properties of the two are used to create the immersion. The later discussion is concerned with how I experienced immersion as a player of the game, and how well my own experience connected with the findings of the analysis

From solving usability problems towards experience-driven design in mobile games

Affected by Apple's data tracking privacy changes and macroeconomic turbulence, the mobile games industry is facing a fundamental shift from the previously dominating free-to-play business model to subscription-based games. The success of subscription games relies on providing an outstanding user experience to the players. The present research describes the process of improving the existing mobile game to cater to the needs of players in a subscription model. Experience-driven design is one of the methodologies in the human-computer interaction discipline, emphasizing the importance of the user's intended experience and using it to guide the design process. This research aims to transfer the experience-driven design approach to the context of mobile games and provide user experience designers with clear starting points and guidance for setting experience goals. The present study describes an experiment of setting immersion and approachability as leading experience goals for guiding the improvement process of the existing game. The inspiration for the experience goals was derived from player motivations based on the previous audience study, secondary analysis of the existing internal and player feedback, game reviews, primary analysis of the usability evaluation findings, and accessibility evaluation of the game. For experience goal evaluation, the design of the in-game dialogue feature was refined with immersion and approachability in mind. Comparative prototype testing featuring a playtest and post-test interviews were used to evaluate the renewed feature design with four participants. The initial comparative prototype testing findings helped identify a sense of control as an additional feature-specific goal critical to the experience of the game's narrative during the first minutes of gameplay. These findings suggest that further experience goal evaluation must include later phases of the player journey, such as scaffolding and endgame, to examine how the experience goals evolve over time. The initial comparative prototype testing allowed to prepare a groundwork for the experience goal evaluation that will be performed outside of the scope of this research due to the production delay. In the big picture, the research on experience-driven design in mobile games enhances understanding of user experience and supports the creation of innovative design strategies for engaging, enjoyable, and meaningful experiences for the players

The effect of Visual Design Quality on Player Experience Components in Tablet Games

Research in the field of Human Computer Interaction Design indicates that there is a need to develop further methods, tools, and frameworks for the design and evaluation of digital game interfaces. This thesis aims to design, develop, and evaluate two different types of tablet games with varying visual design quality interfaces to examine users’ perceptions of hedonic quality, visual design, emotions, and game enjoyment in different channels of experience. The design-oriented approach was adopted to combine both creative practice and scientific inquiry in the game design process and empirical evaluation. Hypotheses were formulated to explore the significance of visual design quality in relation to the components of player experience. The study entailed two phases. In the first phase, participatory design methods were employed to design and develop the tablet games encompassing mind-mapping techniques, focus groups, iterative prototyping with multiple cycles of usability testing of user interfaces. In the second phase, survey instruments were applied to collect and analyze data from 111 participants using tablet games as stimuli in a controlled experimental condition. The main contribution of this research is creation of a player experience model, validated in the domain of tablet gaming, to serve as a new theory. This research will allow for game researchers and practitioners to obtain a deeper understanding of the significance of the player experience framework components to create optimal player experience in tablet games. The finding shows that highly attractive game user interfaces were perceived to have higher utility and ease of use. Participants exhibited higher levels of arousal and valence in the high visual design quality interfaces mediated by hedonic quality. Participants who were highly sensitive to visual design did not necessarily derive the highest level of game enjoyment. Participants derived a heightened level of engagement in the arousal channel of experience and the highest level of enjoyment in the flow state. The use of 2.5D graphics and analogous color schemes created a spatial illusion that captivated users' attention. Practitioners are encouraged to design game artifacts with feature sets and mechanics capable of transporting players into the state of flow, as this is the stage where they experience game control, excitement and relaxation in addition to game immersion in the state of arousal

Effective Affective User Interface Design in Games

It is proposed that games, which are designed to generate positive affect, are most successful when they facilitate flow (Csikszentmihalyi 1992). Flow is a state of concentration, deep enjoyment, and total absorption in an activity. The study of games, and a resulting understanding of flow in games can inform the design of nonleisure software for positive affect. The paper considers the ways in which computer games contravene Nielsen’s guidelines for heuristic evaluation (Nielsen and Molich 1990) and how these contraventions impact on flow. The paper also explores the implications for research that stem from the differences between games played on a personal computer and games played on a dedicated console. This research takes important initial steps towards defining how flow in computer games can inform affective design

Heuristic Evaluation for Serious Immersive Games and M-instruction

© Springer International Publishing Switzerland 2016. Two fast growing areas for technology-enhanced learning are serious games and mobile instruction (M-instruction or M-Learning). Serious games are ones that are meant to be more than just entertainment. They have a serious use to educate or promote other types of activity. Immersive Games frequently involve many players interacting in a shared rich and complex-perhaps web-based-mixed reality world, where their circumstances will be multi and varied. Their reality may be augmented and often self-composed, as in a user-defined avatar in a virtual world. M-instruction and M-Learning is learning on the move; much of modern computer use is via smart devices, pads, and laptops. People use these devices all over the place and thus it is a natural extension to want to use these devices where they are to learn. This presents a problem if we wish to evaluate the effectiveness of the pedagogic media they are using. We have no way of knowing their situation, circumstance, education background and motivation, or potentially of the customisation of the final software they are using. Getting to the end user itself may also be problematic; these are learning environments that people will dip into at opportune moments. If access to the end user is hard because of location and user self-personalisation, then one solution is to look at the software before it goes out. Heuristic Evaluation allows us to get User Interface (UI) and User Experience (UX) experts to reflect on the software before it is deployed. The effective use of heuristic evaluation with pedagogical software [1] is extended here, with existing Heuristics Evaluation Methods that make the technique applicable to Serious Immersive Games and mobile instruction (M-instruction). We also consider how existing Heuristic Methods may be adopted. The result represents a new way of making this methodology applicable to this new developing area of learning technology

User Experience Evaluation in BCI: Filling the Gap

Brain-computer interface (BCI) systems can improve the user experience (UX) when used in entertainment technologies. Improved UX can enhance user acceptance, improve quality of life and also increase the system performance of a BCI system. Therefore, the evaluation of UX is essential in BCI research. However, BCI systems are generally evaluated according to the system aspect only so there is no methodology to evaluate UX in BCI systems. This paper gives an overview of such methods from the human-computer interaction field and discusses their possible uses in BCI research

Human factors in entertainment computing: designing for diversity

Although several casual gaming systems have been developed during the past years, little research examining the impact of human factors on the design and use of digital games has been carried out, and commercially available games are only partially suitable for audiences with special needs. The research project described within this paper aims to analyze and explore design guidelines for diverse audiences and results of focus group gaming sessions to develop a research toolbox allowing for the easy creation of adaptable and accessible game scenarios. Thereby, a controllable environment for the detailed evaluation of the interrelations between human factors and entertainment systems is provided. Results obtained by further testing will be integrated in the toolbox, and may foster the development of accessible games, thus opening up new opportunities for diverse audiences and allowing them to further engage in digital games. Copyright 2011 ACM