GameFlow 2020: 15 Years of a Model of Player Enjoyment

The original GameFlow model was first published in 2005 and in the last 15 years it has seen thousands of citations and hundreds of applications to designing and evaluating games and gameful experiences. Previous work has sought to test and validate the model by applying it to different game experiences to further understand those experiences and to expose any weaknesses of the model. In this paper, we survey over 200 applications of GameFlow over the last 15 years, to understand how, where, and why the model has been applied. We found that the model has been applied to a diverse set of experiences, domains, platforms, audiences, and used in a variety of ways. This work lays the foundations for targeting the next version of the GameFlow model towards the most valuable and appropriate applications and to define how it fits within the broader landscape of player experience tools

Heuristic usability evaluation on games: a modular approach

Heuristic evaluation is the preferred method to assess usability in games when experts conduct this evaluation. Many heuristics guidelines have been proposed attending to specificities of games but they only focus on specific subsets of games or platforms. In fact, to date the most used guideline to evaluate games usability is still Nielsen’s proposal, which is focused on generic software. As a result, most evaluations do not cover important aspects in games such as mobility, multiplayer interactions, enjoyability and playability, etc. To promote the usage of new heuristics adapted to different game and platform aspects we propose a modular approach based on the classification of existing game heuristics using metadata and a tool, MUSE (Meta-heUristics uSability Evaluation tool) for games, which allows a rebuild of heuristic guidelines based on metadata selection in order to obtain a customized list for every real evaluation case. The usage of these new rebuilt heuristic guidelines allows an explicit attendance to a wide range of usability aspects in games and a better detection of usability issues. We preliminarily evaluate MUSE with an analysis of two different games, using both the Nielsen’s heuristics and the customized heuristic lists generated by our tool.Unión Europea PI055-15/E0

Developing an Evaluation Framework for Analysing Educational Simulation Games

Despite the emergence of new methodologies for analysing and evaluating games using usability testing and heuristics evaluation frameworks, there is still lack of inclusive game heuristics for analysing educational simulation games. To address this, we conduct two case studies: professional critic game reviews and focus group interviews. We have looked at the effects of games on players’ gaming experiences in different gaming context (i.e. playing educational versus (vs.) entertaining simulation games). Findings show various game design similarities & differences between playing these simulation games. It also highlights game design issues. In this paper, we propose a new game evaluation heuristics model (GADDIE) that consists of Game Analysis (GA), Design (D), Development (D), Implementation (I) and Evaluation (E). These heuristics were compiled as a result of game design issues identified from the professional critic game reviews and the focus group interviews. On the basis of the data obtained it is argued that the GADDIE model could provide further guidance that leads on from previous research, since it encapsulates research findings, game design principles, human computer interaction, usability testing guidelines, educational perspectives and overall our experiences as educators and game researchers. Consequently, the proposed framework would support our ongoing research project in game evaluation process (educational vs. entertaining), and other researchers, more effectively

A Mixed Method Approach for Evaluating and Improving the Design of Learning in Puzzle Games

Despite the acknowledgment that learning is a necessary part of all gameplay, the area of Games User Research lacks an established evidence based method through which designers and researchers can understand, assess, and improve how commercial games teach players game-specific skills and information. In this paper, we propose a mixed method procedure that draws together both quantitative and experiential approaches to examine the extent to which players are supported in learning about the game world and mechanics. We demonstrate the method through presenting a case study of the game Portal involving 14 participants, who differed in terms of their gaming expertise. By comparing optimum solutions to puzzles against observed player performance, we illustrate how the method can indicate particular problems with how learning is structured within a game. We argue that the method can highlight where major breakdowns occur and yield design insights that can improve the player experience with puzzle games

User perception of gaming element effectiveness in a corporate learning application

This Conversion Masters in Information Technology thesis gathered users' perceptions about eight gaming elements to determine their effectiveness on aspects of playability, enjoyment and intrinsic motivation needed in a gamified corporate learning application. The study focused on user opinions about a Progress Bar, Individual Leaderboard, Departmental Leaderboard, Timer, In-Game Currency, Badges, Storyline/Theme and Avatar. A gamification application containing these gaming elements was designed and developed to make the evaluation. The application entailed users learning four Information Technology Infrastructure Library (ITIL) processes needed to manage an information technology department in a telecommunications company. The application design process considered the business goals, rules, target behaviours, time limits, rewards, feedback, levels, storytelling, interest, aesthetics, replay or do-overs, user types, activity cycles, fun mechanisms and development tools needed to create a coherent, addictive, engaging and fun user experience. Player types were determined using the Brainhex online survey. Federoff's Game Playability Heuristics model was used to measure the users' perceptions about the playability of the application. Sweetser and Wyeth's Gameflow model was used to measure perceptions about the gaming elements' contribution toward creating an enjoyable experience. Malone and Lepper's Taxonomy of Intrinsic Motivation for Learning was used to measure the gaming elements' ability to promote an intrinsically motivating learning environment. Masterminds, Achievers, Conquerors and Seekers were the most prominent player types found in the Brainhex online survey for which the gamification application design then catered. The staff in the department play-tested the application to evaluate the gaming elements. Overall the Storyline/Theme, suited to Seekers and Masterminds, ranked as the most effective gaming element in this study. The users perceived artwork as an essential component of a gamified learning application. The Individual Leaderboard, suited to Conquerors, ranked very closely as the second most effective gaming element. The Storyline/Theme and Individual Leaderboard both performed the strongest against the criteria measuring the playability. The Storyline/Theme was by far the strongest from a gameflow perspective and the Individual Leaderboard from a motivation perspective. The Avatars ranked the worst across all the measurement criteria. Based on quiz results, 86 percent of the staff in the department had learned the material from the gamified training prototype developed in this work. The findings from this study will therefore serve as input for developing a full-scale gamification learning application

User Experience of Geocaching and Its Application to Tourism and Education

Advances in technology have provided new ways of using entertainment and game technology to foster human interaction. Games and playing with games have always been an important part of people’s everyday lives. Traditionally, human-computer interaction (HCI) research was seen as a psychological cognitive science focused on human factors, with engineering sciences as the computer science part of it. Although cognitive science has made significant progress over the past decade, the influence of people’s emotions on design networks is increasingly important, especially when the primary goal is to challenge and entertain users (Norman 2002). Game developers have explored the key issues in game design and identified that the driving force in the success of games is user experience. User-centered design integrates knowledge of users’ activity practices, needs, and preferences into the design process. Geocaching is a location-based treasure hunt game created by a community of players. Players use GPS (Global Position System) technology to find “treasures” and create their own geocaches; the game can be developed when the players invent caches and used more imagination to creations the caches. This doctoral dissertation explores user experience of geocaching and its applications in tourism and education. Globally, based on the Geocaching.com webpage, geocaching has been played about 180 countries and there are more than 10 million registered geocachers worldwide (Geocaching.com, 25.11.2014). This dissertation develops and presents an interaction model called the GameFlow Experience model that can be used to support the design of treasure hunt applications in tourism and education contexts. The GameFlow Model presents and clarifies various experiences; it provides such experiences in a real-life context, offers desirable design targets to be utilized in service design, and offers a perspective to consider when evaluating the success of adventure game concepts. User-centered game designs have adapted to human factor research in mainstream computing science. For many years, the user-centered design approach has been the most important research field in software development. Research has been focusing on user-centered design in software development such as office programs, but the same ideas and theories that will reflect the needs of a user-centered research are now also being applied to game design (Charles et al. 2005.) For several years, we have seen a growing interest in user experience design. Digital games are experience providers, and game developers need tools to better understand the user experience related to products and services they have created. This thesis aims to present what the user experience is in geocaching and treasure hunt games and how it can be used to develop new concepts for the treasure hunt. Engineers, designers, and researchers should have a clear understanding of what user experience is, what its parts are, and most importantly, how we can influence user satisfaction. In addition, we need to understand how users interact with electronic products and people, and how different elements synergize their experiences. This doctoral dissertation represents pioneering work on the user experience of geocaching and treasure hunt games in the context of tourism and education. The research also provides a model for game developers who are planning treasure hunt concepts.Teknologinen kehitys on tarjonnut uusia tapoja hyödyntää viihdettä ja peliteknologiaa ihmisten välisessä vuorovaikutuksessa. Pelit ja niiden pelaaminen on ollut aina tärkeä osa ihmisten arkipäivää. Ihmisen ja tietokoneen välisen vuorovaikutuksen tutkimus, human-computer interaction research (HCI), on perinteisesti nähty kognitiivisena psykologiana, johon kuuluvat inhimilliset tekijät, sekä insinööritieteenä, johon sisältyy tietojenkäsittelytiede. Vaikka kognitiivinen tiede on kehittynyt viime vuosina valtavasti, suunnitteluverkostoihin vaikuttavat ihmisten tunteet ovat yhä tärkeämmässä osassa, erityisesti silloin kun tavoitteena on haastaa ja viihdyttää käyttäjiä. (Norman 2002.) Pelinkehittäjät ovat selvittäneet pelisuunnittelun kannalta olennaisia tekijöitä ja tunnistaneet, että pelien menestyksen salaisuus on käyttäjäkokemus. Käyttäjäkeskeisessä suunnittelussa käyttäjien toiminnan käytäntöjen, tarpeiden ja toiveiden tuntemus tuodaan mukaan suunnitteluprosessiin. Geokätköily on paikannukseen perustuva aarteenetsintäpeli, jonka pelaajat ovat luoneet yhdessä. Pelaajat käyttävät GPS-teknologiaa "aarteiden" etsimiseen ja lisäävät omia geokätkökohteita ja peli kehittyy jatkuvasti pelaajien keksiessä kätköjä, jotka vaativat yhä enemmän mielikuvitusta. Tässäväitöskirjassa tutkitaan geokätköilyn käyttäjäkokemusta ja sen sovelluksia koulutuksen- ja matkailunaloilla. Perustuen Geocaching.com websivustoon geokätköilyä pelataan noin 180 maassa, ja rekisteröityneitä käyttäjiä on yli kymmenen miljoonaa eri puolilla maailmaa (Geocaching.com, 25.11.2014). Tässä tutkielmassa esitellään vuorovaikutusmalli nimeltään GameFlow Experience -mallia, jota voidaan käyttää aarteenetsintäsovellusten suunnittelussa koulutuksen- ja matkailualojen konteksteissa. GameFlow Experience -malli esittelee ja selventää erilaisia kokemuksia - se esittelee ne todellisessa kontekstissa, tarjoaa erilaisia suunnittelutavoitteita palvelusuunnittelua varten sekä näkökulman, joka tulisi ottaa huomioon seikkailupelien menestystä arvioitaessa. Käyttäjäkeskeisessä pelisuunnittelussa on sovellettu inhimillisten tekijöiden tutkimusta valtavirran tietojenkäsittelytieteeseen. Useiden vuosien ajan, käyttäjäkeskeisen suunnittelun lähestymistavasta on tullut tärkein tutkimusala ohjelmistokehityksessä. Tutkimus on keskittynyt ohjelmistojen kehitykseen käyttäjäkeskeisessä suunnittelussa etenkin toimisto-ohjelmistoihin, mutta samoja ideoita ja teorioita, jotka heijastavat yhteiskunnan tarpeita käyttäjäkeskeisessä tutkimuksessa sovelletaan nyt myös pelisuunnitteluun. (Charles ja ym. 2005.) Kiinnostus käyttäjäkokemuksen suunnitteluun on kasvanut jo useiden vuosien ajan. Digitaaliset pelit tarjoavat kokemuksia, ja pelisuunnittelijat tarvitsevatkin työkaluja, joiden avulla voidaan entistä paremmin ymmärtää tuotteiden ja palvelujen luomia käyttäjäkokemuksia. Tutkimuksen tavoitteena on esitellä käyttäjäkokemusta ja miten sitä voidaan käyttää uusien aarteenmetsästyskonseptien kehittämiseen. Insinööreillä, suunnittelijoilla ja tutkijoilla tulisi olla selkeä käsitys siitä, mikä käyttäjäkokemus on, mitkä ovat sen osat ja mikä tärkeintä, miten voimme vaikuttaa käyttäjän tyytyväisyyteen. Lisäksi pitäisi ymmärtää, miten käyttäjät toimivat elektronisten tuotteiden kanssa sekä miten ihmiset toimivat vuorovaikutuksessa toistensa kanssa ja miten eri osat vaikuttavat yhdessä käyttäjien kokemuksiin. Väitöskirja on pioneerityö käyttäjäkokemuksesta geokätköilyssä ja aarteenetsintä peleissä matkailun ja opetuksen kontekstissa. Tutkimus antaa myös mallin pelin kehittäjille, jotka suunnittelevat aarteenetsintäkonsepteja.Siirretty Doriast

Affording Enjoyment in VR Games: Possibilities, Pitfalls, and Perfection

In this paper, we present research that aims to understand affordances and inhibitors of enjoyment in virtual reality (VR) video games. We apply the GameFlow model to analyse VR and non-VR versions of the same games to identify differences in enjoyment in VR games. Our approach involves conducting qualitative analysis on video game reviews, using GameFlow as a theoretical foundation. We report on our analysis of the games Superhot and Skyrim. We find that affordances are largely consistent between VR and non-VR versions of the same games, with a few key differences related to Feedback, Control, Player Skills, and Immersion. We conclude that GameFlow is applicable to VR games, with the addition of a Comfort element to describe player comfort while playing

Heuristics for evaluating video games: A two-tier set incorporating universal and genre-specific elements

The continued significance of video games in contemporary society has led to the production of many heuristic sets by which the playability of games can be evaluated. These sets encompass a wide range of aims and theoretical perspectives, furthermore, they have been developed via a number of distinct methods. This thesis is the result of a two-stage investigation, the first of which was to identify and extract any heuristics that could be considered as having universal relevance, irrespective of the method or theoretical position by which they were developed. The second stage of the investigation complemented this universal list with genre-specific elements, providing a model by which further information can be added in the future. Comparative analysis was used to extract common principles from a selected body of work, resulting in a list of 19 heuristics. In addition, open and axial coding was applied to data sourced from online game reviews, extracting information relating to the Real-Time Strategy genre. This information was then converted into 25 RTS-specific heuristics and integrated with the set developed in the first stage. The results of this study, therefore, clearly demonstrate the existence of a core set of universal heuristics, and the value of incorporating genre-specific information. The finalised set was presented in the form of a deck of cards, with each face representing information according to two different levels of abstraction, thereby increasing accessibility and facilitating use in different contexts. These cards have been made available in a print-ready format and are included as an appendix

GameFlow-heuristiikkamalli verkkoroolipelien suunnitteluun ja arviointiin

Tutkielman tavoitteena on kehittää GameFlow-heuristiikkamalli viihdyttävien verkkoroolipelien suunnitteluun ja toteutukseen. Kyseessä on toistaiseksi vähäiselle tarkastelulle jäänyt pelitutkimuksen alue. Pelien viihdyttävyys on kuitenkin niiden päätarkoitus, joten aiheen tutkiminen on perusteltua. Tutkielman tuloksena saatavaa heuristista mallia voidaan soveltaa käytännön pelinkehitystyössä. Heuristinen malli rakennettiin flow- ja GameFlow-teorioiden sekä heuristisen arvioinnin menetelmän pohjalle. Tutkimusaineistona toimi laaja otos viime vuosina julkaistujen verkkoroolipelien peliarvosteluja, joista kerättiin eri peliominaisuuksien viihdyttävyyttä käsitteleviä kommentteja. Arvostelujen myönteiset ja kielteiset kommentit yhdistettyinä ja peliominaisuuksittain kategorisoituina muodostivat lopullisen mallin 76 heuristiikkaa. Tutkimuksen tuloksena saatua heuristista mallia voidaan hyödyntää niin verkkoroolipelien suunnittelu-, toteutus- kuin testausvaiheissakin. Pelilajikohtaisella ja siksi käytännönläheisellä mallilla päästään käsiksi varsinaisiin peliteknisiin ongelmiin abstraktien yleisheuristiikkojen tulkinnanvaraisuuksien sijaan.fi=Opinnäytetyö kokotekstinä PDF-muodossa.|en=Thesis fulltext in PDF format.|sv=Lärdomsprov tillgängligt som fulltext i PDF-format

DESIGNING BETTER EXERGAMES: APPLICATION OF FLOW CONCEPTS AND THE FITT PRINCIPLE TO FULL BODY EXERTION VIDEO GAMES AND FLEXIBLE CHALLENGE SYSTEMS

Exercise video games have a recognized potential for widespread use as tools for effective exercise. Current exergames do not consistently strike a successful balance between the “fun gameplay” and “effective exercise” aspects of the ideal exergame. Our research into the design of better exergames applies existing gameflow research and established exercise guidelines, such as those published by the American College of Sports Medicine, to a collection of four custom exergames: Astrojumper, Washboard, Sweet Harvest and Legerdemain implement full-body motion mechanics that support different types of exercise, and vary in intended duration of play, game complexity, and level of physical challenge. Each game also implements a difficulty adjustment system that detects player performance from in-game data and dynamically adjusts game difficulty, in order to balance between a player’s fitness level and the physical challenge presented by the game. We have evaluated the games produced by our design approach through a series of user studies on players’ physiological and psychological responses to gameplay, finding that balance between challenge types (cognitive or physical) is an important consideration along with challenge-skill balance, and further, that game mechanics able to support creativity of movement are an effective means of bridging between gameplay and exercise in order to improve the player experience