Deep learning for video game playing

In this article, we review recent Deep Learning advances in the context of how they have been applied to play different types of video games such as first-person shooters, arcade games, and real-time strategy games. We analyze the unique requirements that different game genres pose to a deep learning system and highlight important open challenges in the context of applying these machine learning methods to video games, such as general game playing, dealing with extremely large decision spaces and sparse rewards

BitBox!:A case study interface for teaching real-time adaptive music composition for video games

Real-time adaptive music is now well-established as a popular medium, largely through its use in video game soundtracks. Commercial packages, such as fmod, make freely available the underlying technical methods for use in educational contexts, making adaptive music technologies accessible to students. Writing adaptive music, however, presents a significant learning challenge, not least because it requires a different mode of thought, and tutor and learner may have few mutual points of connection in discovering and understanding the musical drivers, relationships and structures in these works. This article discusses the creation of ‘BitBox!’, a gestural music interface designed to deconstruct and explain the component elements of adaptive composition through interactive play. The interface was displayed at the Dare Protoplay games exposition in Dundee in August 2014. The initial proof-of- concept study proved successful, suggesting possible refinements in design and a broader range of applications

The design-by-adaptation approach to universal access: learning from videogame technology

This paper proposes an alternative approach to the design of universally accessible interfaces to that provided by formal design frameworks applied ab initio to the development of new software. This approach, design-byadaptation, involves the transfer of interface technology and/or design principles from one application domain to another, in situations where the recipient domain is similar to the host domain in terms of modelled systems, tasks and users. Using the example of interaction in 3D virtual environments, the paper explores how principles underlying the design of videogame interfaces may be applied to a broad family of visualization and analysis software which handles geographical data (virtual geographic environments, or VGEs). One of the motivations behind the current study is that VGE technology lags some way behind videogame technology in the modelling of 3D environments, and has a less-developed track record in providing the variety of interaction methods needed to undertake varied tasks in 3D virtual worlds by users with varied levels of experience. The current analysis extracted a set of interaction principles from videogames which were used to devise a set of 3D task interfaces that have been implemented in a prototype VGE for formal evaluation

Automatic Mapping of NES Games with Mappy

Game maps are useful for human players, general-game-playing agents, and data-driven procedural content generation. These maps are generally made by hand-assembling manually-created screenshots of game levels. Besides being tedious and error-prone, this approach requires additional effort for each new game and level to be mapped. The results can still be hard for humans or computational systems to make use of, privileging visual appearance over semantic information. We describe a software system, Mappy, that produces a good approximation of a linked map of rooms given a Nintendo Entertainment System game program and a sequence of button inputs exploring its world. In addition to visual maps, Mappy outputs grids of tiles (and how they change over time), positions of non-tile objects, clusters of similar rooms that might in fact be the same room, and a set of links between these rooms. We believe this is a necessary step towards developing larger corpora of high-quality semantically-annotated maps for PCG via machine learning and other applications.Comment: 9 pages, 7 figures. Appearing at Procedural Content Generation Workshop 201

Autonomy in Video Games and Gamification

In the past decade, gamification (using game elements in non-gaming tasks to enhance motivation and engagement) has become a popular concept in many industries, but few studies have explored the principles under which it works. Self-determination theory suggests three psychological needs that gamification fulfills: competence, relatedness, and autonomy. Autonomy, a person\u27s perception that they have the ability to act however they choose, has emerged as an important, yet less-studied aspect in gamification. Inclusion of autonomy in gamification should foster engagement, enjoyment, and better performance. An experiment inspired by the above was carried out in which a sample of college students (N = 57) played a video game called Super Mario Bros. Crossover with either the choice to customize the aesthetics of their character and background (autonomy-supportive) or no choice of aesthetics (non-supportive). It was hypothesized that conditions involving more choice would lead to higher perceived autonomy and performance, and that perceived autonomy would be positively correlated with engagement, enjoyment, and performance. The manipulation resulted in no significant difference in perceived autonomy or performance, and perceived autonomy was only significantly positively correlated with enjoyment. Prior Super Mario Bros. experience was also found to positively correlate with perceived autonomy in the autonomy-supportive condition. The choice of aesthetics does not appear to have been sufficiently strong enough to increase perceived autonomy in this context

The Role of Videogame Glitch in Adult Learning

This research investigates the responses of three individuals engaging with the Super Mario World (SMW) platform videogame glitches, and how they learned to solve the problem without formal help. This investigation was chosen because it explores connections between media literacy, critical thinking, and play in adults in the context of responding to unexpected technological errors. At the core of this study is the question of how encounters with arbitrary glitches can motivate and elicit critical thinking. Following a case study model, data were collected as the three subjects played SMW and encountered glitches. Questions regarding the (glitchy) game play experience were addressed in the first interview immediately following. The subjects were asked to create a visual essay and keep personal journals, which were gathered after 30 days, and a second interview at that time focused on the overall experience. Several results emerged from the data. Each of the subjects identified and solved for glitches in a way that suggested critical thinking processes. In addition, they all reflected in various ways on the challenges that glitches presented, making connections to larger issues and their everyday lives. The data also showed the importance of memory in these processes. The results suggest that while subjects approached and solved a technological glitch in SMW game play, they simultaneously acquired, developed, and—at least for the duration of the study—sustained new literacy skills and expanded their proficiency with critical thinking. This holds some potential implications for the value of incorporating glitch experiences both inside and outside the classroom, suggesting that videogame play—and particularly glitches in play—can be considered valuable opportunities for learners and teachers alike