Automated state of play: rethinking anthropocentric rules of the game

Automation of play has become an ever more noticeable phenomenon in the domain of video games, expressed by self-playing game worlds, self-acting characters, and non-human agents traversing multiplayer spaces. This article proposes to look at AI-driven non-human play and, what follows, rethink digital games, taking into consideration their cybernetic nature, thus departing from the anthropocentric perspectives dominating the field of Game Studies. A decentralised post-humanist reading, as the author argues, not only allows to rethink digital games and play, but is a necessary condition to critically reflect AI, which due to the fictional character of video games, often plays by very different rules than the so-called “true” AI

An Actor-Centric Approach to Facial Animation Control by Neural Networks For Non-Player Characters in Video Games

Game developers increasingly consider the degree to which character animation emulates facial expressions found in cinema. Employing animators and actors to produce cinematic facial animation by mixing motion capture and hand-crafted animation is labor intensive and therefore expensive. Emotion corpora and neural network controllers have shown promise toward developing autonomous animation that does not rely on motion capture. Previous research and practice in disciplines of Computer Science, Psychology and the Performing Arts have provided frameworks on which to build a workflow toward creating an emotion AI system that can animate the facial mesh of a 3d non-player character deploying a combination of related theories and methods. However, past investigations and their resulting production methods largely ignore the emotion generation systems that have evolved in the performing arts for more than a century. We find very little research that embraces the intellectual process of trained actors as complex collaborators from which to understand and model the training of a neural network for character animation. This investigation demonstrates a workflow design that integrates knowledge from the performing arts and the affective branches of the social and biological sciences. Our workflow begins at the stage of developing and annotating a fictional scenario with actors, to producing a video emotion corpus, to designing training and validating a neural network, to analyzing the emotion data annotation of the corpus and neural network, and finally to determining resemblant behavior of its autonomous animation control of a 3d character facial mesh. The resulting workflow includes a method for the development of a neural network architecture whose initial efficacy as a facial emotion expression simulator has been tested and validated as substantially resemblant to the character behavior developed by a human actor

Narratives of ocular experience in interactive 360° environments

The purpose of this research project was to examine how immersive digital virtual technologies have the potential to expand the genre of interactive film into new forms of audience engagement and narrative production. Aside from addressing the limitations of interactive film, I have explored how interactive digital narratives can be reconfigured in the wake of immersive media. My contribution to knowledge stems from using a transdisciplinary synthesis of the interactive systems in film and digital media art, which is embodied in the research framework and theoretical focal point that I have titled Cynematics (chapter 2). Using a methodology that promotes iterative experimentation I developed a series of works that allowed me to practically explore the limitations of interactive film systems that involve non-haptic user interaction. This is evidenced in the following series of works: Virtual Embodiment, Narrative Maze, Eye Artefact Interactions and Routine Error - all of which are discussed in chapter 4 of this thesis. Each of these lab experiments collectively build towards the development of novel interactive 360° film practices. Funneling my research towards these underexplored processes I focused on virtual gaze interaction (chapters 4-6), aiming to define and historically contextualise this system of interaction, whilst critically engaging with it through my practice. It is here that gaze interaction is cemented as the key focus of this thesis. The potential of interactive 360° film is explored through the creation of three core pieces of practice, which are titled as follows: Systems of Seeing (chapter 5), Mimesis (chapter 6), Vanishing Point (chapter 7). Alongside the close readings in these chapters and the theoretical developments explored in each are the interaction designs included in the appendix of the thesis. These provide useful context for readers unable to experience these site-specific installations as virtual reality applications. After creating these systems, I established terms to theoretically unpack some of the processes occurring within them. These include Datascape Mediation (chapter 2), which frames agency as a complex entanglement built on the constantly evolving relationships between human and machine - and Live-Editing Practice (chapter 7), which aims to elucidate how the interactive 360° film practice designed for this research leads to new way of thinking about how we design, shoot and interact with 360° film. Reflecting on feedback from exhibiting Mimesis I decided to define and evaluate the key modes of virtual gaze interaction, which led to the development of a chapter and concept referred to as The Reticle Effect (chapter 6). This refers to how a visual overlay that is used to represent a user's line of sight not only shapes their experience of the work, but also dictates their perception of genre. To navigate this, I combined qualitative and quantitative analysis to explore user responses to four different types of gaze interaction. In preparing to collect this data I had to articulate these different types of interaction, which served to demarcate the difference between each of these types of gaze interaction. Stemming from this I used questionnaires, thematic analysis and data visualisation to explore the use and response to these systems. The results of this not only supports the idea of the reticle effect, but also gives insight into how these different types of virtual gaze interaction shape whether these works are viewed as games or as types of interactive film. The output of this allowed me to further expand on interactive 360° film as a genre of immersive media and move beyond the realm of interactive film into new technological discourses, which serves to validate the nascent, yet expansive reach of interactive 360° film as a form of practice. The thesis is concluded by framing this research within the wider discourse of posthuman theory as given that the technologies of immersive media perpetuate a state of extended human experience - how we interact and consider the theories that surround these mediums needs to be considered in the same way. The practice and theory developed throughout this thesis contribute to this discourse and allow for new ways of considering filmic language in the wake of interactive 360° film practice

Agents for educational games and simulations

This book consists mainly of revised papers that were presented at the Agents for Educational Games and Simulation (AEGS) workshop held on May 2, 2011, as part of the Autonomous Agents and MultiAgent Systems (AAMAS) conference in Taipei, Taiwan. The 12 full papers presented were carefully reviewed and selected from various submissions. The papers are organized topical sections on middleware applications, dialogues and learning, adaption and convergence, and agent applications

Abstracts: HASTAC 2017: The Possible Worlds of Digital Humanities

The document contains abstracts for HASTAC 2017

Aesthetic choices: Defining the range of aesthetic views in interactive digital media including games and 3D virtual environments (3D VEs)

Defining aesthetic choices for interactive digital media such as games is a challenging task. Objective and subjective factors such as colour, symmetry, order and complexity, and statistical features among others play an important role for defining the aesthetic properties of interactive digital artifacts. Computational approaches developed in this regard also consider objective factors such as statistical image features for the assessment of aesthetic qualities. However, aesthetics for interactive digital media, such as games, requires more nuanced consideration than simple objective and subjective factors, for choosing a range of aesthetic features. From the study it was found that the there is no one single optimum position or viewpoint with a corresponding relationship to the aesthetic considerations that influence interactive digital media. Instead, the incorporation of aesthetic features demonstrates the need to consider each component within interactive digital media as part of a range of possible features, and therefore within a range of possible camera positions. A framework, named as PCAWF, emphasized that combination of features and factors demonstrated the need to define a range of aesthetic viewpoints. This is important for improved user experience. From the framework it has been found that factors including the storyline, user state, gameplay, and application type are critical to defining the reasons associated with making aesthetic choices. The selection of a range of aesthetic features and characteristics is influenced by four main factors and sub-factors associated with the main factors. This study informs the future of interactive digital media interaction by providing clarity and reasoning behind the aesthetic decision-making inclusions that are integrated into automatically generated vision by providing a framework for choosing a range of aesthetic viewpoints in a 3D virtual environment of a game. The study identifies critical juxtapositions between photographic and cinema-based media aesthetics by incorporating qualitative rationales from experts within the interactive digital media field. This research will change the way Artificial Intelligence (AI) generated interactive digital media in the way that it chooses visual outputs in terms of camera positions, field-view, orientation, contextual considerations, and user experiences. It will impact across all automated systems to ensure that human-values, rich variations, and extensive complexity are integrated in the AI-dominated development and design of future interactive digital media production

Thinking in stories

This thesis considers cognitive narrative a component of intelligence that specializes in generality. In exploring the ubiquitous external (mediated) and internal (cognitive) functions of narrative it provides two contributions to the literature: a uniquely cross-discipline survey of narratology that bridges humanities, social science, and computational fields; and a theory to generate cognitive personal narratives from ongoing perception. The implications of narrative cognition and cognitive narrative are discussed as well as the limitations of this introductory theory and the grounds for promising future work.M.S

Stories within Immersive Virtual Environments

[eng] How can we use immersive and interactive technologies to portray stories?How can we take advantage of the fact that within immersive virtual en-vironments people tend to respond realistically to virtual situations andevents to develop narrative content? Stories in such a media would allowthe participant to contribute to the story and interact with the virtualcharacters while the narrative plot would not change, or change only upto how it was decided a priori. Participants in such a narrative would beable to freely interact within the virtual environments and yet still beaware of the main trust of the stories presented. How can we preserve the‘respond as if it is real’ phenomenon induced by these technologies, butalso develop an unfolding plot in this environment? In other words, canwe develop a story, conserving the structure, its psychological and cul-tural richness and the emotional and cognitive involvement it supposes,in an interactive and immersive audiovisual space?In recent years Virtual Reality therapy has shown that an Immersive Vir-tual Environment (IVE) with a predetermined plot can be experienced asan interactive narrative. For example, in the context of Post TraumaticStress Disorder treatment, the reactions of the participants and the thera-peutic impact suggest that an IVE is a qualitatively different experiencethan classical audiovisual content. However, the methods to develop suchkind of content are not systematic, and the consistency of the experienceis only granted by a therapist or operator controlling in real time theunfolding narrative. Can a story with a strong classical plot be renderedin an automated and interactive immersive virtual environment?..[cat] Podem emprar la realitat virtual immersiva per contar històries? Com po-dem aprofitar el fet que dins dels entorns virtuals immersius les personestendeixen a respondre de manera realista a les situacions i esdevenimentsvirtuals per desenvolupar històries? Els participants en aquest tipus denarrativa podrien interactuar lliurement amb els entorns virtuals i noobstant això experimentarien les històries presentades com a plausibles iconsistents. Una història en aquest medi audiovisual permetria als parti-cipants interactuar amb els personatges virtuals i contribuir activamentals esdeveniments escenificats en l’entorn virtual. Malgrat això, la tramaestablerta a priori no canviaria, o canviaria només dins els marges es-tablerts per l’autor. Com podem preservar el fet que hom tendeix a "re-spondre com si fos real" induït per aquestes tecnologies mentre desenvolu-pem una trama en aquests entorns? En altres paraules, podem desenvolu-par una història conservant-ne l’estructura, la riquesa cultural i psicolò-gica i la implicació emocional i cognitiva que suposa, en una realitatvirtual immersiva i interactiva?Recentment la teràpia de realitat virtual ha mostrat que un entorn vir-tual amb un guió preestablert pot ser percebut com una narració inter-activa. Per exemple, en el context del tractament de Trastorns per EstrèsPostraumàtic, les reaccions i impactes terapèutics suggereixen que pro-voca una sensació de realitat que en fa una experiència qualitativamentdiferent als continguts audiovisuals clàssics. No obstant això, la consistèn-cia de l’experiència tan sols pot ser garantida si un un terapeuta o op-erador controla en temps real el flux dels esdeveniments constituint elguió narratiu. Podem representar un guió clàssic en un entorn virtualautomatitzat?..