TIME BALANCING OF COMPUTER GAMES USING ADAPTIVE TIME-VARIANT MINIGAMES

Game designers spend a great deal of time developing balanced game experiences. However, differences in player ability, hardware capacity (e.g. network connections) or real-world elements (as in mixed-reality games), make it difficult to balance games for different players in different conditions. In this research, adaptive time-variant minigames have been introduced as a method of addressing the challenges in time balancing as a part of balancing players of games. These minigames were parameterized to allow both a guaranteed minimum play time (the minimum time to complete a minigames to address the fixed temporal constraints) and dynamic adaptability (the ability of adapting the game during the game play to address temporal variations caused by individual differences). Three time adaptation algorithms have been introduced in this research and the interaction between adaptive algorithm, game mechanic, and game difficulty were analyzed in controlled experiments. The studies showed that there are significant effects and interactions for all three factors, confirming the initial hypothesis that these processes were important and linked to each other. Furthermore, the studies revealed that finer temporal granularity leads to less-perceptible adaptation and smaller deviations in game completion times. The results also provided evidence that adaptation mechanisms allow accurate prediction of play time. The designed minigames were valuable in helping to balance temporal asymmetries in a real mixed-reality game. It was also found that these adaptation algorithms did not interrupt the overall play experience

Gra w grze – problem paraludyczności

Głównym celem artykułu jest propozycja nowego języka opisu umożliwiającego skuteczniejszą analizę gier złożonych poprzez wstępne zdefiniowanie terminów takich jak: gra podstawowa, gra peryferyjna, gra zagnieżdżona i gra towarzysząca. Obok innych tytułów za główne źródło przykładów służą przy tym dwie polskie produkcje: wysokobudżetowe komputerowe RPG z otwartym światem Wiedźmin 3: Dziki Gon oraz niezależna strzelanka Superhot. Od strony teoretycznej podstawą artykułu są dotychczasowe ludoontologiczne badania nad składowymi gier złożonych: tzw. meta- i minigrami w zestawieniu z pracami Gerarda Genette’a. Przez analogię do Genette’owskiej paratekstualności postulowane jest uznanie gier w grze za przejaw paraludyczności.Kominiarczuk proposes a new descriptive language that would facilitate a more effective analysis of complex games though a preliminary definition of terms such as: basic game, peripheral game, nested game and accompanying game. Besides other titles, two Polish productions serve as the main source of examples: The Witcher 3: Wild Hunt, a big-budget role-playing video game played in an open world, as well as the independent shooter video game Superhot. From a theoretical perspective, the article is based on current ludoontological research on the components of complex games – so-called metagames and minigames – juxtaposed with the works of Gérard Genette. The analogy to Genette’s paratextuality allows Kominiarczuk to postulate the recognition of the game within the game as a manifestation of the paraludic

System Design for an Integrated Lifelong Reinforcement Learning Agent for Real-Time Strategy Games

As Artificial and Robotic Systems are increasingly deployed and relied upon for real-world applications, it is important that they exhibit the ability to continually learn and adapt in dynamically-changing environments, becoming Lifelong Learning Machines. Continual/lifelong learning (LL) involves minimizing catastrophic forgetting of old tasks while maximizing a model's capability to learn new tasks. This paper addresses the challenging lifelong reinforcement learning (L2RL) setting. Pushing the state-of-the-art forward in L2RL and making L2RL useful for practical applications requires more than developing individual L2RL algorithms; it requires making progress at the systems-level, especially research into the non-trivial problem of how to integrate multiple L2RL algorithms into a common framework. In this paper, we introduce the Lifelong Reinforcement Learning Components Framework (L2RLCF), which standardizes L2RL systems and assimilates different continual learning components (each addressing different aspects of the lifelong learning problem) into a unified system. As an instantiation of L2RLCF, we develop a standard API allowing easy integration of novel lifelong learning components. We describe a case study that demonstrates how multiple independently-developed LL components can be integrated into a single realized system. We also introduce an evaluation environment in order to measure the effect of combining various system components. Our evaluation environment employs different LL scenarios (sequences of tasks) consisting of Starcraft-2 minigames and allows for the fair, comprehensive, and quantitative comparison of different combinations of components within a challenging common evaluation environment.Comment: The Second International Conference on AIML Systems, October 12--15, 2022, Bangalore, Indi

Design and Instantiation of an Interactive Multidimensional Ontology for Game Design Elements – a Design and Behavioral Approach

While games and play are commonly perceived as leisure tools, focus on the strategic implementation of isolated gameful elements outside of games has risen in recent years under the term gamification. Given their ease of implementation and impact in competitive games, a small set of game design elements, namely points, badges, and leaderboards, initially dominated research and practice. However, these elements reflect only a small group of components that game designers use to achieve positive outcomes in their systems. Current research has shifted towards focusing on the game design process instead of the isolated implementation of single elements under the term gameful design. But the problem of a tendency toward a monocultural selection of prominent design elements persists in-game and gameful design, preventing the method from reaching its full potential. This dissertation addresses this problem by designing and developing a digital, interactive game design element ontology that scholars and practitioners can use to make more informed and inspired decisions in creating gameful solutions to their problems. The first part of this work is concerned with the collation and development of the digital ontology. First, two datasets were collated from game design and gamification literature (game design elements and playing motivations). Next, four explorative studies were conducted to add user-relevant metadata and connect their items into an ontological structure. The first two studies use card sorting to assess game theory frameworks regarding their suitability as foundational categories for the game design element dataset and to gain an overview of different viewpoints from which categorizations can be derived. The second set of studies builds on an explorative method of matching dataset entries via their descriptive keywords to arrive at a connected graph. The first of these studies connects items of the playing motivations dataset with themselves, while the second connects them with an additional dataset of human needs. The first part closes with the documentation of the design and development of the tool Kubun, reporting on the outcome of its evaluation via iterative expert interviews and a field study. The results suggest that the tool serves its preset goals of affording intuitive browsing for dedicated searches and serendipitous findings. While the first part of this work reports on the top-down development process of the ontology and related navigation tool, the second part presents an in-depth research of specific learning-oriented game design elements to complement the overall research goal through a complementary bottom-up approach. Therein, two studies on learning-oriented game design elements are reported regarding their effect on performance, long-term learning outcome, and knowledge transfer. The studies are conducted with a game dedicated to teaching correct waste sorting. The first study focuses on a reward-based game design element in terms of its motivatory effect on perfect play. The second study evaluates two learning-enhancing game design elements, repeat, and look-up, in terms of their contribution to a long-term learning outcome. The comprehensive insights gained through the in-depth research manifest in the design of a module dedicated to reporting research outcomes in the ontology. The dissertation concludes with a discussion on the studies’ varying limitations and an outlook on pathways for future research

Adaptive games for learner and systems (bidirectional) learning

Thesis (PhD)--Stellenbosch University, 2022.ENGLISH ABSTRACT:Traditional learning environments are ineffective and inefficient and are failing to adequately equip students and employees with the knowledge and skills required in today’s jobs, let alone prepare them for the jobs of tomorrow. Given the rapidly changing landscapes of technologies and business models, organisations need to be flexible and adaptable to respond to, and even pre-empt future demands. One of the primary shortcomings of existing learning environments is their inflexibility and the ‘one size fits all’ approach followed. Serious games and game-based learning are widely recognised for their potential in providing more effective learning environments, especially when designed in a personalised, adaptive manner, and are explored in this dissertation. In addition to adapting to the individual traits and preferences of users, games are also highly context dependent. Whilst there is a great deal of literature and documented case studies of game-based learning, most focus only on the implementation of one particular game in a specific context. Whilst many existing game design models and approaches focus on achieving improved learning outcomes of learners, there is an opportunity to consider the impact of gameplay on other stakeholders and drive the active development of meta-skills in various stakeholders. Bidirectional learning, where learning simultaneously takes place in a two-way direction [295], has great potential and has, to date, not been incorporated in serious game design. By integrating different perspectives and variable scenarios, the dynamic personalisation of learning trajectories may be possible. Serious games offer a potential platform to aggregate learner behaviours and results, and use these to dynamically configure, adjust and tailor the game to individuals and contexts, ultimately providing a learning environment of improved quality, effectiveness and efficiency. In this dissertation, adaptive, bidirectional games are explored as a means to provide more effective and efficient learning environments for multiple stakeholders. Moreover, an architecture is presented to support the creation of such games for specific scenarios in a faster, more effective and more efficient manner. Following a research-by-design approach, the architecture is iteratively developed and simultaneously applied in four case studies. Experiences and learnings from each case study are infused into subsequent design iterations of the architecture. The architecture allows users to explore and exploit the solution space more deliberately and better understand the various functions and the interrelations between them. The flexible and modular structure of the architecture allows users to prioritise functionalities as required in the given scenario. Furthermore, the directional relations between functions can be interpreted and prioritised as needed given the specific context and requirements. The architecture incorporates various stakeholders in the design process, leading to greater transparency and better understanding throughout the process. More importantly, it emphasises bidirectional learning whereby different stakeholders can learn from gameplay and the aggregated results and behaviours of players.AFRIKAANS OPSOMMING: Tradisionele leeromgewings is oneffektief en ondoeltreffend en slaag nie daarin om studente en werknemers voldoende toe te rus met die kennis en vaardighede wat in die huidige werk benodig is nie, en nog minder vir toekomstige werk. Gegewe die vinnig veranderende landskappe van tegnologie¨e en sakemodelle, moet organisasies buigsaam en aanpasbaar wees om te reageer op, en selfs toekomstige behoeftes te voorkom. Een van die belangrikste tekortkominge van bestaande leeromgewings is die onbuigsaamheid daarvan asook die ‘een grootte pas almal’ benadering wat gevolg word. Ernstige speletjies en spelgebaseerde leer word oor die algemeen erken vir hul potensiaal om meer effektiewe leeromgewings te skep, veral as dit op ’n persoonlike, aanpasbare manier ontwerp is, en word in hierdie proefskrif ondersoek. Benewens die aanpassing by die individuele eienskappe en voorkeure van gebruikers, is speletjies ook baie kontekstafhanklik. Alhoewel daar baie literatuur en gedokumenteerde gevallestudies oor spelgebaseerde leer is, fokus die meeste daarvan slegs op die implementering van een spesifieke spel in ’n spesifieke konteks. Alhoewel baie bestaande spelontwerpmodelle en -benaderings op die verbeterde leeruitkomste van leerders focus, is daar ’n geleentheid om die impak van spel op ander belanghebbendes te oorweeg en die aktiewe ontwikkeling van metavaardighede by verskeie belanghebbendes te dryf. Tweerigtingleer, waar leer gelyktydig in twee rigtinge plaasvind [295], het ’n groot potensiaal en is huidig nog nie in ernstige spelontwerp opgeneem nie. Deur die integrasie van verskillende perspektiewe en veranderlike scenario’s, word die dinamiese personalisering van leertrajekte moontlik. Ernstige speletjies bied ’n moontlike platform om leerdergedrag en -resultate saam te voeg, en dit te gebruik om die spel dinamies te konfigureer en aan te pas by individue en kontekste, wat ’n leeromgewing van verbeterde kwaliteit, effektiwiteit en doeltreffendheid bied. In hierdie proefskrif word aanpasbare, tweerigting speletjies ondersoek as ’n manier om meer effektiewe en doeltreffende leeromgewings vir verskeie belanghebbendes te bied. Boonop word ’n argitektuur aangebied om die skep van sulke speletjies vir spesifieke scenario’s vinniger, meer effektief en doeltreffender te ondersteun. Na aanleiding van ’n navorsing-deur-ontwerp benadering word die argitektuur iteratief ontwikkel en gelyktydig toegepas in vier gevallestudies. Ervarings en leerstellings uit elke gevallestudie word ingesluit in die daaropvolgende ontwerp iterasies van die argitektuur. Met die argitektuur kan gebruikers die oplossingsruimte doelbewus ondersoek en benut, en die verskillende funksies en onderlinge verwantskappe tussen hulle beter verstaan. Die buigsame en modulˆere struktuur van die argitektuur stel gebruikers in staat om funksionaliteite te prioritiseer soos vereis in die gegewe scenario. Verder kan die rigtingverhoudinge tussen funksies ge¨ınterpreteer en geprioritiseer word soos benodig, gegewe die spesifieke konteks en vereistes. Die argitektuur bevat verskillende belanghebbendes in die ontwerpproses, wat lei tot verbeterde deursigtigheid en begrip gedurende die proses. Belangriker nog, dit beklemtoon tweerigtingleer waardeur verskillende belanghebbendes kan leer deur die spel en die saamgestelde resultate en gedrag van spelers.Doctora

Distributed, Low-Cost, Non-Expert Fine Dust Sensing with Smartphones

Diese Dissertation behandelt die Frage, wie mit kostengünstiger Sensorik Feinstäube in hoher zeitlicher und räumlicher Auflösung gemessen werden können. Dazu wird ein neues Sensorsystem auf Basis kostengünstiger off-the-shelf-Sensoren und Smartphones vorgestellt, entsprechende robuste Algorithmen zur Signalverarbeitung entwickelt und Erkenntnisse zur Interaktions-Gestaltung für die Messung durch Laien präsentiert. Atmosphärische Aerosolpartikel stellen im globalen Maßstab ein gravierendes Problem für die menschliche Gesundheit dar, welches sich in Atemwegs- und Herz-Kreislauf-Erkrankungen äußert und eine Verkürzung der Lebenserwartung verursacht. Bisher wird Luftqualität ausschließlich anhand von Daten relativ weniger fester Messstellen beurteilt und mittels Modellen auf eine hohe räumliche Auflösung gebracht, so dass deren Repräsentativität für die flächendeckende Exposition der Bevölkerung ungeklärt bleibt. Es ist unmöglich, derartige räumliche Abbildungen mit den derzeitigen statischen Messnetzen zu bestimmen. Bei der gesundheitsbezogenen Bewertung von Schadstoffen geht der Trend daher stark zu räumlich differenzierenden Messungen. Ein vielversprechender Ansatz um eine hohe räumliche und zeitliche Abdeckung zu erreichen ist dabei Participatory Sensing, also die verteilte Messung durch Endanwender unter Zuhilfenahme ihrer persönlichen Endgeräte. Insbesondere für Luftqualitätsmessungen ergeben sich dabei eine Reihe von Herausforderungen - von neuer Sensorik, die kostengünstig und tragbar ist, über robuste Algorithmen zur Signalauswertung und Kalibrierung bis hin zu Anwendungen, die Laien bei der korrekten Ausführung von Messungen unterstützen und ihre Privatsphäre schützen. Diese Arbeit konzentriert sich auf das Anwendungsszenario Partizipatorischer Umweltmessungen, bei denen Smartphone-basierte Sensorik zum Messen der Umwelt eingesetzt wird und üblicherweise Laien die Messungen in relativ unkontrollierter Art und Weise ausführen. Die Hauptbeiträge hierzu sind: 1. Systeme zum Erfassen von Feinstaub mit Smartphones (Low-cost Sensorik und neue Hardware): Ausgehend von früher Forschung zur Feinstaubmessung mit kostengünstiger off-the-shelf-Sensorik wurde ein Sensorkonzept entwickelt, bei dem die Feinstaub-Messung mit Hilfe eines passiven Aufsatzes auf einer Smartphone-Kamera durchgeführt wird. Zur Beurteilung der Sensorperformance wurden teilweise Labor-Messungen mit künstlich erzeugtem Staub und teilweise Feldevaluationen in Ko-Lokation mit offiziellen Messstationen des Landes durchgeführt. 2. Algorithmen zur Signalverarbeitung und Auswertung: Im Zuge neuer Sensordesigns werden Kombinationen bekannter OpenCV-Bildverarbeitungsalgorithmen (Background-Subtraction, Contour Detection etc.) zur Bildanalyse eingesetzt. Der resultierende Algorithmus erlaubt im Gegensatz zur Auswertung von Lichtstreuungs-Summensignalen die direkte Zählung von Partikeln anhand individueller Lichtspuren. Ein zweiter neuartiger Algorithmus nutzt aus, dass es bei solchen Prozessen ein signalabhängiges Rauschen gibt, dessen Verhältnis zum Mittelwert des Signals bekannt ist. Dadurch wird es möglich, Signale die von systematischen unbekannten Fehlern betroffen sind auf Basis ihres Rauschens zu analysieren und das "echte" Signal zu rekonstruieren. 3. Algorithmen zur verteilten Kalibrierung bei gleichzeitigem Schutz der Privatsphäre: Eine Herausforderung partizipatorischer Umweltmessungen ist die wiederkehrende Notwendigkeit der Sensorkalibrierung. Dies beruht zum einen auf der Instabilität insbesondere kostengünstiger Luftqualitätssensorik und zum anderen auf der Problematik, dass Endbenutzern die Mittel für eine Kalibrierung üblicherweise fehlen. Bestehende Ansätze zur sogenannten Cross-Kalibrierung von Sensoren, die sich in Ko-Lokation mit einer Referenzstation oder anderen Sensoren befinden, wurden auf Daten günstiger Feinstaubsensorik angewendet sowie um Mechanismen erweitert, die eine Kalibrierung von Sensoren untereinander ohne Preisgabe privater Informationen (Identität, Ort) ermöglicht. 4. Mensch-Maschine-Interaktions-Gestaltungsrichtlinien für Participatory Sensing: Auf Basis mehrerer kleiner explorativer Nutzerstudien wurde empirisch eine Taxonomie der Fehler erstellt, die Laien beim Messen von Umweltinformationen mit Smartphones machen. Davon ausgehend wurden mögliche Gegenmaßnahmen gesammelt und klassifiziert. In einer großen summativen Studie mit einer hohen Teilnehmerzahl wurde der Effekt verschiedener dieser Maßnahmen durch den Vergleich vier unterschiedlicher Varianten einer App zur partizipatorischen Messung von Umgebungslautstärke evaluiert. Die dabei gefundenen Erkenntnisse bilden die Basis für Richtlinien zur Gestaltung effizienter Nutzerschnittstellen für Participatory Sensing auf Mobilgeräten. 5. Design Patterns für Participatory Sensing Games auf Mobilgeräten (Gamification): Ein weiterer erforschter Ansatz beschäftigt sich mit der Gamifizierung des Messprozesses um Nutzerfehler durch den Einsatz geeigneter Spielmechanismen zu minimieren. Dabei wird der Messprozess z.B. in ein Smartphone-Spiel (sog. Minigame) eingebettet, das im Hintergrund bei geeignetem Kontext die Messung durchführt. Zur Entwicklung dieses "Sensified Gaming" getauften Konzepts wurden Kernaufgaben im Participatory Sensing identifiziert und mit aus der Literatur zu sammelnden Spielmechanismen (Game Design Patterns) gegenübergestellt

The Playful Citizen

This edited volume collects current research by academics and practitioners on playful citizen participation through digital media technologies

Advancements in Safe Deep Reinforcement Learning for Real-Time Strategy Games and Industry Applications

publishedVersio

Generation of effective serious games with static and dynamic content

With video games being a huge market, attracting and engaging millions of players, it is tempting to use these motivational aspects not just for entertainment. After all, play as the basis of games has inherent learning aspects, for example seen at the way how children play and learn. The serious games movement that took off at the beginning of the 21st century wants to achieve exactly that: provide playful learning environments and utilize the motivational aspects of games to transport serious content to players. Getting from such an idea to an actual game, however, is far from trivial. A fundamental problem is how to integrate serious content and game parts. Finding ways how to improve the game creation process to produce applications that are both fun to play and effective in delivering a serious content is the main focus of this thesis. Therefore, the problem is approached in two ways: by providing best practice tips for the creators of serious games and by presenting results of different practical game implementations and studies. Two sets of serious games — seven in total — have been developed within the course of this thesis. The first set comprises games with static serious content. These games depict the regular development approach. Here, a static game concept is created and implemented by professional game developers. This approach allows for a high degree of freedom in the game creation process. Nevertheless, emphasis has to be put on combining serious content in the right way to produce effective and fun serious games. Best practice tips are given along with presenting results from user studies that are based on the implemented game prototypes. The second set of games features dynamic learning content. In contrast to static variants, these games support changing the learning content at runtime. This allows for more accessible creation methods: Once created, any domain expert can create own custom games without the need for expertise in game development. On the other hand, special emphasis has to be put on designing the frameworks in a manner that game scenario and learning content are well integrated, despite not having a thematic connection. Different approaches are examined by developing games with dynamic content. The games are evaluated in terms of their usefulness. Different user studies look at the motivational aspects as well as at the learning outcome. Furthermore, the effect of not having a connection between game scenario and learning content is examined to compare the effectiveness of static and dynamic variants

The Playful Citizen

This edited volume collects current research by academics and practitioners on playful citizen participation through digital media technologies