A spatially-structured PCG method for content diversity in a Physics-based simulation game

This paper presents a spatially-structured evolutionary algorithm (EA) to procedurally generate game maps of di ferent levels of di ficulty to be solved, in Gravityvolve!, a physics-based simulation videogame that we have implemented and which is inspired by the n- body problem, a classical problem in the fi eld of physics and mathematics. The proposal consists of a steady-state EA whose population is partitioned into three groups according to the di ficulty of the generated content (hard, medium or easy) which can be easily adapted to handle the automatic creation of content of diverse nature in other games. In addition, we present three fitness functions, based on multiple criteria (i.e:, intersections, gravitational acceleration and simulations), that were used experimentally to conduct the search process for creating a database of maps with di ferent di ficulty in Gravityvolve!.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech

Enhancing automatic level generation for platform videogames

This dissertation addresses the challenge of improving automatic level generation processes for plat-form videogames. As Procedural Content Generation (PCG) techniques evolved from the creation of simple elements to the construction of complete levels and scenarios, the principles behind the generation algorithms became more ambitious and complex, representing features that beforehand were only possible with human design. PCG goes beyond the search for valid geometries that can be used as levels, where multiple challenges are represented in an adequate way. It is also a search for user-centred design content and the creativity sparks of humanly created content. In order to improve the creativity capabilities of such generation algorithms, we conducted part of our research directed to the creation of new techniques using more ambitious design patterns. For this purpose, we have implemented two overall structure generation algorithms and created an addi-tional adaptation algorithm. The later can transform simple branched paths into more compelling game challenges by adding items and other elements in specific places, such as gates and levers for their activation. Such approach is suitable to avoid excessive level linearity and to represent certain design patterns with additional content richness. Moreover, content adaptation was transposed from general design domain to user-centred principles. In this particular case, we analysed success and failure patterns in action videogames and proposed a set of metrics to estimate difficulty, taking into account that each user has a different perception of that concept. This type of information serves the generation algorithms to make them more directed to the creation of personalised experiences. Furthermore, the conducted research also aimed to the integration of different techniques into a common ground. For this purpose, we have developed a general framework to represent content of platform videogames, compatible with several titles within the genre. Our algorithms run over this framework, whereby they are generic and game independent. We defined a modular architecture for the generation process, using this framework to normalise the content that is shared by multiple modules. A level editor tool was also created, which allows human level design and the testing of automatic generation algorithms. An adapted version of the editor was implemented for the semi-automatic creation of levels, in which the designer may simply define the type of content that he/she desires, in the form of quests and missions, and the system creates a corresponding level structure. This materialises our idea of bridging human high-level design patterns with lower level automated generation algorithms. Finally, we integrated the different contributions into a game prototype. This implementation allowed testing the different proposed approaches altogether, reinforcing the validity of the proposed archi-tecture and framework. It also allowed performing a more complete gameplay data retrieval in order to strengthen and validate the proposed metrics regarding difficulty perceptions

Learning Curricula in Open-Ended Worlds

Deep reinforcement learning (RL) provides powerful methods for training optimal sequential decision-making agents. As collecting real-world interactions can entail additional costs and safety risks, the common paradigm of sim2real conducts training in a simulator, followed by real-world deployment. Unfortunately, RL agents easily overfit to the choice of simulated training environments, and worse still, learning ends when the agent masters the specific set of simulated environments. In contrast, the real-world is highly open-ended—featuring endlessly evolving environments and challenges, making such RL approaches unsuitable. Simply randomizing across a large space of simulated environments is insufficient, as it requires making arbitrary distributional assumptions, and as the design space grows, it can become combinatorially less likely to sample specific environment instances that are useful for learning. An ideal learning process should automatically adapt the training environment to maximize the learning potential of the agent over an open-ended task space that matches or surpasses the complexity of the real world. This thesis develops a class of methods called Unsupervised Environment Design (UED), which seeks to enable such an open-ended process via a principled approach for gradually improving the robustness and generality of the learning agent. Given a potentially open-ended environment design space, UED automatically generates an infinite sequence or curriculum of training environments at the frontier of the learning agent’s capabilities. Through both extensive empirical studies and theoretical arguments founded on minimax-regret decision theory and game theory, the findings in this thesis show that UED autocurricula can produce RL agents exhibiting significantly improved robustness and generalization to previously unseen environment instances. Such autocurricula are promising paths toward open-ended learning systems that approach general intelligence—a long sought-after ambition of artificial intelligence research—by continually generating and mastering additional challenges of their own design

Bio-inspired computation: where we stand and what's next

In recent years, the research community has witnessed an explosion of literature dealing with the adaptation of behavioral patterns and social phenomena observed in nature towards efficiently solving complex computational tasks. This trend has been especially dramatic in what relates to optimization problems, mainly due to the unprecedented complexity of problem instances, arising from a diverse spectrum of domains such as transportation, logistics, energy, climate, social networks, health and industry 4.0, among many others. Notwithstanding this upsurge of activity, research in this vibrant topic should be steered towards certain areas that, despite their eventual value and impact on the field of bio-inspired computation, still remain insufficiently explored to date. The main purpose of this paper is to outline the state of the art and to identify open challenges concerning the most relevant areas within bio-inspired optimization. An analysis and discussion are also carried out over the general trajectory followed in recent years by the community working in this field, thereby highlighting the need for reaching a consensus and joining forces towards achieving valuable insights into the understanding of this family of optimization techniques

Bio-inspired computation: where we stand and what's next

In recent years, the research community has witnessed an explosion of literature dealing with the adaptation of behavioral patterns and social phenomena observed in nature towards efficiently solving complex computational tasks. This trend has been especially dramatic in what relates to optimization problems, mainly due to the unprecedented complexity of problem instances, arising from a diverse spectrum of domains such as transportation, logistics, energy, climate, social networks, health and industry 4.0, among many others. Notwithstanding this upsurge of activity, research in this vibrant topic should be steered towards certain areas that, despite their eventual value and impact on the field of bio-inspired computation, still remain insufficiently explored to date. The main purpose of this paper is to outline the state of the art and to identify open challenges concerning the most relevant areas within bio-inspired optimization. An analysis and discussion are also carried out over the general trajectory followed in recent years by the community working in this field, thereby highlighting the need for reaching a consensus and joining forces towards achieving valuable insights into the understanding of this family of optimization techniques

INVESTIGATION INTO GAME-BASED CRISIS SCENARIO MODELLING AND SIMULATION SYSTEM

A crisis is an infrequent and unpredictable event. Training and preparation process requires tools for representation of crisis context. Particularly, crisis events consist of different situations, which can occur at the same time combining into complex situation and becoming a challenge in coordinating several crisis management departments. In this regards, disaster prevention, preparedness and relief can be conceptualized into a design of hypothetical crisis game. Many complex tasks during development of emergency circumstance provide an opportunity for practitioners to train their skills, which are situation analysis, decision-making, and coordination procedures. While the training in physical workouts give crisis personal a hand-on experience in the given situation, it often requires a long time to prepare with a considerable budget. Alternatively, computational framework which allows simulation of crisis models tailoring into crisis scenario can become a cost-effective substitution to this study and training. Although, there are several existing computational toolsets to simulate crisis, there is no system providing a generic functionality to define crisis scenario, simulation model, agent development, and artificial intelligence problem planning in the single unified framework. In addition, a development of genetic framework can become too complex due to a multi-disciplinary knowledge required in each component. Besides, they have not fully incorporated a game technology toolset to fasten the system development process and provide a rich set of features and functionalities to these mentioned components. To develop such crisis simulation system, there are several technologies that must be studied to derive a requirement for software engineering approach in system’s specification designs. With a current modern game technology available in the market, it enables fast prototyping of the framework integrating with cutting-edge graphic render engine, asset management, networking, and scripting library. Therefore, a serious game application for education in crisis management can be fundamentally developed early. Still, many features must be developed exclusively for the novel simulation framework on top of the selected game engine. In this thesis, we classified for essential core components to design a software specification of a serious game framework that eased crisis scenario generation, terrain design, and agent simulation in UML formats. From these diagrams, the framework was prototyped to demonstrate our proposed concepts. From the beginning, the crisis models for different disasters had been analysed for their design and environment representation techniques, thus provided a choice of based simulation technique of a cellular automata in our framework. Importantly, a study for suitability in selection of a game engine product was conducted since the state of the art game engines often ease integration with upcoming technologies. Moreover, the literatures for a procedural generation of crisis scenario context were studied for it provided a structure to the crisis parameters. Next, real-time map visualization in dynamic of resource representation in the area was developed. Then the simulation systems for a large-scale emergency response was discussed for their choice of framework design with their examples of test-case study. An agent-based modelling tool was also not provided from the game engine technology so its design and decision-making procedure had been developed. In addition, a procedural content generation (PCG) was integrated for automated map generation process, and it allowed configuration of scenario control parameters over terrain design during run-time. Likewise, the artificial planning architecture (AI planning) to solve a sequence of suitable action toward a specific goal was considered to be useful to investigate an emergency plan. However, AI planning most often requires an offline computation with a specific planning language. So the comparison study to select a fast and reliable planner was conducted. Then an integration pipeline between the planner and agent was developed over web-service architecture to separate a large computation from the client while provided ease of AI planning configuration using an editor interface from the web application. Finally, the final framework called CGSA-SIM (Crisis Game for Scenario design and Agent modelling simulation) was evaluated for run-time performance and scalability analysis. It shown an acceptable performance framerate for a real-time application in the worst 15 frame-per-seconds (FPS) with maximum visual objects. The normal gameplay performed capped 60 FPS. At same time, the simulation scenario for a wildfire situation had been tested with an agent intervention which generated a simulation data for personal or case evaluation. As a result, we have developed the CGSA-SIM framework to address the implementation challenge of incorporating an emergency simulation system with a modern game technology. The framework aims to be a generic application providing main functionality of crisis simulation game for a visualization, crisis model development and simulation, real-time interaction, and agent-based modelling with AI planning pipeline

State of the Art on Diffusion Models for Visual Computing

The field of visual computing is rapidly advancing due to the emergence of generative artificial intelligence (AI), which unlocks unprecedented capabilities for the generation, editing, and reconstruction of images, videos, and 3D scenes. In these domains, diffusion models are the generative AI architecture of choice. Within the last year alone, the literature on diffusion-based tools and applications has seen exponential growth and relevant papers are published across the computer graphics, computer vision, and AI communities with new works appearing daily on arXiv. This rapid growth of the field makes it difficult to keep up with all recent developments. The goal of this state-of-the-art report (STAR) is to introduce the basic mathematical concepts of diffusion models, implementation details and design choices of the popular Stable Diffusion model, as well as overview important aspects of these generative AI tools, including personalization, conditioning, inversion, among others. Moreover, we give a comprehensive overview of the rapidly growing literature on diffusion-based generation and editing, categorized by the type of generated medium, including 2D images, videos, 3D objects, locomotion, and 4D scenes. Finally, we discuss available datasets, metrics, open challenges, and social implications. This STAR provides an intuitive starting point to explore this exciting topic for researchers, artists, and practitioners alike

Synthetic image generation and the use of virtual environments for image enhancement tasks

Deep learning networks are often difficult to train if there are insufficient image samples. Gathering real-world images tailored for a specific job takes a lot of work to perform. This dissertation explores techniques for synthetic image generation and virtual environments for various image enhancement/ correction/restoration tasks, specifically distortion correction, dehazing, shadow removal, and intrinsic image decomposition. First, given various image formation equations, such as those used in distortion correction and dehazing, synthetic image samples can be produced, provided that the equation is well-posed. Second, using virtual environments to train various image models is applicable for simulating real-world effects that are otherwise difficult to gather or replicate, such as dehazing and shadow removal. Given synthetic images, one cannot train a network directly on it as there is a possible gap between the synthetic and real domains. We have devised several techniques for generating synthetic images and formulated domain adaptation methods where our trained deep-learning networks perform competitively in distortion correction, dehazing, and shadow removal. Additional studies and directions are provided for the intrinsic image decomposition problem and the exploration of procedural content generation, where a virtual Philippine city was created as an initial prototype. Keywords: image generation, image correction, image dehazing, shadow removal, intrinsic image decomposition, computer graphics, rendering, machine learning, neural networks, domain adaptation, procedural content generation