Automated Game Design Learning

While general game playing is an active field of research, the learning of game design has tended to be either a secondary goal of such research or it has been solely the domain of humans. We propose a field of research, Automated Game Design Learning (AGDL), with the direct purpose of learning game designs directly through interaction with games in the mode that most people experience games: via play. We detail existing work that touches the edges of this field, describe current successful projects in AGDL and the theoretical foundations that enable them, point to promising applications enabled by AGDL, and discuss next steps for this exciting area of study. The key moves of AGDL are to use game programs as the ultimate source of truth about their own design, and to make these design properties available to other systems and avenues of inquiry.Comment: 8 pages, 2 figures. Accepted for CIG 201

Aetherius: Real-Time Volumetric Cloud Generation Tool for Unity

This thesis describes the development of Aetherius, a Unity tool which can generate and visualize virtually endless and unique cloudscapes in real-time dynamically; The resulting tool can be used in videogames to easily and quickly create immersive and dynamic skies without wasting resources in the development of a dedicated system. Developing a volumetric cloud system is complicated and especially small studios do not have the resources to create such systems for their skies. The objective of this project is to provide an accessible and easy to use alternative for small studios and indie developers to turn static, boring and featureless skies into high quality ones. In this document the problems encountered during the development of the tool and the techniques used to generate, render and optimize cloudscapes are described; to test the tool’s usefulness this project includes the creation of a small demo application

Production of 3D animated short films in Unity 5 : can game engines replace the traditional methods?

In 3D animation cinema, the elements of a scene are created by artists using computer software. To generate the final result, there must be a conversion (rendering) of the threedimensional models to two-dimensional images (frames) that will later be joined together and edited into a video format. 3D animation films have traditionally been rendered using pre-rendering engines, a time consuming and expensive process that usually requires the use of multiple computers rendering at the same time (render farms), renders which may need to be repeated if the results are not ideal. Videogames, on the other hand, are reactive applications where the player may have different possible courses of action that will generate distinct results. In those cases, it is necessary that the engine waits for the player’s input before it calculates the following frames. To allow for fast calculations in real time, 3D game developers use game engines that incorporate real time rendering methods which can generate images much faster than the prerendering engines mentioned above. To be able to generate a large number of frames per second, there must be an optimization of the entire scene, in order to reduce the number of necessary calculations. That optimization is created by using techniques, practices and tools that are not commonly used by animation cinema professionals. Due to that optimization necessity, videogames always had a lower graphic quality than that of animated films, where each frame is rendered separately and takes as long as necessary to obtain the required result. Physically Based Rendering (PBR) technology is one of the methods incorporated by some rendering engines for the generation of physically accurate results, using calculations that follow the laws of physics as it happens in the real world and creating more realistic images which require less effort, not only from the artist but also from the equipment. The incorporation of PBR in game engines allowed for high graphic quality generated results in real time, gradually closing the visual quality gap between videogames and animated cinema. Recently, game engines such as Unity and Unreal Engine started to be used – mostly by the companies that created the engine, as a proof of concept – for rendering 3D animated films. This could lead to changes in the animation cinema production methods by the studios that, until now, have used traditional pre-rendering methods.No cinema de animação 3D, os elementos de uma cena são criados por artistas através da utilização de programas de computador. Para gerar o resultado final, é necessário fazer-se uma conversão (render) dos modelos tri-dimensionais para imagens bi-dimensionais (frames), que posteriormente serão unidas e editadas para um formato de vídeo. Tradicionalmente, o rendering de filmes de animação 3D é feita através de motores de pre-rendering, um processo demorado e dispendioso que geralmente requer a utilização de múltiplos computadores a trabalhar em simultâneo (render farms), e que poderá ter que ser repetido caso os resultados obtidos não sejam ideais. Os videojogos, por outro lado, são aplicações reactivas, onde o jogador pode ter várias sequências de acções, que poderão gerar resultados distintos. Nesses casos, é necessário o motor de jogo esperar pela acção do jogador antes de calcular as imagens seguintes. Para possibilitar cálculos rápidos em tempo-real, os criadores de jogos 3D usam motores de jogo que incorporam métodos de renderização em tempo-real que conseguem gerar imagens muito mais rápido do que os motores de pre-rendering mencionados acima. Para conseguir gerar um grande número de imagens por segundo, é necessário existir uma optimização de toda a cena, para reduzir o número de cálculos necessários. Essa optimização é criada através da utilização de técnicas, práticas e ferramentas que, geralmente, não são utiliadas por profissionais da área de cinema de animação. Devido a essa necessidade de optimização, os videojogos sempre tiveram uma qualidade gráfica inferior à dos filmes de animação, onde o render de cada imagem é gerado separadamente e pode levar tanto tempo quanto for necessário para obter o resultado desejado. A tecnologia de Rendering Baseado em Física (Physically Based Rendering – PBR) é um dos métodos incorporados por alguns motores de rendering para a geração de resultados físicamente correctos, usando cálculos que seguem as leis da física, tal como acontece no mundo real e criando imagens mais realistas necessitando de menos esforço, não só da parte do artista mas também do equipamento. A incorporação de PBR em motores de jogo possibilitou resultados gerados em tempo-real com grande qualidade gráfica, o que gradualmente vai aproximando a qualidade visual dos videojogos à do cinema de animação. Recentemente, motores de jogo como o Unity e o Unreal Engine começaram a ser utilizados – maioritariamente pelas companhias que criaram o motor de jogo, como prova de conceito – para renderização de filmes de animação 3D. Este passo poderá levar a mudanças nos métodos de produção do cinema de animação em estúdios que, até agora, utilizaram métodos de pré-renderização tradicionais

Multimodality with Eye tracking and Haptics: A New Horizon for Serious Games?

The goal of this review is to illustrate the emerging use of multimodal virtual reality that can benefit learning-based games. The review begins with an introduction to multimodal virtual reality in serious games and we provide a brief discussion of why cognitive processes involved in learning and training are enhanced under immersive virtual environments. We initially outline studies that have used eye tracking and haptic feedback independently in serious games, and then review some innovative applications that have already combined eye tracking and haptic devices in order to provide applicable multimodal frameworks for learning-based games. Finally, some general conclusions are identified and clarified in order to advance current understanding in multimodal serious game production as well as exploring possible areas for new applications

Models of ICT Innovation. A Focus on the Cinema Sector

The report starts by looking at the competing and overlapping definitions of creative industries, media and content industries. Chapter 1 investigates the fate of R&D and innovation in the creative industries and in the broader Telecom Media and Technology sectors. Chapter 2 summarizes past studies on innovation in distinct media and content industries (videogames, music recording and newspapers publishing) and draws some lessons from them. Chapter 3 delves more deeply into the specific case of cinema. This chapter investigates the film industry's complex and evolving relationship with technologies and technological inventions. Chapter 4 offers a short cross-comparison with R&D in the book publishing industry. Chapter 5 deals with policy issues triggered by the observed digital changes. Chapter 6 concludes with a brief assessment of EU strengths and weaknesses, and offers some recommendations.JRC.J.3-Information Societ

Methods and metrics for the improvement of the interaction and the rehabilitation of cerebral palsy through inertial technology

Cerebral palsy (CP) is one of the most limiting disabilities in childhood, with 2.2 cases per 1000 1-year survivors. It is a disorder of movement and posture due to a defect or lesion of the immature brain during the pregnancy or the birth. These motor limitations appear frequently in combination with sensory and cognitive alterations generally result in great difficulties for some people with CP to manipulate objects, communicate and interact with their environment, as well as limiting their mobility. Over the last decades, instruments such as personal computers have become a popular tool to overcome some of the motor limitations and promote neural plasticity, especially during childhood. According to some estimations, 65% of youths with CP that present severely limited manipulation skills cannot use standard mice nor keyboards. Unfortunately, even when people with CP use assistive technology for computer access, they face barriers that lead to the use of typical mice, track balls or touch screens for practical reasons. Nevertheless, with the proper customization, novel developments of alternative input devices such as head mice or eye trackers can be a valuable solution for these individuals. This thesis presents a collection of novel mapping functions and facilitation algorithms that were proposed and designed to ease the act of pointing to graphical elements on the screen—the most elemental task in human-computer interaction—to individuals with CP. These developments were implemented to be used with any head mouse, although they were all tested with the ENLAZA, an inertial interface. The development of such techniques required the following approach: Developing a methodology to evaluate the performance of individuals with CP in pointing tasks, which are usually described as two sequential subtasks: navigation and targeting. Identifying the main motor abnormalities that are present in individuals with CP as well as assessing the compliance of these people with standard motor behaviour models such as Fitts’ law. Designing and validating three novel pointing facilitation techniques to be implemented in a head mouse. They were conceived for users with CP and muscle weakness that have great difficulties to maintain their heads in a stable position. The first two algorithms consist in two novel mapping functions that aim to facilitate the navigation phase, whereas the third technique is based in gravity wells and was specially developed to facilitate the selection of elements in the screen. In parallel with the development of the facilitation techniques for the interaction process, we evaluated the feasibility of use inertial technology for the control of serious videogames as a complement to traditional rehabilitation therapies of posture and balance. The experimental validation here presented confirms that this concept could be implemented in clinical practice with good results. In summary, the works here presented prove the suitability of using inertial technology for the development of an alternative pointing device—and pointing algorithms—based on movements of the head for individuals with CP and severely limited manipulation skills and new rehabilitation therapies for the improvement of posture and balance. All the contributions were validated in collaboration with several centres specialized in CP and similar disorders and users with disability recruited in those centres.La parálisis cerebral (PC) es una de las deficiencias más limitantes de la infancia, con un incidencia de 2.2 casos por cada 1000 supervivientes tras un año de vida. La PC se manifiesta principalmente como una alteración del movimiento y la postura y es consecuencia de un defecto o lesión en el cerebro inmaduro durante el embarazo o el parto. Las limitaciones motrices suelen aparecer además en compañía de alteraciones sensoriales y cognitivas, lo que provoca por lo general grandes dificultades de movilidad, de manipulación, de relación y de interacción con el entorno. En las últimas décadas, el ordenador personal se ha extendido como herramienta para la compensación de parte de estas limitaciones motoras y como medio de promoción de la neuroplasticidad, especialmente durante la infancia. Desafortunadamente, cerca de un 65% de las personas PC que son diagnosticadas con limitaciones severas de manipulación son incapaces de utilizar ratones o teclados convencionales. A veces, ni siquiera la tecnología asistencial les resulta de utilidad ya que se encuentran con impedimentos que hacen que opten por usar dispositivos tradicionales aun sin dominar su manejo. Para estas personas, los desarrollos recientes de ratones operados a través de movimientos residuales con la cabeza o la mirada podrían ser una solución válida, siempre y cuando se personalice su manejo. Esta tesis presenta un conjunto de novedosas funciones de mapeo y algoritmos de facilitaci ón que se han propuesto y diseñado con el ánimo de ayudar a personas con PC en las tareas de apuntamiento de objetos en la pantalla —las más elementales dentro de la interacción con el ordenador. Aunque todas las contribuciones se evaluaron con la interfaz inercial ENLAZA, desarrollada igualmente en nuestro grupo, podrían ser aplicadas a cualquier ratón basado en movimientos de cabeza. El desarrollo de los trabajos se resume en las siguientes tareas abordadas: Desarrollo de una metodología para la evaluación de la habilidad de usuarios con PC en tareas de apuntamiento, que se contemplan como el encadenamiento de dos sub-tareas: navegación (alcance) y selección (clic). Identificación de los tipos de alteraciones motrices presentes en individuos con PC y el grado de ajuste de éstos a modelos estándares de comportamiento motriz como puede ser la ley de Fitts. Propuesta y validación de tres técnicas de facilitación del alcance para ser implementadas en un ratón basado en movimientos de cabeza. La facilitación se ha centrado en personas que presentan debilidad muscular y dificultades para mantener la posición de la cabeza. Mientras que los dos primeros algoritmos se centraron en facilitar la navegación, el tercero tuvo como objetivo ayudar en la selección a través de una técnica basada en pozos gravitatorios de proximidad. En paralelo al desarrollo de estos algoritmos de facilitación de la interacción, evaluamos la posibilidad de utilizar tecnología inercial para el control de videojuegos en rehabilitación. Nuestra validación experimental demostró que este concepto puede implementarse en la práctica clínica como complemento a terapias tradicionales de rehabilitación de la postura y el equilibrio. Como conclusión, los trabajos desarrollados en esta tesis vienen a constatar la idoneidad de utilizar sensores inerciales para el desarrollo de interfaces de accesso alternativo al ordenador basados en movimientos residuales de la cabeza para personas con limitaciones severas de manipulación. Esta solución se complementa con algoritmos de facilitación del alcance. Por otra parte, estas soluciones tecnológicas de interfaz con el ordenador representan igualmente un complemento de terapias tradicionales de rehabilitación de la postura y el equilibrio. Todas las contribuciones se validaron en colaboración con una serie de centros especializados en parálisis cerebral y trastornos afines contando con usuarios con discapacidad reclutados en dichos centros.This thesis was completed in the Group of Neural and Cognitive Engineering (gNEC) of the CAR UPM-CSIC with the financial support of the FP7 Framework EU Research Project ABC (EU-2012-287774), the IVANPACE Project (funded by Obra Social de Caja Cantabria, 2012-2013), and the Spanish Ministry of Economy and Competitiveness in the framework of two projects: the Interplay Project (RTC-2014-1812-1) and most recently the InterAAC Project (RTC-2015-4327-1)Programa Oficial de Doctorado en Ingeniería Eléctrica, Electrónica y AutomáticaPresidente: Juan Manuel Belda Lois.- Secretario: María Dolores Blanco Rojas.- Vocal: Luis Fernando Sánchez Sante

VR for Cultural Heritage. A VR-WEB-BIM for the future maintenance of Milan’s Cathedral.

The work presented here is the final step of a multidisciplinary research project conducted on the Milan Cathedral for eight years (2008–2015). Three main topics, consequentially related, will be here addressed: (i) the survey of the structure, meant to update the old drawings; (ii) the construction of an accurate and detailed 3D model to be used to produce measurements at a 1:20–1:50 representation scale; (iii) the development of a Building Information System (BIM) to collect all the data relating to the restoration projects, as well as all information relating to past, current and future maintenance activities of the cathedral. The result of this research project is a complex and accurate digital 3D model of the main spire of the cathedral and of other parts of the building. This model can be visualized, navigated and used by the Veneranda Fabbrica technicians as an info-data catalogue, thanks to a common web browser connected with the remote BIM System Server and the modelling software where ad hoc I/O plugins are implemented. The last step of this long project was to take advantage of the nascent potential of immersive visualization techniques and to transpose the BIM system in a VR environment, thus obtaining two main results. The first was a high-appeal visualization system that allows a virtual visit of the Main Spire of the cathedral, the building’s highest part that has been closed to visitors since the beginning of the XX century. The second was the possibility to use this technology to virtually explore the cathedral from a technical point of view: by using an immersive visualization technology, operators can improve their understanding of the structure and obtain real-time information about the state of conservation, including current and past maintenance activities, in a sort of “augmented reality system in a virtual environment”

Design of an application with Virtual Reality for neurorehabilitation purposes

The purpose of this project is to carry out a study of virtual reality and its applications in hospital environments such as neurorehabilitation or physiotherapy, since it is a technology which is starting to be used nowadays. A 3D virtual reality application for a basic demonstration of a game which could be useful for these trainings will be also done. To achieve this, we will work with Unity, a graphic motor for 3D application and game creation. The hardware for the development of the virtual reality immersive system will be the HTC Vive system, which additionally allows position and movement detection in a room scale using the light signalling technology Lighthouse. This application will focus on the creation of an immersive videogame to track upper extremity movement from the user so he can do his rehabilitation training in a more enjoyable and motivating way, in the form of avoiding obstacles in the videogame using those movements. In addition, the necessary informatic support will be done so the application can be used in a virtual reality headset to improve visual immersion. It will also be obtained some parameter indicating how the game play was

A serious game to explore human foraging in a 3D environment

Traditional search tasks have taught us much about vision and attention. Recently, several groups have begun to use multiple-target search to explore more complex and temporally extended "foraging" behaviour. Many of these new foraging tasks, however, maintain the simplified 2D displays and response demands associated with traditional, single-target visual search. In this respect, they may fail to capture important aspects of real-world search or foraging behaviour. In the current paper, we present a serious game for mobile platforms, developed in Unity3D, in which human participants play the role of an animal foraging for food in a simulated 3D environment. Game settings can be adjusted, so that, for example, custom target and distractor items can be uploaded, and task parameters, such as the number of target categories or target/distractor ratio are all easy to modify. We are also making the Unity3D project available, so that further modifications can also be made. We demonstrate how the app can be used to address specific research questions by conducting two human foraging experiments. Our results indicate that in this 3D environment, a standard feature/conjunction manipulation does not lead to a reduction in foraging runs, as it is known to do in simple, 2D foraging tasks