Système intelligent pour le suivi et l’optimisation de l’état cognitif

Les émotions des êtres humains changent régulièrement et parfois de manière brusque entrainant un changement de l’état mental c’est-à-dire de l’aptitude cérébrale à fonctionner normalement. Il en résulte une capacité cognitive (ou état cognitif) de l’individu à pouvoir raisonner, accéder à la mémoire, ou effectuer des déductions, variable selon l’état mental. Ceci affecte, en conséquence, les performances des utilisateurs qui varient en fonction de leurs état cognitifs. Cette thèse vise à optimiser l’état cognitif d’un utilisateur lors de ses interactions avec un environnement virtuel. Comme cet état dépend des émotions, l’optimisation de l’état cognitif peut être réalisée à travers l’optimisation des émotions et en particulier la réduction des émotions négatives. Une première partie concerne les moyens de mesurer en temps réel (par un Module de mesures) l’état émotionnel et mental d’un utilisateur lors de ses interactions avec un environnement virtuel. Nous avons réalisé pour cela quatre études expérimentales avec quatre environnements différents. Nous avons montré que ces mesures peuvent être réalisées en utilisant différents capteurs physiologiques. Nous avons aussi montré qu’il est possible de prédire la tendance de l’excitation (un état mental) à partir d’un traceur de regard. Dans une deuxième partie, nous présentons l’Agent Neural qui modifie les environnements virtuels afin de provoquer une modification de l’état émotionnel d’un utilisateur pour améliorer son état cognitif. Nous avons réalisé quatre études expérimentales avec quatre environnements virtuels, où l’Agent Neural intervient dans ces environnements afin de changer l’état émotionnel de l’utilisateur. Nous avons montré que l’agent est capable d’intervenir dans plusieurs types d’environnements et de modifier les émotions de l’utilisateur. Dans une troisième partie, présentons l’Agent Limbique, qui personnalise et améliore les adaptations faites par l’Agent Neural à travers l’observation et l’apprentissage des impacts des changements des environnements virtuels et des réactions émotionnelles des utilisateurs. Nous avons montré que cet agent est capable d’analyser les interventions de l’Agent Neural et de les modifier. Nous avons montré aussi que l’Agent Limbique est capable de générer une nouvelle règle d’intervention et de prédire son impact sur l’utilisateur. La combinaison du Module de mesures, de l’Agent Neural, et de l’Agent Limbique, nous a permis de créer un système de contrôle cognitif intelligent que nous avons appelé Système Limbique Digital.The human’s emotions change regularly and sometimes suddenly leading to changes in their mental state which is the brain’s ability to function normally. This mental state’s changes affect the users’ cognitive ability (or cognitive state) to reason, access memory, or make inferences, which varies depending on the mental state. Consequently, this affects the users’ performances which varies according to their cognitive states. This thesis aims to optimize the users’ cognitive state during their interactions with a virtual environment. Since this state depends on emotions, optimization of cognitive state can be achieved through the optimization of emotions and in particular the reduction of negative emotions. In a first part, we present the means of measuring in real time (using a Measuring module) the users’ emotional and mental state during their interactions with a virtual environment. We performed four experimental studies with four different environments. We have shown that these measurements can be performed using different physiological sensors. We have also shown that it is possible to predict the tendency of excitement (a mental state) using an eye tracker. In a second part, we present the Neural Agent which modifies virtual environments to provoke a modification on the users’ emotional state in order to improve their cognitive state. We performed four experimental studies with four virtual environments, in which the Neural Agent intervenes in these environments to change the users’ emotional state. We have shown that the agent is able to intervene in several types of environments and able to modify the users’ emotions. In a third part, we present the Limbic Agent, which personalizes and improves the adaptations performed by the Neural Agent through the observation and the learning from the virtual environments changes’ impacts and the users’ emotional reactions. We have shown that this agent is able to analyze the Neural Agent’s interventions and able to modify them. We have also shown that the Limbic Agent is able to generate a new intervention rule and predict its impact on the user. The combination of the Measuring Module, the Neural Agent, and the Limbic Agent, allowed us to create an intelligent cognitive control system that we called the Digital Limbic System

A Ludic Generation: Bridging Architecture, Games, and Technology for More Playful Spaces

In a world dominated by mundane environments, this thesis proposes a novel approach to designing public spaces that integrate game design principles and extended reality technology. By embracing the inherent ludic behavior found in human nature and games, I aim to elevate everyday experiences. This research delves into the capabilities of extended reality technology, psychology of play and its cultural and societal background, psychology of human archetypes, and game design components as an extraction for architectural typologies. Key findings reveal that by analyzing game components, design languages are formed and can be used to develop feasible architectural typologies. The significance of ephemerality in architecture is also revealed as a mirroring concept for the need of frequent updates in games to maintain stimulation. There must also be an emphasis on understanding that typical space users may have different emotions and tendencies compared to game users, and thus, spaces must be designed to coexist harmoniously with their users

Measuring Fun: A Case Study in Adapting to the Evolving Metrics of Player Experience

The gaming industry and the concept of gamification have altered the way many developers and users approach interactive products. As social gaming demographics expand to what was previously considered “casual” audiences, more users expect an enjoyable experience from their digital applications and games. Developers now request more detailed subjective descriptions of satisfaction and the player experience from user-experience (UX) practitioners. Focusing on how fun a product is for users/players requires subjective, situationally dependent metrics rather than traditional UX efficiency metrics. The UX discipline is still constructing a comprehensive ecology of the player experience and how to measure it. This article contributes to that ecology by detailing a case in which our team conducted a usability test on a new video game peripheral. Our client’s primary concern dealt with how fun experienced gamers found the device. As our test progressed, we encountered a number of fun-related participant behaviors that led us to develop new metrics beyond our initial planned metrics. These new metrics helped us and our client better define and discuss enjoyability. Our case, in conjunction with a detailed definition and review of player experience and UX scholarship, shows the importance of adopting metrics contextually specific to the video-game product and player group when measuring fun is the primary goal

Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion

Virtual Reality Methods

ePDF and ePUB available Open Access under CC-BY-NC-ND licence. Since the mid-2010s, virtual reality (VR) technology has advanced rapidly. This book explores the many opportunities that VR can offer for humanities and social sciences researchers. The book provides a user-friendly, non-technical methods guide to using ready-made VR content and 360° video as well as creating custom materials. It examines the advantages and disadvantages of different approaches to using VR, providing helpful, real-world examples of how researchers have used the technology

An Immersive Learning Model

Our overarching goal is to provide children with immersive game-based learning environments to support Arabic linguistic skills acquisition. We postulate that immersion in- creases learning. To investigate this hypothesis, we developed a model and built an implementation of an educational virtual environment (EVE) that supports immersion and thus, induces effective learning. Experimental results confirm our hypothesis. Our model integrates learning content, learning activities, immersion and gameplay. Based on our analysis of various curricula, specifically the United Arab Emirates grade one curriculum, we identified the nature of the learning content in order to satisfy the curriculum requirements. This content is conceptually structured to support gradual and independent learning. Acquiring knowledge from the learning content involves a learning process that we operationalize as a set of well-defined cognitive activities, which are categorized as perception, recognition, association, composition and recall. Accordingly, gameplay events and actions are designed to afford and instantiate these activities to engage the learner. Besides gameplay, engagement is explicitly addressed by modeling immersion using three different dimensions (sensory, imaginative and challenge-based). Our implementation is a 3D virtual reality game that captures various learning environments, each of which provides adventure, exploration, and learning. The gameplay engages players into learning activities that stimulate their senses, challenges them, and keep them absorbed in their quests. The implemented system runs on PC’s with Oculus and on smart phones with virtual glasses. These configurations were used in experiments in the lab- oratory, at a primary school, and in informal settings to measure immersion and learning. Results show that our model contributes effectively to immersion and learning

"Viesti Venuksesta / Message from Venus" – Creating new kind of game concept with emphasis on experience design

The games offer, or actually ultimately, they are experiences. These experiences can be directly, as well as indirectly, crafted by the game designer. How can the various design principles, especially the experience design principles, be used to create exceptional game experiences? I look into the ways of telling meaningful stories and to the methods for creating emotional experiences. But before that, the attributes for, and the affects to an experience needed to be thought out. As part of this Thesis, I present my unique game concept Message from Venus and explain the basis for its design and describe the design journey. I discuss my use of the previously studied tools, methods and principles. I ended up developing my own experience design principles, that combines and enhances the existing ones. I map the experience goals for my game, and think of ways to reach these goals. Also, after comparing three existing analysing frameworks, I created my own analysing framework to break my game down into pieces, so that I could perform a thorough analysis of it