ASSESSING GAMEPLAY EMOTIONS FROM PHYSIOLOGICAL SIGNALS: A FUZZY DECISION TREES BASED MODEL

International audienceAs video games become a widespread form of entertainment, there is need to develop new evaluative methodologies for acknowledging the various aspects of the player's subjective experience, and especially the emotional aspect. Video game developers could benefit from being aware of how the player reacts emotionally to specific game parameters. In this study, we addressed the possibility to record physiological measures on players involved in an action game, with the main objective of developing adequate models to describe emotional states. Our goal was to estimate the emotional state of the player from physiological signals so as to relate these variations of the autonomic nervous system to the specific game narratives. To achieve this, we developed a fuzzy set theory based model to recognize various episodes of the game from the user's physiological signals. We used fuzzy decision trees to generate the rules that map these signals to game episodes characterized by a variation of challenge at stake. A specific advantage to our approach is that we automatically recognize game episodes from physiological signals with explicitly defined rules relating the signals to episodes in a continuous scale. We compare our results with the actual game statistics information associated with the game episode

Assessing Gameplay Emotions from physiological signals: a fuzzy decision trees based model

Paper presented at INTERNATIONAL CONFERENCE ON KANSEI ENGINEERING AND EMOTION RESEARCH 2010, KEER2010, PARIS | MARCH 2-4 2010As video games become a widespread form of entertainment, there is need to develop new evaluative methodologies for acknowledging the various aspects of the player’s subjective experience, and especially the emotional aspect. Video game developers could benefit from being aware of how the player reacts emotionally to specific game parameters. In this study, we addressed the possibility to record physiological measures on players involved in an action game, with the main objective of developing adequate models to describe emotional states. Our goal was to estimate the emotional state of the player from physiological signals so as to relate these variations of the autonomic nervous system to the specific game narratives. To achieve this, we developed a fuzzy set theory based model to recognize various episodes of the game from the user’s physiological signals. We used fuzzy decision trees to generate the rules that map these signals to game episodes characterized by a variation of challenge at stake. A specific advantage to our approach is that we automatically recognize game episodes from physiological signals with explicitly defined rules relating the signals to episodes in a continuous scale. We compare our results with the actual game statistics information associated with the game episodes.As video games become a widespread form of entertainment, there is need to develop new evaluative methodologies for acknowledging the various aspects of the player’s subjective experience, and especially the emotional aspect. Video game developers could benefit from being aware of how the player reacts emotionally to specific game parameters. In this study, we addressed the possibility to record physiological measures on players involved in an action game, with the main objective of developing adequate models to describe emotional states. Our goal was to estimate the emotional state of the player from physiological signals so as to relate these variations of the autonomic nervous system to the specific game narratives. To achieve this, we developed a fuzzy set theory based model to recognize various episodes of the game from the user’s physiological signals. We used fuzzy decision trees to generate the rules that map these signals to game episodes characterized by a variation of challenge at stake. A specific advantage to our approach is that we automatically recognize game episodes from physiological signals with explicitly defined rules relating the signals to episodes in a continuous scale. We compare our results with the actual game statistics information associated with the game episodes

'The emotional wardrobe': a fashion perspective on the integration of technology and clothing

Since the Industrial Revolution, fashion and technology have been linked through the textile and manufacturing industries, a relationship that has propelled technical innovation and aesthetic and social change. Today a new alliance is emerging through the integration of electronic technology and smart materials on the body. However, it is not fashion designers who are exploiting this emerging area but interaction design, performance art and electronic and computing technologists. 'The Emotional Wardrobe' is a practice-based research project that seeks to address this imbalance by integrating technology with clothing from a fashion perspective. It aims to enhance fashion's expressive and responsive potential by investigating clothing that can both represent and stimulate an emotional response through the interface of technology. Precedents can be found in the work of other practitioners who merge clothing design with responsive material technology to explore social interaction, social commentary and body responsive technology. Influence is also sought from designers who investigate the notion of paradoxical emotions. A survey of emotion science, emotional design, and affective computing is mapped onto a fashion design structure to assess if this fusion can create new 'poetic' paradigms for the interaction of fashion and technology. These models are explored through the production of 'worn' and 'unworn' case studies which are visualised through responsive garment prototypes and multimedia representations. The marriage of fashion and technology is tested through a series of material experiments that aim to create a new aesthetic vocabulary that is responsive and emotional. They integrate traditional fashion fabrics with material technology to enhance the definition of fashion. The study shows that the merger of fashion and technology can offer a more personal and provocative definition of self, one which actively involves the wearer in a mutable aesthetic identity, replacing the fixed physicality of fashion with a constant flux of self-expression and playful psychological experience. The contribution of the research consists of: the integration of technology to alter communication in fashion, a recontextualisation of fashion within a wider arena of emotion and technology, the use of technologies from other disciplines to materialize ideas and broaden the application of those technologies, and the articulation of a fashion design methodology

Characterizing player’s experience from physiological signals using fuzzy decision trees

Author manuscript, published in "IEEE Conference on Computational Intelligence and Games (CIG) 2010, Copenhagen : Denmark (2010)"In the recent years video games have enjoyed a dramatic increase in popularity, the growing market being echoed by a genuine interest in the academic field. With this flourishing technological and theoretical efforts, there is need to develop new evaluative methodologies for acknowledging the various aspects of the player’s subjective experience, and especially the emotional aspect. In this study, we addressed the possibility of developing a model for assessing the player’s enjoyment (amusement) with respect to challenge in an action game. Our aim was to explore the viability of a generic model for assessing emotional experience during gameplay from physiological signals. In particular, we propose an approach to characterize the player’s subjective experience in different psychological levels of enjoyment from physiological signals using fuzzy decision trees.In the recent years video games have enjoyed a dramatic increase in popularity, the growing market being echoed by a genuine interest in the academic field. With this flourishing technological and theoretical efforts, there is need to develop new evaluative methodologies for acknowledging the various aspects of the player’s subjective experience, and especially the emotional aspect. In this study, we addressed the possibility of developing a model for assessing the player’s enjoyment (amusement) with respect to challenge in an action game. Our aim was to explore the viability of a generic model for assessing emotional experience during gameplay from physiological signals. In particular, we propose an approach to characterize the player’s subjective experience in different psychological levels of enjoyment from physiological signals using fuzzy decision trees

: Rapport final du projet ANR 2006-2008 (annexes scientifiques)

As a 24 months platform project, Lutin Game Lab was designed for making academic researchers and game companies cooperate in order to reach a new stage in the process of game quality assessment, before and after they are available on the market. The project was organized along 6 WP, all of them having fulfilled their specific goals, although we had to endure some delays due to the time required for settling the technical platform and due to the lack of time available for the companies to collaborate during the year 2008.The project results can be summed up in 4 different aspects:* A platform is now open to companies as well as to academic labs, equipped with all the devices and the softwares needed for conducting evaluation of gamers behaviour, including all game platforms, excepted for on-line games. Two eye-tracking devices and sensorial analysis tools are part of the equipment of the platform. This technical platform is operated by the UMS CNRS Lutin at the Cité des Sciences in Paris.* The methods created for analyzing the existing games and the ones in development phase were scientifically validated and adapted to the requirements of companies (time needed, display of the results, prerequisites and modes of cooperation with developers). These methods have not yet been tested in the developing phase of real games except for one of them (QRC), due to the workload of developers during this period. * The methods are the following:o Artificial expert for the prediction of gamers judgments based on a description framework of game properties. A subjective evaluation database has been designed using the data collected during the tests of 240 gamers (experts and naives) expressing judgments in a 11 items questionnaire, using the data from an objective description of game properties and the data obtained through an "objectivated subjective" description of games qualities retrieved from experts who designed and filled up a framework of 56 items per game genre (126 iterations). This expert allows companies to test their games while they are still in the design phase through the description framework in order to predict the judgments from the gamers and to optimize their various choices in game design using the 15 fuzzy models selected for each game genre.o Usability testing method adapted specifically to videogames (Quick Reality Check, QRC), based on a test protocol involving 10 gamers, on logs tracking the gamer behaviour (implemented by the developers in their prototype), on synthetic visualization tools displaying the results, and on remediation method in cooperation with game designers (game doctor). This method focuses on ergonomics features and acceptability issues.o An eyetracking method dedicated to gamers behaviour analysis. It helps to explore in-depth the areas or phases of concern discovered with the previous method. This allows the game designers to reshape some features in the interfaces and to compare their results with the patterns of each game genre that the research was able to modelize.o A method for tracking emotional states during the game, through sensors placed on the gamers bodies, in order to explore and better understand the reasons of the problems pointed out by the other methods. This is a much more innovative methodology and field of research and this explains the need for focusing on specific features in order to validate the whole framework with the existing scientific state of the art. This is a very promising field and a very attractive one for the game designers, one that would require much more research efforts.o An artificial expert providing diagnosis through the gathering of every piece of data collected during the various tests, with added results from on line questionnaires. The expert software provides an integrative view of the results for a specific game and can refer it to the various models available in the literature.* In the gameplay evaluation field, the project evolves from a review of literature to the design of a wiki open to the community of game designers, which aim is to create de knowledge database about gameplay qualities for each game genre. The wiki includes a list of rules shared by the community and examples of games displaying the uses of these rules, extracted from a corpus of the most famous games. The database can be enriched with new cases, rules can be adapted, through the revision process of the wiki which includes collective validation. Developers can access the wiki as a resource for validation of their choices.In brief, the platform offers a set of devices, a set of methods, available for the game industry, operated by Lutin experts, and a website including the wiki. Lutin Game lab platform represents an European reference center in the field of game evaluation. Lutin plans to design a quality label for games that could be used before the games are placed on the market. LUtin Game Lab requires a new research project devoted to the extension of the methods to on-line games (Lutin Game Lab on line). The next year will be devoted to dissemination and validation on real game being developed.Le projet annonçait ainsi ses objectifs en 2006 : " Lutin Game Lab, projet de plate-forme de 24 mois, se propose de fédérer les forces de recherche académiques et de développement des entreprises pour faire faire un pas significatif aux méthodologies d'évaluation de la qualité d'un jeu vidéo fini ou en cours de développement. " Le travail a comporté 6 sous -projets qui ont tous été menés à bien conformément au programme prévu avec des décalages non négligeables dus notamment au temps nécessaire au montage technique de la plate-forme et à la difficulté des entreprises à dégager du temps pour leur collaboration au moment voulu alors qu'elles sont sous haute pression concurrentielle. Le bilan du projet peut se résumer en 4 points : * il existe désormais en France une plate-forme ouverte aux entreprises et aux laboratoires, équipée de tous les matériels et logiciels nécessaires pour faire l'évaluation des comportements des joueurs de jeux vidéo, toutes plates-formes de jeu confondus, à l'exception des jeux multi joueurs en ligne. Cette plate-forme technique, comportant notamment des dispositifs d'oculométrie opérationnels de divers types, et des dispositifs d'analyse sensorielle, est opérationnelle en permanence dans le cadre des missions de l'UMS CNRS Lutin 2803 à la Cité des Sciences. * Les méthodes élaborées pour l'analyse des jeux existants et des jeux en cours de développement ont été validées scientifiquement et opérationnellement selon les critères des entreprises de jeux vidéo (délais, présentation des résultats, prérequis et formes de coopération). Ces méthodes devront cependant être validées en situation de jeux en cours de développement car les délais de coopération avec les entreprises n'ont permis de mettre en œuvre cette étape que pour une seule de ces méthodes (dite QRC)* Les méthodes comportent 5 volets : o un expert artificiel prédictif qui permet de prédire l'appréciation subjective des joueurs à partir d'une description formalisée des propriétés d'un jeu. Une base de données d'évaluation subjective a été constituée à partir de tests réalisés par 240 joueurs de tous niveaux et de leur appréciation subjective (11 items), à partir de description des propriétés objectives du jeu (106 items) et à partir d'une description subjective objectivée des qualités d'un jeu par genre (56 items par genre de jeu) et de 126 itérations de cette grille réalisée à partir d'une extraction d'expertise auprès de game designers et élèves game designers. Il est proposé aux entreprises de jeux vidéo de tester leur jeu dans une phase amont du développement pour prédire les scores de leurs jeux et ensuite optimiser les choix effectués, en exploitant les 15 modèles en logique floue sélectionnés pour chaque genre de jeu. o Une méthode en usability (Quick Reality Check) qui comporte un protocole de tests auprès de 10 joueurs minimum, des outils de suivi des déplacements par implantation de logs dans le jeu en cours de développement, de modes de visualisation synthétique des résultats et une méthode de correction associant les développeurs (Game Doctor). Cette méthode traite avant tout les questions d'ergonomie et d'acceptabilité. o Une méthode de suivi du regard des joueurs permettant d'affiner les résultats de la méthode précédente, sur des zones ou des phases problématiques pour repositionner le game design et l'ergonomie en fonction des patterns, ou signatures, identifiés par la recherche pour chaque type de jeux. o Une méthode de suivi de l'engagement émotionnel durant le jeu à partir de capteurs d'analyse sensorielle placés sur les joueurs, permettant là aussi d'affiner la recherche éventuelle de problèmes pour des phases plus précises selon les stratégies du game designer. Cette méthode est la plus innovante en termes de recherche et nos résultats restent donc limités à certains points précis qui sont cependant très prometteurs et nécessiteraient des travaux supplémentaires.o Un expert artificiel diagnostic permettant de traiter et de synthétiser toutes les données recueillies lors des tests des autres méthodes, de les compléter par des questionnaires en ligne si nécessaire et de les rapporter à des modèles issus de la littérature pour proposer un diagnostic intégré sur les qualités d'un jeu donné. * Dans le domaine du gameplay, le projet a évolué à partir d'un recensement exhaustif de la littérature sur la mise en place d'un wiki permettant à toute la communauté des développeurs de constituer une base de connaissances partagées sur les qualités du gameplay selon les genres. Ce wiki comporte un énoncé de règles reconnues par la communauté mais aussi leur exemplification à partir d'un corpus de jeux parmi les plus connus dans tous les genres. La base peut être enrichie par d'autres études de cas, les règles peuvent être affinées, et les développeurs peuvent la consulter en tant que de besoin pour valider les choix qu'ils effectuent. La mise en place de la plate-forme comporte ainsi une partie d'équipements localisés à la cité des sciences, une expertise en méthodes, directement opérationnelles et proposées déjà aux entreprises par les différents partenaires membres de Lutin, et un site collaboratif qui rassemble la communauté autour de son expertise propre. Lutin Game Lab peut ainsi prétendre devenir un centre de références européen en termes de méthodes qualité pour les jeux vidéo et nous prévoyons de travailler à proposer un label pour qualifier les jeux vidéo avant leur mise sur le marché, ainsi qu'à une extension de ses compétences pour les jeux vidéo multi joueurs en ligne (Lutin Game Lab on line). Le projet a ainsi atteint son objectif général ainsi que ses objectifs particuliers, à l'exception du temps de validation encore nécessaire auprès des entreprises qui n'a pu être pris en compte durant le projet

An investigation into the use of AffectiveWare in interactive computer applications

Imperial Users onl

An investigation into the use of AffectiveWare in interactive computer applications

EThOS - Electronic Theses Online ServiceGBUnited Kingdo