Robot NAO used in therapy: Advanced design and evaluation

Treball de Final de Màster Universitari en Sistemes Intel·ligents. Codi: SIE043. Curs acadèmic 2013-2014Following with the previous work which we have done in the Final Research Project, we introduced a therapeutic application with social robotics to improve the positive mood in patients with fibromyalgia. Different works about therapeutic robotics, positive psychology, emotional intelligence, social learning and mood induction procedures (MIPs) are reviewed. Hardware and software requirements and system development are explained with detail. Conclusions about the clinical utility of these robots are disputed. Nowadays, experiments with real fibromyalgia patients are running, the methodology and procedures which take place in them are described in the future lines section of this work

A contribution to the incorporation of sociability and creativity skills to computers and robots

This dissertation contains the research and work completed by the PhD candidate on the incorporation of sociability and creativity skills to computers and robots. Both skills can be directly related with empathy, which is the ability to understand and share the feelings of another. In this form, this research can be contextualized in the framework of recent developments towards the achievement of empathy machines. The first challenge at hands refers to designing pioneering techniques based on the use of social robots to improve user experience interacting with them. In particular, research focus is on eliminating or minimizing pain and anxiety as well as loneliness and stress of long-term hospitalized child patients. This challenge is approached by developing a cloud-based robotics architecture to effectively develop complex tasks related to hospitalized children assistance. More specifically, a multiagent learning system is introduced based on a combination of machine learning and cloud computing using low-cost robots (Innvo labs's Pleo rb). Moreover, a wireless communication system is also developed for the Pleo robot in order to help the health professional who conducts therapy with the child, monitoring, understanding, and controlling Pleo behavior at any moment. As a second challenge, a new formulation of the concept of creativity is proposed in order to empower computers with. Based on previous well established theories from Boden and Wiggins, this thesis redefines the formal mechanism of exploratory and transformational creativity in a way which facilitates the computational implementation of these mechanisms in Creativity Support Systems. The proposed formalization is applied and validated on two real cases: the first, about chocolate designing, in which a novel and flavorful combination of chocolate and fruit is generated. The second case is about the composition of a single voice tune of reel using ABC notation.Postprint (published version

From Affect Theoretical Foundations to Computational Models of Intelligent Affective Agents

[EN] The links between emotions and rationality have been extensively studied and discussed. Several computational approaches have also been proposed to model these links. However, is it possible to build generic computational approaches and languages so that they can be "adapted " when a specific affective phenomenon is being modeled? Would these approaches be sufficiently and properly grounded? In this work, we want to provide the means for the development of these generic approaches and languages by making a horizontal analysis inspired by philosophical and psychological theories of the main affective phenomena that are traditionally studied. Unfortunately, not all the affective theories can be adapted to be used in computational models; therefore, it is necessary to perform an analysis of the most suitable theories. In this analysis, we identify and classify the main processes and concepts which can be used in a generic affective computational model, and we propose a theoretical framework that includes all these processes and concepts that a model of an affective agent with practical reasoning could use. Our generic theoretical framework supports incremental research whereby future proposals can improve previous ones. This framework also supports the evaluation of the coverage of current computational approaches according to the processes that are modeled and according to the integration of practical reasoning and affect-related issues. This framework is being used in the development of the GenIA(3) architecture.This work is partially supported by the Spanish Government projects PID2020-113416RB-I00, GVA-CEICE project PROMETEO/2018/002, and TAILOR, a project funded by EU Horizon 2020 research and innovation programme under GA No 952215.Alfonso, B.; Taverner-Aparicio, JJ.; Vivancos, E.; Botti, V. (2021). From Affect Theoretical Foundations to Computational Models of Intelligent Affective Agents. Applied Sciences. 11(22):1-29. https://doi.org/10.3390/app112210874S129112

A contribution to the incorporation of sociability and creativity skills to computers and robots

This dissertation contains the research and work completed by the PhD candidate on the incorporation of sociability and creativity skills to computers and robots. Both skills can be directly related with empathy, which is the ability to understand and share the feelings of another. In this form, this research can be contextualized in the framework of recent developments towards the achievement of empathy machines. The first challenge at hands refers to designing pioneering techniques based on the use of social robots to improve user experience interacting with them. In particular, research focus is on eliminating or minimizing pain and anxiety as well as loneliness and stress of long-term hospitalized child patients. This challenge is approached by developing a cloud-based robotics architecture to effectively develop complex tasks related to hospitalized children assistance. More specifically, a multiagent learning system is introduced based on a combination of machine learning and cloud computing using low-cost robots (Innvo labs's Pleo rb). Moreover, a wireless communication system is also developed for the Pleo robot in order to help the health professional who conducts therapy with the child, monitoring, understanding, and controlling Pleo behavior at any moment. As a second challenge, a new formulation of the concept of creativity is proposed in order to empower computers with. Based on previous well established theories from Boden and Wiggins, this thesis redefines the formal mechanism of exploratory and transformational creativity in a way which facilitates the computational implementation of these mechanisms in Creativity Support Systems. The proposed formalization is applied and validated on two real cases: the first, about chocolate designing, in which a novel and flavorful combination of chocolate and fruit is generated. The second case is about the composition of a single voice tune of reel using ABC notation

The exploration of unknown environments by affective agents

Tese de doutoramento em Engenharia Informática apresentada à Fac. de Ciências e Tecnologia de CoimbraIn this thesis, we study the problem of the exploration of unknown environments populated with entities by affective autonomous agents. The goal of these agents is twofold: (i) the acquisition of maps of the environment – metric maps – to be stored in memory, where the cells occupied by the entities that populate that environment are represented; (ii) the construction of models of those entities. We examine this problem through simulations because of the various advantages this approach offers, mainly efficiency, more control, and easy focus of the research. Furthermore, the simulation approach can be used because the simplifications that we made do not influence the value of the results. With this end, we have developed a framework to build multi-agent systems comprising affective agents and then, based on this platform, we developed an application for the exploration of unknown environments. This application is a simulated multi-agent environment in which, in addition to inanimate agents (objects), there are agents interacting in a simple way, whose goal is to explore the environment. By relying on an affective component plus ideas from the Belief-Desire-Intention model, our approach to building artificial agents is that of assigning agents mentalistic qualities such as feelings, basic desires, memory/beliefs, desires/goals, and intentions. The inclusion of affect in the agent architecture is supported by the psychological and neuroscience research over the past decades which suggests that emotions and, in general, motivations play a critical role in decision-making, action, and reasoning, by influencing a variety of cognitive processes (e.g., attention, perception, planning, etc.). Reflecting the primacy of those mentalistic qualities, the architecture of an agent includes the following modules: sensors, memory/beliefs (for entities - which comprises both analogical and propositional knowledge representations -, plans, and maps of the environment), desires/goals, intentions, basic desires (basic motivations/motives), feelings, and reasoning. The key components that determine the exhibition of the exploratory behaviour in an agent are the kind of basic desires, feelings, goals and plans with which the agent is equipped. Based on solid, psychological experimental evidence, an agent is equipped in advance with the basic desires for minimal hunger, maximal information gain (maximal reduction of curiosity), and maximal surprise, as well as with the correspondent feelings of hunger, curiosity and surprise. Each one of those basic desires drives the agent to reduce or to maximize a particular feeling. The desire for minimal hunger, maximal information gain and maximal surprise directs the agent, respectively, to reduce the feeling of hunger, to reduce the feeling of curiosity (by maximizing information gain) and to maximize the feeling of surprise. The desire to reduce curiosity does not mean that the agent dislike curiosity. Instead, it means the agent desires selecting actions whose execution maximizes the reduction of curiosity, i.e., actions that are preceded by maximal levels of curiosity and followed by minimal levels of curiosity, which corresponds to maximize information gain. The intensity of these feelings is, therefore, important to compute the degree of satisfaction of the basic desires. For the basic desires of minimal hunger and maximal surprise it is given by the expected intensities of the feelings of hunger and surprise, respectively, after performing an action, while for the desire of maximal information gain it is given by the intensity of the feeling of curiosity before performing the action (this is the expected information gain). The memory of an agent is setup with goals and decision-theoretic, hierarchical task-network plans for visiting entities that populate the environment, regions of the environment, and for going to places where the agent can recharge its battery. New goals are generated for each unvisited entity of the environment, for each place in the frontier of the explored area, and for recharging battery, by adapting past goals and plans to the current world state computed based on sensorial information and on the generation of expectations and assumptions for the gaps in the environment information provided by the sensors. These new goals and respective plans are then ranked according to their Expected Utility which reflects the positive and negative relevance for the basic desires of their accomplishment. The first one, i.e., the one with highest Expected Utility is taken as an intention. Besides evaluating the computational model of surprise, we experimentally investigated through simulations the following issues: the role of the exploration strategy (role of surprise, curiosity, and hunger), environment complexity, and amplitude of the visual field on the performance of the exploration of environments populated with entities; the role of the size or, to some extent, of the diversity of the memory of entities, and environment complexity on map-building by exploitation. The main results show that: the computational model of surprise is a satisfactory model of human surprise; the exploration of unknown environments populated with entities can be robustly and efficiently performed by affective agents (the strategies that rely on hunger combined or not with curiosity or surprise outperform significantly the others, being strong contenders to the classical strategy based on entropy and cost)

Human-AI Collaboration in Content Moderation: The Effects of Information Cues and Time Constraints

An extremely large amount of user-generated content is produced by users worldwide every day with the rapid development of online social media. Content moderation has emerged to ensure the quality of posts on various social media platforms. This process typically demands collaboration between humans and AI because of the complementarity of the two agents in different facets. Wondering how AI can better assist humans to make final judgment in the “machine-in-the-loop” paradigm, we propose a lab experiment to explore the influence of different types of cues provided by AI through a nudging approach as well as time constraints on human moderators’ performance. The proposed study contributes to the literature on the AI-assisted decision-making pattern, and helps social media platforms in creating an effective human-AI collaboration framework for content moderation

Encoding Theory of Mind in Character Design for Pedagogical Interactive Narrative

Computer aided interactive narrative allows people to participate actively in a dynamically unfolding story, by playing a character or by exerting directorial control. Because of its potential for providing interesting stories as well as allowing user interaction, interactive narrative has been recognized as a promising tool for providing both education and entertainment. This paper discusses the challenges in creating interactive narratives for pedagogical applications and how the challenges can be addressed by using agent-based technologies. We argue that a rich model of characters and in particular a Theory of Mind capacity are needed. The character architect in the Thespian framework for interactive narrative is presented as an example of how decision-theoretic agents can be used for encoding Theory of Mind and for creating pedagogical interactive narratives