Embodied Robot Models for Interdisciplinary Emotion Research

Due to their complex nature, emotions cannot be properly understood from the perspective of a single discipline. In this paper, I discuss how the use of robots as models is beneficial for interdisciplinary emotion research. Addressing this issue through the lens of my own research, I focus on a critical analysis of embodied robots models of different aspects of emotion, relate them to theories in psychology and neuroscience, and provide representative examples. I discuss concrete ways in which embodied robot models can be used to carry out interdisciplinary emotion research, assessing their contributions: as hypothetical models, and as operational models of specific emotional phenomena, of general emotion principles, and of specific emotion ``dimensions''. I conclude by discussing the advantages of using embodied robot models over other models.Peer reviewe

A Hormone-Driven Epigenetic Mechanism for Adaptation in Autonomous Robots

Different epigenetic mechanisms provide biological organisms with the ability to adjust their physiology and/or morphology and adapt to a wide range of challenges posed by their environments. In particular, one type of epigenetic process, in which hormone concentrations are linked to the regulation of hormone receptors, has been shown to have implications for behavioral development. In this paper, taking inspiration from these biological processes, we investigate whether an epigenetic model based on the concept of hormonal regulation of receptors can provide a similarly robust and general adaptive mechanism for autonomous robots. We have implemented our model using a Koala robot, and tested it in a series of experiments in six different environments with varying challenges to negotiate. Our results, including the emergence of varied behaviors that permit the robot to exploit its current environment, demonstrate the potential of our epigenetic model as a general mechanism for adaptation in autonomous robots.Peer reviewe

Hormonal Modulation of Developmental Plasticity in an Epigenetic Robot

In autonomous robotics, there is still a trend to develop and tune controllers with highly explicit goals and environments in mind. However, this tuning means that these robotic models often lack the developmental and behavioral flexibility seen in biological organisms. The lack of flexibility in these controllers leaves the robot vulnerable to changes in environmental condition. Whereby any environmental change may lead to the behaviors of the robots becoming unsuitable or even dangerous. In this manuscript we look at a potential biologically plausible mechanism which may be used in robotic controllers in order to allow them to adapt to different environments. This mechanism consists of a hormone driven epigenetic mechanism which regulates a robot’s internal environment in relation to its current environmental conditions. As we will show in our early chapters, this epigenetic mechanism allows an autonomous robot to rapidly adapt to a range of different environmental conditions. This adaption is achieved without the need for any explicit knowledge of the environment. Allowing a single architecture to adapt to a range of challenges and develop unique behaviors. In later chapters however, we find that this mechanism not only allows for regulation of short term behavior, but also long development. Here we show how this system permits a robot to develop in a way that is suitable for its current environment. Further during this developmental process we notice similarities to infant development, along with acquisition of unplanned skills and abilities. The unplanned developments appears to leads to the emergence of unplanned potential cognitive abilities such as object permanence, which we assess using a range of different real world tests

Epigenetic adaptation in action selection environments with temporal dynamics

John Lones, Lola Canamero, and Andrew Lewis, 'Epigenetic adaptation in action selection environments with temporal dynamics' in Pietro Lio, et al, eds., Advances in Artificial Life ECAL 2013, Proceedings of the twelfth European conference on the synthesis and simulation of living systems, (Massachussetts: MIT, 2013), available at doi: 10.7551/978-0-262-31709-2-ch073. This is an open access publication under the CC Attribution-NonCommercial-NoDerivs 3.0 United States license. http://creativecommons.org/licenses/by/nc/nd/3.0/us/. You are free to share - to copy, distribute and transmit the work under the following conditions: Attribution: You must attribute the work in the manner specified by the author or licensor; Noncommercial: You may not use this work for commercial purposes; No Derivative Works: You may not alter, transform, or build upon this work.To operate in dynamic environments robots must be able to adapt their behaviour to meet the challenges that these pose while being constrained by their physical and computational limitation. In this paper we continue our study into using biologically inspired epigenetic adaptation through hormone modulation as a way to accommodate the needed flexibility in robots’ behaviour, focusing on problems of temporal dynamics. We have specifically framed our study in three variants of dynamic three-resource action selection environment. The challenges posed by these environments include: moving resources, temporal and increasing unavailability of resources, and cyclic changes in type and availability of resources related to cyclic environmental changes

The Long-Term Efficacy of “Social Buffering” in Artificial Social Agents: Contextual Affective Perception Matters

© 2022 Khan and Cañamero. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). https://creativecommons.org/licenses/by/4.0/In dynamic (social) environments, an affective state of “stress” can be adaptive and promote agent wellbeing, but maladaptive if not appropriately regulated. The presence of (and interactions with) affect-based social support has been hypothesised to provide mechanisms to regulate stress (the “social buffering” hypothesis), though the precise, underlying mechanisms are still unclear. However, the hormone oxytocin has been implicated in mediating these effects in at least two ways: by improving social appraisals and reducing the short-term release of stress hormones (i.e., cortisol), and adapting an agent’s long-term stress tolerance. These effects likely facilitate an agent’s long-term adaptive ability by grounding their physiological and behavioural adaptation in the (affective) social environment, though these effects also appear to be context-dependent. In this paper, we investigate whether two of the hypothesised hormonal mechanisms that underpin the “social buffering” phenomenon affect the long-term wellbeing of (artificial) social agents who share affective social bonds, across numerous social and physical environmental contexts. Building on previous findings, we hypothesise that “social buffering” effects can improve the long-term wellbeing of agents who share affective social bonds in dynamic environments, through regular prosocial interactions with social bond partners. We model some of the effects associated with oxytocin and cortisol that underpin these hypothesised mechanisms in our biologically-inspired, socially-adaptive agent model, and conduct our investigation in a small society of artificial agents whose goal is to survive in challenging environments. Our results find that, while stress can be adaptive and regulated through affective social support, long-term behavioural and physiological adaptation is determined by the contextual perception of affective social bonds, which is influenced by early-stage interactions between affective social bond partners as well as the degree of the physical and social challenges. We also show how these low-level effects associated with oxytocin and cortisol can be used as “biomarkers” of social support and environmental stress. For socially-situated artificial agents, we suggest that these “social buffering” mechanisms can adapt the (adaptive) stress mechanisms, but that the long-term efficacy of this adaptation is related to the temporal dynamics of social interactions and the contextual perception of the affective social and physical environments.Peer reviewe

Hedonic Quality or Reward? A Study of Basic Pleasure in Homeostasis and Decision Making of a Motivated Autonomous Robot

© The Author (s) 2016. Published by SAGE. This is an Open Access article distributed under the terms of the Creative Commons Attribution 3.0 License (http://www.creativecommons.org/licenses/by/3.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).We present a robot architecture and experiments to investigate some of the roles that pleasure plays in the decision making (action selection) process of an autonomous robot that must survive in its environment. We have conducted three sets of experiments to assess the effect of different types of pleasure---related versus unrelated to the satisfaction of physiological needs---under different environmental circumstances. Our results indicate that pleasure, including pleasure unrelated to need satisfaction, has value for homeostatic management in terms of improved viability and increased flexibility in adaptive behavior.Peer reviewedFinal Published versio

A C.elegans inspired robotic model for pothole detection

Animals navigate complex and variable environments, but often use only limited sensory information. Here we present a simulated robot system using a C. elegans inspired sensory model and navigation strategy and demonstrate its ability to successfully identify specific, discretely located cues. We show a range of conditions under which this approach has performance benefits over other search strategies

Emotion in Future Intelligent Machines

Over the past decades, research in cognitive and affective neuroscience has emphasized that emotion is crucial for human intelligence and in fact inseparable from cognition. Concurrently, there has been a significantly growing interest in simulating and modeling emotion in robots and artificial agents. Yet, existing models of emotion and their integration in cognitive architectures remain quite limited and frequently disconnected from neuroscientific evidence. We argue that a stronger integration of emotion in robot models is critical for the design of intelligent machines capable of tackling real world problems. Drawing from current neuroscientific knowledge, we provide a set of guidelines for future research in artificial emotion and intelligent machines more generally

A systematic literature review of decision-making and control systems for autonomous and social robots

In the last years, considerable research has been carried out to develop robots that can improve our quality of life during tedious and challenging tasks. In these contexts, robots operating without human supervision open many possibilities to assist people in their daily activities. When autonomous robots collaborate with humans, social skills are necessary for adequate communication and cooperation. Considering these facts, endowing autonomous and social robots with decision-making and control models is critical for appropriately fulfiling their initial goals. This manuscript presents a systematic review of the evolution of decision-making systems and control architectures for autonomous and social robots in the last three decades. These architectures have been incorporating new methods based on biologically inspired models and Machine Learning to enhance these systems’ possibilities to developed societies. The review explores the most novel advances in each application area, comparing their most essential features. Additionally, we describe the current challenges of software architecture devoted to action selection, an analysis not provided in similar reviews of behavioural models for autonomous and social robots. Finally, we present the future directions that these systems can take in the future.The research leading to these results has received funding from the projects: Robots Sociales para Estimulación Física, Cognitiva y Afectiva de Mayores (ROSES), RTI2018-096338-B-I00, funded by the Ministerio de Ciencia, Innovación y Universidades; Robots sociales para mitigar la soledad y el aislamiento en mayores (SOROLI), PID2021-123941OA-I00, funded by Agencia Estatal de Investigación (AEI), Spanish Ministerio de Ciencia e Innovación. This publication is part of the R&D&I project PLEC2021-007819 funded by MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR

Autonomous Decision-Making based on Biological Adaptive Processes for Intelligent Social Robots

Mención Internacional en el título de doctorThe unceasing development of autonomous robots in many different scenarios drives a new revolution to improve our quality of life. Recent advances in human-robot interaction and machine learning extend robots to social scenarios, where these systems pretend to assist humans in diverse tasks. Thus, social robots are nowadays becoming real in many applications like education, healthcare, entertainment, or assistance. Complex environments demand that social robots present adaptive mechanisms to overcome different situations and successfully execute their tasks. Thus, considering the previous ideas, making autonomous and appropriate decisions is essential to exhibit reasonable behaviour and operate well in dynamic scenarios. Decision-making systems provide artificial agents with the capacity of making decisions about how to behave depending on input information from the environment. In the last decades, human decision-making has served researchers as an inspiration to endow robots with similar deliberation. Especially in social robotics, where people expect to interact with machines with human-like capabilities, biologically inspired decisionmaking systems have demonstrated great potential and interest. Thereby, it is expected that these systems will continue providing a solid biological background and improve the naturalness of the human-robot interaction, usability, and the acceptance of social robots in the following years. This thesis presents a decision-making system for social robots acting in healthcare, entertainment, and assistance with autonomous behaviour. The system’s goal is to provide robots with natural and fluid human-robot interaction during the realisation of their tasks. The decision-making system integrates into an already existing software architecture with different modules that manage human-robot interaction, perception, or expressiveness. Inside this architecture, the decision-making system decides which behaviour the robot has to execute after evaluating information received from different modules in the architecture. These modules provide structured data about planned activities, perceptions, and artificial biological processes that evolve with time that are the basis for natural behaviour. The natural behaviour of the robot comes from the evolution of biological variables that emulate biological processes occurring in humans. We also propose a Motivational model, a module that emulates biological processes in humans for generating an artificial physiological and psychological state that influences the robot’s decision-making. These processes emulate the natural biological rhythms of the human organism to produce biologically inspired decisions that improve the naturalness exhibited by the robot during human-robot interactions. The robot’s decisions also depend on what the robot perceives from the environment, planned events listed in the robot’s agenda, and the unique features of the user interacting with the robot. The robot’s decisions depend on many internal and external factors that influence how the robot behaves. Users are the most critical stimuli the robot perceives since they are the cornerstone of interaction. Social robots have to focus on assisting people in their daily tasks, considering that each person has different features and preferences. Thus, a robot devised for social interaction has to adapt its decisions to people that aim at interacting with it. The first step towards adapting to different users is identifying the user it interacts with. Then, it has to gather as much information as possible and personalise the interaction. The information about each user has to be actively updated if necessary since outdated information may lead the user to refuse the robot. Considering these facts, this work tackles the user adaptation in three different ways. • The robot incorporates user profiling methods to continuously gather information from the user using direct and indirect feedback methods. • The robot has a Preference Learning System that predicts and adjusts the user’s preferences to the robot’s activities during the interaction. • An Action-based Learning System grounded on Reinforcement Learning is introduced as the origin of motivated behaviour. The functionalities mentioned above define the inputs received by the decisionmaking system for adapting its behaviour. Our decision-making system has been designed for being integrated into different robotic platforms due to its flexibility and modularity. Finally, we carried out several experiments to evaluate the architecture’s functionalities during real human-robot interaction scenarios. In these experiments, we assessed: • How to endow social robots with adaptive affective mechanisms to overcome interaction limitations. • Active user profiling using face recognition and human-robot interaction. • A Preference Learning System we designed to predict and adapt the user preferences towards the robot’s entertainment activities for adapting the interaction. • A Behaviour-based Reinforcement Learning System that allows the robot to learn the effects of its actions to behave appropriately in each situation. • The biologically inspired robot behaviour using emulated biological processes and how the robot creates social bonds with each user. • The robot’s expressiveness in affect (emotion and mood) and autonomic functions such as heart rate or blinking frequency.Programa de Doctorado en Ingeniería Eléctrica, Electrónica y Automática por la Universidad Carlos III de MadridPresidente: Richard J. Duro Fernández.- Secretaria: Concepción Alicia Monje Micharet.- Vocal: Silvia Ross