Chaotic exploration and learning of locomotion behaviours

We present a general and fully dynamic neural system, which exploits intrinsic chaotic dynamics, for the real-time goal-directed exploration and learning of the possible locomotion patterns of an articulated robot of an arbitrary morphology in an unknown environment. The controller is modeled as a network of neural oscillators that are initially coupled only through physical embodiment, and goal-directed exploration of coordinated motor patterns is achieved by chaotic search using adaptive bifurcation. The phase space of the indirectly coupled neural-body-environment system contains multiple transient or permanent self-organized dynamics, each of which is a candidate for a locomotion behavior. The adaptive bifurcation enables the system orbit to wander through various phase-coordinated states, using its intrinsic chaotic dynamics as a driving force, and stabilizes on to one of the states matching the given goal criteria. In order to improve the sustainability of useful transient patterns, sensory homeostasis has been introduced, which results in an increased diversity of motor outputs, thus achieving multiscale exploration. A rhythmic pattern discovered by this process is memorized and sustained by changing the wiring between initially disconnected oscillators using an adaptive synchronization method. Our results show that the novel neurorobotic system is able to create and learn multiple locomotion behaviors for a wide range of body configurations and physical environments and can readapt in realtime after sustaining damage

Neuro-Controllers, scalability and adaptation

A Layered Evolution (LE) paradigm based method for the generation of a neuron-controller is developed and verified through simulations and experimentally. It is intended to solve scalability issues in systems with many behavioral modules. Each and every module is a genetically evolved neuro-controller specialized in performing a different task. The main goal is to reach a combination of different basic behavioral elements using different artificial neural-network paradigms concerning mobile robot navigation in an unknown environment. The obtained controller is evaluated over different scenarios in a structured environment, ranging from a detailed simulation model to a real experiment. Finally most important implies are shown through several focuses

Towards homeostatic architecture: simulation of the generative process of a termite mound construction

This report sets out to the theme of the generation of a ‘living’, homeostatic and self-organizing architectural structure. The main research question this project addresses is what innovative techniques of design, construction and materials could prospectively be developed and eventually applied to create and sustain human-made buildings which are mostly adaptive, self-controlled and self-functioning, without option to a vast supply of materials and peripheral services. The hypothesis is that through the implementation of the biological building behaviour of termites, in terms of collective construction mechanisms that are based on environmental stimuli, we could achieve a simulation of the generative process of their adaptive structures, capable to inform in many ways human construction. The essay explicates the development of the 3-dimensional, agent-based simulation of the termite collective construction and analyzes the results, which involve besides physical modelling of the evolved structures. It finally elucidates the potential of this emerging and adaptive architectural performance to be translated to human practice and thus enlighten new ecological engineering and design methodologies

Neuro-Controllers, scalability and adaptation

A Layered Evolution (LE) paradigm based method for the generation of a neuron-controller is developed and verified through simulations and experimentally. It is intended to solve scalability issues in systems with many behavioral modules. Each and every module is a genetically evolved neuro-controller specialized in performing a different task. The main goal is to reach a combination of different basic behavioral elements using different artificial neural-network paradigms concerning mobile robot navigation in an unknown environment. The obtained controller is evaluated over different scenarios in a structured environment, ranging from a detailed simulation model to a real experiment. Finally most important implies are shown through several focuses.Red de Universidades con Carreras en Informática (RedUNCI

What is Intrinsic Motivation? A Typology of Computational Approaches

Intrinsic motivation, centrally involved in spontaneous exploration and curiosity, is a crucial concept in developmental psychology. It has been argued to be a crucial mechanism for open-ended cognitive development in humans, and as such has gathered a growing interest from developmental roboticists in the recent years. The goal of this paper is threefold. First, it provides a synthesis of the different approaches of intrinsic motivation in psychology. Second, by interpreting these approaches in a computational reinforcement learning framework, we argue that they are not operational and even sometimes inconsistent. Third, we set the ground for a systematic operational study of intrinsic motivation by presenting a formal typology of possible computational approaches. This typology is partly based on existing computational models, but also presents new ways of conceptualizing intrinsic motivation. We argue that this kind of computational typology might be useful for opening new avenues for research both in psychology and developmental robotics

A systematic literature review of decision-making and control systems for autonomous and social robots

In the last years, considerable research has been carried out to develop robots that can improve our quality of life during tedious and challenging tasks. In these contexts, robots operating without human supervision open many possibilities to assist people in their daily activities. When autonomous robots collaborate with humans, social skills are necessary for adequate communication and cooperation. Considering these facts, endowing autonomous and social robots with decision-making and control models is critical for appropriately fulfiling their initial goals. This manuscript presents a systematic review of the evolution of decision-making systems and control architectures for autonomous and social robots in the last three decades. These architectures have been incorporating new methods based on biologically inspired models and Machine Learning to enhance these systems’ possibilities to developed societies. The review explores the most novel advances in each application area, comparing their most essential features. Additionally, we describe the current challenges of software architecture devoted to action selection, an analysis not provided in similar reviews of behavioural models for autonomous and social robots. Finally, we present the future directions that these systems can take in the future.The research leading to these results has received funding from the projects: Robots Sociales para Estimulación Física, Cognitiva y Afectiva de Mayores (ROSES), RTI2018-096338-B-I00, funded by the Ministerio de Ciencia, Innovación y Universidades; Robots sociales para mitigar la soledad y el aislamiento en mayores (SOROLI), PID2021-123941OA-I00, funded by Agencia Estatal de Investigación (AEI), Spanish Ministerio de Ciencia e Innovación. This publication is part of the R&D&I project PLEC2021-007819 funded by MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR

Hanging in there: Prenatal origins of antigravity homeostasis in humans

All life on Earth must find a way to manage the continuous perturbation of gravity. From birth, and even before, humans exhibit effortful antigravity work to enact bodily, postural and behavioural form despite gravity. Indeed, observable antigravity behaviour is a standard diagnostic indicator of neonatal sensorimotor health. Antigravity behaviour has been investigated extensively in its biomechanical details. Yet its motivational structure has not been a focus of research. What drives the human body to expend energy on this effortful behaviour? It is widely understood that thermic homeostasis in humans is organised around conserving core body temperature at a set-point of 36.5-37.5oC. There is currently no equivalent concept of a general homeostatic set-point driving antigravity effort. In this theoretical paper, we aim to establish such a concept. We make the case that the core developmental set-point for human antigravity homeostasis is neutral buoyancy (gravity and buoyant force are balanced), which is afforded to the foetus by its approximately equi-dense amniotic fluid medium in utero. We argue that postnatally, the general task of human antigravity balance is to emulate the conditions of neutral buoyancy, based upon prenatal experience thereof. Our aim in this paper is to sketch a high-level outline of a novel characterisation of antigravity balance as conservative homeostasis, and lay out some implications and predictions of this model, with the intention of spurring wider research and discussion on this hitherto little explored topic. Keywords: antigravity, posture, homeostasis, prenatal, buoyancy, density, fetus, foetusComment: 19 pages (including references) Zero figure

Emotion in Future Intelligent Machines

Over the past decades, research in cognitive and affective neuroscience has emphasized that emotion is crucial for human intelligence and in fact inseparable from cognition. Concurrently, there has been a significantly growing interest in simulating and modeling emotion in robots and artificial agents. Yet, existing models of emotion and their integration in cognitive architectures remain quite limited and frequently disconnected from neuroscientific evidence. We argue that a stronger integration of emotion in robot models is critical for the design of intelligent machines capable of tackling real world problems. Drawing from current neuroscientific knowledge, we provide a set of guidelines for future research in artificial emotion and intelligent machines more generally

Development of the huggable social robot Probo: on the conceptual design and software architecture

This dissertation presents the development of a huggable social robot named Probo. Probo embodies a stuffed imaginary animal, providing a soft touch and a huggable appearance. Probo's purpose is to serve as a multidisciplinary research platform for human-robot interaction focused on children. In terms of a social robot, Probo is classified as a social interface supporting non-verbal communication. Probo's social skills are thereby limited to a reactive level. To close the gap with higher levels of interaction, an innovative system for shared control with a human operator is introduced. The software architecture de nes a modular structure to incorporate all systems into a single control center. This control center is accompanied with a 3D virtual model of Probo, simulating all motions of the robot and providing a visual feedback to the operator. Additionally, the model allows us to advance on user-testing and evaluation of newly designed systems. The robot reacts on basic input stimuli that it perceives during interaction. The input stimuli, that can be referred to as low-level perceptions, are derived from vision analysis, audio analysis, touch analysis and object identification. The stimuli will influence the attention and homeostatic system, used to de ne the robot's point of attention, current emotional state and corresponding facial expression. The recognition of these facial expressions has been evaluated in various user-studies. To evaluate the collaboration of the software components, a social interactive game for children, Probogotchi, has been developed. To facilitate interaction with children, Probo has an identity and corresponding history. Safety is ensured through Probo's soft embodiment and intrinsic safe actuation systems. To convey the illusion of life in a robotic creature, tools for the creation and management of motion sequences are put into the hands of the operator. All motions generated from operator triggered systems are combined with the motions originating from the autonomous reactive systems. The resulting motion is subsequently smoothened and transmitted to the actuation systems. With future applications to come, Probo is an ideal platform to create a friendly companion for hospitalised children