A Situation-Aware Fear Learning (SAFEL) Model for Robots

This work proposes a novel Situation-Aware FEar Learning (SAFEL) model for robots. SAFEL combines concepts of situation-aware expert systems with well-known neuroscientific findings on the brain fear-learning mechanism to allow companion robots to predict undesirable or threatening situations based on past experiences. One of the main objectives is to allow robots to learn complex temporal patterns of sensed environmental stimuli and create a representation of these patterns. This memory can be later associated with a negative or positive “emotion”, analogous to fear and confidence. Experiments with a real robot demonstrated SAFEL’s success in generating contextual fear conditioning behaviour with predictive capabilities based on situational information

Robotic Trajectory Tracking: Position- and Force-Control

This thesis employs a bottom-up approach to develop robust and adaptive learning algorithms for trajectory tracking: position and torque control. In a first phase, the focus is put on the following of a freeform surface in a discontinuous manner. Next to resulting switching constraints, disturbances and uncertainties, the case of unknown robot models is addressed. In a second phase, once contact has been established between surface and end effector and the freeform path is followed, a desired force is applied. In order to react to changing circumstances, the manipulator needs to show the features of an intelligent agent, i.e. it needs to learn and adapt its behaviour based on a combination of a constant interaction with its environment and preprogramed goals or preferences. The robotic manipulator mimics the human behaviour based on bio-inspired algorithms. In this way it is taken advantage of the know-how and experience of human operators as their knowledge is translated in robot skills. A selection of promising concepts is explored, developed and combined to extend the application areas of robotic manipulators from monotonous, basic tasks in stiff environments to complex constrained processes. Conventional concepts (Sliding Mode Control, PID) are combined with bio-inspired learning (BELBIC, reinforcement based learning) for robust and adaptive control. Independence of robot parameters is guaranteed through approximated robot functions using a Neural Network with online update laws and model-free algorithms. The performance of the concepts is evaluated through simulations and experiments. In complex freeform trajectory tracking applications, excellent absolute mean position errors (<0.3 rad) are achieved. Position and torque control are combined in a parallel concept with minimized absolute mean torque errors (<0.1 Nm)

SAFEL - A Situation-aware Fear Learning Model

This thesis proposes a novel and robust online adaptation mechanism for threat prediction and prevention capable of taking into consideration complex contextual and temporal information in its internal learning processes. The proposed mechanism is a hybrid cognitive computational model named SAFEL (Situation-Aware FEar Learning), which integrates machine learning algorithms with concepts of situation-awareness from expert systems to simulate both the cued and contextual fear-conditioning phenomena. SAFEL is inspired by well-known neuroscience findings on the brain's mechanisms of fear learning and memory to provide autonomous robots with the ability to predict undesirable or threatening situations to themselves. SAFEL's ultimate goal is to allow autonomous robots to perceive intricate elements and relationships in their environment, learn with experience through autonomous environmental exploration, and adapt at execution time to environmental changes and threats. SAFEL consists of a hybrid architecture composed of three modules, each based on a different approach and inspired by a different region (or function) of the brain involved in fear learning. These modules are: the Amygdala Module (AM), the Hippocampus Module (HM) and the Working Memory Module (WMM). The AM learns and detects environmental threats while the HM makes sense of the robot's context. The WMM is responsible for combining and associating the two types of information processed by the AM and HM. More specifically, the AM simulates the cued conditioning phenomenon by creating associations between co-occurring aversive and neutral environmental stimuli. The AM represents the kernel of emotional appraisal and threat detection in SAFEL's architecture. The HM, in turn, handles environmental information at a higher level of abstraction and complexity than the AM, which depicts the robot's situation as a whole. The information managed by the HM embeds in a unified representation the temporal interactions of multiple stimuli in the environment. Finally, the WMM simulates the contextual conditioning phenomenon by creating associations between the contextual memory formed in the HM and the emotional memory formed in the AM, thus giving emotional meaning to the contextual information acquired in past experiences. Ultimately, any previously experienced pattern of contextual information triggers the retrieval of that stored contextual memory and its emotional meaning from the WMM, warning the robot that an undesirable situation is likely to happen in the near future. The main contribution of this work as compared to the state of the art is a domain-independent mechanism for online learning and adaptation that combines a fear-learning model with the concept of temporal context and is focused on real-world applications for autonomous robotics. SAFEL successfully integrates a symbolic rule-based paradigm for situation management with machine learning algorithms for memorizing and predicting environmental threats to the robot based on complex temporal context. SAFEL has been evaluated in several experiments, which analysed the performance of each module separately. Ultimately, we conducted a comprehensive case study in the robot soccer scenario to evaluate the collective work of all modules as a whole. This case study also analyses to which extent the emotional feedback of SAFEL can improve the intelligent behaviour of a robot in a practical real-world situation, where adaptive skills and fast/flexible decision-making are crucial