Active Learning based on Data Uncertainty and Model Sensitivity

Robots can rapidly acquire new skills from demonstrations. However, during generalisation of skills or transitioning across fundamentally different skills, it is unclear whether the robot has the necessary knowledge to perform the task. Failing to detect missing information often leads to abrupt movements or to collisions with the environment. Active learning can quantify the uncertainty of performing the task and, in general, locate regions of missing information. We introduce a novel algorithm for active learning and demonstrate its utility for generating smooth trajectories. Our approach is based on deep generative models and metric learning in latent spaces. It relies on the Jacobian of the likelihood to detect non-smooth transitions in the latent space, i.e., transitions that lead to abrupt changes in the movement of the robot. When non-smooth transitions are detected, our algorithm asks for an additional demonstration from that specific region. The newly acquired knowledge modifies the data manifold and allows for learning a latent representation for generating smooth movements. We demonstrate the efficacy of our approach on generalising elementary skills, transitioning across different skills, and implicitly avoiding collisions with the environment. For our experiments, we use a simulated pendulum where we observe its motion from images and a 7-DoF anthropomorphic arm.Comment: Published on 2018 IEEE/RSJ International Conference on Intelligent Robots and Syste

A New Computed Torque Control System with an Uncertain RBF Neural Network Controller for a 7-DOF Robot

A novel percutaneous puncture robot system is proposed in the paper. Increasing the surgical equipment precision to reduce the patient\u27s pain and the doctor\u27s operation difficulty to treat smaller tumors can increase the success rate of surgery. To attain this goal, an optimized Computed Torque Law (CTL) using a radial basis function (RBF) neural network controller (RCTL) is proposed to improve the direction and position accuracy. BRF neural network with an uncertain term (URBF) which is able to compensate the system error caused by the imprecision of the model is added in the RCTL system. At first, a 7-DOF robotic system is established. It consists of robotic arm and actuator control channels. Now, the RBF compensator is added to the CTL to adjust the robot arm to reduce the position and direction errors. The angle and velocity errors of the robot arm are compensated using the RBF controller. According to the Lyapunov theory, the accuracy of torque control system depends on path tracking errors, inertia of robot, dynamic parameters and disturbance of each joint. Compared to general CTL approaches, the precision of a 7-DOF robot could be improved by adjusting the RBF parameters

Learning Sensor Feedback Models from Demonstrations via Phase-Modulated Neural Networks

In order to robustly execute a task under environmental uncertainty, a robot needs to be able to reactively adapt to changes arising in its environment. The environment changes are usually reflected in deviation from expected sensory traces. These deviations in sensory traces can be used to drive the motion adaptation, and for this purpose, a feedback model is required. The feedback model maps the deviations in sensory traces to the motion plan adaptation. In this paper, we develop a general data-driven framework for learning a feedback model from demonstrations. We utilize a variant of a radial basis function network structure --with movement phases as kernel centers-- which can generally be applied to represent any feedback models for movement primitives. To demonstrate the effectiveness of our framework, we test it on the task of scraping on a tilt board. In this task, we are learning a reactive policy in the form of orientation adaptation, based on deviations of tactile sensor traces. As a proof of concept of our method, we provide evaluations on an anthropomorphic robot. A video demonstrating our approach and its results can be seen in https://youtu.be/7Dx5imy1KcwComment: 8 pages, accepted to be published at the International Conference on Robotics and Automation (ICRA) 201

Inverse Kinematics Based on Fuzzy Logic and Neural Networks for the WAM-Titan II Teleoperation System

The inverse kinematic problem is crucial for robotics. In this paper, a solution algorithm is presented using artificial intelligence to improve the pseudo-inverse Jacobian calculation for the 7-DOF Whole Arm Manipulator (WAM) and 6-DOF Titan II teleoperation system. An investigation of the inverse kinematics based on fuzzy logic and artificial neural networks for the teleoperation system was undertaken. Various methods such as Adaptive Neural-Fuzzy Inference System (ANFIS), Genetic Algorithms (GA), Multilayer Perceptrons (MLP) Feedforward Networks, Radial Basis Function Networks (RBF) and Generalized Regression Neural Networks (GRNN) were tested and simulated using MATLAB. Each method for identification of the pseudo-inverse problem was tested, and the best method was selected from the simulation results and the error analysis. From the results, the Multilayer Perceptrons with Levenberg-Marquardt (MLP-LM) method had the smallest error and the fastest computation among the other methods. For the WAM-Titan II teleoperation system, the new inverse kinematics calculations for the Titan II were simulated and analyzed using MATLAB. Finally, extensive C code for the alternative algorithm was developed, and the inverse kinematics based on the artificial neural network with LM method is implemented in the real system. The maximum error of Cartesian position was 1.3 inches, and from several trajectories, 75 % of time implementation was achieved compared to the conventional method. Because fast performance of a real time system in the teleoperation is vital, these results show that the new inverse kinematics method based on the MLP-LM is very successful with the acceptable error

Reinforcement Learning Adaptive PID Controller for an Under-actuated Robot Arm

Abstract: An adaptive PID controller is used to control of a two degrees of freedom under actuated manipulator. An actor-critic based reinforcement learning is employed for tuning of parameters of the adaptive PID controller. Reinforcement learning is an unsupervised scheme wherein no reference exists to which convergence of algorithm is anticipated. Thus, it is appropriate for real time applications. Controller structure and learning equations as well as update rules are provided. Simulations are performed in SIMULINK and performance of the controller is compared with NARMA-L2 controller. The results verified good performance of the controller in tracking and disturbance rejection tests