Intrinsic Motivation and Mental Replay enable Efficient Online Adaptation in Stochastic Recurrent Networks

Autonomous robots need to interact with unknown, unstructured and changing environments, constantly facing novel challenges. Therefore, continuous online adaptation for lifelong-learning and the need of sample-efficient mechanisms to adapt to changes in the environment, the constraints, the tasks, or the robot itself are crucial. In this work, we propose a novel framework for probabilistic online motion planning with online adaptation based on a bio-inspired stochastic recurrent neural network. By using learning signals which mimic the intrinsic motivation signalcognitive dissonance in addition with a mental replay strategy to intensify experiences, the stochastic recurrent network can learn from few physical interactions and adapts to novel environments in seconds. We evaluate our online planning and adaptation framework on an anthropomorphic KUKA LWR arm. The rapid online adaptation is shown by learning unknown workspace constraints sample-efficiently from few physical interactions while following given way points.Comment: accepted in Neural Network

Nonlinear control of multibody flexible mechanisms: A model-free approach

In this paper a novel nonlinear controller for position and vibration control of flexible-link mechanisms is introduced. The proposed control strategy is model-free and does not require the measurement of the elastic deformation of the mechanism, since the control relies only on the knowledge of the angular position of the actuator and on its time derivative, which can be measured simply with a quadrature encoder. The conditions for the closed-loop stability are evaluated using Lyapunov theory. The performance of the proposed technique is evaluated on a four-bar flexible-link mechanism. Superior vibration damping and more accurate trajectory tracking is obtained in comparison with a PD controller and a fractional order controller, which relies on the same set of measurement as the proposed nonlinear controller

Human Motion Trajectory Prediction: A Survey

With growing numbers of intelligent autonomous systems in human environments, the ability of such systems to perceive, understand and anticipate human behavior becomes increasingly important. Specifically, predicting future positions of dynamic agents and planning considering such predictions are key tasks for self-driving vehicles, service robots and advanced surveillance systems. This paper provides a survey of human motion trajectory prediction. We review, analyze and structure a large selection of work from different communities and propose a taxonomy that categorizes existing methods based on the motion modeling approach and level of contextual information used. We provide an overview of the existing datasets and performance metrics. We discuss limitations of the state of the art and outline directions for further research.Comment: Submitted to the International Journal of Robotics Research (IJRR), 37 page

Study of Motion Control of A Flexible Link

20th century has witnessed massive upsurge in the use of manipulators in several industries especially in space, defense, and medical industries. Among the types of manipulators used, single link manipulators are the most widely used. A single link robotic manipulator is nothing but a link controlled by an actuator to carry out a particular function such as placing a payload from point A to point B. For low power requirements single link manipulators are made up of light weight materials which require flexibility considerations.Flexibility makes the dynamics of the link heavily non-linear which induces vibrations and overshoot. In this project initially the dynamic model of rigid flexible manipulator is explained, then the state space model of the manipulator system is incorporated into MATLAB. The link flexibility is studied by a single beam FEmodel, where expressions for kinetic and potential energyare employed to derive the torqueequation.The 3 flexible link equations are coupled in terms of 3 variables, θ, Ø and v. The tip angle is finally given aslvfor flexible case whereas for the rigid manipulator the tip angle is same as the hub angle θ. Thereforeaccurate computation of v is very important. The joint flexibility is excluded from analysis.Several comparisons were made between the rigid and flexible link for torque requirement. The relation between the trajectory and hub angle is also plotted in a graph.Finally a PD controller taking the errors and its derivative is designed based on the rigid link dynamics