Morphological properties of mass-spring networks for optimal locomotion learning

Robots have proven very useful in automating industrial processes. Their rigid components and powerful actuators, however, render them unsafe or unfit to work in normal human environments such as schools or hospitals. Robots made of compliant, softer materials may offer a valid alternative. Yet, the dynamics of these compliant robots are much more complicated compared to normal rigid robots of which all components can be accurately controlled. It is often claimed that, by using the concept of morphological computation, the dynamical complexity can become a strength. On the one hand, the use of flexible materials can lead to higher power efficiency and more fluent and robust motions. On the other hand, using embodiment in a closed-loop controller, part of the control task itself can be outsourced to the body dynamics. This can significantly simplify the additional resources required for locomotion control. To this goal, a first step consists in an exploration of the trade-offs between morphology, efficiency of locomotion, and the ability of a mechanical body to serve as a computational resource. In this work, we use a detailed dynamical model of a Mass–Spring–Damper (MSD) network to study these trade-offs. We first investigate the influence of the network size and compliance on locomotion quality and energy efficiency by optimizing an external open-loop controller using evolutionary algorithms. We find that larger networks can lead to more stable gaits and that the system’s optimal compliance to maximize the traveled distance is directly linked to the desired frequency of locomotion. In the last set of experiments, the suitability of MSD bodies for being used in a closed loop is also investigated. Since maximally efficient actuator signals are clearly related to the natural body dynamics, in a sense, the body is tailored for the task of contributing to its own control. Using the same simulation platform, we therefore study how the network states can be successfully used to create a feedback signal and how its accuracy is linked to the body size

The body as a reservoir: locomotion and sensing with linear feedback

It is known that mass-spring nets have computational power and can be trained to reproduce oscillating patterns. In this work, we extend this idea to locomotion and sensing. We simulate systems made out of bars and springs and show that stable gaits can be maintained by these structures with only linear feedback. We then conduct a classification experiment in which the system has to distinguish terrains while maintaining an oscillatory pattern. These experiments indicate that the control of compliant robots can be simplified if one exploits the computational power of the body’s dynamics

In silico case studies of compliant robots: AMARSI deliverable 3.3

In the deliverable 3.2 we presented how the morphological computing ap- proach can significantly facilitate the control strategy in several scenarios, e.g. quadruped locomotion, bipedal locomotion and reaching. In particular, the Kitty experimental platform is an example of the use of morphological computation to allow quadruped locomotion. In this deliverable we continue with the simulation studies on the application of the different morphological computation strategies to control a robotic system

Body randomization reduces the sim-to-real gap for compliant quadruped locomotion

Designing controllers for compliant, underactuated robots is challenging and usually requires a learning procedure. Learning robotic control in simulated environments can speed up the process whilst lowering risk of physical damage. Since perfect simulations are unfeasible, several techniques are used to improve transfer to the real world. Here, we investigate the impact of randomizing body parameters during learning of CPG controllers in simulation. The controllers are evaluated on our physical quadruped robot. We find that body randomization in simulation increases chances of finding gaits that function well on the real robot

The role of feedback in morphological computation with compliant bodies

The generation of robust periodic movements of complex nonlinear robotic systems is inherently difficult, especially, if parts of the robots are compliant. It has previously been proposed that complex nonlinear features of a robot, similarly as in biological organisms, might possibly facilitate its control. This bold hypothesis, commonly referred to as morphological computation, has recently received some theoretical support by Hauser etal. (Biol Cybern 105:355-370, doi: 10.1007/s00422-012-0471-0 , 2012). We show in this article that this theoretical support can be extended to cover not only the case of fading memory responses to external signals, but also the essential case of autonomous generation of adaptive periodic patterns, as, e.g., needed for locomotion. The theory predicts that feedback into the morphological computing system is necessary and sufficient for such tasks, for which a fading memory is insufficient. We demonstrate the viability of this theoretical analysis through computer simulations of complex nonlinear mass-spring systems that are trained to generate a large diversity of periodic movements by adapting the weights of a simple linear feedback device. Hence, the results of this article substantially enlarge the theoretically tractable application domain of morphological computation in robotics, and also provide new paradigms for understanding control principles of biological organism

Calibration method to improve transfer from simulation to quadruped robots

Using passive compliance in robotic locomotion has been seen as a cheap and straightforward way of increasing the performance in energy consumption and robustness. However, the control for such systems remains quite challenging when using traditional robotic techniques. The progress in machine learning opens a horizon of new possibilities in this direction but the training methods are generally too long and laborious to be conducted on a real robot platform. On the other hand, learning a control policy in simulation also raises a lot of complication in the transfer. In this paper, we designed a cheap quadruped robot and detail a calibration method to optimize a simulation model in order to facilitate the transfer of parametric motor primitives. We present results validating the transfer of Central Pattern Generators (CPG) learned in simulation to the robot which already give positive insights on the validity of this method

Digital Twin Modeling And Optimal Control Of Soft-Bodied Robotics Using Reservoir Computing

Soft-bodied robots have become increasingly popular due to their ability to per- form tasks that are difficult or impossible for traditional rigid robots. However, accurately modeling and controlling the movement and behavior of soft robots are very challenging due to their complex and dynamic nature. In recent years, Reservoir Computing has emerged as a promising approach to modeling and controlling soft robots. In this thesis, reservoir computing was used to create a digital twin of soft-bodied robots. Specifically, a digital twin of a spring-mass system was created using echo state network, a popular reservoir computing model. Furthermore, an optimal controller was trained using reservoir computing to drive the spring-mass system to follow a desired trajectory. Extensive simulations were carried out to validate the proposed methods. The results demonstrate the effectiveness of the proposed approach. For example, the digital twin model achieved 2% MAPE and the optimal controller achieved 8.7% MAPE for a 20-node 54-spring system. Index Terms: Deep Learning, Digital Twin Modeling, Echo State Network, Optimal control, Soft Bodied Robotics, Time series predictio