Deep Kernels for Optimizing Locomotion Controllers

Sample efficiency is important when optimizing parameters of locomotion controllers, since hardware experiments are time consuming and expensive. Bayesian Optimization, a sample-efficient optimization framework, has recently been widely applied to address this problem, but further improvements in sample efficiency are needed for practical applicability to real-world robots and high-dimensional controllers. To address this, prior work has proposed using domain expertise for constructing custom distance metrics for locomotion. In this work we show how to learn such a distance metric automatically. We use a neural network to learn an informed distance metric from data obtained in high-fidelity simulations. We conduct experiments on two different controllers and robot architectures. First, we demonstrate improvement in sample efficiency when optimizing a 5-dimensional controller on the ATRIAS robot hardware. We then conduct simulation experiments to optimize a 16-dimensional controller for a 7-link robot model and obtain significant improvements even when optimizing in perturbed environments. This demonstrates that our approach is able to enhance sample efficiency for two different controllers, hence is a fitting candidate for further experiments on hardware in the future.Comment: (Rika Antonova and Akshara Rai contributed equally

Predictive modelling of human walking over a complete gait cycle

An inverse dynamics multi-segment model of the body was combined with optimisation techniques to simulate normal walking in the sagittal plane on level ground. Walking is formulated as an optimal motor task subject to multiple constraints with minimisation of mechanical energy expenditure over a complete gait cycle being the performance criterion. All segmental motions and ground reactions were predicted from only three simple gait descriptors (inputs): walking velocity, cycle period and double stance duration. Quantitative comparisons of the model predictions with gait measurements show that the model reproduced the significant characteristics of normal gait in the sagittal plane. The simulation results suggest that minimising energy expenditure is a primary control objective in normal walking. However, there is also some evidence for the existence of multiple concurrent performance objectives. Keywords: Gait prediction; Inverse dynamics; Optimisation; Optimal motor tas

A Pinned Polymer Model of Posture Control

A phenomenological model of human posture control is posited. The dynamics are modelled as an elastically pinned polymer under the influence of noise. The model accurately reproduces the two-point correlation functions of experimental posture data and makes predictions for the response function of the postural control system. The physiological and clinical significance of the model is discussed.Comment: uuencoded post script file, 17 pages with 3 figure

Feedback control of unsupported standing in paraplegia. Part I: optimal control approach

This is the first of a pair of papers which describe an investigation into the feasibility of providing artificial balance to paraplegics using electrical stimulation of the paralyzed muscles. By bracing the body above the shanks, only stimulation of the plantarflexors is necessary. This arrangement prevents any influence from the intact neuromuscular system above the spinal cord lesion. Here, the authors extend the design of the controllers to a nested-loop LQG (linear quadratic Gaussian) stimulation controller which has ankle moment feedback (inner loops) and inverted pendulum angle feedback (outer loop). Each control loop is tuned by two parameters, the control weighting and an observer rise-time, which together determine the behavior. The nested structure was chosen because it is robust, despite changes in the muscle properties (fatigue) and interference from spasticity

Optimal control of ankle joint moment: Toward unsupported standing in paraplegia

This paper considers part of the problem of how to provide unsupported standing for paraplegics by feedback control. In this work our overall objective is to stabilize the subject by stimulation only of his ankle joints while the other joints are braced, Here, we investigate the problem of ankle joint moment control. The ankle plantarflexion muscles are first identified with pseudorandom binary sequence (PRBS) signals, periodic sinusoidal signals, and twitches. The muscle is modeled in Hammerstein form as a static recruitment nonlinearity followed by a linear transfer function. A linear-quadratic-Gaussian (LQG)-optimal controller design procedure for ankle joint moment was proposed based on the polynomial equation formulation, The approach was verified by experiments in the special Wobbler apparatus with a neurologically intact subject, and these experimental results are reported. The controller structure is formulated in such a way that there are only two scalar design parameters, each of which has a clear physical interpretation. This facilitates fast controller synthesis and tuning in the laboratory environment. Experimental results show the effects of the controller tuning parameters: the control weighting and the observer response time, which determine closed-loop properties. Using these two parameters the tradeoff between disturbance rejection and measurement noise sensitivity can be straightforwardly balanced while maintaining a desired speed of tracking. The experimentally measured reference tracking, disturbance rejection, and noise sensitivity are good and agree with theoretical expectations

Benchmarking Cerebellar Control

Cerebellar models have long been advocated as viable models for robot dynamics control. Building on an increasing insight in and knowledge of the biological cerebellum, many models have been greatly refined, of which some computational models have emerged with useful properties with respect to robot dynamics control. Looking at the application side, however, there is a totally different picture. Not only is there not one robot on the market which uses anything remotely connected with cerebellar control, but even in research labs most testbeds for cerebellar models are restricted to toy problems. Such applications hardly ever exceed the complexity of a 2 DoF simulated robot arm; a task which is hardly representative for the field of robotics, or relates to realistic applications. In order to bring the amalgamation of the two fields forwards, we advocate the use of a set of robotics benchmarks, on which existing and new computational cerebellar models can be comparatively tested. It is clear that the traditional approach to solve robotics dynamics loses ground with the advancing complexity of robotic structures; there is a desire for adaptive methods which can compete as traditional control methods do for traditional robots. In this paper we try to lay down the successes and problems in the fields of cerebellar modelling as well as robot dynamics control. By analyzing the common ground, a set of benchmarks is suggested which may serve as typical robot applications for cerebellar models