1,977 research outputs found
Sample Efficient Optimization for Learning Controllers for Bipedal Locomotion
Learning policies for bipedal locomotion can be difficult, as experiments are
expensive and simulation does not usually transfer well to hardware. To counter
this, we need al- gorithms that are sample efficient and inherently safe.
Bayesian Optimization is a powerful sample-efficient tool for optimizing
non-convex black-box functions. However, its performance can degrade in higher
dimensions. We develop a distance metric for bipedal locomotion that enhances
the sample-efficiency of Bayesian Optimization and use it to train a 16
dimensional neuromuscular model for planar walking. This distance metric
reflects some basic gait features of healthy walking and helps us quickly
eliminate a majority of unstable controllers. With our approach we can learn
policies for walking in less than 100 trials for a range of challenging
settings. In simulation, we show results on two different costs and on various
terrains including rough ground and ramps, sloping upwards and downwards. We
also perturb our models with unknown inertial disturbances analogous with
differences between simulation and hardware. These results are promising, as
they indicate that this method can potentially be used to learn control
policies on hardware.Comment: To appear in International Conference on Humanoid Robots (Humanoids
'2016), IEEE-RAS. (Rika Antonova and Akshara Rai contributed equally
Feedback Control of an Exoskeleton for Paraplegics: Toward Robustly Stable Hands-free Dynamic Walking
This manuscript presents control of a high-DOF fully actuated lower-limb
exoskeleton for paraplegic individuals. The key novelty is the ability for the
user to walk without the use of crutches or other external means of
stabilization. We harness the power of modern optimization techniques and
supervised machine learning to develop a smooth feedback control policy that
provides robust velocity regulation and perturbation rejection. Preliminary
evaluation of the stability and robustness of the proposed approach is
demonstrated through the Gazebo simulation environment. In addition,
preliminary experimental results with (complete) paraplegic individuals are
included for the previous version of the controller.Comment: Submitted to IEEE Control System Magazine. This version addresses
reviewers' concerns about the robustness of the algorithm and the motivation
for using such exoskeleton
- …