Bayesian Optimization Using Domain Knowledge on the ATRIAS Biped

Controllers in robotics often consist of expert-designed heuristics, which can be hard to tune in higher dimensions. It is typical to use simulation to learn these parameters, but controllers learned in simulation often don't transfer to hardware. This necessitates optimization directly on hardware. However, collecting data on hardware can be expensive. This has led to a recent interest in adapting data-efficient learning techniques to robotics. One popular method is Bayesian Optimization (BO), a sample-efficient black-box optimization scheme, but its performance typically degrades in higher dimensions. We aim to overcome this problem by incorporating domain knowledge to reduce dimensionality in a meaningful way, with a focus on bipedal locomotion. In previous work, we proposed a transformation based on knowledge of human walking that projected a 16-dimensional controller to a 1-dimensional space. In simulation, this showed enhanced sample efficiency when optimizing human-inspired neuromuscular walking controllers on a humanoid model. In this paper, we present a generalized feature transform applicable to non-humanoid robot morphologies and evaluate it on the ATRIAS bipedal robot -- in simulation and on hardware. We present three different walking controllers; two are evaluated on the real robot. Our results show that this feature transform captures important aspects of walking and accelerates learning on hardware and simulation, as compared to traditional BO.Comment: 8 pages, submitted to IEEE International Conference on Robotics and Automation 201

Deep Kernels for Optimizing Locomotion Controllers

Sample efficiency is important when optimizing parameters of locomotion controllers, since hardware experiments are time consuming and expensive. Bayesian Optimization, a sample-efficient optimization framework, has recently been widely applied to address this problem, but further improvements in sample efficiency are needed for practical applicability to real-world robots and high-dimensional controllers. To address this, prior work has proposed using domain expertise for constructing custom distance metrics for locomotion. In this work we show how to learn such a distance metric automatically. We use a neural network to learn an informed distance metric from data obtained in high-fidelity simulations. We conduct experiments on two different controllers and robot architectures. First, we demonstrate improvement in sample efficiency when optimizing a 5-dimensional controller on the ATRIAS robot hardware. We then conduct simulation experiments to optimize a 16-dimensional controller for a 7-link robot model and obtain significant improvements even when optimizing in perturbed environments. This demonstrates that our approach is able to enhance sample efficiency for two different controllers, hence is a fitting candidate for further experiments on hardware in the future.Comment: (Rika Antonova and Akshara Rai contributed equally

Don't break a leg: Running birds from quail to ostrich prioritise leg safety and economy in uneven terrain

Cursorial ground birds are paragons of bipedal running that span a 500-fold mass range from quail to ostrich. Here we investigate the task-level control priorities of cursorial birds by analysing how they negotiate single-step obstacles that create a conflict between body stability (attenuating deviations in body motion) and consistent leg force–length dynamics (for economy and leg safety). We also test the hypothesis that control priorities shift between body stability and leg safety with increasing body size, reflecting use of active control to overcome size-related challenges. Weight-support demands lead to a shift towards straighter legs and stiffer steady gait with increasing body size, but it remains unknown whether non-steady locomotor priorities diverge with size. We found that all measured species used a consistent obstacle negotiation strategy, involving unsteady body dynamics to minimise fluctuations in leg posture and loading across multiple steps, not directly prioritising body stability. Peak leg forces remained remarkably consistent across obstacle terrain, within 0.35 body weights of level running for obstacle heights from 0.1 to 0.5 times leg length. All species used similar stance leg actuation patterns, involving asymmetric force–length trajectories and posture-dependent actuation to add or remove energy depending on landing conditions. We present a simple stance leg model that explains key features of avian bipedal locomotion, and suggests economy as a key priority on both level and uneven terrain. We suggest that running ground birds target the closely coupled priorities of economy and leg safety as the direct imperatives of control, with adequate stability achieved through appropriately tuned intrinsic dynamics

Don't break a leg: Running birds from quail to ostrich prioritise leg safety and economy in uneven terrain

Cursorial ground birds are paragons of bipedal running that span a 500-fold mass range from quail to ostrich. Here we investigate the task-level control priorities of cursorial birds by analysing how they negotiate single-step obstacles that create a conflict between body stability (attenuating deviations in body motion) and consistent leg force–length dynamics (for economy and leg safety). We also test the hypothesis that control priorities shift between body stability and leg safety with increasing body size, reflecting use of active control to overcome size-related challenges. Weight-support demands lead to a shift towards straighter legs and stiffer steady gait with increasing body size, but it remains unknown whether non-steady locomotor priorities diverge with size. We found that all measured species used a consistent obstacle negotiation strategy, involving unsteady body dynamics to minimise fluctuations in leg posture and loading across multiple steps, not directly prioritising body stability. Peak leg forces remained remarkably consistent across obstacle terrain, within 0.35 body weights of level running for obstacle heights from 0.1 to 0.5 times leg length. All species used similar stance leg actuation patterns, involving asymmetric force–length trajectories and posture-dependent actuation to add or remove energy depending on landing conditions. We present a simple stance leg model that explains key features of avian bipedal locomotion, and suggests economy as a key priority on both level and uneven terrain. We suggest that running ground birds target the closely coupled priorities of economy and leg safety as the direct imperatives of control, with adequate stability achieved through appropriately tuned intrinsic dynamics

Bio-inspired neuromuscular reflex based hopping controller for a segmented robotic leg

It has been shown that human-like hopping can be achieved by muscle reflex control in neuromechanical simulations. However, it is unclear if this concept is applicable and feasible for controlling a real robot. This paper presents a low-cost two-segmented robotic leg design and demonstrates the feasibility and the benefits of the bio-inspired neuromuscular reflex based control for hopping. Simulation models were developed to describe the dynamics of the real robot. Different neuromuscular reflex pathways were investigated with the simulation models. We found that stable hopping can be achieved with both positive muscle force and length feedback, and the hopping height can be controlled by modulating the muscle force feedback gains with the return maps. The force feedback neuromuscular reflex based controller is robust against body mass and ground impedance changes. Finally, we implemented the controller on the real robot to prove the feasibility of the proposed neuromuscular reflex based control idea. This paper demonstrates the neuromuscular reflex based control approach is feasible to implement and capable of achieving stable and robust hopping in a real robot. It provides a promising direction of controlling the legged robot to achieve robust dynamic motion in the future

HPER Biomechanics Laboratory 2005 Annual Report, Issue 4

This issue features Dr. Stergiou Receives a K25 Award from the National Institutes of Health, Training Methods to Improve Robotic Laparoscopic Surgery, Progress Update for Federal Grant: The Development of Sitting Posture in Children with Cerebral Palsy, Pioneering Gait Analysis Research, Collaboration with UNMC Department of Surgery and VA Hospital: The Effects of Peripheral Arterial Disease on Gait, Sabbatical Strengthened Collaborations in Orthopedics, Computer Modeling with Dynamic Toys Reveals Human Gait Patterns, Prestigious Awards to Dr. Stergiou, Teachers Enriched During Final Year of Banneker 2000, New Staff Joins the HPER Biomechanics Laboratory, Noteworthy Events, Internationally Recognized Bioengineer Visited HPER Biomechanics Lab April 1, Madonna Rehabilitation Center Researcher visits HPER Biomechanics Lab Nov. 4 and Other Exciting News.https://digitalcommons.unomaha.edu/nbcfnewsletter/1003/thumbnail.jp

Simulating a Flexible Robotic System based on Musculoskeletal Modeling

Humanoid robotics offers a unique research tool for understanding the human brain and body. The synthesis of human motion is a complex procedure that involves accurate reconstruction of movement sequences, modeling of musculoskeletal kinematics, dynamics and actuation, and characterization of reliable performance criteria. Many of these processes have much in common with the problems found in robotics research, with the recent advent of complex humanoid systems. This work presents the design and development of a new-generation bipedal robot. Its modeling and simulation has been realized by using an open-source software to create and analyze dynamic simulation of movement: OpenSim. Starting from a study by Fuben He, our model aims to be used as an innovative approach to the study of a such type of robot in which there are series elastic actuators represented by active and passive spring components in series with motors. It has provided of monoarticular and biarticular joint in a very similar manner to human musculoskeletal model. This thesis is only the starting point of a wide range of other possible future works: from the control structure completion and whole-body control application, to imitation learning and reinforcement learning for human locomotion, from motion test on at ground to motion test on rough ground, and obviously the transition from simulation to practice with a real elastic bipedal robot biologically-inspired that can move like a human bein

Evidence for a Time-Invariant Phase Variable in Human Ankle Control

Human locomotion is a rhythmic task in which patterns of muscle activity are modulated by state-dependent feedback to accommodate perturbations. Two popular theories have been proposed for the underlying embodiment of phase in the human pattern generator: a time-dependent internal representation or a time-invariant feedback representation (i.e., reflex mechanisms). In either case the neuromuscular system must update or represent the phase of locomotor patterns based on the system state, which can include measurements of hundreds of variables. However, a much simpler representation of phase has emerged in recent designs for legged robots, which control joint patterns as functions of a single monotonic mechanical variable, termed a phase variable. We propose that human joint patterns may similarly depend on a physical phase variable, specifically the heel-to-toe movement of the Center of Pressure under the foot. We found that when the ankle is unexpectedly rotated to a position it would have encountered later in the step, the Center of Pressure also shifts forward to the corresponding later position, and the remaining portion of the gait pattern ensues. This phase shift suggests that the progression of the stance ankle is controlled by a biomechanical phase variable, motivating future investigations of phase variables in human locomotor control.United States Army Medical Research Acquisition Activity (USAMRAA grant W81XWH-09-2-0020)National Institute of Neurological Disorders and Stroke (U.S.) (NIH award number F31NS074687)Burroughs Wellcome Fund (Career Award at the Scientific Interface