Optimal Control of the Cheetah During Rapid Manoeuvres

Cheetahs are incredibly fast, manoeuvrable and highly dynamic, but relatively little is understood about how this is achieved. Thus, understanding their abilities is a subject of research for roboticists and biologists. Trajectory optimisation is a tool often used to increase our understanding of cheetahs, but current approaches which handle the full complexity of poorly understood manoeuvres are slow. The lack of data means that there are no simulated models of cheetahs known to be representative of dynamic movements such as acceleration and turning. In this project, a modelling change is investigated that decreases the time to find trajectories for models involving long serial chains of rigid bodies. Leveraging this development, a software library is created which facilitates the process of finding trajectories of models of legged robots and animals. Using this library, a complex model of a cheetah is developed, based on real data and some experimentation. Finally, the model is used to generate high speed dynamic manoeuvres which present progress towards understanding the incredible abilities of cheetahs

Understanding and Improving Locomotion: The Simultaneous Optimization of Motion and Morphology in Legged Robots

There exist many open design questions in the field of legged robotics. Should leg extension and retraction occur with a knee or a prismatic joint? Will adding a compliant ankle lead to improved energetics compared to a point foot? Should quadrupeds have a flexible or a rigid spine? Should elastic elements in the actuation be placed in parallel or in series with the motors? Though these questions may seem basic, they are fundamentally difficult to approach. A robot with either discrete choice will likely need very different components and use very different motion to perform at its best. To make a fair comparison between two design variations, roboticists need to ask, is the best version of a robot with a discrete morphological variation better than the best version of a robot with the other variation? In this dissertation, I propose to answer these type of questions using an optimization based approach. Using numerical algorithms, I let a computer determine the best possible motion and best set of parameters for each design variation in order to be able to compare the best instance of each variation against each other. I developed and implemented that methodology to explore three primary robotic design questions. In the first, I asked if parallel or series elastic actuation is the more energetically economical choice for a legged robot. Looking at a variety of force and energy based cost functions, I mapped the optimal motion cost landscape as a function of configurable parameters in the hoppers. In the best case, the series configuration was more economical for an energy based cost function, and the parallel configuration was better for a force based cost function. I then took this work a step further and included the configurable parameters directly within the optimization on a model with gear friction. I found, for the most realistic cost function, the electrical work, that series was the better choice when the majority of the transmission was handled by a low-friction rotary-to-linear transmission. In the second design question, I extended this analysis to a two-dimensional monoped moving at a forward velocity with either parallel or series elastic actuation at the hip and leg. In general it was best to have a parallel elastic actuator at the hip, and a series elastic actuator at the leg. In the third design question, I asked if there is an energetic benefit to having an articulated spinal joint instead of a rigid spinal joint in a quadrupedal legged robot. I found that the answer was gait dependent. For symmetrical gaits, such as walking and trotting, the rigid and articulated spine models have similar energetic economy. For asymmetrical gaits, such as bounding and galloping, the articulated spine led to significant energy savings at high speeds. The combination of the above studies readily presents a methodology for simultaneously optimizing for motion and morphology in legged robots. Aside from giving insight into these specific design questions, the technique can also be extended to a variety of other design questions. The explorations in turn inform future hardware development by roboticists and help explain why animals in nature move in the ways that they do.PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/144074/1/yevyes_1.pd

Dynamically Stable 3D Quadrupedal Walking with Multi-Domain Hybrid System Models and Virtual Constraint Controllers

Hybrid systems theory has become a powerful approach for designing feedback controllers that achieve dynamically stable bipedal locomotion, both formally and in practice. This paper presents an analytical framework 1) to address multi-domain hybrid models of quadruped robots with high degrees of freedom, and 2) to systematically design nonlinear controllers that asymptotically stabilize periodic orbits of these sophisticated models. A family of parameterized virtual constraint controllers is proposed for continuous-time domains of quadruped locomotion to regulate holonomic and nonholonomic outputs. The properties of the Poincare return map for the full-order and closed-loop hybrid system are studied to investigate the asymptotic stabilization problem of dynamic gaits. An iterative optimization algorithm involving linear and bilinear matrix inequalities is then employed to choose stabilizing virtual constraint parameters. The paper numerically evaluates the analytical results on a simulation model of an advanced 3D quadruped robot, called GR Vision 60, with 36 state variables and 12 control inputs. An optimal amble gait of the robot is designed utilizing the FROST toolkit. The power of the analytical framework is finally illustrated through designing a set of stabilizing virtual constraint controllers with 180 controller parameters.Comment: American Control Conference 201

Benchmarking Deep Reinforcement Learning for Continuous Control

Recently, researchers have made significant progress combining the advances in deep learning for learning feature representations with reinforcement learning. Some notable examples include training agents to play Atari games based on raw pixel data and to acquire advanced manipulation skills using raw sensory inputs. However, it has been difficult to quantify progress in the domain of continuous control due to the lack of a commonly adopted benchmark. In this work, we present a benchmark suite of continuous control tasks, including classic tasks like cart-pole swing-up, tasks with very high state and action dimensionality such as 3D humanoid locomotion, tasks with partial observations, and tasks with hierarchical structure. We report novel findings based on the systematic evaluation of a range of implemented reinforcement learning algorithms. Both the benchmark and reference implementations are released at https://github.com/rllab/rllab in order to facilitate experimental reproducibility and to encourage adoption by other researchers.Comment: 14 pages, ICML 201

Control Implementation of Dynamic Locomotion on Compliant, Underactuated, Force-Controlled Legged Robots with Non-Anthropomorphic Design

The control of locomotion on legged robots traditionally involves a robot that takes a standard legged form, such as the anthropomorphic humanoid, the dog-like quadruped, or the bird-like biped. Additionally, these systems will often be actuated with position-controlled servos or series-elastic actuators that are connected through rigid links. This work investigates the control implementation of dynamic, force-controlled locomotion on a family of legged systems that significantly deviate from these classic paradigms by incorporating modern, state-of-the-art proprioceptive actuators on uniquely configured compliant legs that do not closely resemble those found in nature. The results of this work can be used to better inform how to implement controllers on legged systems without stiff, position-controlled actuators, and also provide insight on how intelligently designed mechanical features can potentially simplify the control of complex, nonlinear dynamical systems like legged robots. To this end, this work presents the approach to control for a family of non-anthropomorphic bipedal robotic systems which are developed both in simulation and with physical hardware. The first is the Non-Anthropomorphic Biped, Version 1 (NABi-1) that features position-controlled joints along with a compliant foot element on a minimally actuated leg, and is controlled using simple open-loop trajectories based on the Zero Moment Point. The second system is the second version of the non-anthropomorphic biped (NABi-2) which utilizes the proprioceptive Back-drivable Electromagnetic Actuator for Robotics (BEAR) modules for actuation and fully realizes feedback-based force controlled locomotion. These systems are used to highlight both the strengths and weaknesses of utilizing proprioceptive actuation in systems, and suggest the tradeoffs that are made when using force control for dynamic locomotion. These systems also present case studies for different approaches to system design when it comes to bipedal legged robots

Energy-Efficient Monopod Running with a Large Payload Based on Open-Loop Parallel Elastic Actuation

Despite the intensive investigations in the past, energetic efficiency is still one of the most important unsolved challenges in legged robot locomotion. This paper presents an unconventional approach to the problem of energetically efficient legged locomotion by applying actuation for spring mass running. This approach makes use of mechanical springs incorporated in parallel with relatively low-torque actuation, which is capable of both accommodating large payload and locomotion with low power input by exploiting self-excited vibration. For a systematic analysis, this paper employs both simulation models and physical platforms. The experiments show that the proposed approach is scalable across different payload between 0 and 150kg, and able to achieve a total cost of transport (TCOT) of 0.10, which is significantly lower than the previous locomotion robots and most of the biological systems in the similar scale, when actuated with the near-to natural frequency with the maximum payload.This study was supported by the Swiss National Science Foundation Grant No. PP00P2123387/1 and the Swiss National Science Foundation through the National Centre of Competence in Research Robotics