Learning to Exploit Elastic Actuators for Quadruped Locomotion

Spring-based actuators in legged locomotion provide energy-efficiency and improved performance, but increase the difficulty of controller design. While previous work has focused on extensive modeling and simulation to find optimal controllers for such systems, we propose to learn model-free controllers directly on the real robot. In our approach, gaits are first synthesized by central pattern generators (CPGs), whose parameters are optimized to quickly obtain an open-loop controller that achieves efficient locomotion. Then, to make this controller more robust and further improve the performance, we use reinforcement learning to close the loop, to learn corrective actions on top of the CPGs. We evaluate the proposed approach on the DLR elastic quadruped bert. Our results in learning trotting and pronking gaits show that exploitation of the spring actuator dynamics emerges naturally from optimizing for dynamic motions, yielding high-performing locomotion despite being model-free. The whole process takes no more than 1.5 hours on the real robot and results in natural-looking gaits

Development and Field Testing of the FootFall Planning System for the ATHLETE Robots

The FootFall Planning System is a ground-based planning and decision support system designed to facilitate the control of walking activities for the ATHLETE (All-Terrain Hex-Limbed Extra-Terrestrial Explorer) family of robots. ATHLETE was developed at NASA's Jet Propulsion Laboratory (JPL) and is a large six-legged robot designed to serve multiple roles during manned and unmanned missions to the Moon; its roles include transportation, construction and exploration. Over the four years from 2006 through 2010 the FootFall Planning System was developed and adapted to two generations of the ATHLETE robots and tested at two analog field sites (the Human Robotic Systems Project's Integrated Field Test at Moses Lake, Washington, June 2008, and the Desert Research and Technology Studies (D-RATS), held at Black Point Lava Flow in Arizona, September 2010). Having 42 degrees of kinematic freedom, standing to a maximum height of just over 4 meters, and having a payload capacity of 450 kg in Earth gravity, the current version of the ATHLETE robot is a uniquely complex system. A central challenge to this work was the compliance of the high-DOF (Degree Of Freedom) robot, especially the compliance of the wheels, which affected many aspects of statically-stable walking. This paper will review the history of the development of the FootFall system, sharing design decisions, field test experiences, and the lessons learned concerning compliance and self-awareness

Ros-based control of a robotic leg for a quadruped robot

The sector of Autonomous Mobile Robots (AMR) has grown a lot during the last years. In the literature an AMR is a robot able to move without any human operator control. With the im- provements of the control systems, robots have gained a lot of dexterity and flexibility in the movements, migrating from restrictive mechanical systems like wheeling. AMR with wheels are very efficient on plane grounds, like conventional industrial environ- ments. Nevertheless, they lose efficiency when dealing with rough terrains like the ones you can find on mountain rescue, vineyards or building industry. A good alternative is to use legged robots, which imitate animal walking behaviour, for these types of terrain since they are able to easily overcome these obstacles. The objective of this project is to create a control system for the robotic leg of a quadruped robot. A mechanical leg was developed and implemented at the CDEI for a quadruped robot, aimed for its locomotion in rugged and unknown terrain. This project will create the control system for this leg, so that it can execute the desired motions and it can be later integrated in the com- plete quadruped robot. The system will be designed so that it can be part of the stack of the quadruped robot. In this sense, the control systems software will be developed using the Robot Operating System (ROS) and MATLAB&Simulin

Understanding and Improving Locomotion: The Simultaneous Optimization of Motion and Morphology in Legged Robots

There exist many open design questions in the field of legged robotics. Should leg extension and retraction occur with a knee or a prismatic joint? Will adding a compliant ankle lead to improved energetics compared to a point foot? Should quadrupeds have a flexible or a rigid spine? Should elastic elements in the actuation be placed in parallel or in series with the motors? Though these questions may seem basic, they are fundamentally difficult to approach. A robot with either discrete choice will likely need very different components and use very different motion to perform at its best. To make a fair comparison between two design variations, roboticists need to ask, is the best version of a robot with a discrete morphological variation better than the best version of a robot with the other variation? In this dissertation, I propose to answer these type of questions using an optimization based approach. Using numerical algorithms, I let a computer determine the best possible motion and best set of parameters for each design variation in order to be able to compare the best instance of each variation against each other. I developed and implemented that methodology to explore three primary robotic design questions. In the first, I asked if parallel or series elastic actuation is the more energetically economical choice for a legged robot. Looking at a variety of force and energy based cost functions, I mapped the optimal motion cost landscape as a function of configurable parameters in the hoppers. In the best case, the series configuration was more economical for an energy based cost function, and the parallel configuration was better for a force based cost function. I then took this work a step further and included the configurable parameters directly within the optimization on a model with gear friction. I found, for the most realistic cost function, the electrical work, that series was the better choice when the majority of the transmission was handled by a low-friction rotary-to-linear transmission. In the second design question, I extended this analysis to a two-dimensional monoped moving at a forward velocity with either parallel or series elastic actuation at the hip and leg. In general it was best to have a parallel elastic actuator at the hip, and a series elastic actuator at the leg. In the third design question, I asked if there is an energetic benefit to having an articulated spinal joint instead of a rigid spinal joint in a quadrupedal legged robot. I found that the answer was gait dependent. For symmetrical gaits, such as walking and trotting, the rigid and articulated spine models have similar energetic economy. For asymmetrical gaits, such as bounding and galloping, the articulated spine led to significant energy savings at high speeds. The combination of the above studies readily presents a methodology for simultaneously optimizing for motion and morphology in legged robots. Aside from giving insight into these specific design questions, the technique can also be extended to a variety of other design questions. The explorations in turn inform future hardware development by roboticists and help explain why animals in nature move in the ways that they do.PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/144074/1/yevyes_1.pd

Injury and Skeletal Biomechanics

This book covers many aspects of Injury and Skeletal Biomechanics. As the title represents, the aspects of force, motion, kinetics, kinematics, deformation, stress and strain are examined in a range of topics such as human muscles and skeleton, gait, injury and risk assessment under given situations. Topics range from image processing to articular cartilage biomechanical behavior, gait behavior under different scenarios, and training, to musculoskeletal and injury biomechanics modeling and risk assessment to motion preservation. This book, together with "Human Musculoskeletal Biomechanics", is available for free download to students and instructors who may find it suitable to develop new graduate level courses and undergraduate teaching in biomechanics

Motion Control of the Hybrid Wheeled-Legged Quadruped Robot Centauro

Emerging applications will demand robots to deal with a complex environment, which lacks the structure and predictability of the industrial workspace. Complex scenarios will require robot complexity to increase as well, as compared to classical topologies such as fixed-base manipulators, wheeled mobile platforms, tracked vehicles, and their combinations. Legged robots, such as humanoids and quadrupeds, promise to provide platforms which are flexible enough to handle real world scenarios; however, the improved flexibility comes at the cost of way higher control complexity. As a trade-off, hybrid wheeled-legged robots have been proposed, resulting in the mitigation of control complexity whenever the ground surface is suitable for driving. Following this idea, a new hybrid robot called Centauro has been developed inside the Humanoid and Human Centered Mechatronics lab at Istituto Italiano di Tecnologia (IIT). Centauro is a wheeled-legged quadruped with a humanoid bi-manual upper-body. Differently from other platform of similar concept, Centauro employs customized actuation units, which provide high torque outputs, moderately fast motions, and the possibility to control the exerted torque. Moreover, with more than forty motors moving its limbs, Centauro is a very redundant platform, with the potential to execute many different tasks at the same time. This thesis deals with the design and development of a software architecture, and a control system, tailored to such a robot; both wheeled and legged locomotion strategies have been studied, as well as prioritized, whole-body and interaction controllers exploiting the robot torque control capabilities, and capable to handle the system redundancy. A novel software architecture, made of (i) a real-time robotic middleware, and (ii) a framework for online, prioritized Cartesian controller, forms the basis of the entire work

Actuation-Aware Simplified Dynamic Models for Robotic Legged Locomotion

In recent years, we witnessed an ever increasing number of successful hardware implementations of motion planners for legged robots. If one common property is to be identified among these real-world applications, that is the ability of online planning. Online planning is forgiving, in the sense that it allows to relentlessly compensate for external disturbances of whatever form they might be, ranging from unmodeled dynamics to external pushes or unexpected obstacles and, at the same time, follow user commands. Initially replanning was restricted only to heuristic-based planners that exploit the low computational effort of simplified dynamic models. Such models deliberately only capture the main dynamics of the system, thus leaving to the controllers the issue of anchoring the desired trajectory to the whole body model of the robot. In recent years, however, we have seen a number of new approaches attempting to increase the accuracy of the dynamic formulation without trading-off the computational efficiency of simplified models. In this dissertation, as an example of successful hardware implementation of heuristics and simplified model-based locomotion, I describe the framework that I developed for the generation of an omni-directional bounding gait for the HyQ quadruped robot. By analyzing the stable limit cycles for the sagittal dynamics and the Center of Pressure (CoP) for the lateral stabilization, the described locomotion framework is able to achieve a stable bounding while adapting to terrains of mild roughness and to sudden changes of the user desired linear and angular velocities. The next topic reported and second contribution of this dissertation is my effort to formulate more descriptive simplified dynamic models, without trading off their computational efficiency, in order to extend the navigation capabilities of legged robots to complex geometry environments. With this in mind, I investigated the possibility of incorporating feasibility constraints in these template models and, in particular, I focused on the joint torques limits which are usually neglected at the planning stage. In this direction, the third contribution discussed in this thesis is the formulation of the so called actuation wrench polytope (AWP), defined as the set of feasible wrenches that an articulated robot can perform given its actuation limits. Interesected with the contact wrench cone (CWC), this yields a new 6D polytope that we name feasible wrench polytope (FWP), defined as the set of all wrenches that a legged robot can realize given its actuation capabilities and the friction constraints. Results are reported where, thanks to efficient computational geometry algorithms and to appropriate approximations, the FWP is employed for a one-step receding horizon optimization of center of mass trajectory and phase durations given a predefined step sequence on rough terrains. For the sake of reachable workspace augmentation, I then decided to trade off the generality of the FWP formulation for a suboptimal scenario in which a quasi-static motion is assumed. This led to the definition of the, so called, local/instantaneous actuation region and of the global actuation/feasible region. They both can be seen as different variants of 2D linear subspaces orthogonal to gravity where the robot is guaranteed to place its own center of mass while being able to carry its own body weight given its actuation capabilities. These areas can be intersected with the well known frictional support region, resulting in a 2D linear feasible region, thus providing an intuitive tool that enables the concurrent online optimization of actuation consistent CoM trajectories and target foothold locations on rough terrains

Design of Compliance Assisted Gaits for a Quadrupedal Amphibious Robot

The goal of this thesis was to develop an amphibious legged quadrupedal robot and associated gaits. Gaits of interest included walking, swimming, and smoothly transitioning between the two. Compliance was employed in the robot's legs to achieve swimming. Various types and configurations of compliant legs were evaluated using physical experiments and simulation. Three primary, two secondary, and two transition gaits were developed. An algorithm was developed to determine the appropriate course of action based on the current gait performance and the desired performance. The robot developed in this thesis met the goals of the design and demonstrated the technical feasibility of using compliance in amphibious legged robots