367 research outputs found
Understanding the agility of running birds: Sensorimotor and mechanical factors in avian bipedal locomotion
Birds are a diverse and agile lineage of vertebrates that all use bipedal locomotion for at least part of their life. Thus birds provide a valuable opportunity to investigate how biomechanics and sensorimotor control are integrated for agile bipedal locomotion. This review summarizes recent work using terrain perturbations to reveal neuromechanical control strategies used by ground birds to achieve robust, stable and agile running. Early experiments in running guinea fowl aimed to reveal the immediate intrinsic mechanical response to an unexpected drop ('pothole') in terrain. When navigating the pothole, guinea fowl experience large changes in leg posture in the perturbed step, which correlates strongly with leg loading and perturbation recovery. Analysis of simple theoretical models of running has further confirmed the crucial role of swing-leg trajectory control for regulating foot contact timing and leg loading in uneven terrain. Coupling between body and leg dynamics results in an inherent trade-off in swing leg retraction rate for fall avoidance versus injury avoidance. Fast leg retraction minimizes injury risk, but slow leg retraction minimizes fall risk. Subsequent experiments have investigated how birds optimize their control strategies depending on the type of perturbation (pothole, step, obstacle), visibility of terrain, and with ample practice negotiating terrain features. Birds use several control strategies consistently across terrain contexts: 1) independent control of leg angular cycling and leg length actuation, which facilitates dynamic stability through simple control mechanisms, 2) feedforward regulation of leg cycling rate, which tunes foot-contact timing to maintain consistent leg loading in uneven terrain (minimizing fall and injury risks), 3) load-dependent muscle actuation, which rapidly adjusts stance push-off and stabilizes body mechanical energy, and 4) multi-step recovery strategies that allow body dynamics to transiently vary while tightly regulating leg loading to minimize risks of fall and injury. In future work, it will be interesting to investigate the learning and adaptation processes that allow animals to adjust neuromechanical control mechanisms over short and long timescales
From walking to running: robust and 3D humanoid gait generation via MPC
Humanoid robots are platforms that can succeed in tasks conceived for humans. From locomotion in unstructured environments, to driving cars, or working in industrial plants,
these robots have a potential that is yet to be disclosed in systematic every-day-life applications. Such a perspective, however, is opposed by the need of solving complex
engineering problems under the hardware and software point of view. In this thesis, we focus on the software side of the problem, and in particular on locomotion control. The operativity of a legged humanoid is subordinate to its capability of realizing a reliable locomotion. In many settings, perturbations may undermine the balance and make the robot fall. Moreover, complex and dynamic motions might be required by the context, as for instance it could be needed to start running or climbing stairs to achieve a certain location in the shortest time. We present gait generation schemes based on Model Predictive Control (MPC) that tackle both the problem of robustness and tridimensional dynamic motions. The proposed control schemes adopt the typical paradigm of centroidal MPC for reference motion generation, enforcing dynamic balance through the Zero Moment Point condition, plus a whole-body controller that maps the generated trajectories to joint commands. Each of the described predictive controllers also feature a so-called stability constraint, preventing the generation of diverging Center of Mass trajectories with respect to the Zero Moment Point. Robustness is addressed by modeling the humanoid as a Linear Inverted Pendulum and devising two types of strategies. For persistent perturbations, a way to use a disturbance observer and a technique for constraint tightening (to ensure robust constraint satisfaction) are presented. In the case of impulsive pushes instead, techniques for footstep and timing adaptation are introduced. The underlying approach is to interpret robustness as a MPC feasibility problem, thus aiming at ensuring the existence of a solution for the constrained optimization problem to be solved at each iteration in spite of the perturbations. This perspective allows to devise simple solutions to complex problems, favoring a reliable real-time implementation.
For the tridimensional locomotion, on the other hand, the humanoid is modeled as a Variable Height Inverted Pendulum. Based on it, a two stage MPC is introduced with particular emphasis on the implementation of the stability constraint. The overall result is a gait generation scheme that allows the robot to overcome relatively complex
environments constituted by a non-flat terrain, with also the capability of realizing running gaits. The proposed methods are validated in different settings: from conceptual simulations in Matlab to validations in the DART dynamic environment, up to experimental tests on the NAO and the OP3 platforms
Real-Time Motion Planning of Legged Robots: A Model Predictive Control Approach
We introduce a real-time, constrained, nonlinear Model Predictive Control for
the motion planning of legged robots. The proposed approach uses a constrained
optimal control algorithm known as SLQ. We improve the efficiency of this
algorithm by introducing a multi-processing scheme for estimating value
function in its backward pass. This pass has been often calculated as a single
process. This parallel SLQ algorithm can optimize longer time horizons without
proportional increase in its computation time. Thus, our MPC algorithm can
generate optimized trajectories for the next few phases of the motion within
only a few milliseconds. This outperforms the state of the art by at least one
order of magnitude. The performance of the approach is validated on a quadruped
robot for generating dynamic gaits such as trotting.Comment: 8 page
Online Optimization-based Gait Adaptation of Quadruped Robot Locomotion
Quadruped robots demonstrated extensive capabilities of traversing complex and unstructured
environments. Optimization-based techniques gave a relevant impulse to the research on legged
locomotion. Indeed, by designing the cost function and the constraints, we can guarantee the
feasibility of a motion and impose high-level locomotion tasks, e.g., tracking of a reference
velocity. This allows one to have a generic planning approach without the need to tailor a
specific motion for each terrain, as in the heuristic case. In this context, Model Predictive
Control (MPC) can compensate for model inaccuracies and external disturbances, thanks to
the high-frequency replanning.
The main objective of this dissertation is to develop a Nonlinear MPC (NMPC)-based
locomotion framework for quadruped robots. The aim is to obtain an algorithm which can
be extended to different robots and gaits; in addition, I sought to remove some assumptions
generally done in the literature, e.g., heuristic reference generator and user-defined gait
sequence.
The starting point of my work is the definition of the Optimal Control Problem to generate
feasible trajectories for the Center of Mass. It is descriptive enough to capture the linear and
angular dynamics of the robot as a whole. A simplified model (Single Rigid Body Dynamics
model) is used for the system dynamics, while a novel cost term maximizes leg mobility
to improve robustness in the presence of nonflat terrain. In addition, to test the approach
on the real robot, I dedicated particular effort to implementing both a heuristic reference
generator and an interface for the controller, and integrating them into the controller framework
developed previously by other team members.
As a second contribution of my work, I extended the locomotion framework to deal with a
trot gait. In particular, I generalized the reference generator to be based on optimization.
Exploiting the Linear Inverted Pendulum model, this new module can deal with the underactuation of the trot when only two legs are in contact with the ground, endowing the NMPC
with physically informed reference trajectories to be tracked. In addition, the reference velocities are used to correct the heuristic footholds, obtaining contact locations coherent with
the motion of the base, even though they are not directly optimized.
The model used by the NMPC receives as input the gait sequence, thus with the last part
of my work I developed an online multi-contact planner and integrated it into the MPC
framework. Using a machine learning approach, the planner computes the best feasible option,
even in complex environments, in a few milliseconds, by ranking online a set of discrete options
for footholds, i.e., which leg to move and where to step. To train the network, I designed
a novel function, evaluated offline, which considers the value of the cost of the NMPC and
robustness/stability metrics for each option.
These methods have been validated with simulations and experiments over the three years. I
tested the NMPC on the Hydraulically actuated Quadruped robot (HyQ) of the IIT’s Dynamic
Legged Systems lab, performing omni-directional motions on flat terrain and stepping on
a pallet (both static and relocated during the motion) with a crawl gait. The trajectory
replanning is performed at high-frequency, and visual information of the terrain is included to
traverse uneven terrain. A Unitree Aliengo quadruped robot is used to execute experiments
with the trot gait. The optimization-based reference generator allows the robot to reach a
fixed goal and recover from external pushes without modifying the structure of the NMPC.
Finally, simulations with the Solo robot are performed to validate the neural network-based
contact planning. The robot successfully traverses complex scenarios, e.g., stepping stones,
with both walk and trot gaits, choosing the footholds online.
The achieved results improved the robustness and the performance of the quadruped locomotion.
High-frequency replanning, dealing with a fixed goal, recovering after a push, and the automatic
selection of footholds could help the robots to accomplish important tasks for the humans,
for example, providing support in a disaster response scenario or inspecting an unknown
environment.
In the future, the contact planning will be transferred to the real hardware. Possible developments foresee the optimization of the gait timings, i.e., stance and swing duration, and a
framework which allows the automatic transition between gaits
Reactive Stepping for Humanoid Robots using Reinforcement Learning: Application to Standing Push Recovery on the Exoskeleton Atalante
State-of-the-art reinforcement learning is now able to learn versatile
locomotion, balancing and push-recovery capabilities for bipedal robots in
simulation. Yet, the reality gap has mostly been overlooked and the simulated
results hardly transfer to real hardware. Either it is unsuccessful in practice
because the physics is over-simplified and hardware limitations are ignored, or
regularity is not guaranteed, and unexpected hazardous motions can occur. This
paper presents a reinforcement learning framework capable of learning robust
standing push recovery for bipedal robots that smoothly transfer to reality,
providing only instantaneous proprioceptive observations. By combining original
termination conditions and policy smoothness conditioning, we achieve stable
learning, sim-to-real transfer and safety using a policy without memory nor
explicit history. Reward engineering is then used to give insights into how to
keep balance. We demonstrate its performance in reality on the lower-limb
medical exoskeleton Atalante
- …