187 research outputs found
Straight-Leg Walking Through Underconstrained Whole-Body Control
We present an approach for achieving a natural, efficient gait on bipedal
robots using straightened legs and toe-off. Our algorithm avoids complex height
planning by allowing a whole-body controller to determine the straightest
possible leg configuration at run-time. The controller solutions are biased
towards a straight leg configuration by projecting leg joint angle objectives
into the null-space of the other quadratic program motion objectives. To allow
the legs to remain straight throughout the gait, toe-off was utilized to
increase the kinematic reachability of the legs. The toe-off motion is achieved
through underconstraining the foot position, allowing it to emerge naturally.
We applied this approach of under-specifying the motion objectives to the Atlas
humanoid, allowing it to walk over a variety of terrain. We present both
experimental and simulation results and discuss performance limitations and
potential improvements.Comment: Submitted to 2018 IEEE International Conference on Robotics and
Automatio
Dynamic Walking: Toward Agile and Efficient Bipedal Robots
Dynamic walking on bipedal robots has evolved from an idea in science fiction to a practical reality. This is due to continued progress in three key areas: a mathematical understanding of locomotion, the computational ability to encode this mathematics through optimization, and the hardware capable of realizing this understanding in practice. In this context, this review article outlines the end-to-end process of methods which have proven effective in the literature for achieving dynamic walking on bipedal robots. We begin by introducing mathematical models of locomotion, from reduced order models that capture essential walking behaviors to hybrid dynamical systems that encode the full order continuous dynamics along with discrete footstrike dynamics. These models form the basis for gait generation via (nonlinear) optimization problems. Finally, models and their generated gaits merge in the context of real-time control, wherein walking behaviors are translated to hardware. The concepts presented are illustrated throughout in simulation, and experimental instantiation on multiple walking platforms are highlighted to demonstrate the ability to realize dynamic walking on bipedal robots that is agile and efficient
Bipedal Walking Analysis, Control, and Applications Towards Human-Like Behavior
Realizing the essentials of bipedal walking balance is one of the core studies in both robotics and biomechanics. Although the recent developments of walking control on bipedal robots have brought the humanoid automation to a different level, the walking performance is still limited compared to human walking, which also restricts the related applications in biomechanics and rehabilitation.
To mitigate the discrepancy between robotic walking and human walking, this dissertation is broken into three parts to develop the control methods to improve three important perspectives: predictive walking behavior, gait optimization, and stepping strategy. To improve the predictive walking behavior captured by the model predictive control (MPC) which is transitionally applied with the nonlinear tracking control in sequence, a quadratic program (QP)-based controller is proposed to unify center of mass (COM) planning using MPC and a nonlinear torque control with control Lyapunov function (CLF). For the gait optimization, we focus on the algorithms of trajectory optimization with direct collocation framework. We propose a robust trajectory optimization using step-time sampling for a simple walker under terrain uncertainties. Towards generating human-like walking gait with multi-domain (phases), we improve the optimization through contact with more accurate transcription method for level walking, and generalize the hybrid zero dynamics (HZD) gait optimization with modified contact conditions for walking on various terrains. The results are compared with human walking gaits, where the similar trends and the sources of discrepancies are identified. In the third part for stepping strategy, we perform step estimation based on capture point (CP) for different human movements, including single-step (balance) recovery, walking and walking with slip. The analysis provides the insights of the efficacy and limitation of CP-based step estimation for human gait
Locomoção de humanoides robusta e versátil baseada em controlo analĂtico e fĂsica residual
Humanoid robots are made to resemble humans but their locomotion
abilities are far from ours in terms of agility and versatility. When humans
walk on complex terrains or face external disturbances, they
combine a set of strategies, unconsciously and efficiently, to regain
stability. This thesis tackles the problem of developing a robust omnidirectional
walking framework, which is able to generate versatile
and agile locomotion on complex terrains. We designed and developed
model-based and model-free walk engines and formulated the
controllers using different approaches including classical and optimal
control schemes and validated their performance through simulations
and experiments. These frameworks have hierarchical structures that
are composed of several layers. These layers are composed of several
modules that are connected together to fade the complexity and
increase the flexibility of the proposed frameworks. Additionally, they
can be easily and quickly deployed on different platforms.
Besides, we believe that using machine learning on top of analytical approaches
is a key to open doors for humanoid robots to step out of laboratories.
We proposed a tight coupling between analytical control and
deep reinforcement learning. We augmented our analytical controller
with reinforcement learning modules to learn how to regulate the walk
engine parameters (planners and controllers) adaptively and generate
residuals to adjust the robot’s target joint positions (residual physics).
The effectiveness of the proposed frameworks was demonstrated and
evaluated across a set of challenging simulation scenarios. The robot
was able to generalize what it learned in one scenario, by displaying
human-like locomotion skills in unforeseen circumstances, even in the
presence of noise and external pushes.Os robĂ´s humanoides sĂŁo feitos para se parecerem com humanos,
mas suas habilidades de locomoção estão longe das nossas em termos
de agilidade e versatilidade. Quando os humanos caminham em
terrenos complexos ou enfrentam distĂşrbios externos combinam diferentes
estratégias, de forma inconsciente e eficiente, para recuperar a
estabilidade. Esta tese aborda o problema de desenvolver um sistema
robusto para andar de forma omnidirecional, capaz de gerar uma locomoção
para robôs humanoides versátil e ágil em terrenos complexos.
Projetámos e desenvolvemos motores de locomoção sem modelos e
baseados em modelos. Formulámos os controladores usando diferentes
abordagens, incluindo esquemas de controlo clássicos e ideais,
e validámos o seu desempenho por meio de simulações e experiências
reais. Estes frameworks têm estruturas hierárquicas compostas por
várias camadas. Essas camadas são compostas por vários módulos
que sĂŁo conectados entre si para diminuir a complexidade e aumentar
a flexibilidade dos frameworks propostos. Adicionalmente, o sistema
pode ser implementado em diferentes plataformas de forma fácil.
Acreditamos que o uso de aprendizagem automática sobre abordagens
analĂticas Ă© a chave para abrir as portas para robĂ´s humanoides
saĂrem dos laboratĂłrios. Propusemos um forte acoplamento entre controlo
analĂtico e aprendizagem profunda por reforço. Expandimos o
nosso controlador analĂtico com mĂłdulos de aprendizagem por reforço
para aprender como regular os parâmetros do motor de caminhada
(planeadores e controladores) de forma adaptativa e gerar resĂduos
para ajustar as posições das juntas alvo do robĂ´ (fĂsica residual). A
eficácia das estruturas propostas foi demonstrada e avaliada em um
conjunto de cenários de simulação desafiadores. O robô foi capaz de
generalizar o que aprendeu em um cenário, exibindo habilidades de
locomoção humanas em circunstâncias imprevistas, mesmo na presença
de ruĂdo e impulsos externos.Programa Doutoral em Informátic
Motion Planning and Control of Dynamic Humanoid Locomotion
Inspired by human, humanoid robots has the potential to become a general-purpose platform that lives along with human. Due to the technological advances in many field, such as actuation, sensing, control and intelligence, it finally enables humanoid robots to possess human comparable capabilities. However, humanoid locomotion is still a challenging research field. The large number of degree of freedom structure makes the system difficult to coordinate online. The presence of various contact constraints and the hybrid nature of locomotion tasks make the planning a harder problem to solve. Template model anchoring approach has been adopted to bridge the gap between simple model behavior and the whole-body motion of humanoid robot.
Control policies are first developed for simple template models like Linear Inverted Pendulum Model (LIPM) or Spring Loaded Inverted Pendulum(SLIP), the result controlled behaviors are then been mapped to the whole-body motion of humanoid robot through optimization-based task-space control strategies. Whole-body humanoid control framework has been verified on various contact situations such as unknown uneven terrain, multi-contact scenarios and moving platform and shows its generality and versatility. For walking motion, existing Model Predictive Control approach based on LIPM has been extended to enable the robot to walk without any reference foot placement anchoring. It is kind of discrete version of \u201cwalking without thinking\u201d.
As a result, the robot could achieve versatile locomotion modes such as automatic foot placement with single reference velocity command, reactive stepping under large external disturbances, guided walking with small constant external pushing forces, robust walking on unknown uneven terrain, reactive stepping in place when blocked by external barrier. As an extension of this proposed framework, also to increase the push recovery capability of the humanoid robot, two new configurations have been proposed to enable the robot to perform cross-step motions. For more dynamic hopping and running motion, SLIP model has been chosen as the template model. Different from traditional model-based analytical approach, a data-driven approach has been proposed to encode the dynamics of the this model. A deep neural network is trained offline with a large amount of simulation data based on the SLIP model to learn its dynamics.
The trained network is applied online to generate reference foot placements for the humanoid robot. Simulations have been performed to evaluate the effectiveness of the proposed approach in generating bio-inspired and robust running motions. The method proposed based on 2D SLIP model can be generalized to 3D SLIP model and the extension has been briefly mentioned at the end
From walking to running: robust and 3D humanoid gait generation via MPC
Humanoid robots are platforms that can succeed in tasks conceived for humans. From locomotion in unstructured environments, to driving cars, or working in industrial plants,
these robots have a potential that is yet to be disclosed in systematic every-day-life applications. Such a perspective, however, is opposed by the need of solving complex
engineering problems under the hardware and software point of view. In this thesis, we focus on the software side of the problem, and in particular on locomotion control. The operativity of a legged humanoid is subordinate to its capability of realizing a reliable locomotion. In many settings, perturbations may undermine the balance and make the robot fall. Moreover, complex and dynamic motions might be required by the context, as for instance it could be needed to start running or climbing stairs to achieve a certain location in the shortest time. We present gait generation schemes based on Model Predictive Control (MPC) that tackle both the problem of robustness and tridimensional dynamic motions. The proposed control schemes adopt the typical paradigm of centroidal MPC for reference motion generation, enforcing dynamic balance through the Zero Moment Point condition, plus a whole-body controller that maps the generated trajectories to joint commands. Each of the described predictive controllers also feature a so-called stability constraint, preventing the generation of diverging Center of Mass trajectories with respect to the Zero Moment Point. Robustness is addressed by modeling the humanoid as a Linear Inverted Pendulum and devising two types of strategies. For persistent perturbations, a way to use a disturbance observer and a technique for constraint tightening (to ensure robust constraint satisfaction) are presented. In the case of impulsive pushes instead, techniques for footstep and timing adaptation are introduced. The underlying approach is to interpret robustness as a MPC feasibility problem, thus aiming at ensuring the existence of a solution for the constrained optimization problem to be solved at each iteration in spite of the perturbations. This perspective allows to devise simple solutions to complex problems, favoring a reliable real-time implementation.
For the tridimensional locomotion, on the other hand, the humanoid is modeled as a Variable Height Inverted Pendulum. Based on it, a two stage MPC is introduced with particular emphasis on the implementation of the stability constraint. The overall result is a gait generation scheme that allows the robot to overcome relatively complex
environments constituted by a non-flat terrain, with also the capability of realizing running gaits. The proposed methods are validated in different settings: from conceptual simulations in Matlab to validations in the DART dynamic environment, up to experimental tests on the NAO and the OP3 platforms
Simple models of legged locomotion based on compliant limb behavior = Grundmodelle pedaler Lokomotion basierend auf nachgiebigem Beinverhalten
In der vorliegenden Dissertation werden einfache Modelle zur Beinlokomotion unter der gemeinsamen Hypothese entwickelt, dass die beiden grundlegenden und als verschieden angesehenen Gangarten Gehen und Rennen auf ein allgemeines Konzept zurückgeführt werden können, welches in den Standphasen allein auf nachgiebigem Beinverhalten beruht. Hierbei wird auf der Ebene der mechanischen Beschreibung der Gangarten nachgiebiges Beinverhalten mittels des vom Rennen bekannten Masse-Feder-Modells abstrahiert. Zunächst wird eine vergleichsweise einfache, analytische Näherungslösung desselben identifiziert; in einem weiteren Schritt wird die charakteristische Geschwindigkeit des Gangartwechsels aus federartigem Beinverhalten erklärt; und schließlich wird ein zweibeiniges Masse-Feder-Modell für Gehen vorgeschlagen, welches die beobachteten Bodenreaktionskräfte dieser Gangart beschreibt. Auf der Ebene der neuromechanischen Beschreibung wird aufgezeigt, wie das mit einer mechanischen Feder abstrahierte Beinverhalten durch eine positive Rückkopplung der Muskelkraft dezentral und autonom innerhalb des Muskelskelettapparats erzeugt werden kann. Schließlich werden die Einzelergebnisse der Arbeit zusammengefasst, wobei die beiden fundamentalen Gangarten Gehen und Rennen innerhalb des zweibeinigen Masse-Feder-Modells vereinigt werden und die Bedeutung dieses, auf nachgiebigem Beinverhalten beruhenden Zusammenschlusses sowohl für die biomechanische und motorische Grundlagenforschung als auch für Anwendungen in der Robotik, Rehabilitation und Prothetik erörtert wird
Optimization-Based Control for Dynamic Legged Robots
In a world designed for legs, quadrupeds, bipeds, and humanoids have the
opportunity to impact emerging robotics applications from logistics, to
agriculture, to home assistance. The goal of this survey is to cover the recent
progress toward these applications that has been driven by model-based
optimization for the real-time generation and control of movement. The majority
of the research community has converged on the idea of generating locomotion
control laws by solving an optimal control problem (OCP) in either a
model-based or data-driven manner. However, solving the most general of these
problems online remains intractable due to complexities from intermittent
unidirectional contacts with the environment, and from the many degrees of
freedom of legged robots. This survey covers methods that have been pursued to
make these OCPs computationally tractable, with specific focus on how
environmental contacts are treated, how the model can be simplified, and how
these choices affect the numerical solution methods employed. The survey
focuses on model-based optimization, covering its recent use in a stand alone
fashion, and suggesting avenues for combination with learning-based
formulations to further accelerate progress in this growing field.Comment: submitted for initial review; comments welcom
Robust and Versatile Bipedal Jumping Control through Reinforcement Learning
This work aims to push the limits of agility for bipedal robots by enabling a
torque-controlled bipedal robot to perform robust and versatile dynamic jumps
in the real world. We present a reinforcement learning framework for training a
robot to accomplish a large variety of jumping tasks, such as jumping to
different locations and directions. To improve performance on these challenging
tasks, we develop a new policy structure that encodes the robot's long-term
input/output (I/O) history while also providing direct access to a short-term
I/O history. In order to train a versatile jumping policy, we utilize a
multi-stage training scheme that includes different training stages for
different objectives. After multi-stage training, the policy can be directly
transferred to a real bipedal Cassie robot. Training on different tasks and
exploring more diverse scenarios lead to highly robust policies that can
exploit the diverse set of learned maneuvers to recover from perturbations or
poor landings during real-world deployment. Such robustness in the proposed
policy enables Cassie to succeed in completing a variety of challenging jump
tasks in the real world, such as standing long jumps, jumping onto elevated
platforms, and multi-axes jumps.Comment: Accepted in Robotics: Science and Systems 2023 (RSS 2023). The
accompanying video is at https://youtu.be/aAPSZ2QFB-
- …