Dynamically Stable 3D Quadrupedal Walking with Multi-Domain Hybrid System Models and Virtual Constraint Controllers

Hybrid systems theory has become a powerful approach for designing feedback controllers that achieve dynamically stable bipedal locomotion, both formally and in practice. This paper presents an analytical framework 1) to address multi-domain hybrid models of quadruped robots with high degrees of freedom, and 2) to systematically design nonlinear controllers that asymptotically stabilize periodic orbits of these sophisticated models. A family of parameterized virtual constraint controllers is proposed for continuous-time domains of quadruped locomotion to regulate holonomic and nonholonomic outputs. The properties of the Poincare return map for the full-order and closed-loop hybrid system are studied to investigate the asymptotic stabilization problem of dynamic gaits. An iterative optimization algorithm involving linear and bilinear matrix inequalities is then employed to choose stabilizing virtual constraint parameters. The paper numerically evaluates the analytical results on a simulation model of an advanced 3D quadruped robot, called GR Vision 60, with 36 state variables and 12 control inputs. An optimal amble gait of the robot is designed utilizing the FROST toolkit. The power of the analytical framework is finally illustrated through designing a set of stabilizing virtual constraint controllers with 180 controller parameters.Comment: American Control Conference 201

A Comparative Study on the L-1 Optimal Event-Based Method for Biped Walking on Rough Terrains

This paper is concerned with a comparative study of biped walking on rough terrains. Given a bipedal robot capable of walking on a flat ground with periodic behavior, whose motion can be described by a limit cycle with the Poincare map, we consider whether the robot remains stable on rough terrain, in which geometrical uncertainties of the terrain are assumed to be persistent and bounded. More precisely, the l(infinity)-induced norm is defined on the Poincare map and taken as a performance measure evaluating a robot walking with the bounded persistent uncertainties. To minimize the performance measure and achieve an optimal walking performance, we further provide a systematic controller design scheme consisting of a inner-loop continuous-time controller and a outer-loop event-based controller, in which the latter is described as a sort of the l(1) optimal controller. Finally, the validity as well as the effectiveness of our proposed methods in biped walking on a rough terrain are demonstrated through simulation studies.11Yscopu

Exponentially Stabilizing Controllers for Multi-Contact 3D Bipedal Locomotion

Models of bipedal walking are hybrid with continuous-time phases representing the Lagrangian stance dynamics and discrete-time transitions representing the impact of the swing leg with the walking surface. The design of continuous-time feedback controllers that exponentially stabilize periodic gaits for hybrid models of underactuated 3D bipedal walking is a significant challenge. We recently introduced a method based on an iterative sequence of optimization problems involving bilinear matrix inequalities (BMIs) to systematically design stabilizing continuous-time controllers for single domain hybrid models of underactuated bipedal robots with point feet. This paper addresses the exponential stabilization problem for multi-contact walking gaits with nontrivial feet. A family of parameterized continuous-time controllers is proposed for different phases of the walking cycle. The BMI algorithm is extended to the multi-domain hybrid models of anthropomorphic 3D walking locomotion to look for stabilizing controller parameters. The Poincaré map is addressed and a new set of sufficient conditions is presented that guarantees the convergence of the BMI algorithm to a stabilizing set of controller parameters at a finite number of iterations. The power of the algorithm is ultimately demonstrated through the design of stabilizing virtual constraint controllers for dynamic walking of a 3D humanoid model with 28 state variables and 275 controller parameters

Control Implementation of Dynamic Locomotion on Compliant, Underactuated, Force-Controlled Legged Robots with Non-Anthropomorphic Design

The control of locomotion on legged robots traditionally involves a robot that takes a standard legged form, such as the anthropomorphic humanoid, the dog-like quadruped, or the bird-like biped. Additionally, these systems will often be actuated with position-controlled servos or series-elastic actuators that are connected through rigid links. This work investigates the control implementation of dynamic, force-controlled locomotion on a family of legged systems that significantly deviate from these classic paradigms by incorporating modern, state-of-the-art proprioceptive actuators on uniquely configured compliant legs that do not closely resemble those found in nature. The results of this work can be used to better inform how to implement controllers on legged systems without stiff, position-controlled actuators, and also provide insight on how intelligently designed mechanical features can potentially simplify the control of complex, nonlinear dynamical systems like legged robots. To this end, this work presents the approach to control for a family of non-anthropomorphic bipedal robotic systems which are developed both in simulation and with physical hardware. The first is the Non-Anthropomorphic Biped, Version 1 (NABi-1) that features position-controlled joints along with a compliant foot element on a minimally actuated leg, and is controlled using simple open-loop trajectories based on the Zero Moment Point. The second system is the second version of the non-anthropomorphic biped (NABi-2) which utilizes the proprioceptive Back-drivable Electromagnetic Actuator for Robotics (BEAR) modules for actuation and fully realizes feedback-based force controlled locomotion. These systems are used to highlight both the strengths and weaknesses of utilizing proprioceptive actuation in systems, and suggest the tradeoffs that are made when using force control for dynamic locomotion. These systems also present case studies for different approaches to system design when it comes to bipedal legged robots

Locomoção de humanoides robusta e versátil baseada em controlo analítico e física residual

Humanoid robots are made to resemble humans but their locomotion abilities are far from ours in terms of agility and versatility. When humans walk on complex terrains or face external disturbances, they combine a set of strategies, unconsciously and efficiently, to regain stability. This thesis tackles the problem of developing a robust omnidirectional walking framework, which is able to generate versatile and agile locomotion on complex terrains. We designed and developed model-based and model-free walk engines and formulated the controllers using different approaches including classical and optimal control schemes and validated their performance through simulations and experiments. These frameworks have hierarchical structures that are composed of several layers. These layers are composed of several modules that are connected together to fade the complexity and increase the flexibility of the proposed frameworks. Additionally, they can be easily and quickly deployed on different platforms. Besides, we believe that using machine learning on top of analytical approaches is a key to open doors for humanoid robots to step out of laboratories. We proposed a tight coupling between analytical control and deep reinforcement learning. We augmented our analytical controller with reinforcement learning modules to learn how to regulate the walk engine parameters (planners and controllers) adaptively and generate residuals to adjust the robot’s target joint positions (residual physics). The effectiveness of the proposed frameworks was demonstrated and evaluated across a set of challenging simulation scenarios. The robot was able to generalize what it learned in one scenario, by displaying human-like locomotion skills in unforeseen circumstances, even in the presence of noise and external pushes.Os robôs humanoides são feitos para se parecerem com humanos, mas suas habilidades de locomoção estão longe das nossas em termos de agilidade e versatilidade. Quando os humanos caminham em terrenos complexos ou enfrentam distúrbios externos combinam diferentes estratégias, de forma inconsciente e eficiente, para recuperar a estabilidade. Esta tese aborda o problema de desenvolver um sistema robusto para andar de forma omnidirecional, capaz de gerar uma locomoção para robôs humanoides versátil e ágil em terrenos complexos. Projetámos e desenvolvemos motores de locomoção sem modelos e baseados em modelos. Formulámos os controladores usando diferentes abordagens, incluindo esquemas de controlo clássicos e ideais, e validámos o seu desempenho por meio de simulações e experiências reais. Estes frameworks têm estruturas hierárquicas compostas por várias camadas. Essas camadas são compostas por vários módulos que são conectados entre si para diminuir a complexidade e aumentar a flexibilidade dos frameworks propostos. Adicionalmente, o sistema pode ser implementado em diferentes plataformas de forma fácil. Acreditamos que o uso de aprendizagem automática sobre abordagens analíticas é a chave para abrir as portas para robôs humanoides saírem dos laboratórios. Propusemos um forte acoplamento entre controlo analítico e aprendizagem profunda por reforço. Expandimos o nosso controlador analítico com módulos de aprendizagem por reforço para aprender como regular os parâmetros do motor de caminhada (planeadores e controladores) de forma adaptativa e gerar resíduos para ajustar as posições das juntas alvo do robô (física residual). A eficácia das estruturas propostas foi demonstrada e avaliada em um conjunto de cenários de simulação desafiadores. O robô foi capaz de generalizar o que aprendeu em um cenário, exibindo habilidades de locomoção humanas em circunstâncias imprevistas, mesmo na presença de ruído e impulsos externos.Programa Doutoral em Informátic

Optimization-based Framework for Stability and Robustness of Bipedal Walking Robots

As robots become more sophisticated and move out of the laboratory, they need to be able to reliably traverse difficult and rugged environments. Legged robots -- as inspired by nature -- are most suitable for navigating through terrain too rough or irregular for wheels. However, control design and stability analysis is inherently difficult since their dynamics are highly nonlinear, hybrid (mixing continuous dynamics with discrete impact events), and the target motion is a limit cycle (or more complex trajectory), rather than an equilibrium. For such walkers, stability and robustness analysis of even stable walking on flat ground is difficult. This thesis proposes new theoretical methods to analyse the stability and robustness of periodic walking motions. The methods are implemented as a series of pointwise linear matrix inequalities (LMI), enabling the use of convex optimization tools such as sum-of-squares programming in verifying the stability and robustness of the walker. To ensure computational tractability of the resulting optimization program, construction of a novel reduced coordinate system is proposed and implemented. To validate theoretic and algorithmic developments in this thesis, a custom-built “Compass gait” walking robot is used to demonstrate the efficacy of the proposed methods. The hardware setup, system identification and walking controller are discussed. Using the proposed analysis tools, the stability property of the hardware walker was successfully verified, which corroborated with the computational results

Legged locomotion over irregular terrains: State of the art of human and robot performance

Legged robotic technologies have moved out of the lab to operate in real environments, characterized by a wide variety of unpredictable irregularities and disturbances, all this in close proximity with humans. Demonstrating the ability of current robots to move robustly and reliably in these conditions is becoming essential to prove their safe operation. Here, we report an in-depth literature review aimed at verifying the existence of common or agreed protocols and metrics to test the performance of legged system in realistic environments. We primarily focused on three types of robotic technologies, i.e., hexapods, quadrupeds and bipeds. We also included a comprehensive overview on human locomotion studies, being it often considered the gold standard for performance, and one of the most important sources of bioinspiration for legged machines. We discovered that very few papers have rigorously studied robotic locomotion under irregular terrain conditions. On the contrary, numerous studies have addressed this problem on human gait, being nonetheless of highly heterogeneous nature in terms of experimental design. This lack of agreed methodology makes it challenging for the community to properly assess, compare and predict the performance of existing legged systems in real environments. On the one hand, this work provides a library of methods, metrics and experimental protocols, with a critical analysis on the limitations of the current approaches and future promising directions. On the other hand, it demonstrates the existence of an important lack of benchmarks in the literature, and the possibility of bridging different disciplines, e.g., the human and robotic, towards the definition of standardized procedure that will boost not only the scientific development of better bioinspired solutions, but also their market uptake

Distributed Feedback Controllers for Stable Cooperative Locomotion of Quadrupedal Robots: A Virtual Constraint Approach

This paper aims to develop distributed feedback control algorithms that allow cooperative locomotion of quadrupedal robots which are coupled to each other by holonomic constraints. These constraints can arise from collaborative manipulation of objects during locomotion. In addressing this problem, the complex hybrid dynamical models that describe collaborative legged locomotion are studied. The complex periodic orbits (i.e., gaits) of these sophisticated and high-dimensional hybrid systems are investigated. We consider a set of virtual constraints that stabilizes locomotion of a single agent. The paper then generates modified and local virtual constraints for each agent that allow stable collaborative locomotion. Optimal distributed feedback controllers, based on nonlinear control and quadratic programming, are developed to impose the local virtual constraints. To demonstrate the power of the analytical foundation, an extensive numerical simulation for cooperative locomotion of two quadrupedal robots with robotic manipulators is presented. The numerical complex hybrid model has 64 continuous-time domains, 192 discrete-time transitions, 96 state variables, and 36 control inputs

Nonholonomic Hybrid Zero Dynamics for the Stabilization of Periodic Orbits: Application to Underactuated Robotic Walking

This brief addresses zero dynamics associated with relative degree one and two nonholonomic outputs for exponential stabilization of given periodic orbits for hybrid models of bipedal locomotion. Zero dynamics manifolds are constructed to contain the orbit while being invariant under both the continuous- and discrete-time dynamics. The associated restriction dynamics are termed the hybrid zero dynamics (HZD). Prior results on the HZD have mainly relied on input–output linearization of holonomic outputs and are referred to as holonomic HZD (H-HZD). This brief presents reduced-order expressions for the HZD associated with nonholonomic output functions referred to as nonholonomic HZD (NH-HZD). This brief systematically synthesizes NH-HZD controllers to stabilize periodic orbits based on a reduced-order stability analysis. A comprehensive study of H-HZD and NH-HZD is presented. It is shown that NH-HZD can stabilize a broader range of walking gaits that are not stabilizable through traditional H-HZD. The power of the analytical results is finally illustrated on a hybrid model of a bipedal robot through numerical simulations