Asymptotically Stable Walking of a Five-Link Underactuated 3D Bipedal Robot

This paper presents three feedback controllers that achieve an asymptotically stable, periodic, and fast walking gait for a 3D (spatial) bipedal robot consisting of a torso, two legs, and passive (unactuated) point feet. The contact between the robot and the walking surface is assumed to inhibit yaw rotation. The studied robot has 8 DOF in the single support phase and 6 actuators. The interest of studying robots with point feet is that the robot's natural dynamics must be explicitly taken into account to achieve balance while walking. We use an extension of the method of virtual constraints and hybrid zero dynamics, in order to simultaneously compute a periodic orbit and an autonomous feedback controller that realizes the orbit. This method allows the computations to be carried out on a 2-DOF subsystem of the 8-DOF robot model. The stability of the walking gait under closed-loop control is evaluated with the linearization of the restricted Poincar\'e map of the hybrid zero dynamics. Three strategies are explored. The first strategy consists of imposing a stability condition during the search of a periodic gait by optimization. The second strategy uses an event-based controller. In the third approach, the effect of output selection is discussed and a pertinent choice of outputs is proposed, leading to stabilization without the use of a supplemental event-based controller

Systematic Controller Design for Dynamic 3D Bipedal Robot Walking.

Virtual constraints and hybrid zero dynamics (HZD) have emerged as a powerful framework for controlling bipedal robot locomotion, as evidenced by the robust, energetically efficient, and natural-looking walking and running gaits achieved by planar robots such as Rabbit, ERNIE, and MABEL. However, the extension to 3D robots is more subtle, as the choice of virtual constraints has a deciding effect on the stability of a periodic orbit. Furthermore, previous methods did not provide a systematic means of designing virtual constraints to ensure stability. This thesis makes both experimental and theoretical contributions to the control of underactuated 3D bipedal robots. On the experimental side, we present the first realization of dynamic 3D walking using virtual constraints. The experimental success is achieved by augmenting a robust planar walking gait with a novel virtual constraint for the lateral swing hip angle. The resulting controller is tested in the laboratory on a human-scale bipedal robot (MARLO) and demonstrated to stabilize the lateral motion for unassisted 3D walking at approximately 1 m/s. MARLO is one of only two known robots to walk in 3D with stilt-like feet. On the theoretical side, we introduce a method to systematically tune a given choice of virtual constraints in order to stabilize a periodic orbit of a hybrid system. We demonstrate the method to stabilize a walking gait for MARLO, and show that the optimized controller leads to improved lateral control compared to the nominal virtual constraints. We also describe several extensions of the basic method, allowing the use of a restricted Poincaré map and the incorporation of disturbance rejection metrics in the optimization. Together, these methods comprise an important contribution to the theory of HZD.PhDElectrical Engineering: SystemsUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/113370/1/bgbuss_1.pd

Dynamically Stable 3D Quadrupedal Walking with Multi-Domain Hybrid System Models and Virtual Constraint Controllers

Hybrid systems theory has become a powerful approach for designing feedback controllers that achieve dynamically stable bipedal locomotion, both formally and in practice. This paper presents an analytical framework 1) to address multi-domain hybrid models of quadruped robots with high degrees of freedom, and 2) to systematically design nonlinear controllers that asymptotically stabilize periodic orbits of these sophisticated models. A family of parameterized virtual constraint controllers is proposed for continuous-time domains of quadruped locomotion to regulate holonomic and nonholonomic outputs. The properties of the Poincare return map for the full-order and closed-loop hybrid system are studied to investigate the asymptotic stabilization problem of dynamic gaits. An iterative optimization algorithm involving linear and bilinear matrix inequalities is then employed to choose stabilizing virtual constraint parameters. The paper numerically evaluates the analytical results on a simulation model of an advanced 3D quadruped robot, called GR Vision 60, with 36 state variables and 12 control inputs. An optimal amble gait of the robot is designed utilizing the FROST toolkit. The power of the analytical framework is finally illustrated through designing a set of stabilizing virtual constraint controllers with 180 controller parameters.Comment: American Control Conference 201

Exponentially Stabilizing Controllers for Multi-Contact 3D Bipedal Locomotion

Models of bipedal walking are hybrid with continuous-time phases representing the Lagrangian stance dynamics and discrete-time transitions representing the impact of the swing leg with the walking surface. The design of continuous-time feedback controllers that exponentially stabilize periodic gaits for hybrid models of underactuated 3D bipedal walking is a significant challenge. We recently introduced a method based on an iterative sequence of optimization problems involving bilinear matrix inequalities (BMIs) to systematically design stabilizing continuous-time controllers for single domain hybrid models of underactuated bipedal robots with point feet. This paper addresses the exponential stabilization problem for multi-contact walking gaits with nontrivial feet. A family of parameterized continuous-time controllers is proposed for different phases of the walking cycle. The BMI algorithm is extended to the multi-domain hybrid models of anthropomorphic 3D walking locomotion to look for stabilizing controller parameters. The Poincaré map is addressed and a new set of sufficient conditions is presented that guarantees the convergence of the BMI algorithm to a stabilizing set of controller parameters at a finite number of iterations. The power of the algorithm is ultimately demonstrated through the design of stabilizing virtual constraint controllers for dynamic walking of a 3D humanoid model with 28 state variables and 275 controller parameters

Bridging Vision and Dynamic Legged Locomotion

Legged robots have demonstrated remarkable advances regarding robustness and versatility in the past decades. The questions that need to be addressed in this field are increasingly focusing on reasoning about the environment and autonomy rather than locomotion only. To answer some of these questions visual information is essential. If a robot has information about the terrain it can plan and take preventive actions against potential risks. However, building a model of the terrain is often computationally costly, mainly because of the dense nature of visual data. On top of the mapping problem, robots need feasible body trajectories and contact sequences to traverse the terrain safely, which may also require heavy computations. This computational cost has limited the use of visual feedback to contexts that guarantee (quasi-) static stability, or resort to planning schemes where contact sequences and body trajectories are computed before starting to execute motions. In this thesis we propose a set of algorithms that reduces the gap between visual processing and dynamic locomotion. We use machine learning to speed up visual data processing and model predictive control to achieve locomotion robustness. In particular, we devise a novel foothold adaptation strategy that uses a map of the terrain built from on-board vision sensors. This map is sent to a foothold classifier based on a convolutional neural network that allows the robot to adjust the landing position of the feet in a fast and continuous fashion. We then use the convolutional neural network-based classifier to provide safe future contact sequences to a model predictive controller that optimizes target ground reaction forces in order to track a desired center of mass trajectory. We perform simulations and experiments on the hydraulic quadruped robots HyQ and HyQReal. For all experiments the contact sequences, the foothold adaptations, the control inputs and the map are computed and processed entirely on-board. The various tests show that the robot is able to leverage the visual terrain information to handle complex scenarios in a safe, robust and reliable manner

Symmetry Method for Limit Cycle Walking of Legged Robots.

Dynamic steady-state walking or running gaits for legged robots correspond to periodic orbits in the dynamic model. The common method for obtaining such periodic orbits is conducting a numerical search for fixed points of a Poincare map. However, as the number of degrees of freedom of the robot grows, such numerical search becomes computationally expensive because in each search trial the dynamic equations need to be integrated. Moreover, the numerical search for periodic orbits is in general sensitive to model errors, and it remains to be seen if the periodic orbit which is the outcome of the search in the domain of the dynamic model corresponds to a periodic gait in the actual robot. To overcome these issues, we have presented the Symmetry Method for Limit Cycle Walking, which relaxes the need to search for periodic orbits, and at the same time, the limit cycles obtained with this method are robust to model errors. Mathematically, we describe the symmetry method in the context of so-called Symmetric Hybrid Systems, whose properties are discussed. In particular, it is shown that a symmetric hybrid system can have an infinite number of periodic orbits that can be identified easily. In addition, it is shown how control strategies need to be selected so that the resulting reduced order system still possesses the properties of a symmetric hybrid system. The method of symmetry for limit cycle walking is successfully tested on a 12-DOF 3D model of the humanoid robot Romeo.PhDApplied and Interdisciplinary MathematicsUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/133356/1/razavi_1.pd

Trajectory Optimization and Machine Learning to Design Feedback Controllers for Bipedal Robots with Provable Stability

This thesis combines recent advances in trajectory optimization of hybrid dynamical systems with machine learning and geometric control theory to achieve unprecedented performance in bipedal robot locomotion. The work greatly expands the class of robot models for which feedback controllers can be designed with provable stability. The methods are widely applicable beyond bipedal robots, including exoskeletons, and prostheses, and eventually, drones, ADAS, and other highly automated machines. One main idea of this thesis is to greatly expand the use of multiple trajectories in the design of a stabilizing controller. The computation of many trajectories is now feasible due to new optimization tools. The computations are not fast enough to apply in the real-time, however, so they are not feasible for model predictive control (MPC). The offline “library” approach will encounter the curse of dimensionality for the high-dimensional models common in bipedal robots. To overcome these obstructions, we embed a stable walking motion in an attractive low-dimensional surface of the system's state space. The periodic orbit is now an attractor of the low-dimensional state-variable model but is not attractive in the full-order system. We then use the special structure of mechanical models associated with bipedal robots to embed the low-dimensional model in the original model in such a manner that the desired walking motions are locally exponentially stable. The ultimate solution in this thesis will generate model-based feedback controllers for bipedal robots, in such a way that the closed-loop system has a large stability basin, exhibits highly agile, dynamic behavior, and can deal with significant perturbations coming from the environment. In the case of bipeds: “model-based” means that the controller will be designed on the basis of the full floating-base dynamic model of the robot, and not a simplified model, such as the LIP (Linear Inverted Pendulum). By “agile and dynamic” is meant that the robot moves at the speed of a normal human or faster while walking off a curb. By “significant perturbation” is meant a human tripping, and while falling, throwing his/her full weight into the back of the robot.PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/145992/1/xda_1.pd