Optimization-based control and planning for highly dynamic legged locomotion in complex environments

Legged animals can dynamically traverse unstructured environments in an elegant and efficient manner, whether it be running down a steep hill or leaping between branches. To harness part of the animal agility to the legged robot would unlock potential applications such as disaster response and planetary exploration. The unique challenge of these tasks is that the robot has to produce highly dynamic maneuvers in complex environments with minimum human guidance. This thesis explores how an optimization-based method can be applied in the control and planning of highly dynamic legged motions to address the locomotion problem in complex environments. Specifically, this work first describes the design synthesis of a small and agile quadrupedal robot \panther. Based on the quadruped platform, we developed a model predictive control (MPC) control framework to realize complex 3D acrobatic motions without resorting to switching among controllers. We present the MPC formulation that directly uses the rotation matrix, which avoids the singularity issue associated with Euler angles. Motion planning algorithms are developed for planar-legged robot traversing challenging terrains. Dynamic trajectories that simultaneously reason about contact, centroidal dynamics, and joint torque limit are obtained by solving mixed-integer convex programs (MICP) without requiring any initial guess from the operator. We further reduce the computational expense of long-horizon planning by leveraging the benefits of both optimization and sampling-based approaches for a simple legged robot. Finally, we present experimental results for each topic on legged robot hardware to validate the proposed method. It is our hope that the results presented in this thesis will eventually enable legged robots to achieve mobility autonomy at the level of biological systems

Learning from optimization for bipedal robots

Legged robots have consistently captured our collective imagination through various forms of media, from Hollywood films, anime, and viral Youtube videos of robots accomplishing incredible feats of acrobatics. These robots have the potential to navigate our environments, capable of completing tasks that would otherwise require human intervention. However, developing controls for these robots to move around in the real world is a difficult engineering challenge replete with unsolved problems. Recently, reinforcement learning (RL) has shown to be a promising alternative solution to traditional model-based methods for difficult control problems. This work explores how model-based methods can be used to train learned models using RL for producing complex behaviors on high degree of freedom bipedal robots. The methods in this work are applied to realizing high-speed turns for Cassie on hardware, as well as box manipulation behaviors for Digit in simulation

Bio-Inspired Robotics

Modern robotic technologies have enabled robots to operate in a variety of unstructured and dynamically-changing environments, in addition to traditional structured environments. Robots have, thus, become an important element in our everyday lives. One key approach to develop such intelligent and autonomous robots is to draw inspiration from biological systems. Biological structure, mechanisms, and underlying principles have the potential to provide new ideas to support the improvement of conventional robotic designs and control. Such biological principles usually originate from animal or even plant models, for robots, which can sense, think, walk, swim, crawl, jump or even fly. Thus, it is believed that these bio-inspired methods are becoming increasingly important in the face of complex applications. Bio-inspired robotics is leading to the study of innovative structures and computing with sensory–motor coordination and learning to achieve intelligence, flexibility, stability, and adaptation for emergent robotic applications, such as manipulation, learning, and control. This Special Issue invites original papers of innovative ideas and concepts, new discoveries and improvements, and novel applications and business models relevant to the selected topics of ``Bio-Inspired Robotics''. Bio-Inspired Robotics is a broad topic and an ongoing expanding field. This Special Issue collates 30 papers that address some of the important challenges and opportunities in this broad and expanding field

Dynamic Bipedal Locomotion: From Hybrid Zero Dynamics to Control Lyapunov Functions via Experimentally Realizable Methods

Robotic bipedal locomotion has become a rapidly growing field of research as humans increasingly look to augment their natural environments with intelligent machines. In order for these robotic systems to navigate the often unstructured environments of the world and perform tasks, they must first have the capability to dynamically, reliably, and efficiently locomote. Due to the inherently hybrid and underactuated nature of dynamic bipedal walking, the greatest experimental successes in the field have often been achieved by considering all aspects of the problem; with explicit consideration of the interplay between modeling, trajectory planning, and feedback control. The methodology and developments presented in this thesis begin with the modeling and design of dynamic walking gaits on bipedal robots through hybrid zero dynamics (HZD), a mathematical framework that utilizes hybrid system models coupled with nonlinear controllers that results in stable locomotion. This will form the first half of the thesis, and will be used to develop a solid foundation of HZD trajectory optimization tools and algorithms for efficient synthesis of accurate hybrid motion plans for locomotion on two underactuated and compliant 3D bipeds. While HZD and the associated trajectory optimization are an existing framework, the resulting behaviors shown in these preliminary experiments will extend the limits of what HZD has demonstrated is possible thus far in the literature. Specifically, the core results of this thesis demonstrate the first experimental multi-contact humanoid walking with HZD on the DURUS robot and then through the first compliant HZD motion library for walking over a continuum of walking speeds on the Cassie robot. On the theoretical front, a novel formulation of an optimization-based control framework is introduced that couples convergence constraints from control Lyapunov functions (CLF)s with desirable formulations existing in other areas of the bipedal locomotion field that have proven successful in practice, such as inverse dynamics control and quadratic programming approaches. The theoretical analysis and experimental validation of this controller thus forms the second half of this thesis. First, a theoretical analysis is developed which demonstrates several useful properties of the approach for tuning and implementation, and the stability of the controller for HZD locomotion is proven. This is then extended to a relaxed version of the CLF controller, which removes a convergence inequality constraint in lieu of a conservative CLF cost within a quadratic program to achieve tracking. It is then explored how this new CLF formulation can fully leverage the planned HZD walking gaits to achieve the target performance on physical hardware. Towards this goal, an experimental implementation of the CLF controller is derived for the Cassie robot, with the resulting experiments demonstrating the first successful realization of a CLF controller for a 3D biped on hardware in the literature. The accuracy of the robot model and synthesized HZD motion library allow the real-time control implementation to regularize the CLF optimization cost about the nominal walking gait. This drives the controller to choose smooth input torques and anticipated spring torques, as well as regulate an optimal distribution of feasible ground reaction forces on hardware while reliably tracking the planned virtual constraints. These final results demonstrate how each component of this thesis were brought together to form an effective end-to-end implementation of a nonlinear control framework for underactuated locomotion on a bipedal robot through modeling, trajectory optimization, and then ultimately real-time control.</p

Conference on Intelligent Robotics in Field, Factory, Service, and Space (CIRFFSS 1994), volume 1

The AIAA/NASA Conference on Intelligent Robotics in Field, Factory, Service, and Space (CIRFFSS '94) was originally proposed because of the strong belief that America's problems of global economic competitiveness and job creation and preservation can partly be solved by the use of intelligent robotics, which are also required for human space exploration missions. Individual sessions addressed nuclear industry, agile manufacturing, security/building monitoring, on-orbit applications, vision and sensing technologies, situated control and low-level control, robotic systems architecture, environmental restoration and waste management, robotic remanufacturing, and healthcare applications