Development of a Hybrid Powered 2D Biped Walking Machine Designed for Rough Terrain Locomotion

Biped robots hold promise as terrestrial explorers because they require a single discrete foothold to place their next step. However, biped robots are multi-input multi-output dynamically unstable machines. This makes walking on rough terrain difficult at best. Progress has been made with non-periodic rough terrain like stairs or inclines with fully active walking machines. Terrain that requires the walker to change its gait pattern from a standard walk is still problematic. Most walking machines have difficulty detecting or responding to the small perturbations induced by this type of terrain. These small perturbations can lead to unstable gait cycles and possibly a fall. The Intelligent Systems and Automation Lab at the University of Kansas has built a three legged 2D biped walking machine to be used as a test stand for studying rough terrain walking. The specific aim of this research is to investigate how biped walkers can best maintain walking stability when acted upon by small perturbations caused by periodic rough terrain. The first walking machine prototype, referred to as Jaywalker has two main custom actuation systems. The first is the hip ratchet system. It allows the walker to have either a passive or active hip swing. The second is the hybrid parallel ankle actuator. This new actuator uses a pneumatic ram and stepper motor in parallel to produce an easily controlled high torque output. In open loop control it has less than a 1° tracking error and 0.065 RPM velocity error compared to a standard stepper motor. Step testing was conducted using the Jaywalker, with a passive hip, to determine if a walker with significant leg mass could walk without full body actuation. The results of testing show the Jaywalker is ultimately not capable of walking with a passive hip. However, the walking motion is fine until the terminal stance phase. At this point the legs fall quickly towards the ground as the knee extends the shank. This quick step phenomenon is caused by increased speeds and forces about the leg and hip caused by the extension of the shank. This issue can be overcome by fully actuating the hip, or by adding counterbalances to the legs about the hip

Bio-Inspired Robotics

Modern robotic technologies have enabled robots to operate in a variety of unstructured and dynamically-changing environments, in addition to traditional structured environments. Robots have, thus, become an important element in our everyday lives. One key approach to develop such intelligent and autonomous robots is to draw inspiration from biological systems. Biological structure, mechanisms, and underlying principles have the potential to provide new ideas to support the improvement of conventional robotic designs and control. Such biological principles usually originate from animal or even plant models, for robots, which can sense, think, walk, swim, crawl, jump or even fly. Thus, it is believed that these bio-inspired methods are becoming increasingly important in the face of complex applications. Bio-inspired robotics is leading to the study of innovative structures and computing with sensory–motor coordination and learning to achieve intelligence, flexibility, stability, and adaptation for emergent robotic applications, such as manipulation, learning, and control. This Special Issue invites original papers of innovative ideas and concepts, new discoveries and improvements, and novel applications and business models relevant to the selected topics of ``Bio-Inspired Robotics''. Bio-Inspired Robotics is a broad topic and an ongoing expanding field. This Special Issue collates 30 papers that address some of the important challenges and opportunities in this broad and expanding field

Legged robotic locomotion with variable impedance joints

Humans have a complex musculoskeletal arrangement which gives them great behavioural flexibility. As well as simply moving their legs, they can modulate the impedance of them. Variable impedance has become a large field in robotics, and tailoring the impedance of a robot to a particular task can improve efficiency, stability, and potentially safety. Locomotion of a bipedal robot is a perfect example of a task for which variable impedance may provide such advantages, since it is a dynamic movement which involves periodic ground impacts. This thesis explores the creation of two novel bipedal robots with variable impedance joints. These robots aim to achieve some of the benefits of compliance, while retaining the behavioural flexibility to be truly versatile machines. The field of variable impedance actuators is explored and evaluated, before the design of the robots is presented. Of the two robots, BLUE (Bipedal Locomotion at the University of Edinburgh) has a 700mm hip rotation height, and is a saggital plane biped. miniBLUE has a hip rotation height of 465mm, and includes additional joints to allow hip adduction and abduction. Rapid prototyping techniques were utilised in the creation of both robots, and both robots are based around a custom, high performance electronics and communication architecture. The human walking cycle is analysed and a simple, parameterised representation developed. Walking trajectories gathered from human motion capture data, and generated from high level gait determinants are evaluated in dynamic simulation, and then on BLUE. With the robot being capable of locomotion, we explore the effect of varying stiffness on efficiency, and find that changing the stiffness can have an effect on the energy efficiency of the movement. Finally, we introduce a system for goal-based teleoperation of the robots, in which parameters are extracted from a user in a motion capture suit and replicated by the robot. In this way, the robot produces the same overall locomotion as the human, but with joint trajectories and stiffnesses that are more suited for its dynamics

Towards energy-efficient limit-cycle walking in biped service robots: design analysis, modeling and experimental study of biped robot actuated by linear motors

Researchers have been studying biped robots for many years, and, while many advances in the field have been accomplished, there still remain the challenge to transfer the existing solutions into real applications. The main issues are related to mobility and autonomy. In mobility, biped robots have evolved greatly, nevertheless they are still far from what a human can do in the work-site. Similarly, autonomy of biped platforms has been tackled on several different grounds, but its core problem still remains, and it is associated to energy issues. Because of these energy issues, lately the main attention has been redirected to the long term autonomy of the biped robotics platforms. For that, much effort has been made to develop new more energy-efficient biped robots. The GIMBiped project in Aalto University was established to tackle the previous issues in energy efficiency and mobility, through the study and implementation of dynamic and energy-efficient bipedal robotic waking. This thesis falls into the first studies needed to achieve the previous goal using the GIMBiped testbed, starting with a detailed analysis of the nonlinear dynamics of the target system, using a modeling and simulation tools. This work also presents an assessment of different control techniques based on Limit Cycle walking, carried out on a two-dimensional kneed bipedal simulator. Furthermore, a numerical continuation analysis of the mechanical parameters of the first GIMBiped prototype was performed, using the same approximated planar kneed biped model. This study is done to analyze the effect that such variations in the mechanical design parameters produce in the stability and energy-efficiency of the system.Finally, experiments were performed in the GIMBiped testbed. These experiments show the results of a hybrid control technique proposed by the author, which combines traditional ZMP-based walking approach with a Limit Cycle trajectory-following control. Furthermore the results of a pure ZMP-based type of control are also presented.

Adaptive control of compliant robots with Reservoir Computing

In modern society, robots are increasingly used to handle dangerous, repetitive and/or heavy tasks with high precision. Because of the nature of the tasks, either being dangerous, high precision or simply repetitive, robots are usually constructed with high torque motors and sturdy materials, that makes them dangerous for humans to handle. In a car-manufacturing company, for example, a large cage is placed around the robot’s workspace that prevents humans from entering its vicinity. In the last few decades, efforts have been made to improve human-robot interaction. Often the movement of robots is characterized as not being smooth and clearly dividable into sub-movements. This makes their movement rather unpredictable for humans. So, there exists an opportunity to improve the motion generation of robots to enhance human-robot interaction. One interesting research direction is that of imitation learning. Here, human motions are recorded and demonstrated to the robot. Although the robot is able to reproduce such movements, it cannot be generalized to other situations. Therefore, a dynamical system approach is proposed where the recorded motions are embedded into the dynamics of the system. Shaping these nonlinear dynamics, according to recorded motions, allows for dynamical system to generalize beyond demonstration. As a result, the robot can generate motions of other situations not included in the recorded human demonstrations. In this dissertation, a Reservoir Computing approach is used to create a dynamical system in which such demonstrations are embedded. Reservoir Computing systems are Recurrent Neural Network-based approaches that are efficiently trained by considering only the training of the readout connections and retaining all other connections of such a network unchanged given their initial randomly chosen values. Although they have been used to embed periodic motions before, they were extended to embed discrete motions, or both. This work describes how such a motion pattern-generating system is built, investigates the nature of the underlying dynamics and evaluates their robustness in the face of perturbations. Additionally, a dynamical system approach to obstacle avoidance is proposed that is based on vector fields in the presence of repellers. This technique can be used to extend the motion abilities of the robot without need for changing the trained Motion Pattern Generator (MPG). Therefore, this approach can be applied in real-time on any system that generates a certain movement trajectory. Assume that the MPG system is implemented on an industrial robotic arm, similar to the ones used in a car factory. Even though the obstacle avoidance strategy presented is able to modify the generated motion of the robot’s gripper in such a way that it avoids obstacles, it does not guarantee that other parts of the robot cannot collide with a human. To prevent this, engineers have started to use advanced control algorithms that measure the amount of torque that is applied on the robot. This allows the robot to be aware of external perturbations. However, it turns out that, even with fast control loops, the adaptation to compensate for a sudden perturbation, is too slow to prevent high interaction forces. To reduce such forces, researchers started to use mechanical elements that are passively compliant (e.g., springs) and light-weight flexible materials to construct robots. Although such compliant robots are much safer and inherently energy efficient to use, their control becomes much harder. Most control approaches use model information about the robot (e.g., weight distribution and shape). However, when constructing a compliant robot it is hard to determine the dynamics of these materials. Therefore, a model-free adaptive control framework is proposed that assumes no prior knowledge about the robot. By interacting with the robot it learns an inverse robot model that is used as controller. The more it interacts, the better the control be- comes. Appropriately, this framework is called Inverse Modeling Adaptive (IMA) control framework. I have evaluated the IMA controller’s tracking ability on sev- eral tasks, investigating its model independence and stability. Furthermore, I have shown its fast learning ability and comparable performance to taskspecific designed controllers. Given both the MPG and IMA controllers, it is possible to improve the inter- actability of a compliant robot in a human-friendly environment. When the robot is to perform human-like motions for a large set of tasks, we need to demonstrate motion examples of all these tasks. However, biological research concerning the motion generation of animals and humans revealed that a limited set of motion patterns, called motion primitives, are modulated and combined to generate advanced motor/motion skills that humans and animals exhibit. Inspired by these interesting findings, I investigate if a single motion primitive indeed can be modulated to achieve a desired motion behavior. By some elementary experiments, where an MPG is controlled by an IMA controller, a proof of concept is presented. Furthermore, a general hierarchy is introduced that describes how a robot can be controlled in a biology-inspired manner. I also investigated how motion primitives can be combined to produce a desired motion. However, I was unable to get more advanced implementations to work. The results of some simple experiments are presented in the appendix. Another approach I investigated assumes that the primitives themselves are undefined. Instead, only a high-level description is given, which describes that every primitive on average should contribute equally, while still allowing for a single primitive to specialize in a part of the motion generation. Without defining the behavior of a primitive, only a set of untrained IMA controllers is used of which each will represent a single primitive. As a result of the high-level heuristic description, the task space is tiled into sub-regions in an unsupervised manner. Resulting in controllers that indeed represent a part of the motion generation. I have applied this Modular Architecture with Control Primitives (MACOP) on an inverse kinematic learning task and investigated the emerged primitives. Thanks to the tiling of the task space, it becomes possible to control redundant systems, because redundant solutions can be spread over several control primitives. Within each sub region of the task space, a specific control primitive is more accurate than in other regions allowing for the task complexity to be distributed over several less complex tasks. Finally, I extend the use of an IMA-controller, which is tracking controller, to the control of under-actuated systems. By using a sample-based planning algorithm it becomes possible to explore the system dynamics in which a path to a desired state can be planned. Afterwards, MACOP is used to incorporate feedback and to learn the necessary control commands corresponding to the planned state space trajectory, even if it contains errors. As a result, the under-actuated control of a cart pole system was achieved. Furthermore, I presented the concept of a simulation based control framework that allows the learning of the system dynamics, planning and feedback control iteratively and simultaneously

A Foot Placement Strategy for Robust Bipedal Gait Control

This thesis introduces a new measure of balance for bipedal robotics called the foot placement estimator (FPE). To develop this measure, stability first is defined for a simple biped. A proof of the stability of a simple biped in a controls sense is shown to exist using classical methods for nonlinear systems. With the addition of a contact model, an analytical solution is provided to define the bounds of the region of stability. This provides the basis for the FPE which estimates where the biped must step in order to be stable. By using the FPE in combination with a state machine, complete gait cycles are created without any precalculated trajectories. This includes gait initiation and termination. The bipedal model is then advanced to include more realistic mechanical and environmental models and the FPE approach is verified in a dynamic simulation. From these results, a 5-link, point-foot robot is designed and constructed to provide the final validation that the FPE can be used to provide closed-loop gait control. In addition, this approach is shown to demonstrate significant robustness to external disturbances. Finally, the FPE is shown in experimental results to be an unprecedented estimate of where humans place their feet for walking and jumping, and for stepping in response to an external disturbance

Advancing Musculoskeletal Robot Design for Dynamic and Energy-Efficient Bipedal Locomotion

Achieving bipedal robot locomotion performance that approaches human performance is a challenging research topic in the field of humanoid robotics, requiring interdisciplinary expertise from various disciplines, including neuroscience and biomechanics. Despite the remarkable results demonstrated by current humanoid robots---they can walk, stand, turn, climb stairs, carry a load, push a cart---the versatility, stability, and energy efficiency of humans have not yet been achieved. However, with robots entering our lives, whether in the workplace, in clinics, or in normal household environments, such improvements are increasingly important. The current state of research in bipedal robot locomotion reveals that several groups have continuously demonstrated enhanced locomotion performance of the developed robots. But each of these groups has taken a unilateral approach and placed the focus on only one aspect, in order to achieve enhanced movement abilities;---for instance, the motion control and postural stability or the mechanical design. The neural and mechanical systems in human and animal locomotion, however, are strongly coupled and should therefore not be treated separately. Human-inspired musculoskeletal design of bipedal robots offers great potential for enhanced dynamic and energy-efficient locomotion but also imposes major challenges for motion planning and control. In this thesis, we first present a detailed review of the problems related to achieving enhanced dynamic and energy-efficient bipedal locomotion, from various important perspectives, and examine the essential properties of the human locomotory apparatus. Subsequently, existing insights and approaches from biomechanics, to understand the neuromechanical motion apparatus, and from robotics, to develop more human-like robots that can move in our environment, are discussed in detail. These thorough investigations of the interrelated essential design decisions are used to develop a novel design for a musculoskeletal bipedal robot, BioBiped1, such that, in the long term, it is capable of realizing dynamic hopping, running, and walking motions. The BioBiped1 robot features a highly compliant tendon-driven actuation system that mimics key functionalities of the human lower limb system. In experiments, BioBiped1's locomotor function for the envisioned gaits is validated globally. It is shown that the robot is able to rebound passively, store and release energy, and actively push off from the ground. The proof of concept of BioBiped1's locomotor function, however, marks only the starting point for our investigations, since this novel design concept opens up a number of questions regarding the required design complexity for the envisioned motions and the appropriate motion generation and control concept. For this purpose, a simulator specifically designed for the requirements of musculoskeletally actuated robotic systems, including sufficiently realistic ground reaction forces, is developed. It relies on object-oriented design and is based on a numerical solver, without model switching, to enable the analysis of impact peak forces and the simulation of flight phases. The developed library also contains the models of the actuated and passive mono- and biarticular elastic tendons and a penalty-based compliant contact model with nonlinear damping, to incorporate the collision, friction, and stiction forces occurring during ground contact. Using these components, the full multibody system (MBS) dynamics model is developed. To ensure a sufficiently similar behavior of the simulated and the real musculoskeletal robot, various measurements and parameter identifications for sub-models are performed. Finally, it is shown that the simulation model behaves similarly to the real robot platform. The intelligent combination of actuated and passive mono- and biarticular tendons, imitating important human muscle groups, offers tremendous potential for improved locomotion performance but also requires a sophisticated concept for motion control of the robot. Therefore, a further contribution of this thesis is the development of a centralized, nonlinear model-based method for motion generation and control that utilizes the derived detailed dynamics models of the implemented actuators. The concept is used to realize both computer-generated hopping and human jogging motions. Additionally, the problem of appropriate motor-gear unit selection prior to the robot's construction is tackled, using this method. The thesis concludes with a number of simulation studies in which several leg actuation designs are examined for their optimality with regard to systematically selected performance criteria. Furthermore, earlier paradoxical biomechanical findings about biarticular muscles in running are presented and, for the first time, investigated by detailed simulation of the motion dynamics. Exploring the Lombard paradox, a novel reduced and energy-efficient locomotion model without knee extensor has been simulated successfully. The models and methods developed within this thesis, as well as the insights gained, are already being employed to develop future prototypes. In particular, the optimal dimensioning and setting of the actuators, including all mono- and biarticular muscle-tendon units, are based on the derived design guidelines and are extensively validated by means of the simulation models and the motion control method. These developments are expected to significantly enhance progress in the field of bipedal robot design and, in the long term, to drive improvements in rehabilitation for humans through an understanding of the neuromechanics underlying human walking and the application of this knowledge to the design of prosthetics