Adaptive, fast walking in a biped robot under neuronal control and learning

Human walking is a dynamic, partly self-stabilizing process relying on the interaction of the biomechanical design with its neuronal control. The coordination of this process is a very difficult problem, and it has been suggested that it involves a hierarchy of levels, where the lower ones, e.g., interactions between muscles and the spinal cord, are largely autonomous, and where higher level control (e.g., cortical) arises only pointwise, as needed. This requires an architecture of several nested, sensori–motor loops where the walking process provides feedback signals to the walker's sensory systems, which can be used to coordinate its movements. To complicate the situation, at a maximal walking speed of more than four leg-lengths per second, the cycle period available to coordinate all these loops is rather short. In this study we present a planar biped robot, which uses the design principle of nested loops to combine the self-stabilizing properties of its biomechanical design with several levels of neuronal control. Specifically, we show how to adapt control by including online learning mechanisms based on simulated synaptic plasticity. This robot can walk with a high speed (> 3.0 leg length/s), self-adapting to minor disturbances, and reacting in a robust way to abruptly induced gait changes. At the same time, it can learn walking on different terrains, requiring only few learning experiences. This study shows that the tight coupling of physical with neuronal control, guided by sensory feedback from the walking pattern itself, combined with synaptic learning may be a way forward to better understand and solve coordination problems in other complex motor tasks

Humanoid robot walking control on inclined planes

The humanoid bipedal structure is suitable for a assitive robot functioning in the human environment. However, the bipedal walk is a difficult control problem. Walking just on even floor is not satisfactory for the applicability of a humanoid robot. This paper presents a study on bipedal walk on inclined planes. A Zero Moment Point (ZMP) based reference generation technique is employed. The orientation of the feet is adjusted online by a fuzzy logic system to adapt to different walking surface slopes. This system uses a sampling time larger than the one of the joint space position controllers. The average value of the body pitch angle is used as the inputs to the fuzzy logic system. A foot pitch orientation compensator implemented independently for the two feet complements the fuzyy controller. A 12-degrees-of-freedom (DOF) biped robot model is used in the full-dynamics 3-D simulations. Simulations are carried out on even floor and inclined planes with different slopes. The results indicate that the control method presented is successful in enabling the robot to climb slopes of 8.5 degrees (15 percent grade)

Bayesian Optimization Using Domain Knowledge on the ATRIAS Biped

Controllers in robotics often consist of expert-designed heuristics, which can be hard to tune in higher dimensions. It is typical to use simulation to learn these parameters, but controllers learned in simulation often don't transfer to hardware. This necessitates optimization directly on hardware. However, collecting data on hardware can be expensive. This has led to a recent interest in adapting data-efficient learning techniques to robotics. One popular method is Bayesian Optimization (BO), a sample-efficient black-box optimization scheme, but its performance typically degrades in higher dimensions. We aim to overcome this problem by incorporating domain knowledge to reduce dimensionality in a meaningful way, with a focus on bipedal locomotion. In previous work, we proposed a transformation based on knowledge of human walking that projected a 16-dimensional controller to a 1-dimensional space. In simulation, this showed enhanced sample efficiency when optimizing human-inspired neuromuscular walking controllers on a humanoid model. In this paper, we present a generalized feature transform applicable to non-humanoid robot morphologies and evaluate it on the ATRIAS bipedal robot -- in simulation and on hardware. We present three different walking controllers; two are evaluated on the real robot. Our results show that this feature transform captures important aspects of walking and accelerates learning on hardware and simulation, as compared to traditional BO.Comment: 8 pages, submitted to IEEE International Conference on Robotics and Automation 201

A study on automatic gait parameter tuning for biped walking robots

Automatic gait parameter tuning for biped walking robots is the subject of this thesis. The biped structure is one of the most versatile ones for the employment of mobile robots in the human environment. Their control is challenging because of their many DOFs and nonlinearities in their dynamics. Open loop walking with offline walk pattern generation is one of the methods for walking control. in this method the reference positions of the foot centers with respect to the body center are generated as functionals. Commonly, the tuning process for the trajectory generation is based on numerous trial and error steps. Obviously, this is a time consuming and elaborate process. In this work, online adaptation schemes for one of the trajectory parameters, "z-reference asymmetry", which is used for the compensation of uneven weight distribution of the robot in the sagittal plane, is proposed. In one of the approaches presented, this parameter is tuned online. As an alternative to parameter tuning, a functional learning scheme employing fuzzy identifiers is tested too. Fuzzy identifiers are universal function approximators. Fuzzy system parameters are adapted via back-propagation. An on-line tuning scheme for biped walk parameters however can only be successful if there is sufficient time for training without falling. The training might last hundreds of reference cycles. This implies that a mechanism for keeping the robot in continuous walk, even when the parameter settings are totally wrong, is necessary during training. In this work, virtual torsional springs which resist against deviations of the robot trunk angles from zero, are attached to the trunk center of the biped. The torques generated by the springs serve as the criteria for the tuning and help in maintaining a stable and a longer walk. The springs are removed after training. This novel approach can be applied to a wide range of control systems that involve parameter tuning. 3-D simulation techniques using C++ are employed for the model of a 12-DOF biped robot to test the proposed adaptive method. in order to visualize the walking, simulation results are animated using an OpenGL based animation environment. As a result of the simulations, a functional for the desired parameter, keeping the system in balance while walking, is generated

Humanoid robot orientation stabilization by shoulder joint motion during locomotion

Arm swing action is a natural phenomenon that emerges in biped locomotion. A shoulder torque reference generation method is introduced in this paper to utilize arms of a humanoid robot during locomotion. Main idea of the technique is the employment of shoulder joint actuation torques in order to stabilize body orientation. The reference torques are computed by a method which utilizes proportional and derivative actions. Body orientation angles serve as the inputs of this system. The approach is tested via simulations with the 3D full-dynamics model of the humanoid robot SURALP (Sabanci University Robotics Research Laboratory Platform). Results indicate that the method is successful in reducing oscillations of body angles during bipedal walking