Locomotion training of legged robots using hybrid machine learning techniques

In this study artificial neural networks and fuzzy logic are used to control the jumping behavior of a three-link uniped robot. The biped locomotion control problem is an increment of the uniped locomotion control. Study of legged locomotion dynamics indicates that a hierarchical controller is required to control the behavior of a legged robot. A structured control strategy is suggested which includes navigator, motion planner, biped coordinator and uniped controllers. A three-link uniped robot simulation is developed to be used as the plant. Neurocontrollers were trained both online and offline. In the case of on-line training, a reinforcement learning technique was used to train the neurocontroller to make the robot jump to a specified height. After several hundred iterations of training, the plant output achieved an accuracy of 7.4%. However, when jump distance and body angular momentum were also included in the control objectives, training time became impractically long. In the case of off-line training, a three-layered backpropagation (BP) network was first used with three inputs, three outputs and 15 to 40 hidden nodes. Pre-generated data were presented to the network with a learning rate as low as 0.003 in order to reach convergence. The low learning rate required for convergence resulted in a very slow training process which took weeks to learn 460 examples. After training, performance of the neurocontroller was rather poor. Consequently, the BP network was replaced by a Cerebeller Model Articulation Controller (CMAC) network. Subsequent experiments described in this document show that the CMAC network is more suitable to the solution of uniped locomotion control problems in terms of both learning efficiency and performance. A new approach is introduced in this report, viz., a self-organizing multiagent cerebeller model for fuzzy-neural control of uniped locomotion is suggested to improve training efficiency. This is currently being evaluated for a possible patent by NASA, Johnson Space Center. An alternative modular approach is also developed which uses separate controllers for each stage of the running stride. A self-organizing fuzzy-neural controller controls the height, distance and angular momentum of the stride. A CMAC-based controller controls the movement of the leg from the time the foot leaves the ground to the time of landing. Because the leg joints are controlled at each time step during flight, movement is smooth and obstacles can be avoided. Initial results indicate that this approach can yield fast, accurate results

Evolution of humanoid robot and contribution of various countries in advancing the research and development of the platform

A human like autonomous robot which is capable to adapt itself with the changing of its environment and continue to reach its goal is considered as Humanoid Robot. These characteristics differs the Android from the other kind of robots. In recent years there has been much progress in the development of Humanoid and still there are a lot of scopes in this field. A number of research groups are interested in this area and trying to design and develop a various platforms of Humanoid based on mechanical and biological concept. Many researchers focus on the designing of lower torso to make the Robot navigating as like as a normal human being do. Designing the lower torso which includes west, hip, knee, ankle and toe, is the more complex and more challenging task. Upper torso design is another complex but interesting task that includes the design of arms and neck. Analysis of walking gait, optimal control of multiple motors or other actuators, controlling the Degree of Freedom (DOF), adaptability control and intelligence are also the challenging tasks to make a Humanoid to behave like a human. Basically research on this field combines a variety of disciplines which make it more thought-provoking area in Mechatronics Engineering. In this paper a various platforms for Humanoid Robot development are identified and described based on the evolutionary research on robotics. The paper also depicts a virtual map of humanoid platform development from the ancient time to present time. It is very important and effective to analyze the development phases of androids because of its Business, Educational and Research value. Basic comparisons between the different designs of Humanoid Structures are also analyzed in this paper. ©ICROS

Biped dynamic walking using reinforcement learning

This thesis presents a study of biped dynamic walking using reinforcement learning. A hardware biped robot was built. It uses low gear ratio DC motors in order to provide free leg movements. The Self Scaling Reinforcement learning algorithm was developed in order to deal with the problem of reinforcement learning in continuous action domains. A new learning architecture was designed to solve complex control problems. It uses different modules that consist of simple controllers and small neural networks. The architecture allows for easy incorporation of modules that represent new knowledge, or new requirements for the desired task. Control experiments were carried out using a simulator and the physical biped. The biped learned dynamic walking on flat surfaces without any previous knowledge about its dynamic model

Prescription of rhythmic patterns for legged locomotion

As the engine behind many life phenomena, motor information generated by the central nervous system (CNS) plays a critical role in the activities of all animals. In this work, a novel, macroscopic and model-independent approach is presented for creating different patterns of coupled neural oscillations observed in biological central pattern generators (CPG) during the control of legged locomotion. Based on a simple distributed state machine, which consists of two nodes sharing pre-defined number of resources, the concept of oscillatory building blocks (OBBs) is summarised for the production of elaborated rhythmic patterns. Various types of OBBs can be designed to construct a motion joint of one degree-of-freedom (DOF) with adjustable oscillatory frequencies and duty cycles. An OBBs network can thus be potentially built to generate a full range of locomotion patterns of a legged animal with controlled transitions between different rhythmic patterns. It is shown that gait pattern transition can be achieved by simply changing a single parameter of an OBB module. Essentially this simple mechanism allows for the consolidation of a methodology for the construction of artificial CPG architectures behaving as an asymmetric Hopfield neural network. Moreover, the proposed CPG model introduced here is amenable to analogue and/or digital circuit integration

A physical model suggests that hip-localized balance sense in birds improves state estimation in perching: implications for bipedal robots

In addition to a vestibular system, birds uniquely have a balance-sensing organ within the pelvis, called the lumbosacral organ (LSO). The LSO is well developed in terrestrial birds, possibly to facilitate balance control in perching and terrestrial locomotion. No previous studies have quantified the functional benefits of the LSO for balance. We suggest two main benefits of hip-localized balance sense: reduced sensorimotor delay and improved estimation of foot-ground acceleration. We used system identification to test the hypothesis that hip-localized balance sense improves estimates of foot acceleration compared to a head-localized sense, due to closer proximity to the feet. We built a physical model of a standing guinea fowl perched on a platform, and used 3D accelerometers at the hip and head to replicate balance sense by the LSO and vestibular systems. The horizontal platform was attached to the end effector of a 6 DOF robotic arm, allowing us to apply perturbations to the platform analogous to motions of a compliant branch. We also compared state estimation between models with low and high neck stiffness. Cross-correlations revealed that foot-to-hip sensing delays were shorter than foot-to-head, as expected. We used multi-variable output error state-space (MOESP) system identification to estimate foot-ground acceleration as a function of hip- and head-localized sensing, individually and combined. Hip-localized sensors alone provided the best state estimates, which were not improved when fused with head-localized sensors. However, estimates from head-localized sensors improved with higher neck stiffness. Our findings support the hypothesis that hip-localized balance sense improves the speed and accuracy of foot state estimation compared to head-localized sense. The findings also suggest a role of neck muscles for active sensing for balance control: increased neck stiffness through muscle co-contraction can improve the utility of vestibular signals. Our engineering approach provides, to our knowledge, the first quantitative evidence for functional benefits of the LSO balance sense in birds. The findings support notions of control modularity in birds, with preferential vestibular sense for head stability and gaze, and LSO for body balance control,respectively. The findings also suggest advantages for distributed and active sensing for agile locomotion in compliant bipedal robots

Diagnostic and adaptive redundant robotic planning and control

Neural networks and fuzzy logic are combined into a hierarchical structure capable of planning, diagnosis, and control for a redundant, nonlinear robotic system in a real world scenario. Throughout this work levels of this overall approach are demonstrated for a redundant robot and hand combination as it is commanded to approach, grasp, and successfully manipulate objects for a wheelchair-bound user in a crowded, unpredictable environment. Four levels of hierarchy are developed and demonstrated, from the lowest level upward: diagnostic individual motor control, optimal redundant joint allocation for trajectory planning, grasp planning with tip and slip control, and high level task planning for multiple arms and manipulated objects. Given the expectations of the user and of the constantly changing nature of processes, the robot hierarchy learns from its experiences in order to more efficiently execute the next related task, and allocate this knowledge to the appropriate levels of planning and control. The above approaches are then extended to automotive and space applications

Pace running of a quadruped robot driven by pneumatic muscle actuators : An experimental study

Our goal is to design a neuromorphic locomotion controller for a prospective bioinspired quadruped robot driven by artificial muscle actuators. In this paper, we focus on achieving a running gait called a pace, in which the ipsilateral pairs of legs move in phase, while the two pairs together move out of phase, by a quadruped robot with realistic legs driven by pneumatic muscle actuators. The robot is controlled by weakly coupled two-level central pattern generators to generate a pace gait with leg loading feedback. Each leg is moved through four sequential phases like an animal, i.e., touch-down, stance, lift-off, and swing phases. We find that leg loading feedback to the central pattern generator can contribute to stabilizing pace running with an appropriate cycle autonomously determined by synchronizing each leg’s oscillation with the roll body oscillation without a human specifying the cycle. The experimental results conclude that our proposed neuromorphic controller is beneficial for achieving pace running by a muscle-driven quadruped robot

Information transfer and causality in the sensorimotor loop

This thesis investigates information-theoretic tools for detecting and describing causal influences in embodied agents. It presents an analysis of philosophical and statistical approaches to causation, and in particular focuses on causal Bayes nets and transfer entropy. It argues for a novel perspective that explicitly incorporates the epistemological role of information as a tool for inference. This approach clarifies and resolves some of the known problems associated with such methods. Here it is argued, through a series of experiments, mathematical results and some philosophical accounts, that universally applicable measures of causal influence strength are unlikely to exist. Instead, the focus should be on the role that information-theoretic tools can play in inferential tests for causal relationships in embodied agents particularly, and dynamical systems in general. This thesis details how these two approaches differ. Following directly from these arguments, the thesis proposes a concept of “hidden” information transfer to describe situations where causal influences passing through a chain of variables may be more easily detected at the end-points than at intermediate nodes. This is described using theoretical examples, and also appears in the information dynamics of computer-simulated and real robots developed herein. Practical examples include some minimal models of agent-environment systems, but also a novel complete system for generating locomotion gait patterns using a biologically-inspired decentralized architecture on a walking robotic hexapod