Chaotic exploration and learning of locomotion behaviours

We present a general and fully dynamic neural system, which exploits intrinsic chaotic dynamics, for the real-time goal-directed exploration and learning of the possible locomotion patterns of an articulated robot of an arbitrary morphology in an unknown environment. The controller is modeled as a network of neural oscillators that are initially coupled only through physical embodiment, and goal-directed exploration of coordinated motor patterns is achieved by chaotic search using adaptive bifurcation. The phase space of the indirectly coupled neural-body-environment system contains multiple transient or permanent self-organized dynamics, each of which is a candidate for a locomotion behavior. The adaptive bifurcation enables the system orbit to wander through various phase-coordinated states, using its intrinsic chaotic dynamics as a driving force, and stabilizes on to one of the states matching the given goal criteria. In order to improve the sustainability of useful transient patterns, sensory homeostasis has been introduced, which results in an increased diversity of motor outputs, thus achieving multiscale exploration. A rhythmic pattern discovered by this process is memorized and sustained by changing the wiring between initially disconnected oscillators using an adaptive synchronization method. Our results show that the novel neurorobotic system is able to create and learn multiple locomotion behaviors for a wide range of body configurations and physical environments and can readapt in realtime after sustaining damage

In silico case studies of compliant robots: AMARSI deliverable 3.3

In the deliverable 3.2 we presented how the morphological computing ap- proach can significantly facilitate the control strategy in several scenarios, e.g. quadruped locomotion, bipedal locomotion and reaching. In particular, the Kitty experimental platform is an example of the use of morphological computation to allow quadruped locomotion. In this deliverable we continue with the simulation studies on the application of the different morphological computation strategies to control a robotic system

Controlling Dynamic Stability and Active Compliance to Improve Quadrupedal Walking

Summary. It is widespread the idea that animal legged locomotion improves wheeled locomotion on very rough terrain. However, the use of legs as locomotion system for vehicles and robots is still far away from competing with wheels and trucks even on natural ground. Walking robots feature two main disadvantages. One is the lack of reacting capabilities from external disturbances, and the other is the very slow walking motion. Both obstacles prevent walking mechanisms from being introduced in industrial processes and from being part of service and assistance robotics. This paper is aimed at solving the two above obstacles by combining a dynamic stability margin that quantifies the impact energy that a robot can withstand, and either controlling a dynamic walk by means of active compliance, which helps the robot react to disturbances. Experiments performed on the SILO4 quadruped robot show a relevant improvement on the walking gait.This work has been partially funded by CICYT (Spain) through Grant DPI2004-05824. The first author is supported by a postdoctoral CSIC-I3P contract granted by the European Social Fund.Peer reviewe

Chaotic exploration and learning of locomotor behaviours

Recent developments in the embodied approach to understanding the generation of adaptive behaviour, suggests that the design of adaptive neural circuits for rhythmic motor patterns should not be done in isolation from an appreciation, and indeed exploitation, of neural-body-environment interactions. Utilising spontaneous mutual entrainment between neural systems and physical bodies provides a useful passage to the regions of phase space which are naturally structured by the neuralbody- environmental interactions. A growing body of work has provided evidence that chaotic dynamics can be useful in allowing embodied systems to spontaneously explore potentially useful motor patterns. However, up until now there has been no general integrated neural system that allows goal-directed, online, realtime exploration and capture of motor patterns without recourse to external monitoring, evaluation or training methods. For the first time, we introduce such a system in the form of a fully dynamic neural system, exploiting intrinsic chaotic dynamics, for the exploration and learning of the possible locomotion patterns of an articulated robot of an arbitrary morphology in an unknown environment. The controller is modelled as a network of neural oscillators which are coupled only through physical embodiment, and goal directed exploration of coordinated motor patterns is achieved by a chaotic search using adaptive bifurcation. The phase space of the indirectly coupled neural-body-environment system contains multiple transient or permanent self-organised dynamics each of which is a candidate for a locomotion behaviour. The adaptive bifurcation enables the system orbit to wander through various phase-coordinated states using its intrinsic chaotic dynamics as a driving force and stabilises the system on to one of the states matching the given goal criteria. In order to improve the sustainability of useful transient patterns, sensory homeostasis has been introduced which results in an increased diversity of motor outputs, thus achieving multi-scale exploration. A rhythmic pattern discovered by this process is memorised and sustained by changing the wiring between initially disconnected oscillators using an adaptive synchronisation method. The dynamical nature of the weak coupling through physical embodiment allows this adaptive weight learning to be easily integrated, thus forming a continuous exploration-learning system. Our result shows that the novel neuro-robotic system is able to create and learn a number of emergent locomotion behaviours for a wide range of body configurations and physical environment, and can re-adapt after sustaining damage. The implications and analyses of these results for investigating the generality and limitations of the proposed system are discussed

Quadruped locomotion reference synthesis wıth central pattern generators tuned by evolutionary algorithms

With the recent advances in sensing, actuating and communication tecnologies and in theory for control and navigation; mobile robotic platforms are seen more promising than ever. This is so for many fields ranging from search and rescue in earthquake sites to military applications. Autonomous or teleoperated land vehicles make a major class of these mobile platforms. Legged robots, with their potential virtues in obstacle avoidance and cross-country capabilities stand out for applications on rugged terrain. In the nature, there are a lot of examples where four-legged anatomy embraces both speed and climbing characteristics. This thesis is on the locomotion reference generation of quadruped robots. Reference generation plays a vital role for the success of the locomotion controller. It involves the timing of the steps and the selection of various spatial parameters. The generated references should be suitable to be followed. They should not be over-demanding to cause the robot fall by loosing its balance. Nature tells that the pattern of the steps, that is, the gait, also changes with the speed of locomotion. A well-planned reference generation algorithm should take gait transitions into account. Central Pattern Generators (CPG) are biologically-inspired tools for legged-robot locomotion reference generation. They represent one of the main stream quadruped robot locomotion synthesis approaches, along with Zero Moment Point (ZMP) based techniques and trial–and–error methods. CPGs stand out with their natural convenience for gait transitions. This is so because of the stable limit cycle behavior inhertent in their structure. However, the parameter selection and tuning of this type of reference generators is difficult. Often, trial–and–error iterations are employed to obtain suitable parameters. The background of complicated dynamics and difficulties in reference generation makes automatic tuning of CPGs an interesting area of research. A natural command for a legged robot is the speed of its locomotion. When considered from kinematics point of view, there is no unique set of walking parameters which yield a given desired speed. However, some of the solutions can be more suitable for a stable walk, whereas others may lead to instability and cause robot to fall. This thesis proposes a quadruped gait tuning method based on evolutionary methods. A velocity command is given as the input to the system. A CPG based reference generation method is employed. 3D full-dynamics locomotion simulations with a 16-degrees-of-freedom (DOF) quadruped robot model are performed to assess the fitness of artificial populations. The fitness is measured by three different cost functions. The first cost function measures the amount of support the simulated quadruped receives from torsional virtual springs and dampers opposing the changes in body orientation, whereas the second one is a measure of energy efficiency in the locomotion. The third cost function is a combination of the firs two. Tuning results with the three cost functions are obtained and compared. Cross-over and mutation mechanisms generate new populations. Simulation results verify the merits of the proposed reference generation and tuning method