Chaotic exploration and learning of locomotion behaviours

We present a general and fully dynamic neural system, which exploits intrinsic chaotic dynamics, for the real-time goal-directed exploration and learning of the possible locomotion patterns of an articulated robot of an arbitrary morphology in an unknown environment. The controller is modeled as a network of neural oscillators that are initially coupled only through physical embodiment, and goal-directed exploration of coordinated motor patterns is achieved by chaotic search using adaptive bifurcation. The phase space of the indirectly coupled neural-body-environment system contains multiple transient or permanent self-organized dynamics, each of which is a candidate for a locomotion behavior. The adaptive bifurcation enables the system orbit to wander through various phase-coordinated states, using its intrinsic chaotic dynamics as a driving force, and stabilizes on to one of the states matching the given goal criteria. In order to improve the sustainability of useful transient patterns, sensory homeostasis has been introduced, which results in an increased diversity of motor outputs, thus achieving multiscale exploration. A rhythmic pattern discovered by this process is memorized and sustained by changing the wiring between initially disconnected oscillators using an adaptive synchronization method. Our results show that the novel neurorobotic system is able to create and learn multiple locomotion behaviors for a wide range of body configurations and physical environments and can readapt in realtime after sustaining damage

Comparative evaluation of approaches in T.4.1-4.3 and working definition of adaptive module

The goal of this deliverable is two-fold: (1) to present and compare different approaches towards learning and encoding movements us- ing dynamical systems that have been developed by the AMARSi partners (in the past during the first 6 months of the project), and (2) to analyze their suitability to be used as adaptive modules, i.e. as building blocks for the complete architecture that will be devel- oped in the project. The document presents a total of eight approaches, in two groups: modules for discrete movements (i.e. with a clear goal where the movement stops) and for rhythmic movements (i.e. which exhibit periodicity). The basic formulation of each approach is presented together with some illustrative simulation results. Key character- istics such as the type of dynamical behavior, learning algorithm, generalization properties, stability analysis are then discussed for each approach. We then make a comparative analysis of the different approaches by comparing these characteristics and discussing their suitability for the AMARSi project

In silico case studies of compliant robots: AMARSI deliverable 3.3

In the deliverable 3.2 we presented how the morphological computing ap- proach can significantly facilitate the control strategy in several scenarios, e.g. quadruped locomotion, bipedal locomotion and reaching. In particular, the Kitty experimental platform is an example of the use of morphological computation to allow quadruped locomotion. In this deliverable we continue with the simulation studies on the application of the different morphological computation strategies to control a robotic system

Incremental embodied chaotic exploration of self-organized motor behaviors with proprioceptor adaptation

This paper presents a general and fully dynamic embodied artificial neural system, which incrementally explores and learns motor behaviors through an integrated combination of chaotic search and reflex learning. The former uses adaptive bifurcation to exploit the intrinsic chaotic dynamics arising from neuro-body-environment interactions, while the latter is based around proprioceptor adaptation. The overall iterative search process formed from this combination is shown to have a close relationship to evolutionary methods. The architecture developed here allows realtime goal-directed exploration and learning of the possible motor patterns (e.g., for locomotion) of embodied systems of arbitrary morphology. Examples of its successful application to a simple biomechanical model, a simulated swimming robot, and a simulated quadruped robot are given. The tractability of the biomechanical systems allows detailed analysis of the overall dynamics of the search process. This analysis sheds light on the strong parallels with evolutionary search

On the Method of Interconnection and Damping Assignment Passivity-Based Control for the Stabilization of Mechanical Systems

Interconnection and damping assignment passivity-based control (IDA-PBC) is an excellent method to stabilize mechanical systems in the Hamiltonian formalism. In this paper, several improvements are made on the IDA-PBC method. The skew-symmetric interconnection submatrix in the conventional form of IDA-PBC is shown to have some redundancy for systems with the number of degrees of freedom greater than two, containing unnecessary components that do not contribute to the dynamics. To completely remove this redundancy, the use of quadratic gyroscopic forces is proposed in place of the skew-symmetric interconnection submatrix. Reduction of the number of matching partial differential equations in IDA-PBC and simplification of the structure of the matching partial differential equations are achieved by eliminating the gyroscopic force from the matching partial differential equations. In addition, easily verifiable criteria are provided for Lyapunov/exponential stabilizability by IDA-PBC for all linear controlled Hamiltonian systems with arbitrary degrees of underactuation and for all nonlinear controlled Hamiltonian systems with one degree of underactuation. A general design procedure for IDA-PBC is given and illustrated with examples. The duality of the new IDA-PBC method to the method of controlled Lagrangians is discussed. This paper renders the IDA-PBC method as powerful as the controlled Lagrangian method

Stabilization Control for the Giant Swing Motion of the Horizontal Bar Gymnastic Robot Using Delayed Feedback Control

Open-loop dynamic characteristics of an underactuated system with nonholonomic constraints, such as a horizontal bar gymnastic robot, show the chaotic nature due to its nonlinearity. This chapter deals with the stabilization problems of periodic motions for the giant swing motion of gymnastic robot using chaos control methods. In order to make an extension of the chaos control method and apply it to a new practical use, some stabilization control strategies were proposed, which were, based on the idea of delayed feedback control (DFC), devised to stabilize the periodic motions embedded in the movements of the gymnastic robot. Moreover, its validity has been investigated by numerical simulations. First, a method named as prediction-based DFC was proposed for a two-link gymnastic robot using a Poincar section. Meanwhile, a way to calculate analytically the error transfer matrix and the input matrix that are necessary for discretization was investigated. Second, an improved DFC method, multiprediction delayed feedback control, using a periodic gain, was extended to a four-link gymnastic robot. A set of plural Poincare maps were defined with regard to the original continuous-time system as a T-periodic discrete-time system. Finally, some simulation results showed the effectiveness of the proposed methods

Chaotic exploration and learning of locomotor behaviours

Recent developments in the embodied approach to understanding the generation of adaptive behaviour, suggests that the design of adaptive neural circuits for rhythmic motor patterns should not be done in isolation from an appreciation, and indeed exploitation, of neural-body-environment interactions. Utilising spontaneous mutual entrainment between neural systems and physical bodies provides a useful passage to the regions of phase space which are naturally structured by the neuralbody- environmental interactions. A growing body of work has provided evidence that chaotic dynamics can be useful in allowing embodied systems to spontaneously explore potentially useful motor patterns. However, up until now there has been no general integrated neural system that allows goal-directed, online, realtime exploration and capture of motor patterns without recourse to external monitoring, evaluation or training methods. For the first time, we introduce such a system in the form of a fully dynamic neural system, exploiting intrinsic chaotic dynamics, for the exploration and learning of the possible locomotion patterns of an articulated robot of an arbitrary morphology in an unknown environment. The controller is modelled as a network of neural oscillators which are coupled only through physical embodiment, and goal directed exploration of coordinated motor patterns is achieved by a chaotic search using adaptive bifurcation. The phase space of the indirectly coupled neural-body-environment system contains multiple transient or permanent self-organised dynamics each of which is a candidate for a locomotion behaviour. The adaptive bifurcation enables the system orbit to wander through various phase-coordinated states using its intrinsic chaotic dynamics as a driving force and stabilises the system on to one of the states matching the given goal criteria. In order to improve the sustainability of useful transient patterns, sensory homeostasis has been introduced which results in an increased diversity of motor outputs, thus achieving multi-scale exploration. A rhythmic pattern discovered by this process is memorised and sustained by changing the wiring between initially disconnected oscillators using an adaptive synchronisation method. The dynamical nature of the weak coupling through physical embodiment allows this adaptive weight learning to be easily integrated, thus forming a continuous exploration-learning system. Our result shows that the novel neuro-robotic system is able to create and learn a number of emergent locomotion behaviours for a wide range of body configurations and physical environment, and can re-adapt after sustaining damage. The implications and analyses of these results for investigating the generality and limitations of the proposed system are discussed