Incremental embodied chaotic exploration of self-organized motor behaviors with proprioceptor adaptation

This paper presents a general and fully dynamic embodied artificial neural system, which incrementally explores and learns motor behaviors through an integrated combination of chaotic search and reflex learning. The former uses adaptive bifurcation to exploit the intrinsic chaotic dynamics arising from neuro-body-environment interactions, while the latter is based around proprioceptor adaptation. The overall iterative search process formed from this combination is shown to have a close relationship to evolutionary methods. The architecture developed here allows realtime goal-directed exploration and learning of the possible motor patterns (e.g., for locomotion) of embodied systems of arbitrary morphology. Examples of its successful application to a simple biomechanical model, a simulated swimming robot, and a simulated quadruped robot are given. The tractability of the biomechanical systems allows detailed analysis of the overall dynamics of the search process. This analysis sheds light on the strong parallels with evolutionary search

When the goal is to generate a series of activities: A self-organized simulated robot arm

Behavior is characterized by sequences of goal-oriented conducts, such as food uptake, socializing and resting. Classically, one would define for each task a corresponding satisfaction level, with the agent engaging, at a given time, in the activity having the lowest satisfaction level. Alternatively, one may consider that the agent follows the overarching objective to generate sequences of distinct activities. To achieve a balanced distribution of activities would then be the primary goal, and not to master a specific task. In this setting, the agent would show two types of behaviors, task-oriented, and task-searching phases, with the latter interseeding the former. We study the emergence of autonomous task switching for the case of a simulated robot arm. Grasping one of several moving objects corresponds in this setting to a specific activity. Overall, the arm should follow a given object temporarily and then move away, in order to search for a new target and reengage. We show that this behavior can be generated robustly when modeling the arm as an adaptive dynamical system. The dissipation function is in this approach time dependent. The arm is in a dissipative state when searching for a nearby object, dissipating energy on approach. Once close, the dissipation function starts to increase, with the eventual sign change implying that the arm will take up energy and wander off. The resulting explorative state ends when the dissipation function becomes again negative and the arm selects a new target. We believe that our approach may be generalized to generate self-organized sequences of activities in general.Comment: 10 pages, 7 figure

Consciousness, Evaluation, and the Self-Organizing Brain

While evolution is guided by natural selection, it is internally driven by self-organizing processes. The brain encompasses these complementary forces and dynamics of evolution in both its structure and dynamics by embodying a historical record of the factors that have shaped it throughout its evolutionary past, as well as by being shaped by selective parameters in real time. Self-organization is evident in not only the brain’s structure and form, but also in the processes that support consciousness. From the convergence of complex structure and the novelty-generating dynamics of chaos that both characterize the brain arises the experience of explicit consciousness, with its endless scope of possible expressions

Consciousness, Evolution, and the Self-Organizing Brain

While evolution is guided by natural selection, it is internally driven by self-organizing processes. The brain encompasses these complementary forces and dynamics of evolution in both its structure and dynamics by embodying a historical record of the factors that have shaped it throughout its evolutionary past, as well as by being shaped by selective parameters in real time. Self-organization is evident in not only the brain’s structure and form, but also in the processes that support consciousness. From the convergence of complex structure and the novelty-generating dynamics of chaos that both characterize the brain arises the experience of explicit consciousness, with its endless scope of possible expressions

A self organization approach to goal-directed multimodal locomotion based on Attractor Selection Mechanism

The realization and utilization of multimodal locomotion to enable robots to accomplish useful tasks is a significantly challenging problem in robotics. Related to the challenge, it is crucial to notice that the locomotion dynamics of the robots is a result of interactions between a particular control structure and its body-environment dynamics. From this perspective, this paper presents a simple control structure known as Attractor Selection Mechanism that enables a robot to self organize its multiple locomotion modes for accomplishing a goal-directed locomotion task. Despite the simplicity, the approach enables the robot to automatically explore different body-environment dynamics and stabilize onto particular attractors which corresponds to locomotion modes relevant to accomplish the task. The robot used throughout the paper is a curved-beam hopping robot, which despite its simple actuation method, possesses rich and complex bodyenvironment dynamics.This is the author accepted manuscript. The final version is available from IEEE via http://dx.doi.org/10.1109/ICRA.2015.713990

A Multi-scale View of the Emergent Complexity of Life: A Free-energy Proposal

We review some of the main implications of the free-energy principle (FEP) for the study of the self-organization of living systems – and how the FEP can help us to understand (and model) biotic self-organization across the many temporal and spatial scales over which life exists. In order to maintain its integrity as a bounded system, any biological system - from single cells to complex organisms and societies - has to limit the disorder or dispersion (i.e., the long-run entropy) of its constituent states. We review how this can be achieved by living systems that minimize their variational free energy. Variational free energy is an information theoretic construct, originally introduced into theoretical neuroscience and biology to explain perception, action, and learning. It has since been extended to explain the evolution, development, form, and function of entire organisms, providing a principled model of biotic self-organization and autopoiesis. It has provided insights into biological systems across spatiotemporal scales, ranging from microscales (e.g., sub- and multicellular dynamics), to intermediate scales (e.g., groups of interacting animals and culture), through to macroscale phenomena (the evolution of entire species). A crucial corollary of the FEP is that an organism just is (i.e., embodies or entails) an implicit model of its environment. As such, organisms come to embody causal relationships of their ecological niche, which, in turn, is influenced by their resulting behaviors. Crucially, free-energy minimization can be shown to be equivalent to the maximization of Bayesian model evidence. This allows us to cast natural selection in terms of Bayesian model selection, providing a robust theoretical account of how organisms come to match or accommodate the spatiotemporal complexity of their surrounding niche. In line with the theme of this volume; namely, biological complexity and self-organization, this chapter will examine a variational approach to self-organization across multiple dynamical scales

The Dynamics of Emergent Self-Organisation: Reconceptualising Child Development in Teacher Education

For more than half a century, child development has endured as one of the main components of teacher education. But if children do develop, as developmentalists claim, what precisely is it that develops and how? Traditionally, within education, answers to these questions have drawn heavily on the theories of Jean Piaget and Lev Vygotsky. Piaget advocated the progressive development of reasoning through identifiable linear phases or stages. Vygotsky emphasised the role of cultural mediation, whereby the child internalises the habits of mind of his/her social group. More generally within cognitive psychology, development has been attributed to the interaction of two distinct causes - nature and nurture - and the developmental process has been viewed as being linear, progressive, and incremental, guided by some inner mechanism of design; by schemas or genetic blueprints acting as programs in the mind. According to the Dynamic Systems Approach (DSA), however, there are no programs or blueprints and no teleological design. Instead, human development is the results of non-linear emergent self-organisation; a holistic process that rejects the dualisms of nature/nurture, perception/cognition and mind/brain associated with traditional theory. This very different account of development calls for a reconceptualisation of child development theory in teacher education. Our paper attempts to move some way in that direction

Chaotic exploration and learning of locomotion behaviours

We present a general and fully dynamic neural system, which exploits intrinsic chaotic dynamics, for the real-time goal-directed exploration and learning of the possible locomotion patterns of an articulated robot of an arbitrary morphology in an unknown environment. The controller is modeled as a network of neural oscillators that are initially coupled only through physical embodiment, and goal-directed exploration of coordinated motor patterns is achieved by chaotic search using adaptive bifurcation. The phase space of the indirectly coupled neural-body-environment system contains multiple transient or permanent self-organized dynamics, each of which is a candidate for a locomotion behavior. The adaptive bifurcation enables the system orbit to wander through various phase-coordinated states, using its intrinsic chaotic dynamics as a driving force, and stabilizes on to one of the states matching the given goal criteria. In order to improve the sustainability of useful transient patterns, sensory homeostasis has been introduced, which results in an increased diversity of motor outputs, thus achieving multiscale exploration. A rhythmic pattern discovered by this process is memorized and sustained by changing the wiring between initially disconnected oscillators using an adaptive synchronization method. Our results show that the novel neurorobotic system is able to create and learn multiple locomotion behaviors for a wide range of body configurations and physical environments and can readapt in realtime after sustaining damage

Delegated causality of complex systems

A notion of delegated causality is introduced here. This subtle kind of causality is dual to interventional causality. Delegated causality elucidates the causal role of dynamical systems at the “edge of chaos”, explicates evident cases of downward causation, and relates emergent phenomena to Gödel’s incompleteness theorem. Apparently rich implications are noticed in biology and Chinese philosophy. The perspective of delegated causality supports cognitive interpretations of self-organization and evolution