Transformations in the Scale of Behaviour and the Global Optimisation of Constraints in Adaptive Networks

The natural energy minimisation behaviour of a dynamical system can be interpreted as a simple optimisation process, finding a locally optimal resolution of problem constraints. In human problem solving, high-dimensional problems are often made much easier by inferring a low-dimensional model of the system in which search is more effective. But this is an approach that seems to require top-down domain knowledge; not one amenable to the spontaneous energy minimisation behaviour of a natural dynamical system. However, in this paper we investigate the ability of distributed dynamical systems to improve their constraint resolution ability over time by self-organisation. We use a ‘self-modelling’ Hopfield network with a novel type of associative connection to illustrate how slowly changing relationships between system components can result in a transformation into a new system which is a low-dimensional caricature of the original system. The energy minimisation behaviour of this new system is significantly more effective at globally resolving the original system constraints. This model uses only very simple, and fully-distributed positive feedback mechanisms that are relevant to other ‘active linking’ and adaptive networks. We discuss how this neural network model helps us to understand transformations and emergent collective behaviour in various non-neural adaptive networks such as social, genetic and ecological networks

Filozofia ewolucji Charlesa Sandersa Peirce’a a współczesne problemy algorytmów ewolucyjnych

The article challenges the view that the Neo-Darwinian theory of evolutionis sufficient to explain the ongoing evolution. The classical evolutionary algorithmsbased on that theory suffer from the loss of diversity, stagnation andpremature convergence. The author claims that the cosmetic changes of thosetools are not sufficient to overcome this situation and the change of overall theoreticalframework is required. The proposition of a semiotic theory of evolutioncreated by Charles Sanders Peirce is revealed as an alternative to the classicalModern Synthesis. This alternative model of evolution is implemented intwo kinds of evolutionary algorithms: P-EA and SEAM, which simulate evolutionby virtue of cooperation and symbiosis respectively. The new approach toalgorithms constructs shows significant benefits upon classical evolutionaryalgorithms in benchmark tests, which may support the original claim that theaccepted theory of evolution needs rethinking today.The article challenges the view that the Neo-Darwinian theory of evolutionis sufficient to explain the ongoing evolution. The classical evolutionary algorithmsbased on that theory suffer from the loss of diversity, stagnation andpremature convergence. The author claims that the cosmetic changes of thosetools are not sufficient to overcome this situation and the change of overall theoreticalframework is required. The proposition of a semiotic theory of evolutioncreated by Charles Sanders Peirce is revealed as an alternative to the classicalModern Synthesis. This alternative model of evolution is implemented intwo kinds of evolutionary algorithms: P-EA and SEAM, which simulate evolutionby virtue of cooperation and symbiosis respectively. The new approach toalgorithms constructs shows significant benefits upon classical evolutionaryalgorithms in benchmark tests, which may support the original claim that theaccepted theory of evolution needs rethinking today

On crossing fitness valleys with the Baldwin Effect

Escaping local optima and crossing fitness valleys to reach higher-fitness regions of a fitness landscape is a ubiquitous concept in much writing on evolutionary difficulty. The Baldwin effect, an interaction between non-heritable lifetime plasticity (e.g. learning) and evolution, has been shown to be able to guide evolutionary change and ‘smooth out’ abrupt fitness changes in fitness landscapes –thus enabling genetic evolution that would otherwise not occur. However, prior work has not provided a detailed study or analysis on the saddle-crossing ability of the Baldwin effect in a simple multi-peaked landscape. Here we provide analytic and simulation studies to investigate the effectiveness and limitations of the Baldwin effect in enabling genotypic evolution to cross fitness valleys. We also discuss how canalisation, an aspect of many prior models of the Baldwin effect, is unnecessary for the Baldwin effect and a hindrance to its valley-crossing ability

Global adaptation in networks of selfish components: emergent associative memory at the system scale

In some circumstances complex adaptive systems composed of numerous self-interested agents can self-organise into structures that enhance global adaptation, efficiency or function. However, the general conditions for such an outcome are poorly understood and present a fundamental open question for domains as varied as ecology, sociology, economics, organismic biology and technological infrastructure design. In contrast, sufficient conditions for artificial neural networks to form structures that perform collective computational processes such as associative memory/recall, classification, generalisation and optimisation, are well-understood. Such global functions within a single agent or organism are not wholly surprising since the mechanisms (e.g. Hebbian learning) that create these neural organisations may be selected for this purpose, but agents in a multi-agent system have no obvious reason to adhere to such a structuring protocol or produce such global behaviours when acting from individual self-interest. However, Hebbian learning is actually a very simple and fully-distributed habituation or positive feedback principle. Here we show that when self-interested agents can modify how they are affected by other agents (e.g. when they can influence which other agents they interact with) then, in adapting these inter-agent relationships to maximise their own utility, they will necessarily alter them in a manner homologous with Hebbian learning. Multi-agent systems with adaptable relationships will thereby exhibit the same system-level behaviours as neural networks under Hebbian learning. For example, improved global efficiency in multi-agent systems can be explained by the inherent ability of associative memory to generalise by idealising stored patterns and/or creating new combinations of sub-patterns. Thus distributed multi-agent systems can spontaneously exhibit adaptive global behaviours in the same sense, and by the same mechanism, as the organisational principles familiar in connectionist models of organismic learning

A knowledge based approach to collaboration in basic research

This paper suggests a knowledge based approach to the formation of collaboration networks in basic research. Though mainly focused on foundations, it provides the example of a set of knowledge distributions supporting effort allocations that are pairwise equilibria of the collaboration game. These equilibrium outcomes produce a collaboration network consisting of connected quasi stars

Modular Random Boolean Networks

Random Boolean networks (RBNs) have been a popular model of genetic regulatory networks for more than four decades. However, most RBN studies have been made with random topologies, while real regulatory networks have been found to be modular. In this work, we extend classical RBNs to define modular RBNs. Statistical experiments and analytical results show that modularity has a strong effect on the properties of RBNs. In particular, modular RBNs have more attractors and are closer to criticality when chaotic dynamics would be expected, compared to classical RBNs.Comment: 33 pages, 14 figures, 11 tables. Corrected version, added experiments with large networks confirming results. Accepted in Artificial Lif

Evolutionary connectionism: algorithmic principles underlying the evolution of biological organisation in evo-devo, evo-eco and evolutionary transitions

The mechanisms of variation, selection and inheritance, on which evolution by natural selection depends, are not fixed over evolutionary time. Current evolutionary biology is increasingly focussed on understanding how the evolution of developmental organisations modifies the distribution of phenotypic variation, the evolution of ecological relationships modifies the selective environment, and the evolution of reproductive relationships modifies the heritability of the evolutionary unit. The major transitions in evolution, in particular, involve radical changes in developmental, ecological and reproductive organisations that instantiate variation, selection and inheritance at a higher level of biological organisation. However, current evolutionary theory is poorly equipped to describe how these organisations change over evolutionary time and especially how that results in adaptive complexes at successive scales of organisation (the key problem is that evolution is self-referential, i.e. the products of evolution change the parameters of the evolutionary process). Here we first reinterpret the central open questions in these domains from a perspective that emphasises the common underlying themes. We then synthesise the findings from a developing body of work that is building a new theoretical approach to these questions by converting well-understood theory and results from models of cognitive learning. Specifically, connectionist models of memory and learning demonstrate how simple incremental mechanisms, adjusting the relationships between individually-simple components, can produce organisations that exhibit complex system-level behaviours and improve the adaptive capabilities of the system. We use the term “evolutionary connectionism” to recognise that, by functionally equivalent processes, natural selection acting on the relationships within and between evolutionary entities can result in organisations that produce complex system-level behaviours in evolutionary systems and modify the adaptive capabilities of natural selection over time. We review the evidence supporting the functional equivalences between the domains of learning and of evolution, and discuss the potential for this to resolve conceptual problems in our understanding of the evolution of developmental, ecological and reproductive organisations and, in particular, the major evolutionary transitions

Explaining Adaptation in Genetic Algorithms With Uniform Crossover: The Hyperclimbing Hypothesis

The hyperclimbing hypothesis is a hypothetical explanation for adaptation in genetic algorithms with uniform crossover (UGAs). Hyperclimbing is an intuitive, general-purpose, non-local search heuristic applicable to discrete product spaces with rugged or stochastic cost functions. The strength of this heuristic lie in its insusceptibility to local optima when the cost function is deterministic, and its tolerance for noise when the cost function is stochastic. Hyperclimbing works by decimating a search space, i.e. by iteratively fixing the values of small numbers of variables. The hyperclimbing hypothesis holds that UGAs work by implementing efficient hyperclimbing. Proof of concept for this hypothesis comes from the use of a novel analytic technique involving the exploitation of algorithmic symmetry. We have also obtained experimental results that show that a simple tweak inspired by the hyperclimbing hypothesis dramatically improves the performance of a UGA on large, random instances of MAX-3SAT and the Sherrington Kirkpatrick Spin Glasses problem.Comment: 22 pages, 5 figure