THE SCIENTIFIC BASIS, SOME RESULTS, AND PERSPECTIVES OF MODELING EVOLUTIONARILY CONDITIONED NOOGENESIS OF ARTIFICIAL CREATURES IN VIRTUAL BIOCENOSES

This research aimed to gain a profound understanding of virtual biocenoses intricate digital ecosystems, with the goal of elucidating and replicating the emergence and evolution of intelligence in artificial creatures – referred to as noogenesis. A comprehensive analysis of existing studies within virtual biocenoses was undertaken to glean valuable insights into the complexities of modeling dynamic ecosystems where artificial agents engaged in intricate interactions. The pivotal role of neural networks in shaping the adaptive behaviors of artificial creatures within these environments was underscored. A meticulous investigation into neural networks' evolution methodologies revealed the evolution of their architecture complexity over time, culminating in the facilitation of flexible and intelligent behaviors. However, a lack of study existed in the domain of nurturing evolutionary-based communication and cooperation capabilities within virtual biocenoses. In response to this gap, a model was introduced and substantiated through simulation experiments. The simulation results vividly illustrated the model's remarkable capacity to engender adaptive creatures endowed with the capability to efficiently respond to dynamic environmental changes. These adaptive entities displayed efficient optimization of energy consumption and resource acquisition. Moreover, they manifested both intellectual and physical transformations attributed to the evolution and encoding principles inspired by the NeuroEvolution of Augmented Topologies. Significantly, it became apparent that the evolutionary processes intrinsic to the model were inextricably linked to the environment itself, thus harmonizing seamlessly with the overarching goal of this research. Future research directions in this field were outlined. These pathways provided a foundation for further exploration into the evolution of artificial creatures in virtual biocenoses and the emergence of advanced communication and cooperation capabilities. These advancements hold the potential to move artificial life and artificial intelligence to new levels of understanding and capability

Probabilistic Meta-Representations Of Neural Networks

Existing Bayesian treatments of neural networks are typically characterized by weak prior and approximate posterior distributions according to which all the weights are drawn independently. Here, we consider a richer prior distribution in which units in the network are represented by latent variables, and the weights between units are drawn conditionally on the values of the collection of those variables. This allows rich correlations between related weights, and can be seen as realizing a function prior with a Bayesian complexity regularizer ensuring simple solutions. We illustrate the resulting meta-representations and representations, elucidating the power of this prior.Comment: presented at UAI 2018 Uncertainty In Deep Learning Workshop (UDL AUG. 2018

Algoritmo Neuroevolucionário que implementa comportamentos inatos por meio de agentes autônomos / A Neuroevolutionary Algorithm that implements innate behaviors through autonomous agents

Este artigo apresenta um Sistema Inspirado Biologicamente, capaz de implementar comportamentos inatos através de agentes autônomos.  Considerações são feitas sobre os paradigmas biológicos utilizados, como mecanismos evolutivos e comportamentos inatos dos animais, tentando encontrar soluções que, uma vez aplicadas ao desenvolvimento de dispositivos artificiais, forneçam agentes autônomos mais robustos e úteis para operar no mundo real. Para ter maior probabilidade de sobreviver, os seres vivos devem ter desenvolvido comportamentos mais complexos, como reativos e motivados internamente, nos quais a ação do agente deve depender da história passada de valores sensoriais para ser eficaz. Após a descrição desse sistema híbrido, realizamos simulações de duas tarefas utilizando o aprendizado por reforço: Taxies e Reflexos, comportamentos reativos e instintivos. Os resultados indicam a eficiência da técnica na seleção de arquiteturas econômicas de RNAs para todos os problemas, tendo em vista que a capacidade de generalização dos mesmos foi em média 99% com os seguintes erros médios quadráticos (EMQ) 0,00025 e 0,00012 respectivamente para os dois problemas estudados. Finalmente, as conclusões são dadas

Neural Architecture Search by Estimation of Network Structure Distributions

The influence of deep learning is continuously expanding across different domains, and its new applications are ubiquitous. The question of neural network design thus increases in importance, as traditional empirical approaches are reaching their limits. Manual design of network architectures from scratch relies heavily on trial and error, while using existing pretrained models can introduce redundancies or vulnerabilities. Automated neural architecture design is able to overcome these problems, but the most successful algorithms operate on significantly constrained design spaces, assuming the target network to consist of identical repeating blocks. While such approach allows for faster search, it does so at the cost of expressivity. We instead propose an alternative probabilistic representation of a whole neural network structure under the assumption of independence between layer types. Our matrix of probabilities is equivalent to the population of models, but allows for discovery of structural irregularities, while being simple to interpret and analyze. We construct an architecture search algorithm, inspired by the estimation of distribution algorithms, to take advantage of this representation. The probability matrix is tuned towards generating high-performance models by repeatedly sampling the architectures and evaluating the corresponding networks, while gradually increasing the model depth. Our algorithm is shown to discover non-regular models which cannot be expressed via blocks, but are competitive both in accuracy and computational cost, while not utilizing complex dataflows or advanced training techniques, as well as remaining conceptually simple and highly extensible.Comment: 16 pages, 4 figures, 3 table

Synaptic plasticity in a recurrent neural network for versatile and adaptive behaviors of a walking robot

Walking animals, like insects, with little neural computing can effectively perform complex behaviors. They can walk around their environment, escape from corners/deadlocks, and avoid or climb over obstacles. While performing all these behaviors, they can also adapt their movements to deal with an unknown situation. As a consequence, they successfully navigate through their complex environment. The versatile and adaptive abilities are the result of an integration of several ingredients embedded in their sensorimotor loop. Biological studies reveal that the ingredients include neural dynamics, plasticity, sensory feedback, and biomechanics. Generating such versatile and adaptive behaviors for a walking robot is a challenging task. In this study, we present a bio-inspired approach to solve this task. Specifically, the approach combines neural mechanisms with plasticity, sensory feedback, and biomechanics. The neural mechanisms consist of adaptive neural sensory processing and modular neural locomotion control. The sensory processing is based on a small recurrent network consisting of two fully connected neurons. Online correlation-based learning with synaptic scaling is applied to adequately change the connections of the network. By doing so, we can effectively exploit neural dynamics (i.e., hysteresis effects and single attractors) in the network to generate different turning angles with short-term memory for a biomechanical walking robot. The turning information is transmitted as descending steering signals to the locomotion control which translates the signals into motor actions. As a result, the robot can walk around and adapt its turning angle for avoiding obstacles in different situations as well as escaping from sharp corners or deadlocks. Using backbone joint control embedded in the locomotion control allows the robot to climb over small obstacles. Consequently, it can successfully explore and navigate in complex environments

Neuroevolution of Self-Interpretable Agents

Inattentional blindness is the psychological phenomenon that causes one to miss things in plain sight. It is a consequence of the selective attention in perception that lets us remain focused on important parts of our world without distraction from irrelevant details. Motivated by selective attention, we study the properties of artificial agents that perceive the world through the lens of a self-attention bottleneck. By constraining access to only a small fraction of the visual input, we show that their policies are directly interpretable in pixel space. We find neuroevolution ideal for training self-attention architectures for vision-based reinforcement learning (RL) tasks, allowing us to incorporate modules that can include discrete, non-differentiable operations which are useful for our agent. We argue that self-attention has similar properties as indirect encoding, in the sense that large implicit weight matrices are generated from a small number of key-query parameters, thus enabling our agent to solve challenging vision based tasks with at least 1000x fewer parameters than existing methods. Since our agent attends to only task critical visual hints, they are able to generalize to environments where task irrelevant elements are modified while conventional methods fail. Videos of our results and source code available at https://attentionagent.github.io/Comment: To appear at the Genetic and Evolutionary Computation Conference (GECCO 2020) as a full pape

An efficient automated parameter tuning framework for spiking neural networks

As the desire for biologically realistic spiking neural networks (SNNs) increases, tuning the enormous number of open parameters in these models becomes a difficult challenge. SNNs have been used to successfully model complex neural circuits that explore various neural phenomena such as neural plasticity, vision systems, auditory systems, neural oscillations, and many other important topics of neural function. Additionally, SNNs are particularly well-adapted to run on neuromorphic hardware that will support biological brain-scale architectures. Although the inclusion of realistic plasticity equations, neural dynamics, and recurrent topologies has increased the descriptive power of SNNs, it has also made the task of tuning these biologically realistic SNNs difficult. To meet this challenge, we present an automated parameter tuning framework capable of tuning SNNs quickly and efficiently using evolutionary algorithms (EA) and inexpensive, readily accessible graphics processing units (GPUs). A sample SNN with 4104 neurons was tuned to give V1 simple cell-like tuning curve responses and produce self-organizing receptive fields (SORFs) when presented with a random sequence of counterphase sinusoidal grating stimuli. A performance analysis comparing the GPU-accelerated implementation to a single-threaded central processing unit (CPU) implementation was carried out and showed a speedup of 65× of the GPU implementation over the CPU implementation, or 0.35 h per generation for GPU vs. 23.5 h per generation for CPU. Additionally, the parameter value solutions found in the tuned SNN were studied and found to be stable and repeatable. The automated parameter tuning framework presented here will be of use to both the computational neuroscience and neuromorphic engineering communities, making the process of constructing and tuning large-scale SNNs much quicker and easier

A Neurogenetic Algorithm Based on Rational Agents

Lately, a lot of research has been conducted on the automatic design of artificial neural networks (ADANNs) using evolutionary algorithms, in the so-called neuro-evolutive algorithms (NEAs). Many of the presented proposals are not biologically inspired and are not able to generate modular, hierarchical and recurrent neural structures, such as those often found in living beings capable of solving intricate survival problems. Bearing in mind the idea that a nervous system's design and organization is a constructive process carried out by genetic information encoded in DNA, this paper proposes a biologically inspired NEA that evolves ANNs using these ideas as computational design techniques. In order to do this, we propose a Lindenmayer System with memory that implements the principles of organization, modularity, repetition (multiple use of the same sub-structure), hierarchy (recursive composition of sub-structures), minimizing the scalability problem of other methods. In our method, the basic neural codification is integrated to a genetic algorithm (GA) that implements the constructive approach found in the evolutionary process, making it closest to biological processes. Thus, the proposed method is a decision-making (DM) process, the fitness function of the NEA rewards economical artificial neural networks (ANNs) that are easily implemented. In other words, the penalty approach implemented through the fitness function automatically rewards the economical ANNs with stronger generalization and extrapolation capacities. Our method was initially tested on a simple, but non-trivial, XOR problem. We also submit our method to two other problems of increasing complexity: time series prediction that represents consumer price index and prediction of the effect of a new drug on breast cancer. In most cases, our NEA outperformed the other methods, delivering the most accurate classification. These superior results are attributed to the improved effectiveness and efficiency of NEA in the decision-making process. The result is an optimized neural network architecture for solving classification problems