471 research outputs found

    Evolving hierarchical visually guided neural network agents to investigate complex interactions.

    Get PDF
    A complex system is a system with a large number of interacting components without any mechanism for central control that displays self organisation. Understanding how these interactions affect the overall behaviour of a system is of great interest to science. Indeed, researchers use a wide variety of models to investigate complex systems. The problem with most models is that they disregard the hierarchical nature of complex systems: they ignore the fact that components of real world systems tend to be complex systems as well. This prevents researchers from investigating the interactions taking place between the lower and the higher levels of the model which may be crucial in order to gain a full understanding of the examined phenomena and of complex systems in general. Therefore, this thesis introduces Mosaic World, a multi-agent model for the purpose of investigating interactions (focusing on 'complex' multilevel interactions) within a hierarchical complex system, in addition to other computational and biological hypotheses. Mosaic World comprises a population of evolving neural network agents that inhabit a changing visual environment. By analysing the interactions that occur within Mosaic World, this thesis demonstrates the importance of incorporating hierarchical complexity into a model, and contributes to our understanding of hierarchical complex systems by showing how selective pressures cause differentiation across levels. Additionally, the study of multilevel interactions is used to probe several hypotheses and provides the following contributions among others: Analysis of agent evolvability as affected by the usage of different types of structural mutations in the evolutionary process. Demonstration that agents controlled by modular neural networks are fitter than agents that are controlled by non-modular neural networks the improvement in fitness occurs through specialisation of modules. Empirical support for a biological theory suggesting that colour vision evolved as a method of dealing with ambiguous stimuli

    Biological Robustness: Paradigms, Mechanisms, and Systems Principles

    Get PDF
    Robustness has been studied through the analysis of data sets, simulations, and a variety of experimental techniques that each have their own limitations but together confirm the ubiquity of biological robustness. Recent trends suggest that different types of perturbation (e.g., mutational, environmental) are commonly stabilized by similar mechanisms, and system sensitivities often display a long-tailed distribution with relatively few perturbations representing the majority of sensitivities. Conceptual paradigms from network theory, control theory, complexity science, and natural selection have been used to understand robustness, however each paradigm has a limited scope of applicability and there has been little discussion of the conditions that determine this scope or the relationships between paradigms. Systems properties such as modularity, bow-tie architectures, degeneracy, and other topological features are often positively associated with robust traits, however common underlying mechanisms are rarely mentioned. For instance, many system properties support robustness through functional redundancy or through response diversity with responses regulated by competitive exclusion and cooperative facilitation. Moreover, few studies compare and contrast alternative strategies for achieving robustness such as homeostasis, adaptive plasticity, environment shaping, and environment tracking. These strategies share similarities in their utilization of adaptive and self-organization processes that are not well appreciated yet might be suggestive of reusable building blocks for generating robust behavior

    Evolutionary Reinforcement Learning: A Survey

    Full text link
    Reinforcement learning (RL) is a machine learning approach that trains agents to maximize cumulative rewards through interactions with environments. The integration of RL with deep learning has recently resulted in impressive achievements in a wide range of challenging tasks, including board games, arcade games, and robot control. Despite these successes, there remain several crucial challenges, including brittle convergence properties caused by sensitive hyperparameters, difficulties in temporal credit assignment with long time horizons and sparse rewards, a lack of diverse exploration, especially in continuous search space scenarios, difficulties in credit assignment in multi-agent reinforcement learning, and conflicting objectives for rewards. Evolutionary computation (EC), which maintains a population of learning agents, has demonstrated promising performance in addressing these limitations. This article presents a comprehensive survey of state-of-the-art methods for integrating EC into RL, referred to as evolutionary reinforcement learning (EvoRL). We categorize EvoRL methods according to key research fields in RL, including hyperparameter optimization, policy search, exploration, reward shaping, meta-RL, and multi-objective RL. We then discuss future research directions in terms of efficient methods, benchmarks, and scalable platforms. This survey serves as a resource for researchers and practitioners interested in the field of EvoRL, highlighting the important challenges and opportunities for future research. With the help of this survey, researchers and practitioners can develop more efficient methods and tailored benchmarks for EvoRL, further advancing this promising cross-disciplinary research field

    Collaborative environment to support a professional community

    Get PDF
    Dissertação apresentada na Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa para obtenção do grau de Mestre em Engenharia Electrotécnica e de ComputadoresRecent manufacturing roadmaps stress current production systems limitations, emphasizing social, economic and ecologic consequences for Europe of a non-evolution to sustainable Production Systems. Hence, both academic institutions and enterprises are committed to develop solutions that would endow enterprises to survive in nowadays’ extremely competitive business environment. A research effort is being carried on by the Evolvable Production Systems consortium towards attaining Production Systems that can cope with current technological, economical, ecological and social demands fulfilling recent roadmaps. Nevertheless research success depends on attaining consensus in the scientific community and therefore an accurate critical mass support is required in the whole process. The main goal of this thesis is the development of a Collaborative Environment Tool to assist Evolvable Production Systems consortium in such research efforts and to enhance Evolvable Assembly Systems paradigm dissemination. This work resulted in EASET (Evolvable Assembly Systems Environment Tool), a collaborative environment tool which promotes EAS dissemination and brings forth improvements through the raise of critical mass and collaboration between entities

    The Watchmaker's guide to Artificial Life: On the Role of Death, Modularity and Physicality in Evolutionary Robotics

    Get PDF
    Photograph used for a newspaper owned by the Oklahoma Publishing Company
    corecore