A comparison of controller architectures and learning mechanisms for arbitrary robot morphologies

The main question this paper addresses is: What combination of a robot controller and a learning method should be used, if the morphology of the learning robot is not known in advance? Our interest is rooted in the context of morphologically evolving modular robots, but the question is also relevant in general, for system designers interested in widely applicable solutions. We perform an experimental comparison of three controller-and-learner combinations: one approach where controllers are based on modelling animal locomotion (Central Pattern Generators, CPG) and the learner is an evolutionary algorithm, a completely different method using Reinforcement Learning (RL) with a neural network controller architecture, and a combination `in-between' where controllers are neural networks and the learner is an evolutionary algorithm. We apply these three combinations to a test suite of modular robots and compare their efficacy, efficiency, and robustness. Surprisingly, the usual CPG-based and RL-based options are outperformed by the in-between combination that is more robust and efficient than the other two setups

A complex systems approach to education in Switzerland

The insights gained from the study of complex systems in biological, social, and engineered systems enables us not only to observe and understand, but also to actively design systems which will be capable of successfully coping with complex and dynamically changing situations. The methods and mindset required for this approach have been applied to educational systems with their diverse levels of scale and complexity. Based on the general case made by Yaneer Bar-Yam, this paper applies the complex systems approach to the educational system in Switzerland. It confirms that the complex systems approach is valid. Indeed, many recommendations made for the general case have already been implemented in the Swiss education system. To address existing problems and difficulties, further steps are recommended. This paper contributes to the further establishment complex systems approach by shedding light on an area which concerns us all, which is a frequent topic of discussion and dispute among politicians and the public, where billions of dollars have been spent without achieving the desired results, and where it is difficult to directly derive consequences from actions taken. The analysis of the education system's different levels, their complexity and scale will clarify how such a dynamic system should be approached, and how it can be guided towards the desired performance

Spéciation guidée par l'environnement‎ : interactions sur des périodes évolutionnaires de communautés de plantes artificielles

Depuis des décades, les chercheurs en Vie Artificielle on créé une pléthore de créatures en utilisant de multiples schémas d’encodage, capacités motrices et aptitudes cognitives. Un motif récurrent, cependant, est que la focalisation est centrée sur les individus à évoluer, ne laissant que peu de place aux variations environnementales. Dans ce travail, nous argumentons que des contraintes abiotiques plus complexes pourraient diriger un processus évolutionnaire vers des régions de l’espace génétique plus robustes and diverses. Nous avons conçu un modèle morphologique complexe, basé sur les graphes orientés de K. Sims, qui repose sur le moteur physique Bullet pour la précision et utilise des contraintes à 6 Degrés de Liberté pour connecter les paires d’organes. Nous avons ainsi évolué un panel de plantes à l’aspect naturel qui devaient survivre malgré des niveaux de ressources variables induits par une source de lumière mobile et des motifs de pluies saisonnières. En plus de cette expérience, nous avons aussi obtenu une meilleure croissance verticale en ajoutant une contrainte biotique artificielle sous la forme de brins d’herbe statiques. La complexité de ce modèle, cependant, ne permettait pas la mise a l’échelle d’une évolution de populations et a donc été réduit dans l’expérience suivante, notamment en supprimant le moteur physique. Cela nous a amené à l’exploration de la co-évolution de populations composées d’une unique espèce et ayant la capacité de se reproduire de manière autonome grâce à notre Bail-Out Crossover (Croisement avec Désistement). Bien que les populations résultantes n’ont pas démontré un grand intérêt pour cette aptitude, elles ont néanmoins fourni d’importantes informations sur les mécanismes d’auto-reproduction. Ceux-ci ont été mis en action dans un second modèle inspiré des travaux de Bornhofen. Grâce à sa légèreté, cela nous a permis de traiter non seulement de plus grandes populations (de l’ordre de milliers d’individus) mais aussi de plus longues périodes évolutionnaires (100 années, approximativement 5000 générations). Notre première expérience avec ce modèle s’est concentrée sur la possibilité de reproduire des cas d’école de spéciation (allopatrique, parapatrique, péripatrique) sur cette plate-forme. Grâce à APOGet, une nouvelle procédure de regroupement pour l’extraction en parallèle d’espèces à partir d’un arbre généalogique, nous avons pu affirmer que le système était effectivement capable de spéciation spontanée. Cela nous a conduit à une dernière expérience dans laquelle l’environnement était contrôlé par de la Programmation Génétique Cartésienne (CGP), permettant ainsi une évolution automatique d’une population et des contraintes abiotiques auxquelles elle était confrontée. Par une variation du traditionnel algorithme 1 + λ nous avons obtenu 10 populations finales qui ont survécu à de brutales et imprévisibles variations environnementales. En les comparant à un groupe contrôle c pour lequel les contraintes ont été maintenues faibles et constantes, le groupe évolué e a montré des performances mitigées: dans les deux types de tests, une moitié de e surpassait c qui, à son tour, surpassait la moitié restante de e. Nous avons aussi trouvé une très forte corrélation entre les chutes catastrophiques de population et la performance des évolutions correspondantes. Il en résulte que l’évolution de population dans des environnements hostiles et dynamiques n’est pas une panacée bien que ces expériences en démontrent le potentiel et souligne le besoin d’études ultérieures plus approfondies.Artificial Life researchers have, for decades, created a plethora of creatures using numerous encoding schemes, motile capabilities and cognitive capacities. One recurring pattern, however, is that focus is solely put on the evolved individuals, with very limited environmental variations. In this work, we argue that more complex abiotic constraints could drive an evolutionary process towards more robust and diverse regions of the genetic space. We started with a complex morphogenetic model, based on K. Sims’ directed graphs, which relied on the Bullet physics engine for accuracy and used 6Degrees of Freedom constraints to connect pairs of organs. We evolved a panel of natural-looking plants which had to cope with varying resource levels thanks to a mobile light source and seasonal rain patterns. In addition to this experiment, we also obtained improved vertical growth by adding an artificialbiotic constraint in the form of static grass blades. However, the computational cost of this model precluded scaling to a population-level evolution and was reduced in the successive experiment, notably by removing the physical engine. This led to the exploration of co-evolution on single-species populations which, thanks to our Bail-Out Crossover (BOC) algorithm, were able to self-reproduce. The resulting populations provided valuable insight into the mechanisms of self-sustainability. These were put to action in an even more straightforward morphogenetic model inspired by the work of Bornhofen. Due to its light weightness, this allowed for both larger populations (up to thousands of individuals) and longer evolutionary periods (100 years, roughly 5K generations). Our first experiment on this model tested whether text-book cases of speciation could be reproduced in our framework. Such positive results were observed thanks to the species monitoring capacities of APOGeT, a novel clustering procedure we designed for online extraction of species from a genealogic tree. This drove us to a final experiment in which the environment was controlled through Cartesian Genetic Programming thus allowing the automated evolution of both the population and abiotic constraints it is subjected to. Through a variation of the traditional1 + λ algorithm, we obtained 10 populations (evolved group e) which had endured in harsh and unpredictable environments. These were confronted to a control group c, in which the constraints were kept mild and constant, on two types of colonization evaluation. Results showed that the evolved group was heterogeneous with half of e consistently outperforming members of c and the other half exhibiting worse performances than the baseline. We also found a very strong positive correlation between catastrophic drops in population level during evolution with the robustness of their final representatives. From this work, two conclusions can be drawn. First, though the need to fight on both the abiotic and biotic fronts can lead to worse performances, more robust individuals can be found in reasonable time-frames. Second, the automated co-evolution of populations and their environments is essential in exploring counter-intuitive, yet fundamental, dynamics both in biological and artificial life