A Hormone Inspired System for On-line Adaptation in Swarm Robotic Systems

Individual robots, while providing the opportunity to develop a bespoke and specialised system, suffer in terms of performance when it comes to executing a large number of concurrent tasks. In some cases it is possible to drastically increase the speed of task execution by adding more agents to a system, however this comes at a cost. By mass producing relatively simple robots, costs can be kept low while still gaining the benefit of large scale multi-tasking. This approach sits at the core of swarm robotics. Robot swarms excel in tasks that rely heavily on their ability to multi-task, rather than applications that require bespoke actuation. Swarm suited tasks include: exploration, transportation or operation in dangerous environments. Swarms are particularly suited to hazardous environments due to the inherent expendability that comes with having multiple, decentralised agents. However, due to the variance in the environments a swarm may explore and their need to remain decentralised, a level of adaptability is required of them that can't be provided before a task begins. Methods of novel hormone-inspired robotic control are proposed in this thesis, offering solutions to these problems. These hormone inspired systems, or virtual hormones, provide an on-line method for adaptation that operates while a task is executed. These virtual hormones respond to environmental interactions. Then, through a mixture of decay and stimulant, provide values that grant contextually relevant information to individual robots. These values can then be used in decision making regarding parameters and behavioural changes. The hormone inspired systems presented in this thesis are found to be effective in mid-task adaptation, allowing robots to improve their effectiveness with minimal user interaction. It is also found that it is possible to deploy amalgamations of multiple hormone systems, controlling robots at multiple levels, enabling swarms to achieve strong, energy-efficient, performance

A Hormone-Inspired Arbitration System For Self Identifying Abilities Amongst A Heterogeneous Robot Swarm

Current exploration of adaptation in robot swarms requires the swarm or individuals within that swarm to have knowledge of their own capabilities. Across long term use a swarms understanding of its capabilities may become inaccurate due to wear or faults in the system. In addition to this, systems capable of self designing morphologies are becoming increasingly feasible. In these self designing examples it would be impossible to have accurate knowledge of capability before executing a task for the first time. We propose an arbitration system that requires no explicit knowledge of capability but instead uses hormone-inspired values to decide on an environmental preference. The robots in the swarm differ by wheel type and thus how quickly they are able to move across terrain. The goal of this system is to allow robots to identify their strengths within a swarm and allocate themselves to areas of an environment with a floor type that suits their ability. This work shows that the use of a hormone-inspired arbitration system can extrapolate robot capability and adapt the systems preference of terrain to suit said capability.</p

An Amalgamation of Hormone Inspired Arbitration Systems For Application In Robot Swarms

Previous work has shown that virtual hormone systems can be engineered to arbitrateswarms of robots between sets of behaviours. These virtual hormones act similarly to theirnatural counterparts, providing a method of online, reactive adaptation. It is yet to be shownhow virtual hormone systems could be used when a robotic swarm has a large variety of task typesto execute. This paper details work that demonstrates the viability of a collection of virtual hormonesthat can be used to regulate and adapt a swarm over time, in response to different environmentsand tasks. Specifically, the paper examines a new method of hormone speed control for energyefficiency and combines it with two existing systems controlling environmental preference as wellas a selection of behaviours that produce an effective foraging swarm. Experiments confirm theeffectiveness of the combined system, showing that a swarm of robots equipped with multiple virtualhormones can forage efficiently to a specified item demand within an allotted period of time

Multi-Robot Systems: Challenges, Trends and Applications

This book is a printed edition of the Special Issue entitled “Multi-Robot Systems: Challenges, Trends, and Applications” that was published in Applied Sciences. This Special Issue collected seventeen high-quality papers that discuss the main challenges of multi-robot systems, present the trends to address these issues, and report various relevant applications. Some of the topics addressed by these papers are robot swarms, mission planning, robot teaming, machine learning, immersive technologies, search and rescue, and social robotics

Bioinspired approaches for coordination and behaviour adaptation of aerial robot swarms

Behavioural adaptation is a pervasive component in a myriad of animal societies. A well-known strategy, known as Levy Walk, has been commonly linked to such adaptation in foraging animals, where the motion of individuals couples periods of localized search and long straight forward motions. Despite the vast number of studies on Levy Walks in computational ecology, it was only in the past decade that the first studies applied this concept to robotics tasks. Therefore, this Thesis draws inspiration from the Levy Walk behaviour, and its recent applications to robotics, to design biologically inspired models for two swarm robotics tasks, aiming at increasing the performance with respect to the state of the art. The first task is cooperative surveillance, where the aim is to deploy a swarm so that at any point in time regions of the domain are observed by multiple robots simultaneously. One of the contributions of this Thesis, is the Levy Swarm Algorithm that augments the concept of Levy Walk to include the Reynolds’ flocking rules and achieve both exploration and coordination in a swarm of unmanned aerial vehicles. The second task is adaptive foraging in environments of clustered rewards. In such environments behavioural adaptation is of paramount importance to modulate the transition between exploitation and exploration. Nature enables these adaptive changes by coupling the behaviour to the fluctuation of hormones that are mostly regulated by the endocrine system. This Thesis draws further inspiration from Nature and proposes a second model, the Endocrine Levy Walk, that employs an Artificial Endocrine System as a modulating mechanism of Levy Walk behaviour. The Endocrine Levy Walk is compared with the Yuragi model (Nurzaman et al., 2010), in both simulated and physical experiments where it shows its increased performance in terms of search efficiency, energy efficiency and number of rewards found. The Endocrine Levy Walk is then augmented to consider social interactions between members of the swarm by mimicking the behaviour of fireflies, where individuals attract others when finding suitable environmental conditions. This extended model, the Endocrine Levy Firefly, is compared to the Levy+ model (Sutantyo et al., 2013) and the Adaptive Collective Levy Walk Nauta et al. (2020). This comparison is also made both in simulated and physical experiments and assessed in terms of search efficiency, number of rewards found and cluster search efficiency, strengthening the argument in favour of the Endocrine Levy Firefly as a promising approach to tackle collaborative foragin

Computational aspects of cellular intelligence and their role in artificial intelligence.

The work presented in this thesis is concerned with an exploration of the computational aspects of the primitive intelligence associated with single-celled organisms. The main aim is to explore this Cellular Intelligence and its role within Artificial Intelligence. The findings of an extensive literature search into the biological characteristics, properties and mechanisms associated with Cellular Intelligence, its underlying machinery - Cell Signalling Networks and the existing computational methods used to capture it are reported. The results of this search are then used to fashion the development of a versatile new connectionist representation, termed the Artificial Reaction Network (ARN). The ARN belongs to the branch of Artificial Life known as Artificial Chemistry and has properties in common with both Artificial Intelligence and Systems Biology techniques, including: Artificial Neural Networks, Artificial Biochemical Networks, Gene Regulatory Networks, Random Boolean Networks, Petri Nets, and S-Systems. The thesis outlines the following original work: The ARN is used to model the chemotaxis pathway of Escherichia coli and is shown to capture emergent characteristics associated with this organism and Cellular Intelligence more generally. The computational properties of the ARN and its applications in robotic control are explored by combining functional motifs found in biochemical network to create temporal changing waveforms which control the gaits of limbed robots. This system is then extended into a complete control system by combining pattern recognition with limb control in a single ARN. The results show that the ARN can offer increased flexibility over existing methods. Multiple distributed cell-like ARN based agents termed Cytobots are created. These are first used to simulate aggregating cells based on the slime mould Dictyostelium discoideum. The Cytobots are shown to capture emergent behaviour arising from multiple stigmergic interactions. Applications of Cytobots within swarm robotics are investigated by applying them to benchmark search problems and to the task of cleaning up a simulated oil spill. The results are compared to those of established optimization algorithms using similar cell inspired strategies, and to other robotic agent strategies. Consideration is given to the advantages and disadvantages of the technique and suggestions are made for future work in the area. The report concludes that the Artificial Reaction Network is a versatile and powerful technique which has application in both simulation of chemical systems, and in robotic control, where it can offer a higher degree of flexibility and computational efficiency than benchmark alternatives. Furthermore, it provides a tool which may possibly throw further light on the origins and limitations of the primitive intelligence associated with cells

Using MapReduce Streaming for Distributed Life Simulation on the Cloud

Distributed software simulations are indispensable in the study of large-scale life models but often require the use of technically complex lower-level distributed computing frameworks, such as MPI. We propose to overcome the complexity challenge by applying the emerging MapReduce (MR) model to distributed life simulations and by running such simulations on the cloud. Technically, we design optimized MR streaming algorithms for discrete and continuous versions of Conway’s life according to a general MR streaming pattern. We chose life because it is simple enough as a testbed for MR’s applicability to a-life simulations and general enough to make our results applicable to various lattice-based a-life models. We implement and empirically evaluate our algorithms’ performance on Amazon’s Elastic MR cloud. Our experiments demonstrate that a single MR optimization technique called strip partitioning can reduce the execution time of continuous life simulations by 64%. To the best of our knowledge, we are the first to propose and evaluate MR streaming algorithms for lattice-based simulations. Our algorithms can serve as prototypes in the development of novel MR simulation algorithms for large-scale lattice-based a-life models.https://digitalcommons.chapman.edu/scs_books/1014/thumbnail.jp

Engineering evolutionary control for real-world robotic systems

Evolutionary Robotics (ER) is the field of study concerned with the application of evolutionary computation to the design of robotic systems. Two main issues have prevented ER from being applied to real-world tasks, namely scaling to complex tasks and the transfer of control to real-robot systems. Finding solutions to complex tasks is challenging for evolutionary approaches due to the bootstrap problem and deception. When the task goal is too difficult, the evolutionary process will drift in regions of the search space with equally low levels of performance and therefore fail to bootstrap. Furthermore, the search space tends to get rugged (deceptive) as task complexity increases, which can lead to premature convergence. Another prominent issue in ER is the reality gap. Behavioral control is typically evolved in simulation and then only transferred to the real robotic hardware when a good solution has been found. Since simulation is an abstraction of the real world, the accuracy of the robot model and its interactions with the environment is limited. As a result, control evolved in a simulator tends to display a lower performance in reality than in simulation. In this thesis, we present a hierarchical control synthesis approach that enables the use of ER techniques for complex tasks in real robotic hardware by mitigating the bootstrap problem, deception, and the reality gap. We recursively decompose a task into sub-tasks, and synthesize control for each sub-task. The individual behaviors are then composed hierarchically. The possibility of incrementally transferring control as the controller is composed allows transferability issues to be addressed locally in the controller hierarchy. Our approach features hybridity, allowing different control synthesis techniques to be combined. We demonstrate our approach in a series of tasks that go beyond the complexity of tasks where ER has been successfully applied. We further show that hierarchical control can be applied in single-robot systems and in multirobot systems. Given our long-term goal of enabling the application of ER techniques to real-world tasks, we systematically validate our approach in real robotic hardware. For one of the demonstrations in this thesis, we have designed and built a swarm robotic platform, and we show the first successful transfer of evolved and hierarchical control to a swarm of robots outside of controlled laboratory conditions.A Robótica Evolutiva (RE) é a área de investigação que estuda a aplicação de computação evolutiva na conceção de sistemas robóticos. Dois principais desafios têm impedido a aplicação da RE em tarefas do mundo real: a dificuldade em solucionar tarefas complexas e a transferência de controladores evoluídos para sistemas robóticos reais. Encontrar soluções para tarefas complexas é desafiante para as técnicas evolutivas devido ao bootstrap problem e à deception. Quando o objetivo é demasiado difícil, o processo evolutivo tende a permanecer em regiões do espaço de procura com níveis de desempenho igualmente baixos, e consequentemente não consegue inicializar. Por outro lado, o espaço de procura tende a enrugar à medida que a complexidade da tarefa aumenta, o que pode resultar numa convergência prematura. Outro desafio na RE é a reality gap. O controlo robótico é tipicamente evoluído em simulação, e só é transferido para o sistema robótico real quando uma boa solução tiver sido encontrada. Como a simulação é uma abstração da realidade, a precisão do modelo do robô e das suas interações com o ambiente é limitada, podendo resultar em controladores com um menor desempenho no mundo real. Nesta tese, apresentamos uma abordagem de síntese de controlo hierárquica que permite o uso de técnicas de RE em tarefas complexas com hardware robótico real, mitigando o bootstrap problem, a deception e a reality gap. Decompomos recursivamente uma tarefa em sub-tarefas, e sintetizamos controlo para cada subtarefa. Os comportamentos individuais são então compostos hierarquicamente. A possibilidade de transferir o controlo incrementalmente à medida que o controlador é composto permite que problemas de transferibilidade possam ser endereçados localmente na hierarquia do controlador. A nossa abordagem permite o uso de diferentes técnicas de síntese de controlo, resultando em controladores híbridos. Demonstramos a nossa abordagem em várias tarefas que vão para além da complexidade das tarefas onde a RE foi aplicada. Também mostramos que o controlo hierárquico pode ser aplicado em sistemas de um robô ou sistemas multirobô. Dado o nosso objetivo de longo prazo de permitir o uso de técnicas de RE em tarefas no mundo real, concebemos e desenvolvemos uma plataforma de robótica de enxame, e mostramos a primeira transferência de controlo evoluído e hierárquico para um exame de robôs fora de condições controladas de laboratório.This work has been supported by the Portuguese Foundation for Science and Technology (Fundação para a Ciência e Tecnologia) under the grants SFRH/BD/76438/2011, EXPL/EEI-AUT/0329/2013, and by Instituto de Telecomunicações under the grant UID/EEA/50008/2013