Fault Recovery in Swarm Robotics Systems using Learning Algorithms

When faults occur in swarm robotic systems they can have a detrimental effect on collective behaviours, to the point that failed individuals may jeopardise the swarm's ability to complete its task. Although fault tolerance is a desirable property of swarm robotic systems, fault recovery mechanisms have not yet been thoroughly explored. Individual robots may suffer a variety of faults, which will affect collective behaviours in different ways, therefore a recovery process is required that can cope with many different failure scenarios. In this thesis, we propose a novel approach for fault recovery in robot swarms that uses Reinforcement Learning and Self-Organising Maps to select the most appropriate recovery strategy for any given scenario. The learning process is evaluated in both centralised and distributed settings. Additionally, we experimentally evaluate the performance of this approach in comparison to random selection of fault recovery strategies, using simulated collective phototaxis, aggregation and foraging tasks as case studies. Our results show that this machine learning approach outperforms random selection, and allows swarm robotic systems to recover from faults that would otherwise prevent the swarm from completing its mission. This work builds upon existing research in fault detection and diagnosis in robot swarms, with the aim of creating a fully fault-tolerant swarm capable of long-term autonomy

Immune systems inspired multi-robot cooperative shepherding

Certain tasks require multiple robots to cooperate in order to solve them. The main problem with multi-robot systems is that they are inherently complex and usually situated in a dynamic environment. Now, biological immune systems possess a natural distributed control and exhibit real-time adaptivity, properties that are required to solve problems in multi-robot systems. In this thesis, biological immune systems and their response to external elements to maintain an organism's health state are researched. The objective of this research is to propose immune-inspired approaches to cooperation, to establish an adaptive cooperation algorithm, and to determine the refinements that can be applied in relation to cooperation. Two immune-inspired models that are based on the immune network theory are proposed, namely the Immune Network T-cell-regulated---with Memory (INT-M) and the Immune Network T-cell-regulated---Cross-Reactive (INT-X) models. The INT-M model is further studied where the results have suggested that the model is feasible and suitable to be used, especially in the multi-robot cooperative shepherding domain. The Collecting task in the RoboShepherd scenario and the application of the INT-M algorithm for multi-robot cooperation are discussed. This scenario provides a highly dynamic and complex situation that has wide applicability in real-world problems. The underlying 'mechanism of cooperation' in the immune inspired model (INT-M) is verified to be adaptive in this chosen scenario. Several multi-robot cooperative shepherding factors are studied and refinements proposed, notably methods used for Shepherds' Approach, Shepherds' Formation and Steering Points' Distance. This study also recognises the importance of flock identification in relation to cooperative shepherding, and the Connected Components Labelling method to overcome the related problem is presented. Further work is suggested on the proposed INT-X model that was not implemented in this study, since it builds on top of the INT-M algorithm and its refinements. This study can also be extended to include other shepherding behaviours, further investigation of other useful features of biological immune systems, and the application of the proposed models to other cooperative tasks

Exogenous Fault Detection in Swarm Robotic Systems

Swarm robotic systems comprise many individual robots, and exhibit a degree of innate fault tolerance due to this built-in redundancy. They are robust in the sense that the complete failure of individual robots will have little detrimental effect on a swarm's overall collective behaviour. However, it has recently been shown that partially failed individuals may be harmful, and cause problems that cannot be solved by simply adding more robots to the swarm. Instead, an active approach to dealing with failed individuals is required for a swarm to continue operation in the face of partial failures. This thesis presents a novel method of exogenous fault detection that allows robots to detect the presence of faults in each other, via the comparison of expected and observed behaviour. Each robot predicts the expected behaviour of its neighbours by simulating them online in an internal replica of the real world. This expected behaviour is then compared against observations of their true behaviour, and any significant discrepancy is detected as a fault. This work represents the first step towards a distributed fault detection, diagnosis, and recovery process that would afford robot swarms a high degree of fault tolerance, and facilitate long-term autonomy

08141 Abstracts Collection -- Organic Computing - Controlled Self-organization

From March 30th to April 4th 2008, the Dagstuhl Seminar 08141 "Organic Computing - Controlled Self-organization"\u27 was held in the International Conference and Research Center (IBFI), Schloss Dagstuhl. During the seminar, several participants presented their current research, and ongoing work and open problems were discussed. Abstracts of the presentations given during the seminar as well as abstracts of seminar results and ideas are put together in this paper. The first section describes the seminar topics and goals in general. Links to extended abstracts or full papers are provided, if available

Background, Systematic Review, Challenges and Outlook

Publisher Copyright: © 2013 IEEE. This research is supported by the Digital Manufacturing and Design Training Network (DiManD) project funded by the European Union through the Marie Skłodowska-Curie Innovative Training Networks (H2020-MSCA-ITN-2018) under grant agreement no. 814078The concept of smart manufacturing has attracted huge attention in the last years as an answer to the increasing complexity, heterogeneity, and dynamism of manufacturing ecosystems. This vision embraces the notion of autonomous and self-organized elements, capable of self-management and self-decision-making under a context-aware and intelligent infrastructure. While dealing with dynamic and uncertain environments, these solutions are also contributing to generating social impact and introducing sustainability into the industrial equation thanks to the development of task-specific resources that can be easily adapted, re-used, and shared. A lot of research under the context of self-organization in smart manufacturing has been produced in the last decade considering different methodologies and developed under different contexts. Most of these works are still in the conceptual or experimental stage and have been developed under different application scenarios. Thus, it is necessary to evaluate their design principles and potentiate their results. The objective of this paper is threefold. First, to introduce the main ideas behind self-organization in smart manufacturing. Then, through a systematic literature review, describe the current status in terms of technological and implementation details, mechanisms used, and some of the potential future research directions. Finally, the presentation of an outlook that summarizes the main results of this work and their interrelation to facilitate the development of self-organized manufacturing solutions. By providing a holistic overview of the field, we expect that this work can be used by academics and practitioners as a guide to generate awareness of possible requirements, industrial challenges, and opportunities that future self-organizing solutions can have towards a smart manufacturing transition.publishersversionpublishe

Bio-inspired multi-agent systems for reconfigurable manufacturing systems

The current market’s demand for customization and responsiveness is a major challenge for producing intelligent, adaptive manufacturing systems. The Multi-Agent System (MAS) paradigm offers an alternative way to design this kind of system based on decentralized control using distributed, autonomous agents, thus replacing the traditional centralized control approach. The MAS solutions provide modularity, flexibility and robustness, thus addressing the responsiveness property, but usually do not consider true adaptation and re-configuration. Understanding how, in nature, complex things are performed in a simple and effective way allows us to mimic nature’s insights and develop powerful adaptive systems that able to evolve, thus dealing with the current challenges imposed on manufactur- ing systems. The paper provides an overview of some of the principles found in nature and biology and analyses the effectiveness of bio-inspired methods, which are used to enhance multi-agent systems to solve complex engineering problems, especially in the manufacturing field. An industrial automation case study is used to illustrate a bio-inspired method based on potential fields to dynamically route pallets

A novel potential field model for perimeter and agent density control in multiagent swarms

parameters for the computation of control vectors. This restriction often limits the structures that can evolve, since agents are unable to modify their behaviour based on their structural role. This paper proposes an enhanced model that uses the perimeter status of agents in selecting control parameters. This allows a wider variety of emergent behaviours, many of which result in much improved swarm structures. The model is based upon equivalence classes of agent pairs, defined by their perimeter status. Array-valued parameters are introduced to allow each equivalence class to be given its own parameter values. The model also introduces a new control vector to ‘flatten’ reflex angles between neighbouring agents on the swarm perimeter, often leading to significantly improved swarm structure. Extensive experiments have been conducted that demonstrate how the new model causes a variety of useful behaviours to emerge from random swarm deployments. The results show that several important behaviours, such as shape control, void removal, perimeter packing and expansion, and perimeter rotation, can be produced without the need for explicit inter-agent communication. The approach is applicable to a variety of applications, including reconnaissance, area-coverage, and containment

Using MapReduce Streaming for Distributed Life Simulation on the Cloud

Distributed software simulations are indispensable in the study of large-scale life models but often require the use of technically complex lower-level distributed computing frameworks, such as MPI. We propose to overcome the complexity challenge by applying the emerging MapReduce (MR) model to distributed life simulations and by running such simulations on the cloud. Technically, we design optimized MR streaming algorithms for discrete and continuous versions of Conway’s life according to a general MR streaming pattern. We chose life because it is simple enough as a testbed for MR’s applicability to a-life simulations and general enough to make our results applicable to various lattice-based a-life models. We implement and empirically evaluate our algorithms’ performance on Amazon’s Elastic MR cloud. Our experiments demonstrate that a single MR optimization technique called strip partitioning can reduce the execution time of continuous life simulations by 64%. To the best of our knowledge, we are the first to propose and evaluate MR streaming algorithms for lattice-based simulations. Our algorithms can serve as prototypes in the development of novel MR simulation algorithms for large-scale lattice-based a-life models.https://digitalcommons.chapman.edu/scs_books/1014/thumbnail.jp

The future of complexity engineering

Complexity Engineering encompasses a set of approaches to engineering systems which are typically composed of various interacting entities often exhibiting self-* behaviours and emergence. The engineer or designer uses methods that benefit from the findings of complexity science and often considerably differ from the classical engineering approach of "divide and conquer".This article provides an overview on some very interdisciplinary and innovative research areas and projects in the field of Complexity Engineering, including synthetic biology, chemistry, artificial life, self-healing materials and others. It then classifies the presented work according to five types of nature-inspired technology, namely: (1) using technology to understand nature, (2) nature-inspiration for technology, (3) using technology on natural systems, (4) using biotechnology methods in software engineering, and (5) using technology to model nature. Finally, future trends in Complexity Engineering are indicated and related risks are discussed