Combining stigmergic and flocking behaviors to coordinate swarms of drones performing target search

Due to growing endurance, safety and non-invasivity, small drones can be increasingly experimented in unstructured environments. Their moderate computing power can be assimilated into swarm coordination algorithms, performing tasks in a scalable manner. For this purpose, it is challenging to investigate the use of biologically-inspired mechanisms. In this paper the focus is on the coordination aspects between small drones required to perform target search. We show how this objective can be better achieved by combining stigmergic and flocking behaviors. Stigmergy occurs when a drone senses a potential target, by releasing digital pheromone on its location. Multiple pheromone deposits are aggregated, increasing in intensity, but also diffused, to be propagated to neighborhood, and lastly evaporated, decreasing intensity in time. As a consequence, pheromone intensity creates a spatiotemporal attractive potential field coordinating a swarm of drones to visit a potential target. Flocking occurs when drones are spatially organized into groups, whose members have approximately the same heading, and attempt to remain in range between them, for each group. It is an emergent effect of individual rules based on alignment, separation and cohesion. In this paper, we present a novel and fully decentralized model for target search, and experiment it empirically using a multi-agent simulation platform. The different combination strategies are reviewed, describing their performance on a number of synthetic and real-world scenarios

Sensing and connection systems for assisted and autonomous driving and unmanned vehicles

The special issue, “Sensors, Wireless Connectivity and Systems for Autonomous Vehicles and Smart Mobility” on MDPI Sensors presents 12 accepted papers, with authors from North America, Asia, Europe and Australia, related to the emerging trends in sensing and navigation systems (i.e., sensors plus related signal processing and understanding techniques in multi-agent and cooperating scenarios) for autonomous vehicles, including also unmanned aerial and underwater ones

Coordinating Aerial Robots and Unattended Ground Sensors for Intelligent Surveillance Systems

Sensor networks are being used to implement different types of sophisticated emerging applications, such as those aimed at supporting ambient intelligence and surveillance systems. This usage is enhanced by employing sensors with different characteristics in terms of sensing, computing and mobility capabilities, working cooperatively in the network. However, the design and deployment of these heterogeneous systems present several issues that have to be handled in order to meet the user expectations. The main problems are related to the nodes‘ interoperability and the overall resource allocation, both inter and intra nodes. The first problem requires a common platform that abstracts the nodes’ heterogeneity and provides a smooth communication, while the second is handled by cooperation mechanisms supported by the platform. Moreover, as the nodes are supposed to be heterogeneous, a customizable platform is required to support both resource rich and poorer nodes. This paper analyses surveillance systems based on a heterogeneous sensor network, which is composed by lowend ground sensor nodes and autonomous aerial robots, i.e. Unmanned Aerial Vehicles (UAVs), carrying different kinds of sensors. The approach proposed in this work tackles the two above mentioned problems by using a customizable hardware platform and a middleware to support interoperability. Experimental results are also provided

Platform Development for the Implementation and Testing of New Swarming Strategies

Gemstone Team SWARM-AISwarm robotics--the use of multiple autonomous robots in coordination to accomplish a task--is useful for mapping, light package transport, and search and rescue operations, among other applications. Researchers and industry professionals have developed robotic swarm mechanisms to accomplish these tasks. Some of those mechanisms or “strategies” have been tested on hardware; however, the technical requirements involved in fielding a drone swarm can be prohibitive to physical testing. Team SWARM-AI has developed a platform that provides a starting point for testing new swarming strategies. This platform allows the user to select vehicles of their choosing- either air, land, or water based, or some combination thereof- as well as define their own swarming method. Using a novel decentralized approach to ground control software, this platform provides a user interface and a system of computational “units” to coordinate drone swarms with a centralized, decentralized, or combination architecture. Additionally, the platform propagates user input from the master unit to the rest of the swarm and allows each unit to request sensor data from other units. The user is free to edit the processes by which each drone interacts with the environment and the rest of the swarm, giving them freedom to test their swarming strategy. The software system is then tested with a swarm of quadcopters using Software in the Loop (SITL) testing

Adaptive and learning-based formation control of swarm robots

Autonomous aerial and wheeled mobile robots play a major role in tasks such as search and rescue, transportation, monitoring, and inspection. However, these operations are faced with a few open challenges including robust autonomy, and adaptive coordination based on the environment and operating conditions, particularly in swarm robots with limited communication and perception capabilities. Furthermore, the computational complexity increases exponentially with the number of robots in the swarm. This thesis examines two different aspects of the formation control problem. On the one hand, we investigate how formation could be performed by swarm robots with limited communication and perception (e.g., Crazyflie nano quadrotor). On the other hand, we explore human-swarm interaction (HSI) and different shared-control mechanisms between human and swarm robots (e.g., BristleBot) for artistic creation. In particular, we combine bio-inspired (i.e., flocking, foraging) techniques with learning-based control strategies (using artificial neural networks) for adaptive control of multi- robots. We first review how learning-based control and networked dynamical systems can be used to assign distributed and decentralized policies to individual robots such that the desired formation emerges from their collective behavior. We proceed by presenting a novel flocking control for UAV swarm using deep reinforcement learning. We formulate the flocking formation problem as a partially observable Markov decision process (POMDP), and consider a leader-follower configuration, where consensus among all UAVs is used to train a shared control policy, and each UAV performs actions based on the local information it collects. In addition, to avoid collision among UAVs and guarantee flocking and navigation, a reward function is added with the global flocking maintenance, mutual reward, and a collision penalty. We adapt deep deterministic policy gradient (DDPG) with centralized training and decentralized execution to obtain the flocking control policy using actor-critic networks and a global state space matrix. In the context of swarm robotics in arts, we investigate how the formation paradigm can serve as an interaction modality for artists to aesthetically utilize swarms. In particular, we explore particle swarm optimization (PSO) and random walk to control the communication between a team of robots with swarming behavior for musical creation

Beetle Colony Optimization Algorithm and its Application

Massive data sets and complex scheduling processes have high-dimensional and non-convex features bringing challenges on various applications. With deep insight into the bio-heuristic opinion, we propose a novel Beetle Colony Optimization (BCO) being able to adapt NP-hard issues to meet growing application demands. Two important mechanisms are introduced into the proposed BCO algorithm. The first one is Beetle Antennae Search (BAS), which is a mechanism of random search along the gradient direction but not use gradient information at all. The second one is swarm intelligence, which is a collective mechanism of decentralized and self-organized agents. Both of them have reached a performance balance to elevate the proposed algorithm to maintain a wide search horizon and high search efficiency. Finally, our algorithm is applied to traveling salesman problem, and quadratic assignment problem and possesses excellent performance, which also shows that the algorithm has good applicability from the side. The effectiveness of the algorithm is also substantiated by comparing the results with the original ant colony optimization (ACO) algorithm in 3D simulation model experimental path planning

Decentralized Control of an Energy Constrained Heterogeneous Swarm for Persistent Surveillance

Robot swarms are envisioned in applications such as surveillance, agriculture, search-and-rescue operations, and construction. The decentralized nature of swarm intelligence has three key advantages over traditional multi-robot control algorithms: it is scalable, it is fault tolerant, and it is not susceptible to a single point of failure. These advantages are critical to the task of persistent surveillance - where a number of target locations need to be visited as frequently as possible. Unfortunately, in the real world, the autonomous robots that can be used for persistent surveillance have a limited battery life (or fuel capacity). Thus, they need to abandon their surveillance duties to visit a battery swapping station (or refueling depot) a.k.a. €˜depots€™. This €˜down time€™ reduces the frequency of visitation. This problem can be eliminated if the depots themselves were autonomous vehicles that could meet the (surveillance) robots at some point along their path from one target to another. Thus, the robots would spend less time on the \u27charging\u27 (or refueling) task. In this thesis we present decentralized control algorithms, and their results, for three stages of the persistent surveillance problem. First, we consider the case where the robots have no energy constraints, and use a decentralized approach to allow the robots choose the €˜best€™ target that they should visit next. While the selection process is decentralized, the robots can communicate with all the other robots in the swarm, and let them know which is their chosen target. We then consider the energy constraints of the robots, and slightly modify the algorithm, so that the robots visit a depot before they run out of energy. Lastly, we consider the case where the depots themselves can move, and communicate with the robots to pick a location and time to meet, to be able to swap the empty battery of a robot, with a fresh one. The goal of persistent surveillance is to visit target locations as frequently as possible, and thus, the performance measurement parameter is chosen to be the median frequency of visitation for all target locations. We evaluate the performance of the three algorithms in an extensive set of simulated experiments

Description and composition of bio-inspired design patterns: a complete overview

In the last decade, bio-inspired self-organising mechanisms have been applied to different domains, achieving results beyond traditional approaches. However, researchers usually use these mechanisms in an ad-hoc manner. In this way, their interpretation, definition, boundary (i.e. when one mechanism stops, and when another starts), and implementation typically vary in the existing literature, thus preventing these mechanisms from being applied clearly and systematically to solve recurrent problems. To ease engineering of artificial bio-inspired systems, this paper describes a catalogue of bio-inspired mechanisms in terms of modular and reusable design patterns organised into different layers. This catalogue uniformly frames and classifies a variety of different patterns. Additionally, this paper places the design patterns inside existing self-organising methodologies and hints for selecting and using a design patter

Networking and Application Interface Technology for Wireless Sensor Network Surveillance and Monitoring

Distributed unattended ground sensor networks used in battlefield surveillance and monitoring missions, have proven to be valuable in providing a tactical information advantage required for command and control, intelligence, surveillance, and reconnaissance planning. Operational effectiveness for surveillance missions can be enhanced further through network centric capability, where distributed UGS networks have the ability to perform surveillance operations autonomously. NCC operation can be enhanced through UGSs having the ability to evaluate their awareness of the current joint surveillance environment, in order to provide the necessary adaptation to dynamic changes. NCC can also provide an advantage for UGS networks to self-manage their limited operational resources efficiently, according to mission objective priority. In this article, we present a cross-layer approach and highlight techniques that have potential to enable NCC operation within a mission-orientated UGS surveillance setting