The Emergence of Lines of Hierarchy in Collective Motion of Biological Systems

The emergence of large scale structures in biological systems, and in particular the formation of lines of hierarchy, is observed in many scales, from collections of cells to groups of insects to herds of animals. Motivated by phenomena in chemotaxis and phototaxis, we present a new class of alignment models which exhibit alignment into lines. The spontaneous formation of such ``fingers" can be interpreted as the emergence of leaders and followers in a system of identically interacting agents. Various numerical examples are provided, which demonstrate emergent behaviors similar to the ``fingering'' phenomenon observed in some phototaxis and chemotaxis experiments; this phenomenon is generally known as a challenging pattern to capture for existing models. The novel pairwise interactions provides a fundamental mechanism by which agents may form social hierarchy across a wide range of biological systems

Emergent velocity agreement in robot networks

In this paper we propose and prove correct a new self-stabilizing velocity agreement (flocking) algorithm for oblivious and asynchronous robot networks. Our algorithm allows a flock of uniform robots to follow a flock head emergent during the computation whatever its direction in plane. Robots are asynchronous, oblivious and do not share a common coordinate system. Our solution includes three modules architectured as follows: creation of a common coordinate system that also allows the emergence of a flock-head, setting up the flock pattern and moving the flock. The novelty of our approach steams in identifying the necessary conditions on the flock pattern placement and the velocity of the flock-head (rotation, translation or speed) that allow the flock to both follow the exact same head and to preserve the flock pattern. Additionally, our system is self-healing and self-stabilizing. In the event of the head leave (the leading robot disappears or is damaged and cannot be recognized by the other robots) the flock agrees on another head and follows the trajectory of the new head. Also, robots are oblivious (they do not recall the result of their previous computations) and we make no assumption on their initial position. The step complexity of our solution is O(n)

Adaptive and learning-based formation control of swarm robots

Autonomous aerial and wheeled mobile robots play a major role in tasks such as search and rescue, transportation, monitoring, and inspection. However, these operations are faced with a few open challenges including robust autonomy, and adaptive coordination based on the environment and operating conditions, particularly in swarm robots with limited communication and perception capabilities. Furthermore, the computational complexity increases exponentially with the number of robots in the swarm. This thesis examines two different aspects of the formation control problem. On the one hand, we investigate how formation could be performed by swarm robots with limited communication and perception (e.g., Crazyflie nano quadrotor). On the other hand, we explore human-swarm interaction (HSI) and different shared-control mechanisms between human and swarm robots (e.g., BristleBot) for artistic creation. In particular, we combine bio-inspired (i.e., flocking, foraging) techniques with learning-based control strategies (using artificial neural networks) for adaptive control of multi- robots. We first review how learning-based control and networked dynamical systems can be used to assign distributed and decentralized policies to individual robots such that the desired formation emerges from their collective behavior. We proceed by presenting a novel flocking control for UAV swarm using deep reinforcement learning. We formulate the flocking formation problem as a partially observable Markov decision process (POMDP), and consider a leader-follower configuration, where consensus among all UAVs is used to train a shared control policy, and each UAV performs actions based on the local information it collects. In addition, to avoid collision among UAVs and guarantee flocking and navigation, a reward function is added with the global flocking maintenance, mutual reward, and a collision penalty. We adapt deep deterministic policy gradient (DDPG) with centralized training and decentralized execution to obtain the flocking control policy using actor-critic networks and a global state space matrix. In the context of swarm robotics in arts, we investigate how the formation paradigm can serve as an interaction modality for artists to aesthetically utilize swarms. In particular, we explore particle swarm optimization (PSO) and random walk to control the communication between a team of robots with swarming behavior for musical creation

Swarm Robotics

Collectively working robot teams can solve a problem more efficiently than a single robot, while also providing robustness and flexibility to the group. Swarm robotics model is a key component of a cooperative algorithm that controls the behaviors and interactions of all individuals. The robots in the swarm should have some basic functions, such as sensing, communicating, and monitoring, and satisfy the following properties

Constructing Geometries for Group Control: Methods for Reasoning about Social Behaviors

Social behaviors in groups has been the subjects of hundreds of studies in a variety of research disciplines, including biology, physics, and robotics. In particular, flocking behaviors (commonly exhibited by birds and fish) are widely considered archetypical social behavioris and are due, in part, to the local interactions among the individuals and the environment. Despite a large number of investigations and a significant fraction of these providing algorithmic descriptions of flocking models, incompleteness and imprecision are readily identifiable in these algorithms, algorithmic input, and validation of the models. This has led to a limited understanding of the group level behaviors. Through two case-studies and a detailed meta-study of the literature, this dissertation shows that study of the individual behaviors are not adequate for understanding the behaviors displayed by the group. To highlight the limitations in only studying the individuals, this dissertation introduces a set of tools, that together, unify many of the existing microscopic approaches. A meta-study of the literature using these tools reveal that there are many small differences and ambiguities in the flocking scenarios being studied by different researchers and domains; unfortunately, these differences are of considerable significance. To address this issue, this dissertation exploits the predictable nature of the group’s behaviors in order to control the given group and thus hope to gain a fuller understanding of the collective. From the current literature, it is clear the environment is an important determinant in the resulting collective behaviors. This dissertation presents a method for reasoning about the effects the geometry of an environment has on individuals that exhibit collective behaviors in order to control them. This work formalizes the problem of controlling such groups by means of changing the environment in which the group operates and shows this problem to be PSPACE-Hard. A general methodology and basic framework is presented to address this problem. The proposed approach is general in that it is agnostic to the individual’s behaviors and geometric representations of the environment; allowing for a large variety in groups, desired behaviors, and environmental constraints to be considered. The results from both the simulations and over 80 robot trials show (1) the solution can automatically generate environments for reliably controlling various groups and (2) the solution can apply to other application domains; such as multi-agent formation planning for shepherding and piloting applications

Distributed Control for Collective Behaviour in Micro-unmanned Aerial Vehicles

Full version unavailable due to 3rd party copyright restrictions.The work presented herein focuses on the design of distributed autonomous controllers for collective behaviour of Micro-unmanned Aerial Vehicles (MAVs). Two alternative approaches to this topic are introduced: one based upon the Evolutionary Robotics (ER) paradigm, the other one upon flocking principles. Three computer simulators have been developed in order to carry out the required experiments, all of them having their focus on the modelling of fixed-wing aircraft flight dynamics. The employment of fixed-wing aircraft rather than the omni-directional robots typically employed in collective robotics significantly increases the complexity of the challenges that an autonomous controller has to face. This is mostly due to the strict motion constraints associated with fixed-wing platforms, that require a high degree of accuracy by the controller. Concerning the ER approach, the experimental setups elaborated have resulted in controllers that have been evolved in simulation with the following capabilities: (1) navigation across unknown environments, (2) obstacle avoidance, (3) tracking of a moving target, and (4) execution of cooperative and coordinated behaviours based on implicit communication strategies. The design methodology based upon flocking principles has involved tests on computer simulations and subsequent experimentation on real-world robotic platforms. A customised implementation of Reynolds’ flocking algorithm has been developed and successfully validated through flight tests performed with the swinglet MAV. It has been notably demonstrated how the Evolutionary Robotics approach could be successfully extended to the domain of fixed-wing aerial robotics, which has never received a great deal of attention in the past. The investigations performed have also shown that complex and real physics-based computer simulators are not a compulsory requirement when approaching the domain of aerial robotics, as long as proper autopilot systems (taking care of the ”reality gap” issue) are used on the real robots.EOARD (European Office of Aerospace Research & Development), euCognitio