An Overview of Recent Progress in the Study of Distributed Multi-agent Coordination

This article reviews some main results and progress in distributed multi-agent coordination, focusing on papers published in major control systems and robotics journals since 2006. Distributed coordination of multiple vehicles, including unmanned aerial vehicles, unmanned ground vehicles and unmanned underwater vehicles, has been a very active research subject studied extensively by the systems and control community. The recent results in this area are categorized into several directions, such as consensus, formation control, optimization, task assignment, and estimation. After the review, a short discussion section is included to summarize the existing research and to propose several promising research directions along with some open problems that are deemed important for further investigations

Distributed formation tracking control of multiple car-like robots

In this thesis, distributed formation tracking control of multiple car-like robots is studied. Each vehicle can communicate and send or receive states information to or from a portion of other vehicles. The communication topology is characterized by a graph. Each vehicle is considered as a vertex in the graph and each communication link is considered as an edge in the graph. The unicycles are modeled firstly by both kinematic systems. Distributed controllers for vehicle kinematics are designed with the aid of graph theory. Two control algorithms are designed based on the chained-form system and its transformation respectively. Both algorithms achieve exponential convergence to the desired reference states. Then vehicle dynamics is considered and dynamic controllers are designed with the aid of two types of kinematic-based controllers proposed in the first section. Finally, a special case of switching graph is addressed considering the probability of vehicle disability and links breakage

Underactuated leader-follower synchronisation for multi-agent systems with rejection of unknown disturbances

Author preprintIn this paper leader-follower synchronization is considered for underactuated followers in an inhomogeneous multi-agent system. The goal is to synchronise the motion of a leader and an underactuated follower. Measurements of the leader's position and velocity are available, while the dynamics and trajectory of the leader is unknown. The leader velocities are used as input for a constant bearing guidance algorithm to assure that the follower synchronises its motion to the leader. It is also shown that the proposed leader-follower scheme can be applied to multi-agent systems that are subjected to unknown environmental disturbances. Furthermore, the trajectory of the leader does not need to be known. The stability properties of the complete control scheme and the unactuated internal dynamics are analysed using nonlinear cascaded system theory. Simulation results are presented to validate the proposed control strategy.Preprint version. © IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works

Adaptive and learning-based formation control of swarm robots

Autonomous aerial and wheeled mobile robots play a major role in tasks such as search and rescue, transportation, monitoring, and inspection. However, these operations are faced with a few open challenges including robust autonomy, and adaptive coordination based on the environment and operating conditions, particularly in swarm robots with limited communication and perception capabilities. Furthermore, the computational complexity increases exponentially with the number of robots in the swarm. This thesis examines two different aspects of the formation control problem. On the one hand, we investigate how formation could be performed by swarm robots with limited communication and perception (e.g., Crazyflie nano quadrotor). On the other hand, we explore human-swarm interaction (HSI) and different shared-control mechanisms between human and swarm robots (e.g., BristleBot) for artistic creation. In particular, we combine bio-inspired (i.e., flocking, foraging) techniques with learning-based control strategies (using artificial neural networks) for adaptive control of multi- robots. We first review how learning-based control and networked dynamical systems can be used to assign distributed and decentralized policies to individual robots such that the desired formation emerges from their collective behavior. We proceed by presenting a novel flocking control for UAV swarm using deep reinforcement learning. We formulate the flocking formation problem as a partially observable Markov decision process (POMDP), and consider a leader-follower configuration, where consensus among all UAVs is used to train a shared control policy, and each UAV performs actions based on the local information it collects. In addition, to avoid collision among UAVs and guarantee flocking and navigation, a reward function is added with the global flocking maintenance, mutual reward, and a collision penalty. We adapt deep deterministic policy gradient (DDPG) with centralized training and decentralized execution to obtain the flocking control policy using actor-critic networks and a global state space matrix. In the context of swarm robotics in arts, we investigate how the formation paradigm can serve as an interaction modality for artists to aesthetically utilize swarms. In particular, we explore particle swarm optimization (PSO) and random walk to control the communication between a team of robots with swarming behavior for musical creation

Hybrid Flocking Control Algorithm with Application to Coordination between Multiple Fixed-wing Aircraft

Flocking, as a collective behavior of a group, has been investigated in many areas, and in the recent decade, flocking algorithm design has gained a lot of attention due to its variety of potential applications. Although there are many applications exclusively related to fixed-wing aircraft, most of the theoretical works rarely consider these situations. The fixed-wing aircraft flocking is distinct from the general flocking problems by four practical concerns, which include the nonholonomic constraint, the limitation of speed, the collision avoidance and the efficient use of airspace. None of the existing works have addressed all these concerns. The major difficulty is to take into account the all four concerns simultaneously meanwhile having a relatively mild requirement on the initial states of aircraft. In this thesis, to solve the fixed-wing aircraft flocking problem, a supervisory decentralized control algorithm is proposed. The proposed control algorithm has a switching control structure, which basically includes three modes of control protocol and a state-dependent switching logic. Three modes of decentralized control protocol are designed based on the artificial potential field method, which helps to address the nonholonomic constraint, the limitation of speed and the collision avoidance for appropriate initial conditions. The switching logic is designed based on the invariance property induced by the control modes such that the desirable convergence properties of the flocking behavior and the efficient use of airspace are addressed. The proposed switching logic can avoid the fast mode switching, and the supervisor does not require to perform switchings frequently and respond to the aircraft immediately, which means the desired properties can still be guaranteed with the presence of the dwell time in the supervisor

Distributed optimal and predictive control methods for networks of dynamic systems

Several recent approaches to distributed control design over networks of interconnected dynamic systems rely on certain assumptions, such as identical subsystem dynamics, absence of dynamical couplings, linear dynamics and undirected interaction schemes. In this thesis, we investigate systematic methods for relaxing a number of simplifying factors leading to a unifying approach for solving general distributed-control stabilization problems of networks of dynamic agents. We show that the gain-margin property of LQR control holds for complex multiplicative input perturbations and a generic symmetric positive definite input weighting matrix. Proving also that the potentially non-simple structure of the Laplacian matrix can be neglected for stability analysis and control design, we extend two well-known distributed LQR-based control methods originally established for undirected networks of identical linear systems, to the directed case. We then propose a distributed feedback method for tackling large-scale regulation problems of a general class of interconnected non-identical dynamic agents with undirected and directed topology. In particular, we assume that local agents share a minimal set of structural properties, such as input dimension, state dimension and controllability indices. Our approach relies on the solution of certain model matching type problems using local linear state-feedback and input matrix transformations which map the agent dynamics to a target system, selected to minimize the joint control effort of the local feedback-control schemes. By adapting well-established distributed LQR control design methodologies to our framework, the stabilization problem of a network of non-identical dynamical agents is solved. We thereafter consider a networked scheme synthesized by multiple agents with nonlinear dynamics. Assuming that agents are feedback linearizable in a neighborhood near their equilibrium points, we propose a nonlinear model matching control design for stabilizing networks of multiple heterogeneous nonlinear agents. Motivated by the structure of a large-scale LQR optimal problem, we propose a stabilizing distributed state-feedback controller for networks of identical dynamically coupled linear agents. First, a fully centralized controller is designed which is subsequently substituted by a distributed state-feedback gain with sparse structure. The control scheme is obtained byoptimizing an LQR performance index with a tuning parameter utilized to emphasize/deemphasize relative state difference between coupled systems. Sufficient conditions for stability of the proposed scheme are derived based on the inertia of a convex combination of two Hurwitz matrices. An extended simulation study involving distributed load frequency control design of a multi-area power network, illustrates the applicability of the proposed method. Finally, we propose a fully distributed consensus-based model matching scheme adapted to a model predictive control setting for tackling a structured receding horizon regulation problem