A Review of Consensus-based Multi-agent UAV Applications

In this paper, a review of distributed control for multi-agent systems is proposed, focusing on consensus-based applications. Both rotary-wing and fixed-wing Unmanned Aerial Vehicles (UAVs) are considered. On one side, methodologies and implementations based on collision and obstacle avoidance through consensus are analyzed for multirotor UAVs. On the other hand, a target tracking through consensus is considered for fixed-wing UAVs. This novel approach to classify the literature could help researchers to assess the outcomes achieved in these two directions in view of potential practical implementations of consensus-based methodologies

An Overview of Recent Progress in the Study of Distributed Multi-agent Coordination

This article reviews some main results and progress in distributed multi-agent coordination, focusing on papers published in major control systems and robotics journals since 2006. Distributed coordination of multiple vehicles, including unmanned aerial vehicles, unmanned ground vehicles and unmanned underwater vehicles, has been a very active research subject studied extensively by the systems and control community. The recent results in this area are categorized into several directions, such as consensus, formation control, optimization, task assignment, and estimation. After the review, a short discussion section is included to summarize the existing research and to propose several promising research directions along with some open problems that are deemed important for further investigations

Two fault-tolerant control problems for multiple-integrators networks

The paper considers a network of agents with multiple-integrator internal dynamics, which share partial information on their states according to an arbitrary topology. For this system, two control problems are addressed and solved. The first consists in assigning the dominant closed-loop poles. The second consists in achieving a specified consensus with arbitrarily fast dynamics. In both cases, the regulator is required to be decentralized and the controlled network has to result tolerant with respect to faults in the communication apparatuses of the agents

Distributed Cooperative Regulation for Multiagent Systems and Its Applications to Power Systems: A Survey

Cooperative regulation of multiagent systems has become an active research area in the past decade. This paper reviews some recent progress in distributed coordination control for leader-following multiagent systems and its applications in power system and mainly focuses on the cooperative tracking control in terms of consensus tracking control and containment tracking control. Next, methods on how to rank the network nodes are summarized for undirected/directed network, based on which one can determine which follower should be connected to leaders such that partial followers can perceive leaders’ information. Furthermore, we present a survey of the most relevant scientific studies investigating the regulation and optimization problems in power systems based on distributed strategies. Finally, some potential applications in the frequency tracking regulation of smart grids are discussed at the end of the paper

Cooperative Control of Nonlinear Multi-Agent Systems

Multi-agent systems have attracted great interest due to their potential applications in a variety of areas. In this dissertation, a nonlinear consensus algorithm is developed for networked Euler-Lagrange multi-agent systems. The proposed consensus algorithm guarantees that all agents can reach a common state in the workspace. Meanwhile, the external disturbances and structural uncertainties are fundamentally considered in the controller design. The robustness of the proposed consensus algorithm is then demonstrated in the stability analysis. Furthermore, experiments are conducted to validate the effectiveness of the proposed consensus algorithm. Next, a distributed leader-follower formation tracking controller is developed for networked nonlinear multi-agent systems. The dynamics of each agent are modeled by Euler-Lagrange equations, and all agents are guaranteed to track a desired time-varying trajectory in the presence of noise. The fault diagnosis strategy of the nonlinear multi-agent system is also investigated with the help of differential geometry tools. The effectiveness of the proposed controller is verified through simulations. To further extend the application area of the multi-agent technique, a distributed robust controller is then developed for networked Lipschitz nonlinear multi-agent systems. With the appearance of system uncertainties and external disturbances, a sampled-data feedback control protocol is carried out through the Lyapunov functional approach. The effectiveness of the proposed controller is verified by numerical simulations. Other than the robustness and sampled-data information exchange, this dissertation is also concerned with the event-triggered consensus problem for the Lipschitz nonlinear multi-agent systems. Furthermore, the sufficient condition for the stochastic stabilization of the networked control system is proposed based on the Lyapunov functional method. Finally, simulation is conducted to demonstrate the effectiveness of the proposed control algorithm. In this dissertation, the cooperative control of networked Euler-Lagrange systems and networked Lipschitz systems is investigated essentially with the assistance of nonlinear control theory and diverse controller design techniques. The main objective of this work is to propose realizable control algorithms for nonlinear multi-agent systems

COOPERATIVE AND CONSENSUS-BASED CONTROL FOR A TEAM OF MULTI-AGENT SYSTEMS

Cooperative control has attracted a noticeable interest in control systems community due to its numerous applications in areas such as formation flying of unmanned aerial vehicles, cooperative attitude control of spacecraft, rendezvous of mobile robots, unmanned underwater vehicles, traffic control, data network congestion control and routing. Generally, in any cooperative control of multi-agent systems one can find a set of locally sensed information, a communication network with limited bandwidth, a decision making algorithm, and a distributed computational capability. The ultimate goal of cooperative systems is to achieve consensus or synchronization throughout the team members while meeting all communication and computational constraints. The consensus problem involves convergence of outputs or states of all agents to a common value and it is more challenging when the agents are subjected to disturbances, measurement noise, model uncertainties or they are faulty. This dissertation deals with the above mentioned challenges and has developed methods to design distributed cooperative control and fault recovery strategies in multi-agent systems. Towards this end, we first proposed a transformation for Linear Time Invariant (LTI) multi-agent systems that facilitates a systematic control design procedure and make it possible to use powerful Lyapunov stability analysis tool to guarantee its consensus achievement. Moreover, Lyapunov stability analysis techniques for switched systems are investigated and a novel method is introduced which is well suited for designing consensus algorithms for switching topology multi-agent systems. This method also makes it possible to deal with disturbances with limited root mean square (RMS) intensities. In order to decrease controller design complexity, a iii method is presented which uses algebraic connectivity of the communication network to decouple augmented dynamics of the team into lower dimensional parts, which allows one to design the consensus algorithm based on the solution to an algebraic Riccati equation with the same order as that of agent. Although our proposed decoupling method is a powerful approach to reduce the complexity of the controller design, it is possible to apply classical pole placement methods to the transformed dynamics of the team to develop and obtain controller gains. The effects of actuator faults in consensus achievement of multi-agent systems is investigated. We proposed a framework to quantitatively study actuator loss-of-effectiveness effects in multi-agent systems. A fault index is defined based on information on fault severities of agents and communication network topology, and sufficient conditions for consensus achievement of the team are derived. It is shown that the stability of the cooperative controller is linked to the fault index. An optimization problem is formulated to minimize the team fault index that leads to improvements in the performance of the team. A numerical optimization algorithm is used to obtain the solutions to the optimal problem and based on the solutions a fault recovery strategy is proposed for both actuator saturation and loss-of-effectiveness fault types. Finally, to make our proposed methodology more suitable for real life scenarios, the consensus achievement of a multi-agent team in presence of measurement noise and model uncertainties is investigated. Towards this end, first a team of LTI agents with measurement noise is considered and an observer based consensus algorithm is proposed and shown that the team can achieve H∞ output consensus in presence of both bounded RMS disturbance input and measurement noise. In the next step a multi-agent team with both linear and Lipschitz nonlinearity uncertainties is studied and a cooperative control algorithm is developed. An observer based approach is also developed to tackle consensus achievement problem in presence of both measurement noise and model uncertainties

Graph Convolutions For Teams Of Robots

In many applications in robotics, there exist teams of robots operating in dynamic environments requiring the design of complex communication and control schemes. The problem is made easier if one assumes the presence of an oracle that has instantaneous access to states of all entities in the environment and can communicate simultaneously without any loss. However, such an assumption is unrealistic especially when there exist a large number of robots. More specifically, we are interested in decentralized control policies for teams of robots using only local communication and sensory information to achieve high level team objectives. We first make the case for using distributed reinforcement learning to learn local behaviours by optimizing for a sparse team wide reward as opposed to existing model based methods. A central caveat of learning policies using model free reinforcement learning is the lack of scalability. To achieve large scale scalable results, we introduce a novel paradigm where the policies are parametrized by graph convolutions. Additionally, we also develop new methodologies to train these policies and derive technical insights into their behaviors. Building upon these, we design perception action loops for teams of robots that rely only on noisy visual sensors, a learned history state and local information from nearby robots to achieve complex team wide-objectives. We demonstrate the effectiveness of our methods on several large scale multi-robot tasks