COOPERATIVE AND CONSENSUS-BASED CONTROL FOR A TEAM OF MULTI-AGENT SYSTEMS

Cooperative control has attracted a noticeable interest in control systems community due to its numerous applications in areas such as formation flying of unmanned aerial vehicles, cooperative attitude control of spacecraft, rendezvous of mobile robots, unmanned underwater vehicles, traffic control, data network congestion control and routing. Generally, in any cooperative control of multi-agent systems one can find a set of locally sensed information, a communication network with limited bandwidth, a decision making algorithm, and a distributed computational capability. The ultimate goal of cooperative systems is to achieve consensus or synchronization throughout the team members while meeting all communication and computational constraints. The consensus problem involves convergence of outputs or states of all agents to a common value and it is more challenging when the agents are subjected to disturbances, measurement noise, model uncertainties or they are faulty. This dissertation deals with the above mentioned challenges and has developed methods to design distributed cooperative control and fault recovery strategies in multi-agent systems. Towards this end, we first proposed a transformation for Linear Time Invariant (LTI) multi-agent systems that facilitates a systematic control design procedure and make it possible to use powerful Lyapunov stability analysis tool to guarantee its consensus achievement. Moreover, Lyapunov stability analysis techniques for switched systems are investigated and a novel method is introduced which is well suited for designing consensus algorithms for switching topology multi-agent systems. This method also makes it possible to deal with disturbances with limited root mean square (RMS) intensities. In order to decrease controller design complexity, a iii method is presented which uses algebraic connectivity of the communication network to decouple augmented dynamics of the team into lower dimensional parts, which allows one to design the consensus algorithm based on the solution to an algebraic Riccati equation with the same order as that of agent. Although our proposed decoupling method is a powerful approach to reduce the complexity of the controller design, it is possible to apply classical pole placement methods to the transformed dynamics of the team to develop and obtain controller gains. The effects of actuator faults in consensus achievement of multi-agent systems is investigated. We proposed a framework to quantitatively study actuator loss-of-effectiveness effects in multi-agent systems. A fault index is defined based on information on fault severities of agents and communication network topology, and sufficient conditions for consensus achievement of the team are derived. It is shown that the stability of the cooperative controller is linked to the fault index. An optimization problem is formulated to minimize the team fault index that leads to improvements in the performance of the team. A numerical optimization algorithm is used to obtain the solutions to the optimal problem and based on the solutions a fault recovery strategy is proposed for both actuator saturation and loss-of-effectiveness fault types. Finally, to make our proposed methodology more suitable for real life scenarios, the consensus achievement of a multi-agent team in presence of measurement noise and model uncertainties is investigated. Towards this end, first a team of LTI agents with measurement noise is considered and an observer based consensus algorithm is proposed and shown that the team can achieve H∞ output consensus in presence of both bounded RMS disturbance input and measurement noise. In the next step a multi-agent team with both linear and Lipschitz nonlinearity uncertainties is studied and a cooperative control algorithm is developed. An observer based approach is also developed to tackle consensus achievement problem in presence of both measurement noise and model uncertainties

Consensus of multi-agent systems with faults and mismatches under switched topologies using a delta operator method

© 2018 Elsevier B.V. This paper studies the consensus of multi-agent systems with faults and mismatches under switched topologies using a delta operator method. Since faults and mismatches can result in failure of the consensus even for a fixed topology with a spanning tree, how to reach a consensus is a complicated and challenging problem under such circumstances especially when part topologies have no spanning tree. Although some works studied the influence of faults and mismatches on the consensus, there is little work on reaching a consensus for the multi-agent systems with faults and mismatches. In this paper, we introduce the delta operator to unify the consensus analysis for continuous, discrete, or sampled systems under one framework. We develop the theories on the delta operator systems first and then apply theories of the delta operator systems to the consensus problems. By converting the consensus problems into stability problems, we investigate and prove consensus and the associated conditions for systems 1) without any fault, 2) with a known fault, and 3) with unknown faults, under switching topologies with matching or mismatching coefficients. Numerical examples are provided and validate the effectiveness of the theoretical results

Cooperative Control Reconfiguration in Networked Multi-Agent Systems

Development of a network of autonomous cooperating vehicles has attracted significant attention during the past few years due to its broad range of applications in areas such as autonomous underwater vehicles for exploring deep sea oceans, satellite formations for space missions, and mobile robots in industrial sites where human involvement is impossible or restricted, to name a few. Motivated by the stringent specifications and requirements for depth, speed, position or attitude of the team and the possibility of having unexpected actuators and sensors faults in missions for these vehicles have led to the proposed research in this thesis on cooperative fault-tolerant control design of autonomous networked vehicles. First, a multi-agent system under a fixed and undirected network topology and subject to actuator faults is studied. A reconfigurable control law is proposed and the so-called distributed Hamilton-Jacobi-Bellman equations for the faulty agents are derived. Then, the reconfigured controller gains are designed by solving these equations subject to the faulty agent dynamics as well as the network structural constraints to ensure that the agents can reach a consensus even in presence of a fault while simultaneously the team performance index is minimized. Next, a multi-agent network subject to simultaneous as well as subsequent actuator faults and under directed fixed topology and subject to bounded energy disturbances is considered. An H∞ performance fault recovery control strategy is proposed that guarantees: the state consensus errors remain bounded, the output of the faulty system behaves exactly the same as that of the healthy system, and the specified H∞ performance bound is guaranteed to be minimized. Towards this end, the reconfigured control law gains are selected first by employing a geometric control approach where a set of controllers guarantees that the output of the faulty agent imitates that of the healthy agent and the consensus achievement objectives are satisfied. Then, the remaining degrees of freedom in the selection of the control law gains are used to minimize the bound on a specified H∞ performance index. Then, control reconfiguration problem in a team subject to directed switching topology networks as well as actuator faults and their severity estimation uncertainties is considered. The consensus achievement of the faulty network is transformed into two stability problems, in which one can be solved offline while the other should be solved online and by utilizing information that each agent has received from the fault detection and identification module. Using quadratic and convex hull Lyapunov functions the control gains are designed and selected such that the team consensus achievement is guaranteed while the upper bound of the team cost performance index is minimized. Finally, a team of non-identical agents subject to actuator faults is considered. A distributed output feedback control strategy is proposed which guarantees that agents outputs’ follow the outputs of the exo-system and the agents states remains stable even when agents are subject to different actuator faults

Distributed Fault-Tolerant Control for Networked Robots in the Presence of Recoverable/Unrecoverable Faults and Reactive Behaviors

The paper presents an architecture for distributed control of multi-robot systems with an integrated fault detection, isolation, and recovery strategy. The proposed solution is based on a distributed observer-controller schema where each robot, by communicating only with its direct neighbors, is able to estimate the overall state of the system; such an estimate is then used by the controllers of each robot to achieve global missions as, for example, centroid and formation tracking. The information exchanged among the observers is also used to compute residual vectors that allow each robot to detect failures on anyone of the teammates, even if not in direct communication. The proposed strategy considers both recoverable and unrecoverable actuator faults as well as it properly manages the possible activation of reactive local control behaviors of the robots (e.g., the activation of obstacle avoidance strategy), which generate control inputs different from those required by the global mission control. In particular, when the robots are subject to recoverable faults, those are managed at a local level by computing a proper compensating control action. On the other side, when the robots are subject to unrecoverable faults, the faults are isolated from anyone of the teammates by means of a distributed fault detection and isolation strategy; then, the faulty robots are removed from the team and the mission is rearranged. The proposed strategy is validated via numerical simulations where the system properly identifies and manages the different cases of recoverable and unrecoverable actuator faults, as well as it manages the activation of local reactive control in an integrated case study

Distributed Fault Detection in Formation of Multi-Agent Systems with Attack Impact Analysis

Autonomous Underwater Vehicles (AUVs) are capable of performing a variety of deepwater marine applications as in multiple mobile robots and cooperative robot reconnaissance. Due to the environment that AUVs operate in, fault detection and isolation as well as the formation control of AUVs are more challenging than other Multi-Agent Systems (MASs). In this thesis, two main challenges are tackled. We first investigate the formation control and fault accommodation algorithms for AUVs in presence of abnormal events such as faults and communication attacks in any of the team members. These undesirable events can prevent the entire team to achieve a safe, reliable, and efficient performance while executing underwater mission tasks. For instance, AUVs may face unexpected actuator/sensor faults and the communication between AUVs can be compromised, and consequently make the entire multi-agent system vulnerable to cyber-attacks. Moreover, a possible deception attack on network system may have a negative impact on the environment and more importantly the national security. Furthermore, there are certain requirements for speed, position or depth of the AUV team. For this reason, we propose a distributed fault detection scheme that is able to detect and isolate faults in AUVs while maintaining their formation under security constraints. The effects of faults and communication attacks with a control theoretical perspective will be studied. Another contribution of this thesis is to study a state estimation problem for a linear dynamical system in presence of a Bias Injection Attack (BIA). For this purpose, a Kalman Filter (KF) is used, where we show that the impact of an attack can be analyzed as the solution of a quadratically constrained problem for which the exact solution can be found efficiently. We also introduce a lower bound for the attack impact in terms of the number of compromised actuators and a combination of sensors and actuators. The theoretical findings are accompanied by simulation results and numerical can study examples

Control and Fault Accommodation for Attitude Control Subsystem of Formation Flying Satellites Subject to Constraints

Stringent precision requirements, communication limitations and automated fault accommodation are three important considerations that need to be taken into account in design of formation control of satellites. In this work a more accurate relative state modeling for the attitude dynamics is developed and a semi-decentralized control strategy is proposed that is accomplished by the model predictive control (MPC) scheme. The proposed MPC incorporates the effects of the actuator constraints in design of the control laws. Furthermore, a semi-decentralized active system recovery scheme is proposed that uses on-line fault information to compensate for the identified characteristics losses under actuator fault conditions. Simulation results for a team of four satellites in formation are presented and the formation precision is compared with the centralized scheme. The results verify that the proposed semi-decentralized strategy yields a quite satisfactory formation performance in a sense that the team behaves similar to a centralized MPC control scheme, however without imposing significant computational complexity that is associated with solving the problem of high dimension with stringent communication requirement as in the centralized scheme. Moreover, the performance of our proposed semi-decentralized recovery scheme is compared with the centralized recovery scheme subject to the reaction wheel (RW) faults in the attitude control subsystem (ACS) of the formation flying satellites. The proposed semi-decentralized recovery scheme satisfies the formation recovery specifications and also imposes lower fault compensation control effort cost as compared with the centralized recovery scheme. It has been validated through multiple fault severity scenarios

Data-Driven Architecture to Increase Resilience In Multi-Agent Coordinated Missions

The rise in the use of Multi-Agent Systems (MASs) in unpredictable and changing environments has created the need for intelligent algorithms to increase their autonomy, safety and performance in the event of disturbances and threats. MASs are attractive for their flexibility, which also makes them prone to threats that may result from hardware failures (actuators, sensors, onboard computer, power source) and operational abnormal conditions (weather, GPS denied location, cyber-attacks). This dissertation presents research on a bio-inspired approach for resilience augmentation in MASs in the presence of disturbances and threats such as communication link and stealthy zero-dynamics attacks. An adaptive bio-inspired architecture is developed for distributed consensus algorithms to increase fault-tolerance in a network of multiple high-order nonlinear systems under directed fixed topologies. In similarity with the natural organisms’ ability to recognize and remember specific pathogens to generate its immunity, the immunity-based architecture consists of a Distributed Model-Reference Adaptive Control (DMRAC) with an Artificial Immune System (AIS) adaptation law integrated within a consensus protocol. Feedback linearization is used to modify the high-order nonlinear model into four decoupled linear subsystems. A stability proof of the adaptation law is conducted using Lyapunov methods and Jordan decomposition. The DMRAC is proven to be stable in the presence of external time-varying bounded disturbances and the tracking error trajectories are shown to be bounded. The effectiveness of the proposed architecture is examined through numerical simulations. The proposed controller successfully ensures that consensus is achieved among all agents while the adaptive law v simultaneously rejects the disturbances in the agent and its neighbors. The architecture also includes a health management system to detect faulty agents within the global network. Further numerical simulations successfully test and show that the Global Health Monitoring (GHM) does effectively detect faults within the network

Cooperative Control and Fault Recovery for Network of Heterogeneous Autonomous Underwater Vehicles

The purpose of this thesis is to develop cooperative recovery control schemes for a team of heterogeneous autonomous underwater vehicles (AUV). The objective is to have the network of autonomous underwater vehicles follow a desired trajectory while agents maintain a desired formation. It is assumed that the model parameters associated with each vehicle is different although the order of the vehicles are the same. Three cooperative control schemes based on dynamic surface control (DSC) technique are developed. First, a DSC-based centralized scheme is presented in which there is a central controller that has access to information of all agents at the same time and designs the optimal solution for this cooperative problem. This scheme is used as a benchmark to evaluate the performance of other schemes developed in this thesis. Second, a DSC-based decentralized scheme is presented in which each agent designs its controller based on only its information and the information of its desired trajectory. In this scheme, there is no information exchange among the agents in the team. This scheme is also developed for the purpose of comparative studies. Third, two different semi-decentralized or distributed schemes for the network of heterogeneous autonomous underwater vehicles are proposed. These schemes are a synthesis of a consensus-based algorithm and the dynamic surface control technique with the difference that in one of them the desired trajectories of agents are used in the consensus algorithm while in the other the actual states of the agents are used. In the former scheme, the agents communicate their desired relative distances with the agents within their set of nearest neighbors and each agent determines its own control trajectory. In this semi-decentralized scheme, the velocity measurements of the virtual leader and all the followers are not required to reach the consensus formation. However, in the latter, agents communicate their relative distances and velocities with the agents within their set of nearest neighbors. In both semi-decentralized schemes only a subset of agents has access to information of a virtual leader. The comparative studies between these two semi-decentralized schemes are provided which show the superiority of the former semi-decentralized scheme over latter. Furthermore, to evaluate the efficiency of the proposed DSC-based semi-decentralized scheme with consensus algorithm using desired trajectories, a comparative study is performed between this scheme and three cooperative schemes of model-dependent coordinated tracking algorithm, namely the centralized, decentralized, and semi-decentralized schemes. Given that the dynamics of autonomous underwater vehicles are inevitably subjected to system faults, and in particular the actuator faults, to improve the performance of the network of agents, active fault-tolerant control strategies corresponding to the three developed schemes are also designed to recover the team from the loss-of-effectiveness in the actuators and to ensure that the closed-loop signals remain bounded and the team of heterogeneous autonomous underwater vehicles satisfy the overall design specifications and requirements. The results of this research can potentially be used in various marine applications such as underwater oil and gas pipeline inspection and repairing, monitoring oil and gas pipelines, detecting and preventing any oil and gas leakages. However, the applications of the proposed cooperative control and its fault-tolerant scheme are not limited to underwater formation path-tracking and can be applied to any other multi-vehicle systems that are characterized by Euler–Lagrange equations

Distributed Control of Networked Nonlinear Euler-Lagrange Systems

Motivated by recent developments in formation and cooperative control of networked multi-agent systems, the main goal of this thesis is development of efficient synchronization and formation control algorithms for distributed control of networked nonlinear systems whose dynamics can be described by Euler-Lagrange (EL) equations. One of the main challenges in the design of the formation control algorithm is its optimality and robustness to parametric uncertainties, external disturbances and ability to reconfigure in presence of component, actuator, or sensor faults. Furthermore, the controller should be capable of handling switchings in the communication network topology. In this work, nonlinear optimal control techniques are studied for developing distributed controllers for networked EL systems. An individual cost function is introduced to design a controller that relies on only local information exchanges among the agents. In the development of the controller, it is assumed that the communication graph is not fixed (in other words the topology is switching). Additionally, parametric uncertainties and faults in the EL systems are considered and two approaches, namely adaptive and robust techniques are introduced to compensate for the effects of uncertainties and actuator faults. Next, a distributed H_infinity performance measure is considered to develop distributed robust controllers for uncertain networked EL systems. The developed distributed controller is obtained through rigorous analysis and by considering an individual cost function to enhance the robustness of the controllers in presence of parametric uncertainties and external bounded disturbances. Moreover, a rigorous analysis is conducted on the performance of the developed controllers in presence of actuator faults as well as fault diagnostic and identification (FDI) imperfections. Next, synchronization and set-point tracking control of networked EL systems are investigated in presence of three constraints, namely, (i) input saturation constraints, (ii) unavailability of velocity feedback, and (iii) lack of knowledge on the system parameters. It is shown that the developed distributed controllers can accomplish the desired requirements and specification under the above constraints. Finally, a quaternion-based approach is considered for the attitude synchronization and set-point tracking control problem of formation flying spacecraft. Employing the quaternion in the control law design enables handling large rotations in the spacecraft attitude and, therefore, any singularities in the control laws are avoided. Furthermore, using the quaternion also enables one to guarantee boundedness of the control signals both with and without velocity feedback

A Hierarchical Architecture for Cooperative Actuator Fault Estimation and Accommodation of Formation Flying Satellites in Deep Space

A new cooperative fault accommodation algorithm based on a multi-level hierarchical architecture is proposed for satellite formation flying missions. This framework introduces a high-level (HL) supervisor and two recovery modules, namely a low-level fault recovery (LLFR) module and a formation-level fault recovery (FLFR) module. At the LLFR module, a new hybrid and switching framework is proposed for cooperative actuator fault estimation of formation flying satellites in deep space. The formation states are distributed among local detection and estimation filters. Each system mode represents a certain cooperative estimation scheme and communication topology among local estimation filters. The mode transitions represent the reconfiguration of the estimation schemes, where the transitions are governed by information that is provided by the detection filters. It is shown that our proposed hybrid and switching framework confines the effects of unmodeled dynamics, disturbances, and uncertainties to local parameter estimators, thereby preventing the propagation of inaccurate information to other estimation filters. Moreover, at the LLFR module a conventional recovery controller is implemented by using estimates of the fault severities. Due to an imprecise fault estimate and an ineffective recovery controller, the HL supervisor detects violation of the mission error specifications. The FLFR module is then activated to compensate for the performance degradations of the faulty satellite by requiring that the healthy satellites allocate additional resources to remedy the problem. Consequently, fault is cooperatively recovered by our proposed architecture, and the formation flying mission specifications are satisfied. Simulation results confirm the validity and effectiveness of our developed and proposed analytical work