Resilient Autonomous Control of Distributed Multi-agent Systems in Contested Environments

An autonomous and resilient controller is proposed for leader-follower multi-agent systems under uncertainties and cyber-physical attacks. The leader is assumed non-autonomous with a nonzero control input, which allows changing the team behavior or mission in response to environmental changes. A resilient learning-based control protocol is presented to find optimal solutions to the synchronization problem in the presence of attacks and system dynamic uncertainties. An observer-based distributed H_infinity controller is first designed to prevent propagating the effects of attacks on sensors and actuators throughout the network, as well as to attenuate the effect of these attacks on the compromised agent itself. Non-homogeneous game algebraic Riccati equations are derived to solve the H_infinity optimal synchronization problem and off-policy reinforcement learning is utilized to learn their solution without requiring any knowledge of the agent's dynamics. A trust-confidence based distributed control protocol is then proposed to mitigate attacks that hijack the entire node and attacks on communication links. A confidence value is defined for each agent based solely on its local evidence. The proposed resilient reinforcement learning algorithm employs the confidence value of each agent to indicate the trustworthiness of its own information and broadcast it to its neighbors to put weights on the data they receive from it during and after learning. If the confidence value of an agent is low, it employs a trust mechanism to identify compromised agents and remove the data it receives from them from the learning process. Simulation results are provided to show the effectiveness of the proposed approach

Neural Network Observer-Based Prescribed-Time Fault-Tolerant Tracking Control for Heterogeneous Multiagent Systems With a Leader of Unknown Disturbances

This study investigates the prescribed-time leader-follower formation strategy for heterogeneous multiagent sys-tems including unmanned aerial vehicles and unmanned ground vehicles under time-varying actuator faults and unknown dis-turbances based on adaptive neural network observers and backstepping method. Compared with the relevant works, the matching and mismatched disturbances of the leader agent are further taken into account in this study. A distributed fixed-time observer is developed for follower agents in order to timely obtain the position and velocity states of the leader, in which neural networks are employed to approximate the unknown disturbances. Furthermore, the actual sensor limitations make each follower only affected by local information and measurable local states. As a result, another fixed-time neural network observer is proposed to obtain the unknown states and the complex uncertainties. Then, a backstepping prescribed-time fault-tolerant formation controller is constructed by utilizing the estimations, which not only guarantees that the multiagent systems realize the desired formation configuration in a user-assignable finite time, but also ensures that the control action can be smooth everywhere. Finally, simulation examples are designed to testify the validity of the developed theoretical method

Event-triggering architectures for adaptive control of uncertain dynamical systems

In this dissertation, new approaches are presented for the design and implementation of networked adaptive control systems to reduce the wireless network utilization while guaranteeing system stability in the presence of system uncertainties. Specifically, the design and analysis of state feedback adaptive control systems over wireless networks using event-triggering control theory is first presented. The state feedback adaptive control results are then generalized to the output feedback case for dynamical systems with unmeasurable state vectors. This event-triggering approach is then adopted for large-scale uncertain dynamical systems. In particular, decentralized and distributed adaptive control methodologies are proposed with reduced wireless network utilization with stability guarantees. In addition, for systems in the absence of uncertainties, a new observer-free output feedback cooperative control architecture is developed. Specifically, the proposed architecture is predicated on a nonminimal state-space realization that generates an expanded set of states only using the filtered input and filtered output and their derivatives for each vehicle, without the need for designing an observer for each vehicle. Building on the results of this new observer-free output feedback cooperative control architecture, an event-triggering methodology is next proposed for the output feedback cooperative control to schedule the exchanged output measurements information between the agents in order to reduce wireless network utilization. Finally, the output feedback cooperative control architecture is generalized to adaptive control for handling exogenous disturbances in the follower vehicles. For each methodology, the closed-loop system stability properties are rigorously analyzed, the effect of the user-defined event-triggering thresholds and the controller design parameters on the overall system performance are characterized, and Zeno behavior is shown not to occur with the proposed algorithms --Abstract, page iv

Estimator-based adaptive neural network control of leader-follower high-order nonlinear multiagent systems with actuator faults

The problem of distributed cooperative control for networked multiagent systems is investigated in this paper. Each agent is modeled as an uncertain nonlinear high-order system incorporating with model uncertainty, unknown external disturbance, and actuator fault. The communication network between followers can be an undirected or a directed graph, and only some of the follower agents can obtain the commands from the leader. To develop the distributed cooperative control algorithm, a prefilter is designed, which can derive the state-space representation to a newly constructed plant. Then, a set of distributed adaptive neural network controllers are designed by making certain modifications on traditional backstepping techniques with the aid of adaptive control, neural network control, and a second-order sliding mode estimator. Rigorous proving procedures are provided,which show that uniform ultimate boundedness of all the tracking errors can be achieved in a networked multiagent system. Finally, a numerical simulation is carried out to evaluate the theoretical results

Prescribed Time Time-varying Output Formation Tracking for Uncertain Heterogeneous Multi-agent Systems

The time-varying output formation tracking for the heterogeneous multi-agent systems (MAS) is investigated in this paper. First, a distributed observer is constructed for followers to estimate the states of the leader, which can ensure that the estimation error converges to the origin in the prescribed time. Then, the local formation controller is designed for each follower based on the estimation of the observer, under which, the formation errors converge to the origin in the prescribed time as well. That is, the settling time of the whole system can be predefined in advance. It's noted that not only the uncertainties in the state matrix but also the uncertainties in the input matrix are considered, which makes the problem more practical. Last, a simulation is performed to show the effectiveness of the proposed approach