Robustness properties of distributed configurations in multi-agent systems

This paper considers a distributed LQR design framework for a multi-agent network consisting of identical dynamically decoupled agents. A systematic method is presented for computing the performance loss of various distributed control configurations relative to the performance of the optimal centralized controller. Necessary and sufficient conditions have been derived for which a distributed control configuration pattern arising from the optimal centralizing solution does not entail loss of performance if the initial vector lies in a certain subspace of state-space which is identified. It was shown that these conditions are always satisfied for systems with communication/control networks corresponding to complete graphs with a single link removed. A procedure is extended for analyzing the performance loss of an arbitrary distributed configuration which is illustrated by an exhaustive analysis of a network consisting of agents described by second-order integrator dynamics. Presented results are useful for quantifying performance loss due to decentralization and for designing optimal or near-optimal distributed control schemes

Asynchronous Communication under Reliable and Unreliable Network Topologies in Distributed Multiagent Systems: A Robust Technique for Computing Average Consensus

Nearly all applications in multiagent systems demand precision, robustness, consistency, and rapid convergence in designing of distributed consensus algorithms. Keeping this thing in our sight, this research suggests a robust consensus protocol for distributed multiagent networks, continuing asynchronous communications, where agent’s states values are updated at diverse interval of time. This paper presents an asynchronous communication for both reliable and unreliable network topologies. The primary goal is to delineate local control inputs to attain time synchronization by processing the update information received by the agents associated in a communication topology. Additionally in order to accomplish the robust convergence, modelling of convergence analysis is conceded by commissioning the basic principles of graph and matrix theory alongside the suitable lemmas. Moreover, statistical examples presenting four diverse scenarios are provided in the end; produced results are the recognisable indicator to authenticate the robust effectiveness of the proposed algorithm. Likewise, a simulation comparison of the projected algorithm with the other existing approaches is conducted, considering different performance parameters are being carried out to support our claim

Distributed averaging over communication networks:Fragility, robustness and opportunities

Distributed averaging, a canonical operation among many natural interconnected systems, has found applications in a tremendous variety of applied fields, including statistical physics, signal processing, systems and control, communication and social science. As information exchange is a central part of distributed averaging systems, it is of practical as well as theoretical importance to understand various properties/limitations of those systems in the presence of communication constraints and devise new algorithms to alleviate those limitations. We study the fragility of a popular distributed averaging algorithm when the information exchange among the nodes is limited by communication delays, fading connections and additive noise. We show that the otherwise well studied and benign multi-agent system can generate a collective global complex behavior. We characterize this behavior, common to many natural and human-made interconnected systems, as a collective hyper-jump diffusion process and as a L\\u27{e}vy flights process in a special case. We further describe the mechanism for its emergence and predict its occurrence, under standard assumptions, by checking the Mean Square instability of a certain part of the system. We show that the strong connectivity property of the network topology guarantees that the complex behavior is global and manifested by all the agents in the network, even though the source of uncertainty is localized. We provide novel computational analysis of the MS stability index under spatially invariant structures and gain certain qualitative as well as quantitative insights of the system. We then focus on design of agents\u27 dynamics to increase the robustness of distributed averaging system to topology variations. We provide a general structure of distributed averaging systems where individual agents are modeled by LTI systems. We show the problem of designing agents\u27 dynamics for distributed averaging is equivalent to an $\mathcal{H}_{\infty}$ minimization problem. In this way, we could use tools from robust control theory to build the distributed averaging system where the design is fully distributed and scalable with the size of the network. It is also shown that the agents could be used in different fixed networks and networks with speical time varying interconnections. We develop new iterative distributed averaging algorithms which allow agents to compute the average quantity in the presence of additive noise and random changing interconnections. The algorithm relaxes several previous restrictive assumptions on distributed averaging under uncertainties, such as diminishing step size rule, doubly stochastic weights, symmetric link switching styles, etc, and introduces novel mechanism of network feedback to mitigate effects of communication uncertainties on information aggregation. Based on the robust distributed averaging algorithm, we propose continuous as well as discrete time computation models to solve the distributed optimization problem where the objective function is formed by the summation of convex functions of the same variable. The algorithm shows faster convergence speed than existing ones and exhibits robustness to additive noise, which is the main source of limitation on algorithms based on convex mixing. It is shown that agents with simple dynamics and gradient sensing abilities could collectively solve complicated convex optimization problems. Finally, we generalize this algorithm to build a general framework forconstrained convex optimization problems. This framework is shown to be particularly effective to derive solutions for distributed decision making problems and lead to a systems perspective for convex optimization

Resilient Autonomous Control of Distributed Multi-agent Systems in Contested Environments

An autonomous and resilient controller is proposed for leader-follower multi-agent systems under uncertainties and cyber-physical attacks. The leader is assumed non-autonomous with a nonzero control input, which allows changing the team behavior or mission in response to environmental changes. A resilient learning-based control protocol is presented to find optimal solutions to the synchronization problem in the presence of attacks and system dynamic uncertainties. An observer-based distributed H_infinity controller is first designed to prevent propagating the effects of attacks on sensors and actuators throughout the network, as well as to attenuate the effect of these attacks on the compromised agent itself. Non-homogeneous game algebraic Riccati equations are derived to solve the H_infinity optimal synchronization problem and off-policy reinforcement learning is utilized to learn their solution without requiring any knowledge of the agent's dynamics. A trust-confidence based distributed control protocol is then proposed to mitigate attacks that hijack the entire node and attacks on communication links. A confidence value is defined for each agent based solely on its local evidence. The proposed resilient reinforcement learning algorithm employs the confidence value of each agent to indicate the trustworthiness of its own information and broadcast it to its neighbors to put weights on the data they receive from it during and after learning. If the confidence value of an agent is low, it employs a trust mechanism to identify compromised agents and remove the data it receives from them from the learning process. Simulation results are provided to show the effectiveness of the proposed approach

Object-oriented Tools for Distributed Computing

Distributed computing systems are proliferating, owing to the availability of powerful, affordable microcomputers and inexpensive communication networks. A critical problem in developing such systems is getting application programs to interact with one another across a computer network. Remote interprogram connectivity is particularly challenging across heterogeneous environments, where applications run on different kinds of computers and operating systems. NetWorks! (trademark) is an innovative software product that provides an object-oriented messaging solution to these problems. This paper describes the design and functionality of NetWorks! and illustrates how it is being used to build complex distributed applications for NASA and in the commercial sector