Optimistic minimax search for noncooperative switched control with or without dwell time

International audienceWe consider adversarial problems in which two agents control two switching signals, the first agent aiming to maximize a discounted sum of rewards, and the second aiming to minimize it. Both signals may be subject to constraints on the dwell time after a switch. We search the tree of possible mode sequences with an algorithm called optimistic minimax search with dwell time (OMSd), showing that it obtains a solution close to the minimax-optimal one, and we characterize the rate at which the suboptimality goes to zero. The analysis is driven by a novel measure of problem complexity, and it is first given in the general dwell-time case, after which it is specialized to the unconstrained case. We exemplify the framework for networked control systems where the minimizer signal is a discrete time delay on the control channel, and we provide extensive simulations and a real-time experiment for nonlinear systems of this type

34th Midwest Symposium on Circuits and Systems-Final Program

Organized by the Naval Postgraduate School Monterey California. Cosponsored by the IEEE Circuits and Systems Society. Symposium Organizing Committee: General Chairman-Sherif Michael, Technical Program-Roberto Cristi, Publications-Michael Soderstrand, Special Sessions- Charles W. Therrien, Publicity: Jeffrey Burl, Finance: Ralph Hippenstiel, and Local Arrangements: Barbara Cristi

Effects of Delay on the Functionality of Large-scale Networks

Networked systems are common across engineering and the physical sciences. Examples include the Internet, coordinated motion of multi-agent systems, synchronization phenomena in nature etc. Their robust functionality is important to ensure smooth operation in the presence of uncertainty and unmodelled dynamics. Many such networked systems can be viewed under a unified optimization framework and several approaches to assess their nominal behaviour have been developed. In this paper, we consider what effect multiple, non-commensurate (heterogeneous) communication delays can have on the functionality of large-scale networked systems with nonlinear dynamics. We show that for some networked systems, the structure of the delayed dynamics allows functionality to be retained for arbitrary communication delays, even for switching topologies under certain connectivity conditions; whereas in other cases the loop gains have to be compensated for by the delay size, in order to render functionality delay-independent for arbitrary network sizes. Consensus reaching in multi-agent systems and stability of network congestion control for the Internet are used as examples. The differences and similarities of the two cases are explained in detail, and the application of the methodology to other technological and physical networks is discussed