Estimation and stability of nonlinear control systems under intermittent information with applications to multi-agent robotics

This dissertation investigates the role of intermittent information in estimation and control problems and applies the obtained results to multi-agent tasks in robotics. First, we develop a stochastic hybrid model of mobile networks able to capture a large variety of heterogeneous multi-agent problems and phenomena. This model is applied to a case study where a heterogeneous mobile sensor network cooperatively detects and tracks mobile targets based on intermittent observations. When these observations form a satisfactory target trajectory, a mobile sensor is switched to the pursuit mode and deployed to capture the target. The cost of operating the sensors is determined from the geometric properties of the network, environment and probability of target detection. The above case study is motivated by the Marco Polo game played by children in swimming pools. Second, we develop adaptive sampling of targets positions in order to minimize energy consumption, while satisfying performance guarantees such as increased probability of detection over time, and no-escape conditions. A parsimonious predictor-corrector tracking filter, that uses geometrical properties of targets\u27 tracks to estimate their positions using imperfect and intermittent measurements, is presented. It is shown that this filter requires substantially less information and processing power than the Unscented Kalman Filter and Sampling Importance Resampling Particle Filter, while providing comparable estimation performance in the presence of intermittent information. Third, we investigate stability of nonlinear control systems under intermittent information. We replace the traditional periodic paradigm, where the up-to-date information is transmitted and control laws are executed in a periodic fashion, with the event-triggered paradigm. Building on the small gain theorem, we develop input-output triggered control algorithms yielding stable closed-loop systems. In other words, based on the currently available (but outdated) measurements of the outputs and external inputs of a plant, a mechanism triggering when to obtain new measurements and update the control inputs is provided. Depending on the noise environment, the developed algorithm yields stable, asymptotically stable, and Lp-stable (with bias) closed-loop systems. Control loops are modeled as interconnections of hybrid systems for which novel results on Lp-stability are presented. Prediction of a triggering event is achieved by employing Lp-gains over a finite horizon in the small gain theorem. By resorting to convex programming, a method to compute Lp-gains over a finite horizon is devised. Next, we investigate optimal intermittent feedback for nonlinear control systems. Using the currently available measurements from a plant, we develop a methodology that outputs when to update the control law with new measurements such that a given cost function is minimized. Our cost function captures trade-offs between the performance and energy consumption of the control system. The optimization problem is formulated as a Dynamic Programming problem, and Approximate Dynamic Programming is employed to solve it. Instead of advocating a particular approximation architecture for Approximate Dynamic Programming, we formulate properties that successful approximation architectures satisfy. In addition, we consider problems with partially observable states, and propose Particle Filtering to deal with partially observable states and intermittent feedback. Finally, we investigate a decentralized output synchronization problem of heterogeneous linear systems. We develop a self-triggered output broadcasting policy for the interconnected systems. Broadcasting time instants adapt to the current communication topology. For a fixed topology, our broadcasting policy yields global exponential output synchronization, and Lp-stable output synchronization in the presence of disturbances. Employing a converse Lyapunov theorem for impulsive systems, we provide an average dwell time condition that yields disturbance-to-state stable output synchronization in case of switching topology. Our approach is applicable to directed and unbalanced communication topologies.\u2

Stochastic output feedback MPC with intermittent observations

This paper considers constrained linear systems with stochastic additive disturbances and noisy measurements transmitted over a lossy communication channel. We propose a model predictive control (MPC) law that minimises a discounted cost subject to a discounted expectation constraint. Sensor data is assumed to be lost with known probability, and data losses are accounted for by expressing the predicted control policy as an affine function of future observations, which results in a convex optimal control problem. An online constraint-tightening technique ensures recursive feasibility of the online optimisation problem and satisfaction of the expectation constraint without imposing bounds on the distributions of the noise and disturbance inputs. The discounted cost evaluated along trajectories of the closed loop system is shown to be bounded by the initial optimal predicted cost. We also provide conditions under which the averaged undiscounted closed loop cost accumulated over an infinite horizon is bounded. Numerical simulations are described to illustrate these results.Comment: 12 pages. arXiv admin note: substantial text overlap with arXiv:2004.0259

Hybrid Attitude Control and Estimation On SO(3)

This thesis presents a general framework for hybrid attitude control and estimation design on the Special Orthogonal group SO(3). First, the attitude stabilization problem on SO(3) is considered. It is shown that, using a min-switch hybrid control strategy designed from a family of potential functions on SO(3), global exponential stabilization on SO(3) can be achieved when this family of potential functions satisfies certain properties. Then, a systematic methodology to construct these potential functions is developed. The proposed hybrid control technique is applied to the attitude tracking problem for rigid body systems. A smoothing mechanism is proposed to filter out the discrete behaviour of the hybrid switching mechanism leading to control torques that are continuous. Next, the problem of attitude estimation from continuous body-frame vector measurements of known inertial directions is considered. Two hybrid attitude and gyro bias observers designed directly on SO(3) are proposed. The first observer uses a set of innovation terms and a switching mechanism that selects the appropriate innovation term. The second observer uses a fixed innovation term and allows the attitude state to be reset (experience discrete transition or jump) to an adequately chosen value on SO(3). Both hybrid observers guarantee global exponential stability of the zero estimation errors. Finally, in the case where the body-frame vector measurements are intermittent, an event-triggered attitude estimation scheme on SO(3) is proposed. The observer consists in integrating the continuous angular velocity during the interval of time where the vector measurements are not available, and updating the attitude state upon the arrival of the vector measurements. Both cases of synchronous and asynchronous vector measurements with possible irregular sampling periods are considered. Moreover, some modifications to the intermittent observer are developed to handle different practical issues such as discrete-time implementation, noise filtering and gyro bias compensation

Periodic event-triggered output regulation for linear multi-agent systems

This study considers the problem of periodic event-triggered (PET) cooperative output regulation for a class of linear multi-agent systems. The advantage of the PET output regulation is that the data transmission and triggered condition are only needed to be monitored at discrete sampling instants. It is assumed that only a small number of agents can have access to the system matrix and states of the leader. Meanwhile, the PET mechanism is considered not only in the communication between various agents, but also in the sensor-to-controller and controller-to-actuator transmission channels for each agent. The above problem set-up will bring some challenges to the controller design and stability analysis. Based on a novel PET distributed observer, a PET dynamic output feedback control method is developed for each follower. Compared with the existing works, our method can naturally exclude the Zeno behavior, and the inter-event time becomes multiples of the sampling period. Furthermore, for every follower, the minimum inter-event time can be determined \textit{a prior}, and computed directly without the knowledge of the leader information. An example is given to verify and illustrate the effectiveness of the new design scheme.Comment: 17 pages, 13 figures, submitted to Automatica. accepte

A Framework for Robust Assessment of Power Grid Stability and Resiliency

Security assessment of large-scale, strongly nonlinear power grids containing thousands to millions of interacting components is a computationally expensive task. Targeting at reducing the computational cost, this paper introduces a framework for constructing a robust assessment toolbox that can provide mathematically rigorous certificates for the grids' stability in the presence of variations in power injections, and for the grids' ability to withstand a bunch sources of faults. By this toolbox we can "off-line" screen a wide range of contingencies or power injection profiles, without reassessing the system stability on a regular basis. In particular, we formulate and solve two novel robust stability and resiliency assessment problems of power grids subject to the uncertainty in equilibrium points and uncertainty in fault-on dynamics. Furthermore, we bring in the quadratic Lyapunov functions approach to transient stability assessment, offering real-time construction of stability/resiliency certificates and real-time stability assessment. The effectiveness of the proposed techniques is numerically illustrated on a number of IEEE test cases

Learning as a rational foundation for macroeconomics and finance

Expectations play a central role in modern macroeconomics. The econometric learning approach, in line with the cognitive consistency principle, models agents as forming expectations by estimating and updating subjective forecasting models in real time. This approach provides a stability test for RE equilibria and a selection criterion in models with multiple equilibria. Further features of learning – such as discounting of older data, use of misspecified models or heterogeneous choice by agents between competing models – generate novel learning dynamics. Empirical applications are reviewed and the roles of the planning horizon and structural knowledge are discussed. We develop several applications of learning with relevance to macroeconomic policy: the scope of Ricardian equivalence, appropriate specification of interest-rate rules, implementation of price-level targeting to achieve learning stability of the optimal RE equilibrium and whether, under learning, price-level targeting can rule out the deflation trap at the zero lower bound.cognitive consistency; E-stability; least-squares; persistent learning dynamics; business cycles; monetary policy; asset prices