Controller Synthesis for Discrete-Time Polynomial Systems via Occupation Measures

In this paper, we design nonlinear state feedback controllers for discrete-time polynomial dynamical systems via the occupation measure approach. We propose the discrete-time controlled Liouville equation, and use it to formulate the controller synthesis problem as an infinite-dimensional linear programming problem on measures, which is then relaxed as finite-dimensional semidefinite programming problems on moments of measures and their duals on sums-of-squares polynomials. Nonlinear controllers can be extracted from the solutions to the relaxed problems. The advantage of the occupation measure approach is that we solve convex problems instead of generally non-convex problems, and the computational complexity is polynomial in the state and input dimensions, and hence the approach is more scalable. In addition, we show that the approach can be applied to over-approximating the backward reachable set of discrete-time autonomous polynomial systems and the controllable set of discrete-time polynomial systems under known state feedback control laws. We illustrate our approach on several dynamical systems

Fast, Optimal, and Safe Motion Planning for Bipedal Robots

Bipedal robots have the potential to traverse a wide range of unstructured environments, which are otherwise inaccessible to wheeled vehicles. Though roboticists have successfully constructed controllers for bipedal robots to walk over uneven terrain such as snow, sand, or even stairs, it has remained challenging to synthesize such controllers in an online fashion while guaranteeing their satisfactory performance. This is primarily due to the lack of numerical method that can accommodate the non-smooth dynamics, high degrees of freedom, and underactuation that characterize bipedal robots. This dissertation proposes and implements a family of numerical methods that begin to address these three challenges along three dimensions: optimality, safety, and computational speed. First, this dissertation develops a convex relaxation-based approach to solve optimal control for hybrid systems without a priori knowledge of the optimal sequence of transition. This is accomplished by formulating the problem in the space of relaxed controls, which gives rise to a linear program whose solution is proven to compute the globally optimal controller. This conceptual program is solved using a sequence of semidefinite programs whose solutions are proven to converge from below to the true optimal solution of the original optimal control problem. Moreover, a method to synthesize the optimal controller is developed. Using an array of examples, the performance of this method is validated on problems with known solutions and also compared to a commercial solver. Second, this dissertation constructs a method to generate safety-preserving controllers for a planar bipedal robot walking on flat ground by performing reachability analysis on simplified models under the assumption that the difference between the two models can be bounded. Subsequently, this dissertation describes how this reachable set can be incorporated into a Model Predictive Control framework to select controllers that result in safe walking on the biped in an online fashion. This method is validated on a 5-link planar model. Third, this dissertation proposes a novel parallel algorithm capable of finding guaranteed optimal solutions to polynomial optimization problems up to pre-specified tolerances. Formal proofs of bounds on the time and memory usage of such method are also given. Such algorithm is implemented in parallel on GPUs and compared against state-of-the-art solvers on a group of benchmark examples. An application of such method on a real-time trajectory-planning task of a mobile robot is also demonstrated. Fourth, this dissertation constructs an online Model Predictive Control framework that guarantees safety of a 3D bipedal robot walking in a forest of randomly-placed obstacles. Using numerical integration and interval arithmetic techniques, approximations to trajectories of the robot are constructed along with guaranteed bounds on the approximation error. Safety constraints are derived using these error bounds and incorporated in a Model Predictive Control framework whose feasible solutions keep the robot from falling over and from running into obstacles. To ensure that the bipedal robot is able to avoid falling for all time, a finite-time terminal constraint is added to the Model Predictive Control algorithm. The performance of this method is implemented and compared against a naive Model Predictive Control method on a biped model with 20 degrees of freedom. In summary, this dissertation presents four methods for control synthesis of bipedal robots with improvements in either optimality, safety guarantee, or computational speed. Furthermore, the performance of all proposed methods are compared with existing methods in the field.PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/162880/1/pczhao_1.pd

A Sums-of-Squares Extension of Policy Iterations

In order to address the imprecision often introduced by widening operators in static analysis, policy iteration based on min-computations amounts to considering the characterization of reachable value set of a program as an iterative computation of policies, starting from a post-fixpoint. Computing each policy and the associated invariant relies on a sequence of numerical optimizations. While the early research efforts relied on linear programming (LP) to address linear properties of linear programs, the current state of the art is still limited to the analysis of linear programs with at most quadratic invariants, relying on semidefinite programming (SDP) solvers to compute policies, and LP solvers to refine invariants. We propose here to extend the class of programs considered through the use of Sums-of-Squares (SOS) based optimization. Our approach enables the precise analysis of switched systems with polynomial updates and guards. The analysis presented has been implemented in Matlab and applied on existing programs coming from the system control literature, improving both the range of analyzable systems and the precision of previously handled ones.Comment: 29 pages, 4 figure

Correct-By-Construction Control Synthesis for Systems with Disturbance and Uncertainty

This dissertation focuses on correct-by-construction control synthesis for Cyber-Physical Systems (CPS) under model uncertainty and disturbance. CPSs are systems that interact with the physical world and perform complicated dynamic tasks where safety is often the overriding factor. Correct-by-construction control synthesis is a concept that provides formal performance guarantees to closed-loop systems by rigorous mathematic reasoning. Since CPSs interact with the environment, disturbance and modeling uncertainty are critical to the success of the control synthesis. Disturbance and uncertainty may come from a variety of sources, such as exogenous disturbance, the disturbance caused by co-existing controllers and modeling uncertainty. To better accommodate the different types of disturbance and uncertainty, the verification and control synthesis methods must be chosen accordingly. Four approaches are included in this dissertation. First, to deal with exogenous disturbance, a polar algorithm is developed to compute an avoidable set for obstacle avoidance. Second, a supervised learning based method is proposed to design a good student controller that has safety built-in and rarely triggers the intervention of the supervisory controller, thus targeting the design of the student controller. Third, to deal with the disturbance caused by co-existing controllers, a Lyapunov verification method is proposed to formally verify the safety of coexisting controllers while respecting the confidentiality requirement. Finally, a data-driven approach is proposed to deal with model uncertainty. A minimal robust control invariant set is computed for an uncertain dynamic system without a given model by first identifying the set of admissible models and then simultaneously computing the invariant set while selecting the optimal model. The proposed methods are applicable to many real-world applications and reflect the notion of using the structure of the system to achieve performance guarantees without being overly conservative.PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/145933/1/chenyx_1.pd

Utilizing Converter-Interfaced Sources for Frequency Control with Guaranteed Performance in Power Systems

To integrate renewable energy, converter-interfaced sources (CISs) keep penetrating into power systems and degrade the grid frequency response. Control synthesis towards guaranteed performance is a challenging task. Meanwhile, the potentials of highly controllable converters are far from fully developed. With properly designed controllers the CISs can not only eliminate the negative impacts on the grid, but also provide performance guarantees.First, the wind turbine generator (WTG) is chosen to represent the CISs. An augmented system frequency response (ASFR) model is derived, including the system frequency response model and a reduced-order model of the WTG representing the supportive active power due to the supplementary inputs.Second, the framework for safety verification is introduced. A new concept, region of safety (ROS), is proposed, and the safe switching principle is provided. Two different approaches are proposed to estimate the largest ROS, which can be solved using the sum of squares programming.Third, the critical switching instants for adequate frequency response are obtained through the study of the ASFR model. A safe switching window is discovered, and a safe speed recovery strategy is proposed to ensure the safety of the second frequency dip due to the WTG speed recovery.Fourth, an adaptive safety supervisory control (SSC) is proposed with a two-loop configuration, where the supervisor is scheduled with respect to the varying renewable penetration level. For small-scale system, a decentralized fashion of the SSC is proposed under rational approximations and verified on the IEEE 39-bus system.Fifth, a two-level control diagram is proposed so that the frequency of a microgrid satisfies the temporal logic specifications (TLSs). The controller is configured into a scheduling level and a triggering level. The satisfaction of TLSs will be guaranteed by the scheduling level, and triggering level will determine the activation instant.Finally, a novel model reference control based synthetic inertia emulation strategy is proposed. This novel control strategy ensures precise emulated inertia by the WTGs as opposed to the trial and error procedure of conventional methods. Safety bounds can be easily derived based on the reference model under the worst-case scenario