Finite-time behavior of inner systems

In this paper, we investigate how nonminimum phase characteristics of a dynamical system affect its controllability and tracking properties. For the class of linear time-invariant dynamical systems, these characteristics are determined by transmission zeros of the inner factor of the system transfer function. The relation between nonminimum phase zeros and Hankel singular values of inner systems is studied and it is shown how the singular value structure of a suitably defined operator provides relevant insight about system invertibility and achievable tracking performance. The results are used to solve various tracking problems both on finite as well as on infinite time horizons. A typical receding horizon control scheme is considered and new conditions are derived to guarantee stabilizability of a receding horizon controller

Adaptive Input Reconstruction with Application to Model Refinement, State Estimation, and Adaptive Control.

Input reconstruction is the process of using the output of a system to estimate its input. In some cases, input reconstruction can be accomplished by determining the output of the inverse of a model of the system whose input is the output of the original system. Inversion, however, requires an exact and fully known analytical model, and is limited by instabilities arising from nonminimum-phase zeros. The main contribution of this work is a novel technique for input reconstruction that does not require model inversion. This technique is based on a retrospective cost, which requires a limited number of Markov parameters. Retrospective cost input reconstruction (RCIR) does not require knowledge of nonminimum-phase zero locations or an analytical model of the system. RCIR provides a technique that can be used for model refinement, state estimation, and adaptive control. In the model refinement application, data are used to refine or improve a model of a system. It is assumed that the difference between the model output and the data is due to an unmodeled subsystem whose interconnection with the modeled system is inaccessible, that is, the interconnection signals cannot be measured and thus standard system identification techniques cannot be used. Using input reconstruction, these inaccessible signals can be estimated, and the inaccessible subsystem can be fitted. We demonstrate input reconstruction in a model refinement framework by identifying unknown physics in a space weather model and by estimating an unknown film growth in a lithium ion battery. The same technique can be used to obtain estimates of states that cannot be directly measured. Adaptive control can be formulated as a model-refinement problem, where the unknown subsystem is the idealized controller that minimizes a measured performance variable. Minimal modeling input reconstruction for adaptive control is useful for applications where modeling information may be difficult to obtain. We demonstrate adaptive control of a seeker-guided missile with unknown aerodynamics.Ph.D.Aerospace EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/91520/1/amdamato_1.pd

Relay Feedback and Multivariable Control

This doctoral thesis treats three issues in control engineering related to relay feedback and multivariable control systems. Linear systems with relay feedback is the first topic. Such systems are shown to exhibit several interesting behaviors. It is proved that there exist multiple fast relay switches if and only if the sign of the first non-vanishing Markov parameter of the linear system is positive. It is also shown that these fast switches can appear as part of a stable limit cycle. A linear system with pole excess one or two is demonstrated to be particularly interesting. Stability conditions for these cases are derived. It is also discussed how fast relay switches can be approximated by sliding modes. Performance limitations in linear multivariable control systems is the second topic. It is proved that if the top left submatrices of a stable transfer matrix have no right half-plane zeros and a certain high-frequency condition holds, then there exists a diagonal stabilizing feedback that makes a weighted sensitivity function arbitrarily small. Implications on control structure design and sequential loop-closure are given. A novel multivariable laboratory process is also presented. Its linearized dynamics have a transmission zero that can be located anywhere on the real axis by simply adjusting two valves. This process is well suited to illustrate many issues in multivariable control, for example, control design limitations due to right half-plane zeros. The third topic is a combination of relay feedback and multivariable control. Tuning of individual loops in an existing multivariable control system is discussed. It is shown that a specific relay feedback experiment can be used to obtain process information suitable for performance improvement in a loop, without any prior knowledge of the system dynamics. The influence of the loop retuning on the overall closed-loop performance is derived and interpreted in several ways

Nonlinear Tracking Control Using a Robust Differential-Algebraic Approach.

This dissertation presents the development and application of an inherently robust nonlinear trajectory tracking control design methodology which is based on linearization along a nominal trajectory. The problem of trajectory tracking is reduced to two separate control problems. The first is to compute the nominal control signal that is needed to place a nonlinear system on a desired trajectory. The second problem is one of stabilizing the nominal trajectory. The primary development of this work is the development of practical methods for designing error regulators for Linear Time Varying systems, which allows for the application of trajectory linearization to time varying trajectories for nonlinear systems. This development is based on a new Differential Algebraic Spectral Theory. The problem of robust tracking for nonlinear systems with parametric uncertainty is studied in relation to the Linear Time Varying spectrum. The control method presented herein constitutes a rather general control strategy for nonlinear dynamic systems. Design and simulation case studies for some challenging nonlinear tracking problems are considered. These control problems include: two academic problems, a pitch autopilot design for a skid-to-turn missile, a two link robot controller, a four degree of freedom roll-yaw autopilot, and a complete six degree of freedom Bank-to-turn planar missile autopilot. The simulation results for these designs show significant improvements in performance and robustness compared to other current control strategies

Continuous-Time Reinforcement Learning: New Design Algorithms with Theoretical Insights and Performance Guarantees

Continuous-time nonlinear optimal control problems hold great promise in real-world applications. After decades of development, reinforcement learning (RL) has achieved some of the greatest successes as a general nonlinear control design method. However, a recent comprehensive analysis of state-of-the-art continuous-time RL (CT-RL) methods, namely, adaptive dynamic programming (ADP)-based CT-RL algorithms, reveals they face significant design challenges due to their complexity, numerical conditioning, and dimensional scaling issues. Despite advanced theoretical results, existing ADP CT-RL synthesis methods are inadequate in solving even small, academic problems. The goal of this work is thus to introduce a suite of new CT-RL algorithms for control of affine nonlinear systems. Our design approach relies on two important factors. First, our methods are applicable to physical systems that can be partitioned into smaller subproblems. This constructive consideration results in reduced dimensionality and greatly improved intuitiveness of design. Second, we introduce a new excitation framework to improve persistence of excitation (PE) and numerical conditioning performance via classical input/output insights. Such a design-centric approach is the first of its kind in the ADP CT-RL community. In this paper, we progressively introduce a suite of (decentralized) excitable integral reinforcement learning (EIRL) algorithms. We provide convergence and closed-loop stability guarantees, and we demonstrate these guarantees on a significant application problem of controlling an unstable, nonminimum phase hypersonic vehicle (HSV)

Nonlinear continuous-time generalised predictive control

The development of the nonlinear version of the Continuous-time Generalised Predictive Control (NCGPC) is presented. Unlike the linear version, the nonlinear version is developed in state-space form and shown to include Nonlinear Generalised Minimum Variance (NGMV), and a new algorithm, Nonlinear Predictive Generalised Minimum Variance (NPGMV), as special cases. Through simulations, it is demonstrated that NCGPC can deal with nonlinear systems whose relative degree is not well defined and nonlinear systems with unstable zero dynamics. Geometric approaches, such as exact linearisation, are shown to be included in the NCGPC as special cases

Resource-aware motion control:feedforward, learning, and feedback

Controllers with new sampling schemes improve motion systems’ performanc

Iterative Machine Learning for Precision Trajectory Tracking with Series Elastic Actuators

When robots operate in unknown environments small errors in postions can lead to large variations in the contact forces, especially with typical high-impedance designs. This can potentially damage the surroundings and/or the robot. Series elastic actuators (SEAs) are a popular way to reduce the output impedance of a robotic arm to improve control authority over the force exerted on the environment. However this increased control over forces with lower impedance comes at the cost of lower positioning precision and bandwidth. This article examines the use of an iteratively-learned feedforward command to improve position tracking when using SEAs. Over each iteration, the output responses of the system to the quantized inputs are used to estimate a linearized local system models. These estimated models are obtained using a complex-valued Gaussian Process Regression (cGPR) technique and then, used to generate a new feedforward input command based on the previous iteration's error. This article illustrates this iterative machine learning (IML) technique for a two degree of freedom (2-DOF) robotic arm, and demonstrates successful convergence of the IML approach to reduce the tracking error.Comment: 9 pages, 16 figure. Submitted to AMC Worksho

Guidance of Nonlinear Nonminimum-Phase Dynamic Systems

The first two years research work has advanced the inversion-based guidance theory for: (1) systems with non-hyperbolic internal dynamics; (2) systems with parameter jumps; (3) systems where a redesign of the output trajectory is desired; and (4) the generation of recovery guidance maneuvers

On Observer-Based Control of Nonlinear Systems

Filtering and reconstruction of signals play a fundamental role in modern signal processing, telecommunications, and control theory and are used in numerous applications. The feedback principle is an important concept in control theory. Many different control strategies are based on the assumption that all internal states of the control object are available for feedback. In most cases, however, only a few of the states or some functions of the states can be measured. This circumstance raises the need for techniques, which makes it possible not only to estimate states, but also to derive control laws that guarantee stability when using the estimated states instead of the true ones. For linear systems, the separation principle assures stability for the use of converging state estimates in a stabilizing state feedback control law. In general, however, the combination of separately designed state observers and state feedback controllers does not preserve performance, robustness, or even stability of each of the separate designs. In this thesis, the problems of observer design and observer-based control for nonlinear systems are addressed. The deterministic continuous-time systems have been in focus. Stability analysis related to the Positive Real Lemma with relevance for output feedback control is presented. Separation results for a class of nonholonomic nonlinear systems, where the combination of independently designed observers and state-feedback controllers assures stability in the output tracking problem are shown. In addition, a generalization to the observer-backstepping method where the controller is designed with respect to estimated states, taking into account the effects of the estimation errors, is presented. Velocity observers with application to ship dynamics and mechanical manipulators are also presented