Multi-Parametric Extremum Seeking-based Auto-Tuning for Robust Input-Output Linearization Control

We study in this paper the problem of iterative feedback gains tuning for a class of nonlinear systems. We consider Input-Output linearizable nonlinear systems with additive uncertainties. We first design a nominal Input-Output linearization-based controller that ensures global uniform boundedness of the output tracking error dynamics. Then, we complement the robust controller with a model-free multi-parametric extremum seeking (MES) control to iteratively auto-tune the feedback gains. We analyze the stability of the whole controller, i.e. robust nonlinear controller plus model-free learning algorithm. We use numerical tests to demonstrate the performance of this method on a mechatronics example.Comment: To appear at the IEEE CDC 201

From Model-Based to Data-Driven Discrete-Time Iterative Learning Control

This dissertation presents a series of new results of iterative learning control (ILC) that progresses from model-based ILC algorithms to data-driven ILC algorithms. ILC is a type of trial-and-error algorithm to learn by repetitions in practice to follow a pre-defined finite-time maneuver with high tracking accuracy. Mathematically ILC constructs a contraction mapping between the tracking errors of successive iterations, and aims to converge to a tracking accuracy approaching the reproducibility level of the hardware. It produces feedforward commands based on measurements from previous iterations to eliminates tracking errors from the bandwidth limitation of these feedback controllers, transient responses, model inaccuracies, unknown repeating disturbance, etc. Generally, ILC uses an a priori model to form the contraction mapping that guarantees monotonic decay of the tracking error. However, un-modeled high frequency dynamics may destabilize the control system. The existing infinite impulse response filtering techniques to stop the learning at such frequencies, have initial condition issues that can cause an otherwise stable ILC law to become unstable. A circulant form of zero-phase filtering for finite-time trajectories is proposed here to avoid such issues. This work addresses the problem of possible lack of stability robustness when ILC uses an imperfect a prior model. Besides the computation of feedforward commands, measurements from previous iterations can also be used to update the dynamic model. In other words, as the learning progresses, an iterative data-driven model development is made. This leads to adaptive ILC methods. An indirect adaptive linear ILC method to speed up the desired maneuver is presented here. The updates of the system model are realized by embedding an observer in ILC to estimate the system Markov parameters. This method can be used to increase the productivity or to produce high tracking accuracy when the desired trajectory is too fast for feedback control to be effective. When it comes to nonlinear ILC, data is used to update a progression of models along a homotopy, i.e., the ILC method presented in this thesis uses data to repeatedly create bilinear models in a homotopy approaching the desired trajectory. The improvement here makes use of Carleman bilinearized models to capture more nonlinear dynamics, with the potential for faster convergence when compared to existing methods based on linearized models. The last work presented here finally uses model-free reinforcement learning (RL) to eliminate the need for an a priori model. It is analogous to direct adaptive control using data to directly produce the gains in the ILC law without use of a model. An off-policy RL method is first developed by extending a model-free model predictive control method and then applied in the trial domain for ILC. Adjustments of the ILC learning law and the RL recursion equation for state-value function updates allow the collection of enough data while improving the tracking accuracy without much safety concerns. This algorithm can be seen as the first step to bridge ILC and RL aiming to address nonlinear systems

New Stable Inverses of Linear Discrete Time Systems and Application to Iterative Learning Control

Digital control needs discrete time models, but conversion from continuous time, fed by a zero order hold, to discrete time introduces sampling zeros which are outside the unit circle, i.e. non-minimum phase (NMP) zeros, in the majority of the systems. Also, some systems are already NMP in continuous time. In both cases, the inverse problem to find the input required to maintain a desired output tracking, produces an unstable causal control action. The control action will grow exponentially every time step, and the error between time steps also grows exponentially. This prevents many control approaches from making use of inverse models. The problem statement for the existing stable inverse theorem is presented in this work, and it aims at finding a bounded nominal state-input trajectory by solving a two-point boundary value problem obtained by decomposing the internal dynamics of the system. This results in the causal part specified from the minus infinity time; and its non-causal part from the positive infinity time. By solving for the nominal bounded internal dynamics, the exact output tracking is achieved in the original finite time interval. The new stable inverses concepts presented and developed here address this instability problem in a different way based on the modified versions of problem states, and in a way that is more practical for implementation. The statements of how the different inverse problems are posed is presented, as well as the calculation and implementation. In order to produce zero tracking error at the addressed time steps, two modified statements are given as the initial delete and the skip step. The development presented here involves: (1) The detection of the signature of instability in both the nonhomogeneous difference equation and matrix form for finite time problems. (2) Create a new factorization of the system separating maximum part from minimum part in matrix form as analogous to transfer function format, and more generally, modeling the behavior of finite time zeros and poles. (3) Produce bounded stable inverse solutions evolving from the minimum Euclidean norm satisfying different optimization objective functions, to the solution having no projection on transient solutions terms excited by initial conditions. Iterative Learning Control (ILC) iterates with a real world control system repeatedly performing the same task. It adjusts the control action based on error history from the previous iteration, aiming to converge to zero tracking error. ILC has been widely used in various applications due to its high precision in trajectory tracking, e.g. semiconductor manufacturing sensors that repeatedly perform scanning maneuvers. Designing effective feedback controllers for non-minimum phase (NMP) systems can be challenging. Applying Iterative Learning Control (ILC) to NMP systems is particularly problematic. Incorporating the initial delete stable inverse thinkg into ILC, the control action obtained in the limit as the iterations tend to infinity, is a function of the tracking error produced by the command in the initial run. It is shown here that this dependence is very small, so that one can reasonably use any initial run. By picking an initial input that goes to zero approaching the final time step, the influence becomes particularly small. And by simply commanding zero in the first run, the resulting converged control minimizes the Euclidean norm of the underdetermined control history. Three main classes of ILC laws are examined, and it is shown that all ILC laws converge to the identical control history, as the converged result is not a function of the ILC law. All of these conclusions apply to ILC that aims to track a given finite time trajectory, and also apply to ILC that in addition aims to cancel the effect of a disturbance that repeats each run. Having these stable inverses opens up opportunities for many control design approaches. (1) ILC was the original motivation of the new stable inverses. Besides the scenario using the initial delete above, consider ILC to perform local learning in a trajectory, by using a quadratic cost control in general, but phasing into the skip step stable inverse for some portion of the trajectory that needs high precision tracking. (2) One step ahead control uses a model to compute the control action at the current time step to produce the output desired at the next time step. Before it can be useful, it must be phased in to honor actuator saturation limits, and being a true inverse it requires that the system have a stable inverse. One could generalize this to p-step ahead control, updating the control action every p steps instead of every one step. It determines how small p can be to give a stable implementation using skip step, and it can be quite small. So it only requires knowledge of future desired control for a few steps. (3) Note that the statement in (2) can be reformulated as Linear Model Predictive Control that updates every p steps instead of every step. This offers the ability to converge to zero tracking error at every time step of the skip step inverse, instead of the usual aim to converge to a quadratic cost solution. (4) Indirect discrete time adaptive control combines one step ahead control with the projection algorithm to perform real time identification updates. It has limited applications, because it requires a stable inverse

A novel adaptive PD-type iterative learning control of the PMSM servo system with the friction uncertainty in low speeds

High precision demands in a large number of emerging robotic applications strengthened the role of the modern control laws in the position control of the Permanent Magnet Synchronous Motor (PMSM) servo system. This paper proposes a learning-based adaptive control approach to improve the PMSM position tracking in the presence of the friction uncertainty. In contrast to most of the reported works considering the servos operating at high speeds, this paper focuses on low speeds in which the friction stemmed deteriorations become more obvious. In this paper firstly, a servo model involving the Stribeck friction dynamics is formulated, and the unknown friction parameters are identified by a genetic algorithm from the offline data. Then, a feedforward controller is designed to inject the friction information into the loop and eliminate it before causing performance degradations. Since the friction is a kind of disturbance and leads to uncertainties having time-varying characters, an Adaptive Proportional Derivative (APD) type Iterative Learning Controller (ILC) named as the APD-ILC is designed to mitigate the friction effects. Finally, the proposed control approach is simulated in MATLAB/Simulink environment and it is compared with the conventional Proportional Integral Derivative (PID) controller, Proportional ILC (P-ILC), and Proportional Derivative ILC (PD-ILC) algorithms. The results confirm that the proposed APD-ILC significantly lessens the effects of the friction and thus noticeably improves the control performance in the low speeds of the PMSM

An Output-Recurrent-Neural-Network-Based Iterative Learning Control for Unknown Nonlinear Dynamic Plants

We present a design method for iterative learning control system by using an output recurrent neural network (ORNN). Two ORNNs are employed to design the learning control structure. The first ORNN, which is called the output recurrent neural controller (ORNC), is used as an iterative learning controller to achieve the learning control objective. To guarantee the convergence of learning error, some information of plant sensitivity is required to design a suitable adaptive law for the ORNC. Hence, a second ORNN, which is called the output recurrent neural identifier (ORNI), is used as an identifier to provide the required information. All the weights of ORNC and ORNI will be tuned during the control iteration and identification process, respectively, in order to achieve a desired learning performance. The adaptive laws for the weights of ORNC and ORNI and the analysis of learning performances are determined via a Lyapunov like analysis. It is shown that the identification error will asymptotically converge to zero and repetitive output tracking error will asymptotically converge to zero except the initial resetting error

특정 점의 추적을 위한 모델예측제어가 결합된 새로운 반복학습제어 기법

학위논문 (박사)-- 서울대학교 대학원 : 화학생물공학부, 2017. 2. 이종민.본 논문에서는 제약조건이 있는 다변수 회분식 공정의 제어를 위해 반복학습제어(Iterative learning control, ILC)와 모델예측제어(Model predictive control, MPC)를 결합한 반복학습 모델예측제어(Iterative learning model predictive control, ILMPC)를 다룬다. 일반적인 ILC는 모델의 불확실성이 있더라도 이전 회분의 정보를 이용해 학습하기 때문에 출력을 기준궤적에 수렴시킬 수 있다. 하지만 기본적으로 개루프 제어이기 때문에 실시간 외란을 제거할 수 없다. MPC는 이전 회분의 정보를 이용하지 않기 때문에 모든 회분에서 동일한 성능을 보이며 모델의 정확도에 크게 의존한다. 본 논문에서 ILC와 MPC의 모든 장점을 포함하는 ILMPC를 제안한다. 많은 회분식 또는 반복 공정에서 출력은 모든 시간에서의 기준궤적을 추적할 필요가 없다. 따라서 본 논문에서는 원하는 점에만 수렴할 수 있는 새로운 ILMPC 기법을 제안한다. 제안한 기법을 사용할 경우 원하는 점을 지나는 기준궤적을 만드는 과정이 필요 없게 된다. 또한 본 논문은 점대점 추적, 반복 학습, 제약조건, 실시간 외란 제거 등의 성능을 보이기 위한 다양한 예제를 제공한다.In this thesis, we study an iterative learning control (ILC) technique combined with model predictive control (MPC), called the iterative learning model predictive control (ILMPC), for constrained multivariable control of batch processes. Although the general ILC makes the outputs converge to reference trajectories under model uncertainty, it uses open-loop control within a batchthus, it cannot reject real-time disturbances. The MPC algorithm shows identical performance for all batches, and it highly depends on model quality because it does not use previous batch information. We integrate the advantages of the two algorithms. In many batch or repetitive processes, the output does not need to track all points of a reference trajectory. We propose a novel ILMPC method which can only consider the desired reference points, not an entire reference trajectory. It does not require to generate a reference trajectory which passes through the specific desired points. Numerical examples are provided to demonstrate the performances of the suggested approach on point-to-point tracking, iterative learning, constraints handling, and real-time disturbance rejection.1. Introduction 1 1.1 Background and Motivation 1 1.2 Literature Review 4 1.2.1 Iterative Learning Control 4 1.2.2 Iterative Learning Control Combined with Model Predictive Control 15 1.2.3 Iterative Learning Control for Point-to-Point Tracking 17 1.3 Major Contributions of This Thesis 18 1.4 Outline of This Thesis 19 2. Iterative Learning Control Combined with Model Predictive Control 22 2.1 Introduction 22 2.2 Prediction Model for Iterative Learning Model Predictive Control 25 2.2.1 Incremental State-Space Model 25 2.2.2 Prediction Model 30 2.3 Iterative Learning Model Predictive Controller 34 2.3.1 Unconstrained ILMPC 34 2.3.2 Constrained ILMPC 35 2.3.3 Convergence Property 37 2.3.4 Extension for Disturbance Model 42 2.4 Numerical Illustrations 44 2.4.1 (Case 1) Unconstrained and Constrained Linear SISO System 45 2.4.2 (Case 2) Constrained Linear MIMO System 49 2.4.3 (Case 3) Nonlinear Batch Reactor 53 2.5 Conclusion 59 3. Iterative Learning Control Combined with Model Predictive Control for Non-Zero Convergence 60 3.1 Iterative Learning Model Predictive Controller for Nonzero Convergence 60 3.2 Convergence Analysis 63 3.2.1 Convergence Analysis for an Input Trajectory 63 3.2.2 Convergence Analysis for an Output Error 65 3.3 Illustrative Example 71 3.4 Conclusions 75 4. Iterative Learning Control Combined with Model Predictive Control for Tracking Specific Points 77 4.1 Introduction 77 4.2 Point-to-Point Iterative Learning Model Predictive Control 79 4.2.1 Extraction Matrix Formulation 79 4.2.2 Constrained PTP ILMPC 82 4.2.3 Iterative Learning Observer 86 4.3 Convergence Analysis 89 4.3.1 Convergence of Input Trajectory 89 4.3.2 Convergence of Error 95 4.4 Numerical Examples 98 4.4.1 Example 1 (Linear SISO System with Disturbance) 98 4.4.2 Example 2 (Linear SISO System) 104 4.4.3 Example 3 (Comparison between the Proposed PTP ILMPC and PTP ILC) 107 4.4.4 Example 4 (Nonlinear Semi-Batch Reactor) 113 4.5 Conclusion 119 5. Stochastic Iterative Learning Control for Batch-varying Reference Trajectory 120 5.1 Introduction 121 5.2 ILC for Batch-Varying Reference Trajectories 123 5.2.1 Convergence Property for ILC with Batch-Varying Reference Trajectories 123 5.2.2 Iterative Learning Identification 126 5.2.3 Deterministic ILC Controller for Batch-Varying Reference Trajectories 129 5.3 ILC for LTI Stochastic System with Batch-Varying Reference Trajectories 132 5.3.1 Approach1: Batch-Domain Kalman Filter-Based Approach 133 5.3.2 Approach2: Time-Domain Kalman Filter-Based Approach 137 5.4 Numerical Examples 141 5.4.1 Example 1 (Random Reference Trajectories 141 5.4.2 Example 2 (Particular Types of Reference Trajectories 149 5.5 Conclusion 151 6. Conclusions and Future Works 156 6.1 Conclusions 156 6.2 Future work 157 Bibliography 158 초록 170Docto

Relaxing Fundamental Assumptions in Iterative Learning Control

Iterative learning control (ILC) is perhaps best decribed as an open loop feedforward control technique where the feedforward signal is learned through repetition of a single task. As the name suggests, given a dynamic system operating on a finite time horizon with the same desired trajectory, ILC aims to iteratively construct the inverse image (or its approximation) of the desired trajectory to improve transient tracking. In the literature, ILC is often interpreted as feedback control in the iteration domain due to the fact that learning controllers use information from past trials to drive the tracking error towards zero. However, despite the significant body of literature and powerful features, ILC is yet to reach widespread adoption by the control community, due to several assumptions that restrict its generality when compared to feedback control. In this dissertation, we relax some of these assumptions, mainly the fundamental invariance assumption, and move from the idea of learning through repetition to two dimensional systems, specifically repetitive processes, that appear in the modeling of engineering applications such as additive manufacturing, and sketch out future research directions for increased practicality: We develop an L1 adaptive feedback control based ILC architecture for increased robustness, fast convergence, and high performance under time varying uncertainties and disturbances. Simulation studies of the behavior of this combined L1-ILC scheme under iteration varying uncertainties lead us to the robust stability analysis of iteration varying systems, where we show that these systems are guaranteed to be stable when the ILC update laws are designed to be robust, which can be done using existing methods from the literature. As a next step to the signal space approach adopted in the analysis of iteration varying systems, we shift the focus of our work to repetitive processes, and show that the exponential stability of a nonlinear repetitive system is equivalent to that of its linearization, and consequently uniform stability of the corresponding state space matrix.PhDElectrical Engineering: SystemsUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/133232/1/altin_1.pd

Norm Optimal Iterative Learning Control with Application to Problems in Accelerator based Free Electron Lasers and Rehabilitation Robotics

This paper gives an overview of the theoretical basis of the norm optimal approach to iterative learning control followed by results that describe more recent work which has experimentally benchmarking the performance that can be achieved. The remainder of then paper then describes its actual application to a physical process and a very novel application in stroke rehabilitation

Performance Improvement of Low-Cost Iterative Learning-Based Fuzzy Control Systems for Tower Crane Systems

This paper is dedicated to the memory of Prof. Ioan Dzitac, one of the fathers of this journal and its founding Editor-in-Chief till 2021. The paper addresses the performance improvement of three Single Input-Single Output (SISO) fuzzy control systems that control separately the positions of interest of tower crane systems, namely the cart position, the arm angular position and the payload position. Three separate low-cost SISO fuzzy controllers are employed in terms of first order discrete-time intelligent Proportional-Integral (PI) controllers with Takagi-Sugeno-Kang Proportional-Derivative (PD) fuzzy terms. Iterative Learning Control (ILC) system structures with PD learning functions are involved in the current iteration SISO ILC structures. Optimization problems are defined in order to tune the parameters of the learning functions. The objective functions are defined as the sums of squared control errors, and they are solved in the iteration domain using the recent metaheuristic Slime Mould Algorithm (SMA). The experimental results prove the performance improvement of the SISO control systems after ten iterations of SMA