Combined state and parameter estimation for Hammerstein systems with time-delay using the Kalman filtering

This paper discusses the state and parameter estimation problem for a class of Hammerstein state space systems with time-delay. Both the process noise and the measurement noise are considered in the system. Based on the observable canonical state space form and the key term separation, a pseudo-linear regressive identification model is obtained. For the unknown states in the information vector, the Kalman filter is used to search for the optimal state estimates. A Kalman-filter based least squares iterative and a recursive least squares algorithms are proposed. Extending the information vector to include the latest information terms which are missed for the time-delay, the Kalman-filter based recursive extended least squares algorithm is derived to obtain the estimates of the unknown time-delay, parameters and states. The numerical simulation results are given to illustrate the effectiveness of the proposed algorithms

System Identification for Continuous-time Linear Dynamical Systems

The problem of system identification for the Kalman filter, relying on the expectation-maximization (EM) procedure to learn the underlying parameters of a dynamical system, has largely been studied assuming that observations are sampled at equally-spaced time points. However, in many applications this is a restrictive and unrealistic assumption. This paper addresses system identification for the continuous-discrete filter, with the aim of generalizing learning for the Kalman filter by relying on a solution to a continuous-time It\^o stochastic differential equation (SDE) for the latent state and covariance dynamics. We introduce a novel two-filter, analytical form for the posterior with a Bayesian derivation, which yields analytical updates which do not require the forward-pass to be pre-computed. Using this analytical and efficient computation of the posterior, we provide an EM procedure which estimates the parameters of the SDE, naturally incorporating irregularly sampled measurements. Generalizing the learning of latent linear dynamical systems (LDS) to continuous-time may extend the use of the hybrid Kalman filter to data which is not regularly sampled or has intermittent missing values, and can extend the power of non-linear system identification methods such as switching LDS (SLDS), which rely on EM for the linear discrete-time Kalman filter as a sub-unit for learning locally linearized behavior of a non-linear system. We apply the method by learning the parameters of a latent, multivariate Fokker-Planck SDE representing a toggle-switch genetic circuit using biologically realistic parameters, and compare the efficacy of learning relative to the discrete-time Kalman filter as the step-size irregularity and spectral-radius of the dynamics-matrix increases.Comment: 31 pages, 3 figures. Only light changes and restructuring to previous version mad

Integrated System Identification and Adaptive State Estimation for Control of Flexible Space Structures

Accurate state information is crucial for control of flexible space structures in which the state feedback strategy is used. The performance of a state estimator relies on accurate knowledge about both the system and its disturbances, which are represented by system model and noise covariances respectively. For flexible space structures, due to their great flexibility, obtaining good models from ground testing is not possible. In addition, the characteristics of the systems in operation may vary due to temperature gradient, reorientation, and deterioration of material, etc. Moreover, the disturbances during operation are usually not known. Therefore, adaptive methods for system identification and state estimation are desirable for control of flexible space structures. This dissertation solves the state estimation problem under three situations: having system model and noise covariances, having system model but no noise covariances, having neither system model nor noise covariances. Recursive least-squares techniques, which require no initial knowledge of the system and noises, are used to identify a matrix polynomial model of the system, then a state space model and the corresponding optimal steady state Kalman filter gain are calculated from the coefficients of the identified matrix polynomial model. The derived methods are suitable for on-board adaptive applications. Experimental example is included to validate the derivations

Adaptive filtering-based multi-innovation gradient algorithm for input nonlinear systems with autoregressive noise

In this paper, by means of the adaptive filtering technique and the multi-innovation identification theory, an adaptive filtering-based multi-innovation stochastic gradient identification algorithm is derived for Hammerstein nonlinear systems with colored noise. The new adaptive filtering configuration consists of a noise whitening filter and a parameter estimator. The simulation results show that the proposed algorithm has higher parameter estimation accuracies and faster convergence rates than the multi-innovation stochastic gradient algorithm for the same innovation length. As the innovation length increases, the filtering-based multi-innovation stochastic gradient algorithm gives smaller parameter estimation errors than the recursive least squares algorithm

Adaptive Optimal Control The Thinking Man's GPC

Exploring connections between adaptive control theory and practice, this book treats the techniques of linear quadratic optimal control and estimation (Kalman filtering), recursive identification, linear systems theory and robust arguments

New methods for the estimation of Takagi-Sugeno model based extended Kalman filter and its applications to optimal control for nonlinear systems

This paper describes new approaches to improve the local and global approximation (matching) and modeling capability of Takagi–Sugeno (T-S) fuzzy model. The main aim is obtaining high function approximation accuracy and fast convergence. The main problem encountered is that T-S identification method cannot be applied when the membership functions are overlapped by pairs. This restricts the application of the T-S method because this type of membership function has been widely used during the last 2 decades in the stability, controller design of fuzzy systems and is popular in industrial control applications. The approach developed here can be considered as a generalized version of T-S identification method with optimized performance in approximating nonlinear functions. We propose a noniterative method through weighting of parameters approach and an iterative algorithm by applying the extended Kalman filter, based on the same idea of parameters’ weighting. We show that the Kalman filter is an effective tool in the identification of T-S fuzzy model. A fuzzy controller based linear quadratic regulator is proposed in order to show the effectiveness of the estimation method developed here in control applications. An illustrative example of an inverted pendulum is chosen to evaluate the robustness and remarkable performance of the proposed method locally and globally in comparison with the original T-S model. Simulation results indicate the potential, simplicity, and generality of the algorithm. An illustrative example is chosen to evaluate the robustness. In this paper, we prove that these algorithms converge very fast, thereby making them very practical to use