Parameter estimation algorithm for multivariable controlled autoregressive autoregressive moving average systems

This paper investigates parameter estimation problems for multivariable controlled autoregressive autoregressive moving average (M-CARARMA) systems. In order to improve the performance of the standard multivariable generalized extended stochastic gradient (M-GESG) algorithm, we derive a partially coupled generalized extended stochastic gradient algorithm by using the auxiliary model. In particular, we divide the identification model into several subsystems based on the hierarchical identification principle and estimate the parameters using the coupled relationship between these subsystems. The simulation results show that the new algorithm can give more accurate parameter estimates of the M-CARARMA system than the M-GESG algorithm

Performance Analysis of Fractional Learning Algorithms

Fractional learning algorithms are trending in signal processing and adaptive filtering recently. However, it is unclear whether the proclaimed superiority over conventional algorithms is well-grounded or is a myth as their performance has never been extensively analyzed. In this article, a rigorous analysis of fractional variants of the least mean squares and steepest descent algorithms is performed. Some critical schematic kinks in fractional learning algorithms are identified. Their origins and consequences on the performance of the learning algorithms are discussed and swift ready-witted remedies are proposed. Apposite numerical experiments are conducted to discuss the convergence and efficiency of the fractional learning algorithms in stochastic environments.Comment: 29 pages, 6 figure

Parameter and State Estimator for State Space Models

This paper proposes a parameter and state estimator for canonical state space systems from measured input-output data. The key is to solve the system state from the state equation and to substitute it into the output equation, eliminating the state variables, and the resulting equation contains only the system inputs and outputs, and to derive a least squares parameter identification algorithm. Furthermore, the system states are computed from the estimated parameters and the input-output data. Convergence analysis using the martingale convergence theorem indicates that the parameter estimates converge to their true values. Finally, an illustrative example is provided to show that the proposed algorithm is effective

A Robust Variable Step Size Fractional Least Mean Square (RVSS-FLMS) Algorithm

In this paper, we propose an adaptive framework for the variable step size of the fractional least mean square (FLMS) algorithm. The proposed algorithm named the robust variable step size-FLMS (RVSS-FLMS), dynamically updates the step size of the FLMS to achieve high convergence rate with low steady state error. For the evaluation purpose, the problem of system identification is considered. The experiments clearly show that the proposed approach achieves better convergence rate compared to the FLMS and adaptive step-size modified FLMS (AMFLMS).Comment: 15 pages, 3 figures, 13th IEEE Colloquium on Signal Processing & its Applications (CSPA 2017

Enhanced Fractional Adaptive Processing Paradigm for Power Signal Estimation

Fractional calculus tools have been exploited to effectively model variety of engineering, physics and applied sciences problems. The concept of fractional derivative has been incorporated in the optimization process of least mean square (LMS) iterative adaptive method. This study exploits the recently introduced enhanced fractional derivative based LMS (EFDLMS) for parameter estimation of power signal formed by the combination of different sinusoids. The EFDLMS addresses the issue of fractional extreme points and provides faster convergence speed. The performance of EFDLMS is evaluated in detail by taking different levels of noise in the composite sinusoidal signal as well as considering various fractional orders in the EFDLMS. Simulation results reveal that the EDFLMS is faster in convergence speed than the conventional LMS (i.e., EFDLMS for unity fractional order)

Extended Stochastic Gradient Identification Method for Hammerstein Model Based on Approximate Least Absolute Deviation

In order to identify the parameters of nonlinear Hammerstein model which are contaminated by colored noise and peak noise, the least absolute deviation (LAD) is selected as the objective function to solve the problem of large residual square when the identification data is disturbed by the impulse noise which obeys symmetrical alpha stable (SαS) distribution. However, LAD cannot meet the need of differentiability required by most algorithms. To improve robustness and to solve the nondifferentiable problem, an approximate least absolute deviation (ALAD) objective function is established by introducing a deterministic function to replace absolute value under certain situations. The proposed method is derived from ALAD criterion and extended stochastic gradient method. Due to the differentiability of the objective function, we can get a recursive identification algorithm which is simple and easy to calculate compared with LAD. The convergence of the proposed identification method is also proved by Lyapunov stability theory, and the simulation experiments show that the proposed method has higher accuracy and stronger robustness than the least square (LS) method in the identification of Hammerstein model with colored noise and impulse noise. The impact of impulse noise can be restrained effectively

Self-tuning controllers via the state space

Imperial Users onl

Nonlinear identification and control of muscle relaxant dynamics.

The work reported in this thesis comprised two major parts which are: 1) Off-line nonlinear identification of muscle relaxant dynamics, 2) Simulation-based design of a variety of controllers (ranging from classical PID to nonlinear self-tuners) for the closed-loop control of muscle relaxation. Relaxant drugs namely, Vecuronium and Atracurium are considered throughout. Off-line identification studies, using two special nonlinear identification packages (Nonlinear Identification package and Nonlinear Orthogonal Identification package), were carried out to determine nonlinear difference equation models (NARMAX) that best fit (in the least squares sense) recorded data from trials on humans and dogs for each drug. After validation, these models were assumed to represent, in a nonlinear polynomial form, the muscle relaxant drugs pharmacology. Two different approaches were explored for determining the physiological structure of both relaxant drugs: a) The drug model to comprise a pharmacokinetics part to represent the drug distribution, and pharmacodynamics which are often modelled by using the well known Hill equation. b) A cross-correlation approach based on Volterra series. With the relaxant dynamics structure thus fixed, the work proceeded to the control phase. Simple three-term PID controllers were first designed with their parameters being optimised, off-line, using the Simplex method. The non-adaptive nature of this class of controllers makes their robustness open to question when the system parameters for which they have been optimised change. Hence adaptive controllers in the form of linear and nonlinear generalised minimum variance, self-tuners, generalised predictive and nonlinear k-step ahead predictive controllers were also considered. All these latter control approaches are shown to be satisfactory, in terms of transient and steady state performance

Improvement of Vector Autoregression (VAR) estimation using Combine White Noise (CWN) technique

Previous studies revealed that Exponential Generalized Autoregressive Conditional Heteroscedastic (EGARCH) outperformed Vector Autoregression (VAR) when data exhibit heteroscedasticity. However, EGARCH estimation is not efficient when the data have leverage effect. Therefore, in this study the weaknesses of VAR and EGARCH were modelled using Combine White Noise (CWN). The CWN model was developed by integrating the white noise of VAR with EGARCH using Bayesian Model Averaging (BMA) for the improvement of VAR estimation. First, the standardized residuals of EGARCH errors (heteroscedastic variance) were decomposed into equal variances and defined as white noise series. Next, this series was transformed into CWN model through BMA. The CWN was validated using comparison study based on simulation and four countries real data sets of Gross Domestic Product (GDP). The data were simulated by incorporating three sample sizes with low, moderate and high values of leverages and skewness. The CWN model was compared with three existing models (VAR, EGARCH and Moving Average (MA)). Standard error, log-likelihood, information criteria and forecast error measures were used to evaluate the performance of the models. The simulation findings showed that CWN outperformed the three models when using sample size of 200 with high leverage and moderate skewness. Similar results were obtained for the real data sets where CWN outperformed the three models with high leverage and moderate skewness using France GDP. The CWN also outperformed the three models when using the other three countries GDP data sets. The CWN was the most accurate model of about 70 percent as compared with VAR, EGARCH and MA models. These simulated and real data findings indicate that CWN are more accurate and provide better alternative to model heteroscedastic data with leverage effect

Developing models for the data-based mechanistic approach to systems analysis:Increasing objectivity and reducing assumptions

Stochastic State-Space Time-Varying Random Walk models have been developed, allowing the existing Stochastic State Space models to operate directly on irregularly sampled time-series. These TVRW models have been successfully applied to two different classes of models benefiting each class in different ways. The first class of models - State Dependent Parameter (SDP) models and used to investigate the dominant dynamic modes of nonlinear dynamic systems and the non-linearities in these models affected by arbitrary State Variables. In SDP locally linearised models it is assumed that the parameters that describe system’s behaviour changes are dependent upon some aspect of the system (it’s ‘state’). Each parameter can be dependent on one or more states. To estimate the parameters that are changing at a rate related to that of it’s states, the estimation procedure is conducted in the state-space along the potentially multivariate trajectory of the states which drive the parameters. The introduction of the newly developed TVRW models significantly improves parameter estimation, particularly in data rich neighbourhoods of the state-space when the parameter is dependent on more than one state, and the ends of the data-series when the parameter is dependent on one state with few data points. The second class of models are known as Dynamic Harmonic Regression (DHR) models and are used to identify the dominant cycles and trends of time-series. DHR models the assumption is that a signal (such as a time-series) can be broken down into four (unobserved) components occupying different parts of the spectrum: trend, seasonal cycle, other cycles, and a high frequency irregular component. DHR is confined to uniformly sampled time-series. The introduction of the TVRW models allows DHR to operate on irregularly sampled time-series, with the added benefit of forecasting origin no longer being confined to starting at the end of the time-series but can now begin at any point in the future. Additionally, the forecasting sampling rate is no longer limited to the sampling rate of the time-series. Importantly, both classes of model were designed to follow the Data-Based Mechanistic (DBM) approach to modelling environmental systems, where the model structure and parameters are to be determined by the data (Data-Based) and then the subsequent models are to be validated based on their physical interpretation (Mechanistic). The aim is to remove the researcher’s preconceptions from model development in order to eliminate any bias, and then use the researcher’s knowledge to validate the models presented to them. Both classes of model lacked model structure identification procedures and so model structure was determined by the researcher, against the DBM approach. Two different model structure identification procedures, one for SDP and the other for DHR, were developed to bring both classes of models back within the DBM framework. These developments have been presented and tested here on both simulated data and real environmental data, demonstrating their importance, benefits and role in environmental modelling and exploratory data analysis