The design of periodic excitations for dynamic system identification

System identification techniques are developed for modelling linear and nonlinear systems. The main results of the work are concerned with the design and utilisation of periodic perturbation signals in general areas of time- and frequency-domain system identification. A design strategy is given for a new class of perturbation signals, together with examples of their use in system identification applications. Signal processing procedures are developed for the practical treatment of drift disturbances and transient effects, and also for the detection of nonlinear contributions to the measurement data. The techniques rely completely on the periodicity of the excitation, and so the advantageous properties of periodic input signals are considered in detail. The use of periodic excitations in discrete- and continuous-time nonlinear system identification is also reported, with the identification methods illustrating the worth of frequency-domain measurements in this area. An automatic tuning procedure for PID controllers is also developed, which illustrates an application of system identification techniques to control problems

Study of the best linear approximation of nonlinear systems with arbitrary inputs

System identification is the art of modelling of a process (physical, biological, etc.) or to predict its behaviour or output when the environment condition or parameter changes. One is modelling the input-output relationship of a system, for example, linking temperature of a greenhouse (output) to the sunlight intensity (input), power of a car engine (output) with fuel injection rate (input). In linear systems, changing an input parameter will result in a proportional increase in the system output. This is not the case in a nonlinear system. Linear system identification has been extensively studied, more so than nonlinear system identification. Since most systems are nonlinear to some extent, there is significant interest in this topic as industrial processes become more and more complex. In a linear dynamical system, knowing the impulse response function of a system will allow one to predict the output given any input. For nonlinear systems this is not the case. If advanced theory is not available, it is possible to approximate a nonlinear system by a linear one. One tool is the Best Linear Approximation (Bla), which is an impulse response function of a linear system that minimises the output differences between its nonlinear counterparts for a given class of input. The Bla is often the starting point for modelling a nonlinear system. There is extensive literature on the Bla obtained from input signals with a Gaussian probability density function (p.d.f.), but there has been very little for other kinds of inputs. A Bla estimated from Gaussian inputs is useful in decoupling the linear dynamics from the nonlinearity, and in initialisation of parameterised models. As Gaussian inputs are not always practical to be introduced as excitations, it is important to investigate the dependence of the Bla on the amplitude distribution in more detail. This thesis studies the behaviour of the Bla with regards to other types of signals, and in particular, binary sequences where a signal takes only two levels. Such an input is valuable in many practical situations, for example where the input actuator is a switch or a valve and hence can only be turned either on or off. While it is known in the literature that the Bla depends on the amplitude distribution of the input, as far as the author is aware, there is a lack of comprehensive theoretical study on this topic. In this thesis, the Blas of discrete-time time-invariant nonlinear systems are studied theoretically for white inputs with an arbitrary amplitude distribution, including Gaussian and binary sequences. In doing so, the thesis offers answers to fundamental questions of interest to system engineers, for example: 1) How the amplitude distribution of the input and the system dynamics affect the Bla? 2) How does one quantify the difference between the Bla obtained from a Gaussian input and that obtained from an arbitrary input? 3) Is the difference (if any) negligible? 4) What can be done in terms of experiment design to minimise such difference? To answer these questions, the theoretical expressions for the Bla have been developed for both Wiener-Hammerstein (Wh) systems and the more general Volterra systems. The theory for the Wh case has been verified by simulation and physical experiments in Chapter 3 and Chapter 6 respectively. It is shown in Chapter 3 that the difference between the Gaussian and non-Gaussian Bla’s depends on the system memory as well as the higher order moments of the non-Gaussian input. To quantify this difference, a measure called the Discrepancy Factor—a measure of relative error, was developed. It has been shown that when the system memory is short, the discrepancy can be as high as 44.4%, which is not negligible. This justifies the need for a method to decrease such discrepancy. One method is to design a random multilevel sequence for Gaussianity with respect to its higher order moments, and this is discussed in Chapter 5. When estimating the Bla even in the absence of environment and measurement noise, the nonlinearity inevitably introduces nonlinear distortions—deviations from the Bla specific to the realisation of input used. This also explains why more than one realisation of input and averaging is required to obtain a good estimate of the Bla. It is observed that with a specific class of pseudorandom binary sequence (Prbs), called the maximum length binary sequence (Mlbs or the m-sequence), the nonlinear distortions appear structured in the time domain. Chapter 4 illustrates a simple and computationally inexpensive method to take advantage this structure to obtain better estimates of the Bla—by replacing mean averaging by median averaging. Lastly, Chapters 7 and 8 document two independent benchmark studies separate from the main theoretical work of the thesis. The benchmark in Chapter 7 is concerned with the modelling of an electrical Wh system proposed in a special session of the 15th International Federation of Automatic Control (Ifac) Symposium on System Identification (Sysid) 2009 (Schoukens, Suykens & Ljung, 2009). Chapter 8 is concerned with the modelling of a ‘hyperfast’ Peltier cooling system first proposed in the U.K. Automatic Control Council (Ukacc) International Conference on Control, 2010 (Control 2010)

Identification of nonlinear processes based on Wiener-Hammerstein models and heuristic optimization.

[ES] En muchos campos de la ingeniería los modelos matemáticos son utilizados para describir el comportamiento de los sistemas, procesos o fenómenos. Hoy en día, existen varias técnicas o métodos que pueden ser usadas para obtener estos modelos. Debido a su versatilidad y simplicidad, a menudo se prefieren los métodos de identificación de sistemas. Por lo general, estos métodos requieren la definición de una estructura y la estimación computacional de los parámetros que la componen utilizando un conjunto de procedimientos y mediciones de las señales de entrada y salida del sistema. En el contexto de la identificación de sistemas no lineales, un desafío importante es la selección de la estructura. En el caso de que el sistema a identificar presente una no linealidad de tipo estático, los modelos orientados a bloques, pueden ser útiles para definir adecuadamente una estructura. Sin embargo, el diseñador puede enfrentarse a cierto grado de incertidumbre al seleccionar el modelo orientado a bloques adecuado en concordancia con el sistema real. Además de este inconveniente, se debe tener en cuenta que la estimación de algunos modelos orientados a bloques no es sencilla, como es el caso de los modelos de Wiener-Hammerstein que consisten en un bloque NL en medio de dos subsistemas LTI. La presencia de dos subsistemas LTI en los modelos de Wiener-Hammerstein es lo que principalmente dificulta su estimación. Generalmente, el procedimiento de identificación comienza con la estimación de la dinámica lineal, y el principal desafío es dividir esta dinámica entre los dos bloques LTI. Por lo general, esto implica una alta interacción del usuario para desarrollar varios procedimientos, y el modelo final estimado depende principalmente de estas etapas previas. El objetivo de esta tesis es contribuir a la identificación de los modelos de Wiener-Hammerstein. Esta contribución se basa en la presentación de dos nuevos algoritmos para atender aspectos específicos que no han sido abordados en la identificación de este tipo de modelos. El primer algoritmo, denominado WH-EA, permite estimar todos los parámetros de un modelo de Wiener-Hammerstein con un solo procedimiento a partir de un modelo dinámico lineal. Con WH-EA, una buena estimación no depende de procedimientos intermedios ya que el algoritmo evolutivo simultáneamente busca la mejor distribución de la dinámica, ajusta con precisión la ubicación de los polos y los ceros y captura la no linealidad estática. Otra ventaja importante de este algoritmo es que bajo consideraciones específicas y utilizando una señal de excitación adecuada, es posible crear un enfoque unificado que permite también la identificación de los modelos de Wiener y Hammerstein, que son casos particulares del modelo de Wiener-Hammerstein cuando uno de sus bloques LTI carece de dinámica. Lo interesante de este enfoque unificado es que con un mismo algoritmo es posible identificar los modelos de Wiener, Hammerstein y Wiener-Hammerstein sin que el usuario especifique de antemano el tipo de estructura a identificar. El segundo algoritmo llamado WH-MOEA, permite abordar el problema de identificación como un Problema de Optimización Multiobjetivo (MOOP). Sobre la base de este algoritmo se presenta un nuevo enfoque para la identificación de los modelos de Wiener-Hammerstein considerando un compromiso entre la precisión alcanzada y la complejidad del modelo. Con este enfoque es posible comparar varios modelos con diferentes prestaciones incluyendo como un objetivo de identificación el número de parámetros que puede tener el modelo estimado. El aporte de este enfoque se sustenta en el hecho de que en muchos problemas de ingeniería los requisitos de diseño y las preferencias del usuario no siempre apuntan a la precisión del modelo como un único objetivo, sino que muchas veces la complejidad es también un factor predominante en la toma de decisiones.[CA] En molts camps de l'enginyeria els models matemàtics són utilitzats per a descriure el comportament dels sistemes, processos o fenòmens. Hui dia, existeixen diverses tècniques o mètodes que poden ser usades per a obtindre aquests models. A causa de la seua versatilitat i simplicitat, sovint es prefereixen els mètodes d'identificació de sistemes. En general, aquests mètodes requereixen la definició d'una estructura i l'estimació computacional dels paràmetres que la componen utilitzant un conjunt de procediments i mesuraments dels senyals d'entrada i eixida del sistema. En el context de la identificació de sistemes no lineals, un desafiament important és la selecció de l'estructura. En el cas que el sistema a identificar presente una no linealitat de tipus estàtic, els models orientats a blocs, poden ser útils per a definir adequadament una estructura. No obstant això, el dissenyador pot enfrontar-se a cert grau d'incertesa en seleccionar el model orientat a blocs adequat en concordança amb el sistema real. A més d'aquest inconvenient, s'ha de tindre en compte que l'estimació d'alguns models orientats a blocs no és senzilla, com és el cas dels models de Wiener-Hammerstein que consisteixen en un bloc NL enmig de dos subsistemes LTI. La presència de dos subsistemes LTI en els models de Wiener-Hammerstein és el que principalment dificulta la seua estimació. Generalment, el procediment d'identificació comença amb l'estimació de la dinàmica lineal, i el principal desafiament és dividir aquesta dinàmica entre els dos blocs LTI. En general, això implica una alta interacció de l'usuari per a desenvolupar diversos procediments, i el model final estimat depén principalment d'aquestes etapes prèvies. L'objectiu d'aquesta tesi és contribuir a la identificació dels models de Wiener-Hammerstein. Aquesta contribució es basa en la presentació de dos nous algorismes per a atendre aspectes específics que no han sigut adreçats en la identificació d'aquesta mena de models. El primer algorisme, denominat WH-EA (Algorisme Evolutiu per a la identificació de sistemes de Wiener-Hammerstein), permet estimar tots els paràmetres d'un model de Wiener-Hammerstein amb un sol procediment a partir d'un model dinàmic lineal. Amb WH-EA, una bona estimació no depén de procediments intermedis ja que l'algorisme evolutiu simultàniament busca la millor distribució de la dinàmica, afina la ubicació dels pols i els zeros i captura la no linealitat estàtica. Un altre avantatge important d'aquest algorisme és que sota consideracions específiques i utilitzant un senyal d'excitació adequada, és possible crear un enfocament unificat que permet també la identificació dels models de Wiener i Hammerstein, que són casos particulars del model de Wiener-Hammerstein quan un dels seus blocs LTI manca de dinàmica. L'interessant d'aquest enfocament unificat és que amb un mateix algorisme és possible identificar els models de Wiener, Hammerstein i Wiener-Hammerstein sense que l'usuari especifique per endavant el tipus d'estructura a identificar. El segon algorisme anomenat WH-MOEA (Algorisme evolutiu multi-objectiu per a la identificació de models de Wiener-Hammerstein), permet abordar el problema d'identificació com un Problema d'Optimització Multiobjectiu (MOOP). Sobre la base d'aquest algorisme es presenta un nou enfocament per a la identificació dels models de Wiener-Hammerstein considerant un compromís entre la precisió aconseguida i la complexitat del model. Amb aquest enfocament és possible comparar diversos models amb diferents prestacions incloent com un objectiu d'identificació el nombre de paràmetres que pot tindre el model estimat. L'aportació d'aquest enfocament se sustenta en el fet que en molts problemes d'enginyeria els requisits de disseny i les preferències de l'usuari no sempre apunten a la precisió del model com un únic objectiu, sinó que moltes vegades la complexitat és també un factor predominant en la presa de decisions.[EN] In several engineering fields, mathematical models are used to describe the behaviour of systems, processes or phenomena. Nowadays, there are several techniques or methods for obtaining mathematical models. Because of their versatility and simplicity, system identification methods are often preferred. Generally, systems identification methods require defining a structure and estimating computationally the parameters that make it up, using a set of procedures y measurements of the system's input and output signals. In the context of nonlinear system identification, a significant challenge is the structure selection. In the case that the system to be identified presents a static type of nonlinearity, block-oriented models can be useful to define a suitable structure. However, the designer may face a certain degree of uncertainty when selecting the block-oriented model in accordance with the real system. In addition to this inconvenience, the estimation of some block-oriented models is not an easy task, as is the case with the Wiener-Hammerstein models consisting of a NL block in the middle of two LTI subsystems. The presence of two LTI subsystems in the Wiener-Hammerstein models is what mainly makes their estimation difficult. Generally, the identification procedure begins with the estimation of the linear dynamics, and the main challenge is to split this dynamic between the two LTI block. Usually, this implies a high user interaction to develop several procedures, and the final model estimated mostly depends on these previous stages. The aim of this thesis is to contribute to the identification of the Wiener-Hammerstein models. This contribution is based on the presentation of two new algorithms to address specific aspects that have not been addressed in the identification of this type of model. The first algorithm, called WH-EA (An Evolutionary Algorithm for Wiener-Hammerstein System Identification), allows estimating all the parameters of a Wiener-Hammerstein model with a single procedure from a linear dynamic model. With WH-EA, a good estimate does not depend on intermediate procedures since the evolutionary algorithm looks for the best dynamic division, while the locations of the poles and zeros are fine-tuned, and nonlinearity is captured simultaneously. Another significant advantage of this algorithm is that under specific considerations and using a suitable excitation signal; it is possible to create a unified approach that also allows the identification of Wiener and Hammerstein models which are particular cases of the Wiener-Hammerstein model when one of its LTI blocks lacks dynamics. What is interesting about this unified approach is that with the same algorithm, it is possible to identify Wiener, Hammerstein, and Wiener-Hammerstein models without the user specifying in advance the type of structure to be identified. The second algorithm called WH-MOEA (Multi-objective Evolutionary Algorithm for Wiener-Hammerstein identification), allows to address the identification problem as a Multi-Objective Optimisation Problem (MOOP). Based on this algorithm, a new approach for the identification of Wiener-Hammerstein models is presented considering a compromise between the accuracy achieved and the model complexity. With this approach, it is possible to compare several models with different performances, including as an identification target the number of parameters that the estimated model may have. The contribution of this approach is based on the fact that in many engineering problems the design requirements and user's preferences do not always point to the accuracy of the model as a single objective, but many times the complexity is also a predominant factor in decision-making.Zambrano Abad, JC. (2021). Identification of nonlinear processes based on Wiener-Hammerstein models and heuristic optimization [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/171739TESI

Nonlinear models and algorithms for RF systems digital calibration

Focusing on the receiving side of a communication system, the current trend in pushing the digital domain ever more closer to the antenna sets heavy constraints on the accuracy and linearity of the analog front-end and the conversion devices. Moreover, mixed-signal implementations of Systems-on-Chip using nanoscale CMOS processes result in an overall poorer analog performance and a reduced yield. To cope with the impairments of the low performance analog section in this "dirty RF" scenario, two solutions exist: designing more complex analog processing architectures or to identify the errors and correct them in the digital domain using DSP algorithms. In the latter, constraints in the analog circuits' precision can be offloaded to a digital signal processor. This thesis aims at the development of a methodology for the analysis, the modeling and the compensation of the analog impairments arising in different stages of a receiving chain using digital calibration techniques. Both single and multiple channel architectures are addressed exploiting the capability of the calibration algorithm to homogenize all the channels' responses of a multi-channel system in addition to the compensation of nonlinearities in each response. The systems targeted for the application of digital post compensation are a pipeline ADC, a digital-IF sub-sampling receiver and a 4-channel TI-ADC. The research focuses on post distortion methods using nonlinear dynamic models to approximate the post-inverse of the nonlinear system and to correct the distortions arising from static and dynamic errors. Volterra model is used due to its general approximation capabilities for the compensation of nonlinear systems with memory. Digital calibration is applied to a Sample and Hold and to a pipeline ADC simulated in the 45nm process, demonstrating high linearity improvement even with incomplete settling errors enabling the use of faster clock speeds. An extended model based on the baseband Volterra series is proposed and applied to the compensation of a digital-IF sub-sampling receiver. This architecture envisages frequency selectivity carried out at IF by an active band-pass CMOS filter causing in-band and out-of-band nonlinear distortions. The improved performance of the proposed model is demonstrated with circuital simulations of a 10th-order band pass filter, realized using a five-stage Gm-C Biquad cascade, and validated using out-of-sample sinusoidal and QAM signals. The same technique is extended to an array receiver with mismatched channels' responses showing that digital calibration can compensate the loss of directivity and enhance the overall system SFDR. An iterative backward pruning is applied to the Volterra models showing that complexity can be reduced without impacting linearity, obtaining state-of-the-art accuracy/complexity performance. Calibration of Time-Interleaved ADCs, widely used in RF-to-digital wideband receivers, is carried out developing ad hoc models because the steep discontinuities generated by the imperfect canceling of aliasing would require a huge number of terms in a polynomial approximation. A closed-form solution is derived for a 4-channel TI-ADC affected by gain errors and timing skews solving the perfect reconstruction equations. A background calibration technique is presented based on cyclo-stationary filter banks architecture. Convergence speed and accuracy of the recursive algorithm are discussed and complexity reduction techniques are applied

Feedback for neuronal system identification

In order to estimate reliable models from noisy input-output data, system identification techniques usually require that the data be generated by a process with a fading memory. Non-equilibrium systems such as neuronal and chaotic models lack a fading memory. Their identification is challenging, in particular in the presence of input noise. In this thesis, we propose a methodology based on the prediction-error method for the identification of neuronal systems subject to input-additive noise. We build on the fundamental observation that while a neuronal model does not have a fading memory, it can be transformed into a fading memory system by output feedback. Our ideas can be generalized to any non-equilibrium system sharing this property. At the core of the methodology is the use of output feedback in experiment design. We provide a theoretical justification for this design choice, which has been exploited in neurophysiology since the invention of the voltage-clamp experiment. To investigate the problem of feedback for identification, we first address the estimation of simple non-equilibrium systems in Lure form, and show that feedback allows estimating the nonlinearity in a static experiment. We then address the estimation of conductance-based models. Assuming that an informed choice can be made on the elements of the model structure, we show that consistent parameter estimates can be obtained when noise is only present at the system input. Finally, we approach the problem from a black-box perspective, and propose identifying the neuronal internal dynamics using a universal approximator with Generalized Orthogonal Basis Functions.Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) – Brasil (Finance Code 001