Nonlinear system modeling based on constrained Volterra series estimates

A simple nonlinear system modeling algorithm designed to work with limited \emph{a priori }knowledge and short data records, is examined. It creates an empirical Volterra series-based model of a system using an $l_{q}$-constrained least squares algorithm with $q\geq 1$. If the system $m\left( \cdot \right)$ is a continuous and bounded map with a finite memory no longer than some known $\tau$, then (for a $D$ parameter model and for a number of measurements $N$) the difference between the resulting model of the system and the best possible theoretical one is guaranteed to be of order $\sqrt{N^{-1}\ln D}$, even for $D\geq N$. The performance of models obtained for $q=1,1.5$ and $2$ is tested on the Wiener-Hammerstein benchmark system. The results suggest that the models obtained for $q>1$ are better suited to characterize the nature of the system, while the sparse solutions obtained for $q=1$ yield smaller error values in terms of input-output behavior

Frequency identification of Wiener systems with Backlash operators using separable least squares estimators

This paper deals with the identification of Wiener models that involve backlash operators bordered by possibly noninvertible parametric lines. The latter are also allowed to cross each other making possible to account for general-shape static nonlinearities. The linear dynamic subsystem is not-necessarily parametric but is BIBO stable. A frequency identification method is developed that provides estimates of the nonlinear operator parameters as well as estimates of the linear subsystem frequency gain. The method involves standard and separable least squares estimators that all are shown to be consistent. Backlash operators and memoryless nonlinearities are handled within a unified framework.Preprin

Sparse Nonlinear MIMO Filtering and Identification

In this chapter system identification algorithms for sparse nonlinear multi input multi output (MIMO) systems are developed. These algorithms are potentially useful in a variety of application areas including digital transmission systems incorporating power amplifier(s) along with multiple antennas, cognitive processing, adaptive control of nonlinear multivariable systems, and multivariable biological systems. Sparsity is a key constraint imposed on the model. The presence of sparsity is often dictated by physical considerations as in wireless fading channel-estimation. In other cases it appears as a pragmatic modelling approach that seeks to cope with the curse of dimensionality, particularly acute in nonlinear systems like Volterra type series. Three dentification approaches are discussed: conventional identification based on both input and output samples, semi–blind identification placing emphasis on minimal input resources and blind identification whereby only output samples are available plus a–priori information on input characteristics. Based on this taxonomy a variety of algorithms, existing and new, are studied and evaluated by simulation

System identification of a class of Wiener systems with hysteretic nonlinearities

Existing works on Wiener system identification have essentially been focused on the case where the output nonlinearity is memoryless. When memory nonlinearities have been considered, the focus has been restricted to backlash like nonlinearities. In this paper, we are considering Wiener systems where the output nonlinearity is a general hysteresis operator captured by the well-known Bouc-Wen model. The Wiener system identification problem is addressed by making use of a steady-state property, obtained in periodic regime, referred to as hysteretic loop assumption'. The complexity of this problem comes from the system nonlinearity as well as its unknown parameters that enter in a non-affine way in the model. It is shown that the linear part of the system is accurately identified using a frequency method. Then, the nonlinear hysteretic subsystem is identified, on the basis of a parameterized representation, using a prediction-error approach.Postprint (author's final draft

Modeling of soot emission for heavy-duty diesel engines in transient operation

The soot emissions from diesel engines are much higher in transient operation than during steady state operation. In this thesis, a method for estimating the soot mass flow emission in transient drive cycles is presented. The proposed method uses stationary emission maps in combination with step responses. Bandpass filters are used to filter the engine torque/power to provide transient detection and quantification. The final estimation method combines the stationary emission map and the bandpass filtered signals with correction parameters determined by the step responses. Good results were obtained for the World Harmonized Transient Cycle (WHTC). Black box modeling was also conducted for the soot mass flow emission. The fitted models take two inputs: injected fuel mass per cycle and equivalence ratio. Linear models as well as nonlinear models were identified with the best results obtained for a nonlinear (Wiener) model. The best model had a fit of 95 % in accumulated soot mass emitted as a function of integrated power in the WHTC cycle. The system identification was performed using data from the first half of a WHTC cycle and validation was conducted using the whole cycle

Adaptation and learning over networks for nonlinear system modeling

In this chapter, we analyze nonlinear filtering problems in distributed environments, e.g., sensor networks or peer-to-peer protocols. In these scenarios, the agents in the environment receive measurements in a streaming fashion, and they are required to estimate a common (nonlinear) model by alternating local computations and communications with their neighbors. We focus on the important distinction between single-task problems, where the underlying model is common to all agents, and multitask problems, where each agent might converge to a different model due to, e.g., spatial dependencies or other factors. Currently, most of the literature on distributed learning in the nonlinear case has focused on the single-task case, which may be a strong limitation in real-world scenarios. After introducing the problem and reviewing the existing approaches, we describe a simple kernel-based algorithm tailored for the multitask case. We evaluate the proposal on a simulated benchmark task, and we conclude by detailing currently open problems and lines of research.Comment: To be published as a chapter in `Adaptive Learning Methods for Nonlinear System Modeling', Elsevier Publishing, Eds. D. Comminiello and J.C. Principe (2018

System approach to robust acoustic echo cancellation through semi-blind source separation based on independent component analysis

We live in a dynamic world full of noises and interferences. The conventional acoustic echo cancellation (AEC) framework based on the least mean square (LMS) algorithm by itself lacks the ability to handle many secondary signals that interfere with the adaptive filtering process, e.g., local speech and background noise. In this dissertation, we build a foundation for what we refer to as the system approach to signal enhancement as we focus on the AEC problem. We first propose the residual echo enhancement (REE) technique that utilizes the error recovery nonlinearity (ERN) to "enhances" the filter estimation error prior to the filter adaptation. The single-channel AEC problem can be viewed as a special case of semi-blind source separation (SBSS) where one of the source signals is partially known, i.e., the far-end microphone signal that generates the near-end acoustic echo. SBSS optimized via independent component analysis (ICA) leads to the system combination of the LMS algorithm with the ERN that allows for continuous and stable adaptation even during double talk. Second, we extend the system perspective to the decorrelation problem for AEC, where we show that the REE procedure can be applied effectively in a multi-channel AEC (MCAEC) setting to indirectly assist the recovery of lost AEC performance due to inter-channel correlation, known generally as the "non-uniqueness" problem. We develop a novel, computationally efficient technique of frequency-domain resampling (FDR) that effectively alleviates the non-uniqueness problem directly while introducing minimal distortion to signal quality and statistics. We also apply the system approach to the multi-delay filter (MDF) that suffers from the inter-block correlation problem. Finally, we generalize the MCAEC problem in the SBSS framework and discuss many issues related to the implementation of an SBSS system. We propose a constrained batch-online implementation of SBSS that stabilizes the convergence behavior even in the worst case scenario of a single far-end talker along with the non-uniqueness condition on the far-end mixing system. The proposed techniques are developed from a pragmatic standpoint, motivated by real-world problems in acoustic and audio signal processing. Generalization of the orthogonality principle to the system level of an AEC problem allows us to relate AEC to source separation that seeks to maximize the independence, hence implicitly the orthogonality, not only between the error signal and the far-end signal, but rather, among all signals involved. The system approach, for which the REE paradigm is just one realization, enables the encompassing of many traditional signal enhancement techniques in analytically consistent yet practically effective manner for solving the enhancement problem in a very noisy and disruptive acoustic mixing environment.PhDCommittee Chair: Biing-Hwang Juang; Committee Member: Brani Vidakovic; Committee Member: David V. Anderson; Committee Member: Jeff S. Shamma; Committee Member: Xiaoli M