Towards Efficient Maximum Likelihood Estimation of LPV-SS Models

How to efficiently identify multiple-input multiple-output (MIMO) linear parameter-varying (LPV) discrete-time state-space (SS) models with affine dependence on the scheduling variable still remains an open question, as identification methods proposed in the literature suffer heavily from the curse of dimensionality and/or depend on over-restrictive approximations of the measured signal behaviors. However, obtaining an SS model of the targeted system is crucial for many LPV control synthesis methods, as these synthesis tools are almost exclusively formulated for the aforementioned representation of the system dynamics. Therefore, in this paper, we tackle the problem by combining state-of-the-art LPV input-output (IO) identification methods with an LPV-IO to LPV-SS realization scheme and a maximum likelihood refinement step. The resulting modular LPV-SS identification approach achieves statical efficiency with a relatively low computational load. The method contains the following three steps: 1) estimation of the Markov coefficient sequence of the underlying system using correlation analysis or Bayesian impulse response estimation, then 2) LPV-SS realization of the estimated coefficients by using a basis reduced Ho-Kalman method, and 3) refinement of the LPV-SS model estimate from a maximum-likelihood point of view by a gradient-based or an expectation-maximization optimization methodology. The effectiveness of the full identification scheme is demonstrated by a Monte Carlo study where our proposed method is compared to existing schemes for identifying a MIMO LPV system

Identification of linear periodically time-varying (LPTV) systems

A linear periodically time-varying (LPTV) system is a linear time-varying system with the coefficients changing periodically, which is widely used in control, communications, signal processing, and even circuit modeling. This thesis concentrates on identification of LPTV systems. To this end, the representations of LPTV systems are thoroughly reviewed. Identification methods are developed accordingly. The usefulness of the proposed identification methods is verified by the simulation results. A periodic input signal is applied to a finite impulse response (FIR)-LPTV system and measure the noise-contaminated output. Using such periodic inputs, we show that we can formulate the problem of identification of LPTV systems in the frequency domain. With the help of the discrete Fourier transform (DFT), the identification method reduces to finding the least-squares (LS) solution of a set of linear equations. A sufficient condition for the identifiability of LPTV systems is given, which can be used to find appropriate inputs for the purpose of identification. In the frequency domain, we show that the input and the output can be related by using the discrete Fourier transform (DFT) and a least-squares method can be used to identify the alias components. A lower bound on the mean square error (MSE) of the estimated alias components is given for FIR-LPTV systems. The optimal training signal achieving this lower MSE bound is designed subsequently. The algorithm is extended to the identification of infinite impulse response (IIR)-LPTV systems as well. Simulation results show the accuracy of the estimation and the efficiency of the optimal training signal design

Performance analysis of low-flux least-squares single-pixel imaging

A single-pixel camera is able to computationally form spatially resolved images using one photodetector and a spatial light modulator. The images it produces in low-light-level operation are imperfect, even when the number of measurements exceeds the number of pixels, because its photodetection measurements are corrupted by Poisson noise. Conventional performance analysis for single-pixel imaging generates estimates of mean-square error (MSE) from Monte Carlo simulations, which require long computational times. In this letter, we use random matrix theory to develop a closed-form approximation to the MSE of the widely used least-squares inversion method for Poisson noise-limited single-pixel imaging. We present numerical experiments that validate our approximation and a motivating example showing how our framework can be used to answer practical optical design questions for a single-pixel camera.This work was supported in part by the Samsung Scholarship and in part by the US National Science Foundation under Grant 1422034. (Samsung Scholarship; 1422034 - US National Science Foundation)Accepted manuscrip

Fractional biorthogonal partners in channel equalization and signal interpolation

The concept of biorthogonal partners has been introduced recently by the authors. The work presented here is an extension of some of these results to the case where the upsampling and downsampling ratios are not integers but rational numbers, hence, the name fractional biorthogonal partners. The conditions for the existence of stable and of finite impulse response (FIR) fractional biorthogonal partners are derived. It is also shown that the FIR solutions (when they exist) are not unique. This property is further explored in one of the applications of fractional biorthogonal partners, namely, the fractionally spaced equalization in digital communications. The goal is to construct zero-forcing equalizers (ZFEs) that also combat the channel noise. The performance of these equalizers is assessed through computer simulations. Another application considered is the all-FIR interpolation technique with the minimum amount of oversampling required in the input signal. We also consider the extension of the least squares approximation problem to the setting of fractional biorthogonal partners