Regularized Covariance Matrix Estimation in Complex Elliptically Symmetric Distributions Using the Expected Likelihood Approach - Part 2: The Under-Sampled Case

In the first part of this series of two papers, we extended the expected likelihood approach originally developed in the Gaussian case, to the broader class of complex elliptically symmetric (CES) distributions and complex angular central Gaussian (ACG) distributions. More precisely, we demonstrated that the probability density function (p.d.f.) of the likelihood ratio (LR) for the (unknown) actual scatter matrix \mSigma_{0} does not depend on the latter: it only depends on the density generator for the CES distribution and is distribution-free in the case of ACG distributed data, i.e., it only depends on the matrix dimension $M$ and the number of independent training samples $T$, assuming that $T \geq M$. Additionally, regularized scatter matrix estimates based on the EL methodology were derived. In this second part, we consider the under-sampled scenario ($T \leq M$) which deserves a specific treatment since conventional maximum likelihood estimates do not exist. Indeed, inference about the scatter matrix can only be made in the $T$-dimensional subspace spanned by the columns of the data matrix. We extend the results derived under the Gaussian assumption to the CES and ACG class of distributions. Invariance properties of the under-sampled likelihood ratio evaluated at \mSigma_{0} are presented. Remarkably enough, in the ACG case, the p.d.f. of this LR can be written in a rather simple form as a product of beta distributed random variables. The regularized schemes derived in the first part, based on the EL principle, are extended to the under-sampled scenario and assessed through numerical simulations

GLRT-based threshold detection-estimation performance improvement and application to uniform circular antenna arrays

©2006 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE."This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder."The problem of estimating the number of independent Gaussian sources and their parameters impinging upon an antenna array is addressed for scenarios that are problematic for standard techniques, namely, under "threshold conditions" (where subspace techniques such as MUSIC experience an abrupt and dramatic performance breakdown). We propose an antenna geometry-invariant method that adopts the generalized-likelihood-ratio test (GLRT) methodology, supported by a maximum-likelihood-ratio lower-bound analysis that allows erroneous solutions ("outliers") to be found and rectified. Detection-estimation performance in both uniform circular and linear antenna arrays is shown to be significantly improved compared with conventional techniques but limited by the performance-breakdown phenomenon that is intrinsic to all such maximum-likelihood (ML) techniques.Yuri I. Abramovich, Nicholas K. Spencer, and Alexei Y. Gorokho

Regularized Covariance Matrix Estimation in Complex Elliptically Symmetric Distributions Using the Expected Likelihood Approach - Part 1: The Over-Sampled Case

In \cite{Abramovich04}, it was demonstrated that the likelihood ratio (LR) for multivariate complex Gaussian distribution has the invariance property that can be exploited in many applications. Specifically, the probability density function (p.d.f.) of this LR for the (unknown) actual covariance matrix $\R_{0}$ does not depend on this matrix and is fully specified by the matrix dimension $M$ and the number of independent training samples $T$. Since this p.d.f. could therefore be pre-calculated for any a priori known $(M,T)$, one gets a possibility to compare the LR of any derived covariance matrix estimate against this p.d.f., and eventually get an estimate that is statistically ``as likely'' as the a priori unknown actual covariance matrix. This ``expected likelihood'' (EL) quality assessment allows for significant improvement of MUSIC DOA estimation performance in the so-called ``threshold area'' \cite{Abramovich04,Abramovich07d}, and for diagonal loading and TVAR model order selection in adaptive detectors \cite{Abramovich07,Abramovich07b}. Recently, a broad class of the so-called complex elliptically symmetric (CES) distributions has been introduced for description of highly in-homogeneous clutter returns. The aim of this series of two papers is to extend the EL approach to this class of CES distributions as well as to a particularly important derivative of CES, namely the complex angular central distribution (ACG). For both cases, we demonstrate a similar invariance property for the LR associated with the true scatter matrix \mSigma_{0}. Furthermore, we derive fixed point regularized covariance matrix estimates using the generalized expected likelihood methodology. This first part is devoted to the conventional scenario ($T \geq M$) while Part 2 deals with the under-sampled scenario ($T \leq M$)

MSE lower bounds for deterministic parameter estimation

This paper presents a simple approach for deriving computable lower bounds on the MSE of deterministic parameter estimators with a clear interpretation of the bounds. We also address the issue of lower bounds tightness in comparison with the MSE of ML estimators and their ability to predict the SNR threshold region. Last, as many practical estimation problems must be regarded as joint detection-estimation problems, we remind that the estimation performance must be conditional on detection performance

On the influence of detection tests on deterministic parameters estimation

In non-linear estimation problems three distinct regions of operation can be observed. In the asymptotic region, the Mean Square Error (MSE) of Maximum Likelihood Estimators (MLE) is small and, in many cases,close to the Cramer-Rao bound (CRB). In the a priory performance region where the number of independent snapshots and/or the SNR are very low, the MSE is close to that obtained from the prior knowledge about the problem. Between these two extremes, there is an additional transition region where MSE of estimators deteriorates with respect to CRB. The present paper provides exemples of improvement of MSE prediction by CRB, not only in the transition region but also in the a priori region, resulting from introduction of a detection step, which proves that this renement in MSE lower bounds derivation is worth investigating

Performance Bounds for Parameter Estimation under Misspecified Models: Fundamental findings and applications

Inferring information from a set of acquired data is the main objective of any signal processing (SP) method. In particular, the common problem of estimating the value of a vector of parameters from a set of noisy measurements is at the core of a plethora of scientific and technological advances in the last decades; for example, wireless communications, radar and sonar, biomedicine, image processing, and seismology, just to name a few. Developing an estimation algorithm often begins by assuming a statistical model for the measured data, i.e. a probability density function (pdf) which if correct, fully characterizes the behaviour of the collected data/measurements. Experience with real data, however, often exposes the limitations of any assumed data model since modelling errors at some level are always present. Consequently, the true data model and the model assumed to derive the estimation algorithm could differ. When this happens, the model is said to be mismatched or misspecified. Therefore, understanding the possible performance loss or regret that an estimation algorithm could experience under model misspecification is of crucial importance for any SP practitioner. Further, understanding the limits on the performance of any estimator subject to model misspecification is of practical interest. Motivated by the widespread and practical need to assess the performance of a mismatched estimator, the goal of this paper is to help to bring attention to the main theoretical findings on estimation theory, and in particular on lower bounds under model misspecification, that have been published in the statistical and econometrical literature in the last fifty years. Secondly, some applications are discussed to illustrate the broad range of areas and problems to which this framework extends, and consequently the numerous opportunities available for SP researchers.Comment: To appear in the IEEE Signal Processing Magazin

Robust Techniques for Bearing Estimation in Contaminated Gaussian Noise

The problem of estimating directions-of-arrival (DOA) of radiating sources from measurements provided by a passive array of sensors is frequently encountered in radar, sonar, radio astronomy and seismology. In this study various robust methods for the DOA estimation problem are developed, where the term robustness refers to insensitivity against small deviation in the underlying Gaussian noise assumption. The first method utilizes an eigenvector method and robust reconstruction of the correlation matrix by time series modeling of the array data; Secondly, a decentralized processing scheme is considered for geographically distributed array sites. The method provides reliable estimates even when a few of the subarray sites are malfunctioning. The above two techniques are useful for narrow band and incoherent sources. The third robust method, which utilizes Radon Transform, is capable of handling both the narrow band and wide band sources as well as the incoherent or coherent sources. The technique is also Useful in situations of very low SNR and colored noise with unknown correlation structure. The fourth method is an efficient narrow band robust maximum likelihood DOA estimation algorithm which is capable of handling coherent signals as well as the single snapshot cases. Furthermore, relationships between eigenvector methods and a ML DOA estimation, where the source signals are treated as sample functions of Gaussian random processes, are investigate