9,730 research outputs found
Bayesian Lower Bounds for Dense or Sparse (Outlier) Noise in the RMT Framework
Robust estimation is an important and timely research subject. In this paper,
we investigate performance lower bounds on the mean-square-error (MSE) of any
estimator for the Bayesian linear model, corrupted by a noise distributed
according to an i.i.d. Student's t-distribution. This class of prior
parametrized by its degree of freedom is relevant to modelize either dense or
sparse (accounting for outliers) noise. Using the hierarchical Normal-Gamma
representation of the Student's t-distribution, the Van Trees' Bayesian
Cram\'er-Rao bound (BCRB) on the amplitude parameters is derived. Furthermore,
the random matrix theory (RMT) framework is assumed, i.e., the number of
measurements and the number of unknown parameters grow jointly to infinity with
an asymptotic finite ratio. Using some powerful results from the RMT,
closed-form expressions of the BCRB are derived and studied. Finally, we
propose a framework to fairly compare two models corrupted by noises with
different degrees of freedom for a fixed common target signal-to-noise ratio
(SNR). In particular, we focus our effort on the comparison of the BCRBs
associated with two models corrupted by a sparse noise promoting outliers and a
dense (Gaussian) noise, respectively
Sparse Estimation using Bayesian Hierarchical Prior Modeling for Real and Complex Linear Models
In sparse Bayesian learning (SBL), Gaussian scale mixtures (GSMs) have been
used to model sparsity-inducing priors that realize a class of concave penalty
functions for the regression task in real-valued signal models. Motivated by
the relative scarcity of formal tools for SBL in complex-valued models, this
paper proposes a GSM model - the Bessel K model - that induces concave penalty
functions for the estimation of complex sparse signals. The properties of the
Bessel K model are analyzed when it is applied to Type I and Type II
estimation. This analysis reveals that, by tuning the parameters of the mixing
pdf different penalty functions are invoked depending on the estimation type
used, the value of the noise variance, and whether real or complex signals are
estimated. Using the Bessel K model, we derive a sparse estimator based on a
modification of the expectation-maximization algorithm formulated for Type II
estimation. The estimator includes as a special instance the algorithms
proposed by Tipping and Faul [1] and by Babacan et al. [2]. Numerical results
show the superiority of the proposed estimator over these state-of-the-art
estimators in terms of convergence speed, sparseness, reconstruction error, and
robustness in low and medium signal-to-noise ratio regimes.Comment: The paper provides a new comprehensive analysis of the theoretical
foundations of the proposed estimators. Minor modification of the titl
A Sparse Bayesian Estimation Framework for Conditioning Prior Geologic Models to Nonlinear Flow Measurements
We present a Bayesian framework for reconstruction of subsurface hydraulic
properties from nonlinear dynamic flow data by imposing sparsity on the
distribution of the solution coefficients in a compression transform domain
Probabilistic Modeling Paradigms for Audio Source Separation
This is the author's final version of the article, first published as E. Vincent, M. G. Jafari, S. A. Abdallah, M. D. Plumbley, M. E. Davies. Probabilistic Modeling Paradigms for Audio Source Separation. In W. Wang (Ed), Machine Audition: Principles, Algorithms and Systems. Chapter 7, pp. 162-185. IGI Global, 2011. ISBN 978-1-61520-919-4. DOI: 10.4018/978-1-61520-919-4.ch007file: VincentJafariAbdallahPD11-probabilistic.pdf:v\VincentJafariAbdallahPD11-probabilistic.pdf:PDF owner: markp timestamp: 2011.02.04file: VincentJafariAbdallahPD11-probabilistic.pdf:v\VincentJafariAbdallahPD11-probabilistic.pdf:PDF owner: markp timestamp: 2011.02.04Most sound scenes result from the superposition of several sources, which can be separately perceived and analyzed by human listeners. Source separation aims to provide machine listeners with similar skills by extracting the sounds of individual sources from a given scene. Existing separation systems operate either by emulating the human auditory system or by inferring the parameters of probabilistic sound models. In this chapter, the authors focus on the latter approach and provide a joint overview of established and recent models, including independent component analysis, local time-frequency models and spectral template-based models. They show that most models are instances of one of the following two general paradigms: linear modeling or variance modeling. They compare the merits of either paradigm and report objective performance figures. They also,conclude by discussing promising combinations of probabilistic priors and inference algorithms that could form the basis of future state-of-the-art systems
Region-Referenced Spectral Power Dynamics of EEG Signals: A Hierarchical Modeling Approach
Functional brain imaging through electroencephalography (EEG) relies upon the
analysis and interpretation of high-dimensional, spatially organized time
series. We propose to represent time-localized frequency domain
characterizations of EEG data as region-referenced functional data. This
representation is coupled with a hierarchical modeling approach to multivariate
functional observations. Within this familiar setting, we discuss how several
prior models relate to structural assumptions about multivariate covariance
operators. An overarching modeling framework, based on infinite factorial
decompositions, is finally proposed to balance flexibility and efficiency in
estimation. The motivating application stems from a study of implicit auditory
learning, in which typically developing (TD) children, and children with autism
spectrum disorder (ASD) were exposed to a continuous speech stream. Using the
proposed model, we examine differential band power dynamics as brain function
is interrogated throughout the duration of a computer-controlled experiment.
Our work offers a novel look at previous findings in psychiatry, and provides
further insights into the understanding of ASD. Our approach to inference is
fully Bayesian and implemented in a highly optimized Rcpp package
Bayesian compressive sensing framework for spectrum reconstruction in Rayleigh fading channels
Compressive sensing (CS) is a novel digital signal processing technique that has found great interest in
many applications including communication theory and wireless communications. In wireless communications, CS
is particularly suitable for its application in the area of spectrum sensing for cognitive radios, where the complete
spectrum under observation, with many spectral holes, can be modeled as a sparse wide-band signal in the frequency
domain. Considering the initial works performed to exploit the benefits of Bayesian CS in spectrum sensing, the fading
characteristic of wireless communications has not been considered yet to a great extent, although it is an inherent feature
for all sorts of wireless communications and it must be considered for the design of any practically viable wireless system.
In this paper, we extend the Bayesian CS framework for the recovery of a sparse signal, whose nonzero coefficients follow
a Rayleigh distribution. It is then demonstrated via simulations that mean square error significantly improves when
appropriate prior distribution is used for the faded signal coefficients and thus, in turns, the spectrum reconstruction
improves. Different parameters of the system model, e.g., sparsity level and number of measurements, are then varied
to show the consistency of the results for different cases
- …