46,524 research outputs found
Sequential Monte Carlo Methods for System Identification
One of the key challenges in identifying nonlinear and possibly non-Gaussian
state space models (SSMs) is the intractability of estimating the system state.
Sequential Monte Carlo (SMC) methods, such as the particle filter (introduced
more than two decades ago), provide numerical solutions to the nonlinear state
estimation problems arising in SSMs. When combined with additional
identification techniques, these algorithms provide solid solutions to the
nonlinear system identification problem. We describe two general strategies for
creating such combinations and discuss why SMC is a natural tool for
implementing these strategies.Comment: In proceedings of the 17th IFAC Symposium on System Identification
(SYSID). Added cover pag
Approximate maximum likelihood estimation using data-cloning ABC
A maximum likelihood methodology for a general class of models is presented,
using an approximate Bayesian computation (ABC) approach. The typical target of
ABC methods are models with intractable likelihoods, and we combine an ABC-MCMC
sampler with so-called "data cloning" for maximum likelihood estimation.
Accuracy of ABC methods relies on the use of a small threshold value for
comparing simulations from the model and observed data. The proposed
methodology shows how to use large threshold values, while the number of
data-clones is increased to ease convergence towards an approximate maximum
likelihood estimate. We show how to exploit the methodology to reduce the
number of iterations of a standard ABC-MCMC algorithm and therefore reduce the
computational effort, while obtaining reasonable point estimates. Simulation
studies show the good performance of our approach on models with intractable
likelihoods such as g-and-k distributions, stochastic differential equations
and state-space models.Comment: 25 pages. Minor revision. It includes a parametric bootstrap for the
exact MLE for the first example; includes mean bias and RMSE calculations for
the third example. Forthcoming in Computational Statistics and Data Analysi
Low Complexity Blind Equalization for OFDM Systems with General Constellations
This paper proposes a low-complexity algorithm for blind equalization of data
in OFDM-based wireless systems with general constellations. The proposed
algorithm is able to recover data even when the channel changes on a
symbol-by-symbol basis, making it suitable for fast fading channels. The
proposed algorithm does not require any statistical information of the channel
and thus does not suffer from latency normally associated with blind methods.
We also demonstrate how to reduce the complexity of the algorithm, which
becomes especially low at high SNR. Specifically, we show that in the high SNR
regime, the number of operations is of the order O(LN), where L is the cyclic
prefix length and N is the total number of subcarriers. Simulation results
confirm the favorable performance of our algorithm
Expectation Propagation for Nonlinear Inverse Problems -- with an Application to Electrical Impedance Tomography
In this paper, we study a fast approximate inference method based on
expectation propagation for exploring the posterior probability distribution
arising from the Bayesian formulation of nonlinear inverse problems. It is
capable of efficiently delivering reliable estimates of the posterior mean and
covariance, thereby providing an inverse solution together with quantified
uncertainties. Some theoretical properties of the iterative algorithm are
discussed, and the efficient implementation for an important class of problems
of projection type is described. The method is illustrated with one typical
nonlinear inverse problem, electrical impedance tomography with complete
electrode model, under sparsity constraints. Numerical results for real
experimental data are presented, and compared with that by Markov chain Monte
Carlo. The results indicate that the method is accurate and computationally
very efficient.Comment: Journal of Computational Physics, to appea
- …