14,528 research outputs found
Computational aspects of Bayesian spectral density estimation
Gaussian time-series models are often specified through their spectral
density. Such models present several computational challenges, in particular
because of the non-sparse nature of the covariance matrix. We derive a fast
approximation of the likelihood for such models. We propose to sample from the
approximate posterior (that is, the prior times the approximate likelihood),
and then to recover the exact posterior through importance sampling. We show
that the variance of the importance sampling weights vanishes as the sample
size goes to infinity. We explain why the approximate posterior may typically
multi-modal, and we derive a Sequential Monte Carlo sampler based on an
annealing sequence in order to sample from that target distribution.
Performance of the overall approach is evaluated on simulated and real
datasets. In addition, for one real world dataset, we provide some numerical
evidence that a Bayesian approach to semi-parametric estimation of spectral
density may provide more reasonable results than its Frequentist counter-parts
Robust approximate Bayesian inference
We discuss an approach for deriving robust posterior distributions from
-estimating functions using Approximate Bayesian Computation (ABC) methods.
In particular, we use -estimating functions to construct suitable summary
statistics in ABC algorithms. The theoretical properties of the robust
posterior distributions are discussed. Special attention is given to the
application of the method to linear mixed models. Simulation results and an
application to a clinical study demonstrate the usefulness of the method. An R
implementation is also provided in the robustBLME package.Comment: This is a revised and personal manuscript version of the article that
has been accepted for publication by Journal of Statistical Planning and
Inferenc
Bayesian semiparametric multi-state models
Multi-state models provide a unified framework for the description of the evolution of discrete phenomena in continuous time. One particular example is Markov processes which can be characterised by a set of time-constant transition intensities between the states. In this paper, we will extend such parametric approaches to semiparametric models with flexible transition intensities based on Bayesian versions of penalised splines. The transition intensities will be modelled as smooth functions of time and can further be related to parametric as well as nonparametric covariate effects. Covariates with time-varying effects and frailty terms can be included in addition. Inference will be conducted either fully Bayesian (using Markov chain Monte Carlo simulation techniques) or empirically Bayesian (based on a mixed model representation). A counting process representation of semiparametric multi-state models provides the likelihood formula and also forms the basis for model validation via martingale residual processes. As an application, we will consider human sleep data with a discrete set of sleep states such as REM and non-REM phases. In this case, simple parametric approaches are inappropriate since the dynamics underlying human sleep are strongly varying throughout the night and individual specific variation has to be accounted for using covariate information and frailty terms
Marginal Likelihood Estimation with the Cross-Entropy Method
We consider an adaptive importance sampling approach to estimating the marginal likelihood, a quantity that is fundamental in Bayesian model comparison and Bayesian model averaging. This approach is motivated by the difficulty of obtaining an accurate estimate through existing algorithms that use Markov chain Monte Carlo (MCMC) draws, where the draws are typically costly to obtain and highly correlated in high-dimensional settings. In contrast, we use the cross-entropy (CE) method, a versatile adaptive Monte Carlo algorithm originally developed for rare-event simulation. The main advantage of the importance sampling approach is that random samples can be obtained from some convenient density with little additional costs. As we are generating independent draws instead of correlated MCMC draws, the increase in simulation effort is much smaller should one wish to reduce the numerical standard error of the estimator. Moreover, the importance density derived via the CE method is in a well-defined sense optimal. We demonstrate the utility of the proposed approach by two empirical applications involving women's labor market participation and U.S. macroeconomic time series. In both applications the proposed CE method compares favorably to existing estimators
- …