Parameterisation and Efficient MCMC Estimation of Non-Gaussian State Space Models

The impact of parameterisation on the simulation efficiency of Bayesian Markov chain Monte Carlo (MCMC) algorithms for two non-Gaussian state space models is examined. Specifically, focus is given to particular forms of the stochastic conditional duration (SCD) model and the stochastic volatility (SV) model, with four alternative parameterisations of each model considered. A controlled experiment using simulated data reveals that relationships exist between the simulation efficiency of the MCMC sampler, the magnitudes of the population parameters and the particular parameterisation of the state space model. Results of an empirical analysis of two separate transaction data sets for the SCD model, as well as equity and exchange rate data sets for the SV model, are also reported. Both the simulation and empirical results reveal that substantial gains in simulation efficiency can be obtained from simple reparameterisations of both types of non-Gaussian state space models.Bayesian methodology, stochastic volatility, durations, non-centred in location, non-centred in scale, inefficiency factors.

Scalable iterative methods for sampling from massive Gaussian random vectors

Sampling from Gaussian Markov random fields (GMRFs), that is multivariate Gaussian ran- dom vectors that are parameterised by the inverse of their covariance matrix, is a fundamental problem in computational statistics. In this paper, we show how we can exploit arbitrarily accu- rate approximations to a GMRF to speed up Krylov subspace sampling methods. We also show that these methods can be used when computing the normalising constant of a large multivariate Gaussian distribution, which is needed for both any likelihood-based inference method. The method we derive is also applicable to other structured Gaussian random vectors and, in particu- lar, we show that when the precision matrix is a perturbation of a (block) circulant matrix, it is still possible to derive O(n log n) sampling schemes.Comment: 17 Pages, 4 Figure

Bayesian stochastic model specification search for seasonal and calendar effects

We apply a recent methodology, Bayesian stochastic model specification search (SMSS), for the selection of the unobserved components (level, slope, seasonal cycles, trading days effects) that are stochastically evolving over time. SMSS hinges on two basic ingredients: the non-centered representation of the unobserved components and the reparameterization of the hyperparameters representing standard deviations as regression parameters with unrestricted support. The choice of the prior and the conditional independence structure of the model enable the definition of a very efficient MCMC estimation strategy based on Gibbs sampling. We illustrate that the methodology can be quite successfully applied to discriminate between stochastic and deterministic trends, fixed and evolutive seasonal and trading day effects

Interweaving Markov Chain Monte Carlo Strategies for Efficient Estimation of Dynamic Linear Models

In dynamic linear models (DLMs) with unknown fixed parameters, a standard Markov chain Monte Carlo (MCMC) sampling strategy is to alternate sampling of latent states conditional on fixed parameters and sampling of fixed parameters conditional on latent states. In some regions of the parameter space, this standard data augmentation (DA) algorithm can be inefficient. To improve efficiency, we apply the interweaving strategies of Yu and Meng to DLMs. For this, we introduce three novel alternative DAs for DLMs: the scaled errors, wrongly scaled errors, and wrongly scaled disturbances. With the latent states and the less well known scaled disturbances, this yields five unique DAs to employ in MCMC algorithms. Each DA implies a unique MCMC sampling strategy and they can be combined into interweaving and alternating strategies that improve MCMC efficiency. We assess these strategies using the local level model and demonstrate that several strategies improve efficiency relative to the standard approach and the most efficient strategy interweaves the scaled errors and scaled disturbances. Supplementary materials are available online for this article

Parameterisation and efficient MCMC estimation of non-Gaussian state space models

The impact of parameterisation on the simulation efficiency of Bayesian Markov chain Monte Carlo (MCMC) algorithms for two non-Gaussian state space models is examined. Specifically, focus is given to particular forms of the stochastic conditional duration (SCD) model and the stochastic volatility (SV) model, with four alternative parameterisations of each model considered. A controlled experiment using simulated data reveals that relationships exist between the simulation efficiency of the MCMC sampler, the magnitudes of the population parameters and the particular parameterisation of the state space model. Results of an empirical analysis of two separate transaction data sets for the SCD model, as well as equity and exchange rate data sets for the SV model, are also reported. Both the simulation and empirical results reveal that substantial gains in simulation efficiency can be obtained from simple reparameterisations of both types of non-Gaussian state space models