Skip to main content
Article thumbnail
Location of Repository

Bayesian Adaptive Hamiltonian Monte Carlo with an Application to High-Dimensional BEKK GARCH Models

By Martin Burda and John Maheu

Abstract

Hamiltonian Monte Carlo (HMC) is a recent statistical procedure to sample from complex distributions. Distant proposal draws are taken in a equence of steps following the Hamiltonian dynamics of the underlying parameter space, often yielding superior mixing properties of the resulting Markov chain. However, its performance can deteriorate sharply with the degree of irregularity of the underlying likelihood due to its lack of local adaptability in the parameter space. Riemann Manifold HMC (RMHMC), a locally adaptive version of HMC, alleviates this problem, but at a substantially increased computational cost that can become prohibitive in high-dimensional scenarios. In this paper we propose the Adaptive HMC (AHMC), an alternative inferential method based on HMC that is both fast and locally adaptive, combining the advantages of both HMC and RMHMC. The benefits become more pronounced with higher dimensionality of the parameter space and with the degree of irregularity of the underlying likelihood surface. We show that AHMC satisfies detailed balance for a valid MCMC scheme and provide a comparison with RMHMC in terms of effective sample size, highlighting substantial efficiency gains of AHMC. Simulation examples and an application of the BEKK GARCH model show the usefulness of the new posterior sampler.High-dimensional joint sampling; Markov chain Monte Carlo; Multivariate GARCH

OAI identifier:

Suggested articles

Citations

  1. (2008). A Bayesian approach to relaxing parameter restrictions in multivariate
  2. (2009). A comparison of generalized hybrid monte carlo methods with and without momentum flip,”
  3. (2004). Adaptive radialbased direction sampling: some flexible and robust Monte Carlo integration methods,”
  4. (2008). Analytical quasi Maximum Likelihood Inference in Multivariate Volatility Models,”
  5. (1999). Applications of Hybrid Monte Carlo to Generalized Linear Models: Quasicomplete Separation and
  6. (2006). Bayesian Auxiliary Variable Models for Binary and Multinomial Regression,” Bayesian Analysis,
  7. (2004). Bayesian comparison of bivariate ARCH-type models for the main exchange rates in Poland,”
  8. (2006). Classical and Bayesian Analysis of Univariate and Multivariate Stochastic Volatility Models,” Econometric Reviews,
  9. (2005). Contemporary Bayesian Econometrics and Statistics.
  10. (2002). Dynamic conditional correlation: A simple class of multivariate generalized autoregressive conditional heteroskedasticity models,”
  11. (1993). Efficient molecular dynamics and hybrid monte carlo algorithms for path integrals,”
  12. (2009). Fitting Vast Dimensional Time-Varying Covariance Models,” Available at SSRN:
  13. (1987). Hybrid Monte Carlo,” Physics Letters B,
  14. (2001). Large Scale Conditional Covariance Matrix Modeling,
  15. (2007). Matrix Differential Calculus with Applications in Statistics and Econometrics.
  16. (2010). MCMC using Hamiltonian dynamics,”
  17. (2004). Monte Carlo statistical methods.
  18. (2004). Monte Carlo Strategies in Scientific Computing.
  19. (1998). Optimal Scaling of Discrete Approximations to Langevin Diffusions,”
  20. (2010). Optimal tuning of the Hybrid Monte-Carlo Algorithm,” Working paper, arxiv:1001.4460v1 [math.pr].
  21. (1993). Probabilistic Inference Using Markov Chain Monte Carlo Methods,”
  22. (2011). Riemann Manifold Langevin and Hamiltonian Monte Carlo Methods (with
  23. (2004). Simulating Hamiltonian Dynamics.
  24. (1993). Solving Ordinary Differential Equations I.
  25. (2010). Tailored randomized block MCMC methods with application to DSGE models,”
  26. (1988). Tuning the hybrid monte carlo algorithm,” Physical Review D,
  27. Vrontos (2007): “Modelling volatility asymmetries: a Bayesian analysis of a class of tree structured multivariate

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.