Optimal scaling for partially updating MCMC algorithms

In this paper we shall consider optimal scaling problems for high-dimensional Metropolis--Hastings algorithms where updates can be chosen to be lower dimensional than the target density itself. We find that the optimal scaling rule for the Metropolis algorithm, which tunes the overall algorithm acceptance rate to be 0.234, holds for the so-called Metropolis-within-Gibbs algorithm as well. Furthermore, the optimal efficiency obtainable is independent of the dimensionality of the update rule. This has important implications for the MCMC practitioner since high-dimensional updates are generally computationally more demanding, so that lower-dimensional updates are therefore to be preferred. Similar results with rather different conclusions are given for so-called Langevin updates. In this case, it is found that high-dimensional updates are frequently most efficient, even taking into account computing costs.Comment: Published at http://dx.doi.org/10.1214/105051605000000791 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org

A piecewise deterministic scaling limit of Lifted Metropolis-Hastings in the Curie-Weiss model

In Turitsyn, Chertkov, Vucelja (2011) a non-reversible Markov Chain Monte Carlo (MCMC) method on an augmented state space was introduced, here referred to as Lifted Metropolis-Hastings (LMH). A scaling limit of the magnetization process in the Curie-Weiss model is derived for LMH, as well as for Metropolis-Hastings (MH). The required jump rate in the high (supercritical) temperature regime equals $n^{1/2}$ for LMH, which should be compared to $n$ for MH. At the critical temperature the required jump rate equals $n^{3/4}$ for LMH and $n^{3/2}$ for MH, in agreement with experimental results of Turitsyn, Chertkov, Vucelja (2011). The scaling limit of LMH turns out to be a non-reversible piecewise deterministic exponentially ergodic `zig-zag' Markov process

SET for success : the supply of people with science, technology, engineering and mathematics skills : the report of Sir Gareth Roberts' review

In March 2001, Sir Gareth Roberts was asked by the Chancellor of the Exchequer and the Secretaries of State at the Department of Trade and Industry and at the Department for Education and Skills to undertake a review into the supply of science and engineering skills in the UK. The review was commissioned as part of the Government's productivity and innovation strategy. Sir Gareth Roberts' final report was published on 15 April. The report sets out a series of recommendations to the Government, employers and others with an interest in fostering science, engineering and innovation in the UK. The Government is currently considering Sir Gareth's report and recommendations. The full report is available below in Adobe Acrobat Portable Document Format (PDF). If you do not have Adobe Acrobat installed on your computer you can download the software free of charge from the Adobe website

Harris recurrence of Metropolis-within-Gibbs and trans-dimensional Markov chains

A $\phi$-irreducible and aperiodic Markov chain with stationary probability distribution will converge to its stationary distribution from almost all starting points. The property of Harris recurrence allows us to replace ``almost all'' by ``all,'' which is potentially important when running Markov chain Monte Carlo algorithms. Full-dimensional Metropolis--Hastings algorithms are known to be Harris recurrent. In this paper, we consider conditions under which Metropolis-within-Gibbs and trans-dimensional Markov chains are or are not Harris recurrent. We present a simple but natural two-dimensional counter-example showing how Harris recurrence can fail, and also a variety of positive results which guarantee Harris recurrence. We also present some open problems. We close with a discussion of the practical implications for MCMC algorithms.Comment: Published at http://dx.doi.org/10.1214/105051606000000510 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org