3 research outputs found

    Computable bounds of â„“2{\ell}^2-spectral gap for discrete Markov chains with band transition matrices

    Full text link
    We analyse the ℓ2(π)\ell^2(\pi)-convergence rate of irreducible and aperiodic Markov chains with NN-band transition probability matrix PP and with invariant distribution π\pi. This analysis is heavily based on: first the study of the essential spectral radius r_ess(P_∣ℓ2(π))r\_{ess}(P\_{|\ell^2(\pi)}) of P_∣ℓ2(π)P\_{|\ell^2(\pi)} derived from Hennion's quasi-compactness criteria; second the connection between the Spectral Gap property (SG_2\_2) of PP on ℓ2(π)\ell^2(\pi) and the VV-geometric ergodicity of PP. Specifically, (SG_2\_2) is shown to hold under the condition \alpha\_0 := \sum\_{{m}=-N}^N \limsup\_{i\rightarrow +\infty} \sqrt{P(i,i+{m})\, P^*(i+{m},i)}\ \textless{}\, 1 Moreover r_ess(P_∣ℓ2(π))≤α_0r\_{ess}(P\_{|\ell^2(\pi)}) \leq \alpha\_0. Effective bounds on the convergence rate can be provided from a truncation procedure.Comment: in Journal of Applied Probability, Applied Probability Trust, 2016. arXiv admin note: substantial text overlap with arXiv:1503.0220

    Additional material on bounds of â„“2\ell^2-spectral gap for discrete Markov chains with band transition matrices

    Full text link
    We analyse the ℓ2(π)\ell^2(\pi)-convergence rate of irreducible and aperiodic Markov chains with NN-band transition probability matrix PP and with invariant distribution π\pi. This analysis is heavily based on: first the study of the essential spectral radius r_ess(P_∣ℓ2(π))r\_{ess}(P\_{|\ell^2(\pi)}) of P_∣ℓ2(π)P\_{|\ell^2(\pi)} derived from Hennion's quasi-compactness criteria; second the connection between the spectral gap property (SG_2\_2) of PP on ℓ2(π)\ell^2(\pi) and the VV-geometric ergodicity of PP. Specifically, (SG_2\_2) is shown to hold under the condition \alpha\_0 := \sum\_{{m}=-N}^N \limsup\_{i\rightarrow +\infty} \sqrt{P(i,i+{m})\, P^*(i+{m},i)}\ \textless{}\, 1. Moreover r_ess(P_∣ℓ2(π))≤α_0r\_{ess}(P\_{|\ell^2(\pi)}) \leq \alpha\_0. Simple conditions on asymptotic properties of PP and of its invariant probability distribution π\pi to ensure that \alpha\_0\textless{}1 are given. In particular this allows us to obtain estimates of the ℓ2(π)\ell^2(\pi)-geometric convergence rate of random walks with bounded increments. The specific case of reversible PP is also addressed. Numerical bounds on the convergence rate can be provided via a truncation procedure. This is illustrated on the Metropolis-Hastings algorithm
    corecore