Skip to main content
Article thumbnail
Location of Repository

Limiting Conditional Distributions: Imprecision and Relation to the Hazard Rate



Many Markov chains with a single absorbing state have a unique limiting conditional distribution (LCD) to which they converge, conditioned on non-absorption, regardless of the initial distribution. If this limiting conditional distribution is used as the initial distribution over the non-absorbing states, then the probability distribution of the process at time n, conditioned on non-absorption, is equal for all values of n>0. Such an initial distribution is known as the quasi-stationary distribution (QSD). Thus the LCD and QSD are equal. These distributions can be found in both the discrete-time and continuous-time case.\ud \ud In this thesis we consider finite Markov chains which have one absorbing state, and for which all other states form a set which is a single communicating class. In addition, every state is aperiodic. These conditions ensure the existence of a unique LCD. We first consider continuous Markov chains in the context of survival analysis. We consider the hazard rate, a function which measures the risk of instantaneous failure of a system at time t conditioned on the system not having failed before t. It is well-known that the QSD leads to a constant hazard rate, and that the hazard rate generated by any other initial distribution tends to that constant rate. Claims have been made by Aalen and by Aalen and Gjessing that it may be possible to predict the shape of hazard rates generated by phase type distributions (first passage time distributions generated by atomic initial distributions) by comparing these initial distributions with the QSD. In Chapter 2 we consider these claims, and demonstrate through the use of several examples that the behaviour considered by those conjectures is more complex then previously believed.\ud \ud In Chapters 3 and 4 we consider discrete Markov chains in the context of imprecise probability. In many situations it may be unrealistic to assume that the transition matrix of a Markov chain can be determined exactly. It may be more plausible to determine upper and lower bounds upon each element, or even determine closed sets of probability distributions to which the rows of the matrix may belong. Such methods have been discussed by Kozine and Utkin and by Skulj, and in each of these papers results were given regarding the long-term behaviour of such processes. None of these papers considered Markov chains with an absorbing state. In Chapter 3 we demonstrate that, under the assumption that the transition matrix cannot change from time step to time step, there exists an imprecise generalisation to both the LCD and the QSD, and that these two generalisations are equal. In Chapter 4, we prove that this result holds even when we no longer assume that the transition matrix cannot change from time step to time step. In each chapter, examples are presented demonstrating the convergence of such processes, and Chapter 4 includes a comparison between the two methods

Topics: Hazard rate, imprecise probability, Markov chains
Year: 2009
OAI identifier:
Provided by: Durham e-Theses

Suggested articles


  1. (1995). A ratio limit theorem for (sub) doi
  2. (1995). A ratio limit theorem for (sub) Markov chains on 1,2,... with bounded jumps. doi
  3. (1981). A Second Course in Stochastic Processes. doi
  4. (1978). An Introduction to Orthogonal Polynomials. doi
  5. (1950). An Introduction to Probability Theory and its Applications, Volume 1, 3rd Edition. doi
  6. (1980). Bathtub and related failure rate characterizations, doi
  7. (1994). Bayesian reliability analysis with imprecise prior probabilities. doi
  8. (2003). Beta-invariant measures for transition matrices of G1/M/1 type. doi
  9. (1947). Certain limit theorems of the theory of branching stochastic processes (in Russian).
  10. (1981). Coherent lower (and upper) probabilities.
  11. (1991). Continuous-Time Markov Chains: an ApplicationsOriented Approach. doi
  12. (1970). Counterexamples in Topology. doi
  13. (2001). Elementare Grundbegriffe einer allgemeineren Wahrscheinlichkeitsrechnung I. Intervallwahrscheinlichkeit als umfassendes Konzept. doi
  14. (1996). Evolution with state-dependent mutations. doi
  15. (2006). Finite discrete time Markov chains with interval probabilities. doi
  16. (2002). Fuzzy Markov chains. doi
  17. (1995). Geometric ergodicity and quasistationarity in discrete-time birth-death processes. doi
  18. (1986). Hazard-rate analysis in stage I malignant melanoma. doi
  19. (2009). Imprecise Markov chains and their limit behaviour. Pre-print at,
  20. (2009). Imprecise Markov chains with absorption. In submission. doi
  21. (2009). Imprecise Markov chains with an absorbing state, In
  22. (2002). Interval-valued finite Markov chains.
  23. (1987). Limit theorems for the population size of a birth and death process allowing catastrophes. doi
  24. (1972). Log-concavity and log-convexity in passage time densities of diffusion and birth-death processes. doi
  25. (1979). Markov chain models - rarity and exponentiality. doi
  26. (1973). Markov chains and M-matrices: inequalities and equalities. doi
  27. (1997). Markov Processes for Stochastic Modeling. doi
  28. (1998). Markov Set Chains. doi
  29. (1981). Note on the theory of a self-catalytic chemical reaction, doi
  30. (1995). od Discrete-Time Markov Chains. doi
  31. (1966). On quasi-stationary distributions in discrete-time Markov chains with a denumerable infinity of states. doi
  32. (1967). On quasistationary distributions in absorbing continuous-time finite Markov chains. doi
  33. (1965). On quasistationary distributions in absorbing discrete-time finite Markov chains. doi
  34. (1960). On the asymptotic behaviour of probabilities within groups of states of a homogeneous Markov process. ˇ Casopis pro pestovani matematiky a fyziky 85,
  35. (1960). On the asymptotic behaviour of probabilities within groups of states of a homogeneous Markov process. Cˇasopis pro pestovani matematiky a fyziky 85,
  36. (1956). On the composition of unimodal distributions. Theory of Probability and its Applications, doi
  37. (1981). On the unimodality of passage time densities in birth-death processes. doi
  38. (1975). Optimal rules for ordering uncertain prospects. doi
  39. (1968). Perturbation theory and finite Markov chains. doi
  40. (1995). Phase type distributions in survival analysis. doi
  41. (1995). Probability and Measures. doi
  42. (1992). Probability and Random Processes. doi
  43. (1975). Probability distributions of phase type. Liber Amicorum Prof. Emeritus H.
  44. (2005). Probability, Statistics, and Stochasitc Processes.
  45. (1995). Quasi-stationarity od Discrete-Time Markov Chains.
  46. (1966). Quasi-stationary behaviour in the random walk with continuous time. doi
  47. (1991). Quasi-stationary distributions and convergence to quasi-stationarity of birth-death processes. doi
  48. (2006). Quasi-stationary distributions for a class of discrete-time doi
  49. (1987). Quasistationary distributions for autocatalytic reactions. doi
  50. (1995). Ratio limits and limiting conditional distributions for discrete-time birth-death processes. doi
  51. (2007). Regular finite Markov chains with interval probabilities. doi
  52. (1962). Renewal Theory. doi
  53. (2007). Semi-parametric Bayesian analysis of the proportional hazard rate model: an application to the effect of training programs on graduate unemployment. doi
  54. (1989). Spectral theory for skip-free Markov chains. doi
  55. (1954). Spectral theory for the differential equations of simple birth-and-death processes. doi
  56. (1991). Statistical Reasoning with Imprecise Probabilities. doi
  57. (2008). Stochastic stability and time-dependent mutations. doi
  58. (1996). Survival Analysis With Long-Term Survivors. doi
  59. (2008). Survival and Event History Analysis: A Process Point of View, doi
  60. (1957). The classification of birth and death processes. doi
  61. (1957). The differential equations of birth-death processes, and the Stieltjes Moment Problem. doi
  62. (1998). The Inverse Gaussian Distribution: Statistical Theory and Applications. doi
  63. (1989). The Inverse Gaussian Distribution: Theory, Methodology and Applications. doi
  64. (1962). The relationship between the mean and variance of a stationary birth-death process, and its economic application. doi
  65. (1951). The rise and fall of a reindeer herd,
  66. (2000). The theory of interval-probability as a unifying concept for uncertainty. doi
  67. (2009). Time homogeneous birth-death processes with probability intervals and absorbing state. doi
  68. (1993). Topologies On Closed And Closed Convex Sets. doi
  69. (2001). Understanding the shape of the hazard rate: a process point of view.
  70. (1997). Weak convergence of conditioned birth-death processes in discrete time. doi
  71. (2003). Weakly Symmetric Graphs, Elementary Landscapes and the TSP. doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.