Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. They may be distributed outside this class only with the permission of the Instructor. 9.1 Random function representation Let P be an ergodic Markov chain on state space Ω. Recall the “random function ” representation of P, namely as a probability distribution over functions f: Ω → Ω such that where the probability is over the random choice of f. Pr[f(x) = y] = P (x, y) ∀x, y, (9.1
To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.