Abstract

Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. They may be distributed outside this class only with the permission of the Instructor. 9.1 Random function representation Let P be an ergodic Markov chain on state space Ω. Recall the “random function ” representation of P, namely as a probability distribution over functions f: Ω → Ω such that where the probability is over the random choice of f. Pr[f(x) = y] = P (x, y) ∀x, y, (9.1

Download PDF:
_{Sorry, we are unable to provide the full text but you may find it at the following location(s):}

http://citeseerx.ist.psu.edu/v... (external link)

http://www.cs.berkeley.edu/%7E... (external link)