Optimality in different strategy classes in zero-sum stochastic games

We present a complete picture of the relationship between the existence of 0-optimal strategies and c-optimal strategies, epsilon > 0, in the classes of stationary, Markov and history dependent strategies