Stochastic Games on a Product State Space

We examine product-games, which are n-player stochastic games satisfying: (1) the state space is a product S(1)Ãâ¦ÃS(n); (2) the action space of any player i only depends of the i-th coordinate of the state; (3) the transition probability of moving from s(i) ∈ S(i) to t(i) ∈S(i), on the i-th coordinate S(i) of the state space, only depends on the action chosen by player i. So, as far as the actions and the transitions are concerned, every player i can play on the i-th coordinate of the product-game without interference of the other players. No condition is imposed on the payoff structure of the game. We focus on product-games with an aperiodic transition structure, for which we present an approach based on so-called communicating states. For the general n-player case, we establish the existence of 0-equilibria, which makes product-games one of the first classes within n-player stochastic games with such a result. In addition, for the special case of two-player zero-sum games of this type, we show that both players have stationary 0-optimal strategies. Both proofs are constructive by nature.Economics (Jel: A)

Pure Subgame-Perfect Equilibria in Free Transition Games

We consider a class of stochastic games, where each state is identified with a player. At any moment during play, one of the players is called active. The active player can terminate the game, or he can announce any player, who then becomes the active player. There is a non-negative payoff for each player upon termination of the game, which depends only on the player who decided to terminate. We give a combinatorial proof of the existence of subgame-perfect equilibria in pure strategies for the games in our class.mathematical economics;

Perfect-information games with lower-semicontinuous payoffs

We prove that every multiplayer perfect-information game with bounded and lower-semicontinuous payoffs admits a subgame-perfect epsilon-equilibrium in pure strategies. This result complements Example 3 in Solan and Vieille [Solan, E., N. Vieille. 2003. Deterministic multi-player Dynkin games. J. Math. Econom. 39 911-929], which shows that a subgame-perfect epsilon-equilibrium in pure strategies need not exist when the payoffs are not lower-semicontinuous. In addition, if the range of payoffs is finite, we characterize in the form of a Folk Theorem the set of all plays and payoffs that are induced by subgame-perfect 0-equilibria in pure strategies