Coarse Correlation in Extensive-Form Games

Coarse correlation models strategic interactions of rational agents complemented by a correlation device, that is a mediator that can recommend behavior but not enforce it. Despite being a classical concept in the theory of normal-form games for more than forty years, not much is known about the merits of coarse correlation in extensive-form settings. In this paper, we consider two instantiations of the idea of coarse correlation in extensive-form games: normal-form coarse-correlated equilibrium (NFCCE), already defined in the literature, and extensive-form coarse-correlated equilibrium (EFCCE), which we introduce for the first time. We show that EFCCE is a subset of NFCCE and a superset of the related extensive-form correlated equilibrium. We also show that, in two-player extensive-form games, social-welfare-maximizing EFCCEs and NFCEEs are bilinear saddle points, and give new efficient algorithms for the special case of games with no chance moves. In our experiments, our proposed algorithm for NFCCE is two to four orders of magnitude faster than the prior state of the art

Function Approximation for Solving Stackelberg Equilibrium in Large Perfect Information Games

Function approximation (FA) has been a critical component in solving large zero-sum games. Yet, little attention has been given towards FA in solving \textit{general-sum} extensive-form games, despite them being widely regarded as being computationally more challenging than their fully competitive or cooperative counterparts. A key challenge is that for many equilibria in general-sum games, no simple analogue to the state value function used in Markov Decision Processes and zero-sum games exists. In this paper, we propose learning the \textit{Enforceable Payoff Frontier} (EPF) -- a generalization of the state value function for general-sum games. We approximate the optimal \textit{Stackelberg extensive-form correlated equilibrium} by representing EPFs with neural networks and training them by using appropriate backup operations and loss functions. This is the first method that applies FA to the Stackelberg setting, allowing us to scale to much larger games while still enjoying performance guarantees based on FA error. Additionally, our proposed method guarantees incentive compatibility and is easy to evaluate without having to depend on self-play or approximate best-response oracles.Comment: To appear in AAAI 202

Applications of negotiation theory to water issues

The authors review the applications of noncooperative bargaining theory to waterrelated issues-which fall in the category of formal models of negotiation. They aim to identify the conditions under which agreements are likely to emerge and their characteristics, to support policymakers in devising the"rules of the game"that could help obtain a desired result. Despite the fact that allocation of natural resources, especially trans-boundary allocation, has all the characteristics of a negotiation problem, there are not many applications of formal negotiation theory to the issue. Therefore, the authors first discuss the noncooperative bargaining models applied to water allocation problems found in the literature. Key findings include the important role noncooperative negotiations can play in cases where binding agreements cannot be signed; the value added of politically and socially acceptable compromises; and the need for a negotiated model that considers incomplete information over the negotiated resource.Water Supply and Sanitation Governance and Institutions,Town Water Supply and Sanitation,Water and Industry,Environmental Economics&Policies,Water Conservation

Applications of negotiation theory to water issues

The purpose of the paper is to review the applications of non-cooperative bargaining theory to water related issues – which fall in the category of formal models of negotiation. The ultimate aim is that of, on the one hand, identify the conditions under which agreements are likely to emerge, and their characteristics; and, on the other hand, to support policy makers in devising the “rules of the game” that could help obtain a desired result. Despite the fact that allocation of natural resources, especially of trans-boundary nature, has all the characteristics of a negotiation problem, there are not many applications of formal negotiation theory to the issue. Therefore, this paper first discusses the noncooperative bargaining models applied to water allocation problems found in the literature. Particular attention will be given to those directly modelling the process of negotiation, although some attempts at finding strategies to maintain the efficient allocation solution will also be illustrated. In addition, this paper will focus on Negotiation Support Systems (NSS), developed to support the process of negotiation. This field of research is still relatively new, however, and NSS have not yet found much use in real life negotiation. The paper will conclude by highlighting the key remaining gaps in the literature.Negotiation theory, Bragaining, Coalitions, Fairness, Agreements