1,248 research outputs found
Matrix Multiplicative Weights Updates in Quantum Zero-Sum Games: Conservation Laws & Recurrence
Recent advances in quantum computing and in particular, the introduction of
quantum GANs, have led to increased interest in quantum zero-sum game theory,
extending the scope of learning algorithms for classical games into the quantum
realm. In this paper, we focus on learning in quantum zero-sum games under
Matrix Multiplicative Weights Update (a generalization of the multiplicative
weights update method) and its continuous analogue, Quantum Replicator
Dynamics. When each player selects their state according to quantum replicator
dynamics, we show that the system exhibits conservation laws in a
quantum-information theoretic sense. Moreover, we show that the system exhibits
Poincare recurrence, meaning that almost all orbits return arbitrarily close to
their initial conditions infinitely often. Our analysis generalizes previous
results in the case of classical games.Comment: NeurIPS 202
Smooth markets: A basic mechanism for organizing gradient-based learners
With the success of modern machine learning, it is becoming increasingly
important to understand and control how learning algorithms interact.
Unfortunately, negative results from game theory show there is little hope of
understanding or controlling general n-player games. We therefore introduce
smooth markets (SM-games), a class of n-player games with pairwise zero sum
interactions. SM-games codify a common design pattern in machine learning that
includes (some) GANs, adversarial training, and other recent algorithms. We
show that SM-games are amenable to analysis and optimization using first-order
methods.Comment: 18 pages, 3 figure
- …