7,560 research outputs found
Generalization and Equilibrium in Generative Adversarial Nets (GANs)
We show that training of generative adversarial network (GAN) may not have
good generalization properties; e.g., training may appear successful but the
trained distribution may be far from target distribution in standard metrics.
However, generalization does occur for a weaker metric called neural net
distance. It is also shown that an approximate pure equilibrium exists in the
discriminator/generator game for a special class of generators with natural
training objectives when generator capacity and training set sizes are
moderate.
This existence of equilibrium inspires MIX+GAN protocol, which can be
combined with any existing GAN training, and empirically shown to improve some
of them.Comment: This is an updated version of an ICML'17 paper with the same title.
The main difference is that in the ICML'17 version the pure equilibrium
result was only proved for Wasserstein GAN. In the current version the result
applies to most reasonable training objectives. In particular, Theorem 4.3
now applies to both original GAN and Wasserstein GA
- …