4,042 research outputs found
Spatial Evolutionary Generative Adversarial Networks
Generative adversary networks (GANs) suffer from training pathologies such as
instability and mode collapse. These pathologies mainly arise from a lack of
diversity in their adversarial interactions. Evolutionary generative
adversarial networks apply the principles of evolutionary computation to
mitigate these problems. We hybridize two of these approaches that promote
training diversity. One, E-GAN, at each batch, injects mutation diversity by
training the (replicated) generator with three independent objective functions
then selecting the resulting best performing generator for the next batch. The
other, Lipizzaner, injects population diversity by training a two-dimensional
grid of GANs with a distributed evolutionary algorithm that includes neighbor
exchanges of additional training adversaries, performance based selection and
population-based hyper-parameter tuning. We propose to combine mutation and
population approaches to diversity improvement. We contribute a superior
evolutionary GANs training method, Mustangs, that eliminates the single loss
function used across Lipizzaner's grid. Instead, each training round, a loss
function is selected with equal probability, from among the three E-GAN uses.
Experimental analyses on standard benchmarks, MNIST and CelebA, demonstrate
that Mustangs provides a statistically faster training method resulting in more
accurate networks
Parametrization of stochastic inputs using generative adversarial networks with application in geology
We investigate artificial neural networks as a parametrization tool for
stochastic inputs in numerical simulations. We address parametrization from the
point of view of emulating the data generating process, instead of explicitly
constructing a parametric form to preserve predefined statistics of the data.
This is done by training a neural network to generate samples from the data
distribution using a recent deep learning technique called generative
adversarial networks. By emulating the data generating process, the relevant
statistics of the data are replicated. The method is assessed in subsurface
flow problems, where effective parametrization of underground properties such
as permeability is important due to the high dimensionality and presence of
high spatial correlations. We experiment with realizations of binary
channelized subsurface permeability and perform uncertainty quantification and
parameter estimation. Results show that the parametrization using generative
adversarial networks is very effective in preserving visual realism as well as
high order statistics of the flow responses, while achieving a dimensionality
reduction of two orders of magnitude
- …