510 research outputs found
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
We present a new method for synthesizing high-resolution photo-realistic
images from semantic label maps using conditional generative adversarial
networks (conditional GANs). Conditional GANs have enabled a variety of
applications, but the results are often limited to low-resolution and still far
from realistic. In this work, we generate 2048x1024 visually appealing results
with a novel adversarial loss, as well as new multi-scale generator and
discriminator architectures. Furthermore, we extend our framework to
interactive visual manipulation with two additional features. First, we
incorporate object instance segmentation information, which enables object
manipulations such as removing/adding objects and changing the object category.
Second, we propose a method to generate diverse results given the same input,
allowing users to edit the object appearance interactively. Human opinion
studies demonstrate that our method significantly outperforms existing methods,
advancing both the quality and the resolution of deep image synthesis and
editing.Comment: v2: CVPR camera ready, adding more results for edge-to-photo example
Projection image-to-image translation in hybrid X-ray/MR imaging
The potential benefit of hybrid X-ray and MR imaging in the interventional
environment is large due to the combination of fast imaging with high contrast
variety. However, a vast amount of existing image enhancement methods requires
the image information of both modalities to be present in the same domain. To
unlock this potential, we present a solution to image-to-image translation from
MR projections to corresponding X-ray projection images. The approach is based
on a state-of-the-art image generator network that is modified to fit the
specific application. Furthermore, we propose the inclusion of a gradient map
in the loss function to allow the network to emphasize high-frequency details
in image generation. Our approach is capable of creating X-ray projection
images with natural appearance. Additionally, our extensions show clear
improvement compared to the baseline method.Comment: In proceedings of SPIE Medical Imaging 201
- …