104 research outputs found
Fast Face-swap Using Convolutional Neural Networks
We consider the problem of face swapping in images, where an input identity
is transformed into a target identity while preserving pose, facial expression,
and lighting. To perform this mapping, we use convolutional neural networks
trained to capture the appearance of the target identity from an unstructured
collection of his/her photographs.This approach is enabled by framing the face
swapping problem in terms of style transfer, where the goal is to render an
image in the style of another one. Building on recent advances in this area, we
devise a new loss function that enables the network to produce highly
photorealistic results. By combining neural networks with simple pre- and
post-processing steps, we aim at making face swap work in real-time with no
input from the user
An image segmentation and registration approach to cardiac function analysis using MRI
Cardiovascular diseases (CVDs) are one of the major causes of death in the world. In recent
years, significant progress has been made in the care and treatment of patients with such
diseases. A crucial factor for this progress has been the development of magnetic resonance
(MR) imaging which makes it possible to diagnose and assess the cardiovascular function
of the patient. The ability to obtain high-resolution, cine volume images easily and safely
has made it the preferred method for diagnosis of CVDs. MRI is also unique in its ability
to introduce noninvasive markers directly into the tissue being imaged(MR tagging) during
the image acquisition process. With the development of advanced MR imaging acquisition
technologies, 3D MR imaging is more and more clinically feasible. This recent development has
allowed new potentially 3D image analysis technologies to be deployed. However, quantitative
analysis of cardiovascular system from the images remains a challenging topic.
The work presented in this thesis describes the development of segmentation and motion
analysis techniques for the study of the cardiac anatomy and function in cardiac magnetic
resonance (CMR) images. The first main contribution of the thesis is the development of a fully
automatic cardiac segmentation technique that integrates and combines a series of state-of-the-art
techniques. The proposed segmentation technique is capable of generating an accurate 3D
segmentation from multiple image sequences. The proposed segmentation technique is robust
even in the presence of pathological changes, large anatomical shape variations and locally
varying contrast in the images.
Another main contribution of this thesis is the development of motion tracking techniques that
can integrate motion information from different sources. For example, the radial motion of
the myocardium can be tracked easily in untagged MR imaging since the epi- and endocardial
surfaces are clearly visible. On the other hand, tagged MR imaging allows easy tracking of
both longitudinal and circumferential motion. We propose a novel technique based on non-rigid
image registration for the myocardial motion estimation using both untagged and 3D tagged MR
images. The novel aspect of our technique is its simultaneous use of complementary information
from both untagged and 3D tagged MR imaging. The similarity measure is spatially weighted
to maximise the utility of information from both images.
The thesis also proposes a sparse representation for free-form deformations (FFDs) using the principles of compressed sensing. The sparse free-form deformation (SFFD) model can
capture fine local details such as motion discontinuities without sacrificing robustness. We
demonstrate the capabilities of the proposed framework to accurately estimate smooth as well
as discontinuous deformations in 2D and 3D CMR image sequences. Compared to the standard
FFD approach, a significant increase in registration accuracy can be observed in datasets with
discontinuous motion patterns.
Both the segmentation and motion tracking techniques presented in this thesis have been
applied to clinical studies. We focus on two important clinical applications that can be
addressed by the techniques proposed in this thesis. The first clinical application aims
at measuring longitudinal changes in cardiac morphology and function during the cardiac
remodelling process. The second clinical application aims at selecting patients that positively
respond to cardiac resynchronization therapy (CRT).
The final chapter of this thesis summarises the main conclusions that can be drawn from the
work presented here and also discusses possible avenues for future research
Recommended from our members
Lossy Image Compression with Compressive Autoencoders
We propose a new approach to the problem of optimizing autoencoders for lossy image compression. New media formats, changing hardware technology, as well as diverse requirements and content types create a need for compression algo- rithms which are more flexible than existing codecs. Autoencoders have the po- tential to address this need, but are difficult to optimize directly due to the inherent non-differentiabilty of the compression loss. We here show that minimal changes to the loss are sufficient to train deep autoencoders competitive with JPEG 2000 and outperforming recently proposed approaches based on RNNs. Our network is furthermore computationally efficient thanks to a sub-pixel architecture, which makes it suitable for high-resolution images. This is in contrast to previous work on autoencoders for compression using coarser approximations, shallower archi- tectures, computationally expensive methods, or focusing on small image
- …