MedGAN: Medical Image Translation using GANs

Image-to-image translation is considered a new frontier in the field of medical image analysis, with numerous potential applications. However, a large portion of recent approaches offers individualized solutions based on specialized task-specific architectures or require refinement through non-end-to-end training. In this paper, we propose a new framework, named MedGAN, for medical image-to-image translation which operates on the image level in an end-to-end manner. MedGAN builds upon recent advances in the field of generative adversarial networks (GANs) by merging the adversarial framework with a new combination of non-adversarial losses. We utilize a discriminator network as a trainable feature extractor which penalizes the discrepancy between the translated medical images and the desired modalities. Moreover, style-transfer losses are utilized to match the textures and fine-structures of the desired target images to the translated images. Additionally, we present a new generator architecture, titled CasNet, which enhances the sharpness of the translated medical outputs through progressive refinement via encoder-decoder pairs. Without any application-specific modifications, we apply MedGAN on three different tasks: PET-CT translation, correction of MR motion artefacts and PET image denoising. Perceptual analysis by radiologists and quantitative evaluations illustrate that the MedGAN outperforms other existing translation approaches.Comment: 16 pages, 8 figure

Steady-state anatomical and quantitative magnetic resonance imaging of the heart using RF-frequencymodulated techniques

Cardiovascular disease (CVD) is the leading cause of death in the United States and Europe and generates healthcare costs of hundreds of billions of dollars annually. Conventional methods of diagnosing CVD are often invasive and carry risks for the patient. For example, the gold standard for diagnosing coronary artery disease, a major class of CVD, is x-ray coronary angiography, which has the disadvantages of being invasive, being expensive, using ionizing radiation, and having a ris k of complications. Conversely, coronary MR angiography (MRA) does not use ionizing radiation, can effectively visualize tissues without the need for exogenous contrast agents, and benefits from an adaptable temporal resolution. However, the acquisition time of cardiac MRI is far longer than the temporal scales of cardiac and respiratory motion, necessitating some method of compensating for this motion. The free-running framework is a novel development in our lab, benefitting from advances over the past three decades, that attempts to address disadvantages of previous cardiac MRI approaches: it provides fully self-gated 5D cardiac MRI with a simplified workflow, improved ease-of-use, reduced operator dependence, and automatic patient-specific motion detection. Free-running imaging increases the amount of information available to the clinician and is flexible enough to be translated to different app lications within cardiac MRI. Moreover, the self-gating of the free-running framework decoupled the acquisition from the motion compensation and thereby opened up cardiac MRI to the wider class of steady-state-based techniques utilizing balanced steady-state free precession (bSSFP) sequences, which have the benefits of practical simplicity and high signal-to-noise ratio. The focus of this thesis was therefore on the application of steady- state techniques to cardiac MRI. The first part addressed the long acquisition time of the current free-running framework and focused on anatomical coronary imaging. The published protocol of the free- running framework used an interrupted bSSFP acquisition where CHESS fat saturation modules were inserted to provide blood-fat contrast, as they suppress the signal of fat tissue surrounding the coronary arteries, and were followed by ramp-up pulses to reduce artefacts arising from the return to steady-state. This interrupted acquisition, however, suffered from an interrupted steady-state, reduced time efficiency, and higher specific absorption rate (SAR). Using novel lipid-insensitive binomial off-resonant RF excitation (LIBRE) pulses developed in our lab, the first project showed that LIBRE pulses incorporated into an uninterrupted free-running bSSFP sequence could be successfully used for 5D cardiac MRI at 1.5T. The free-running LIBRE approach reduced the acquisition time and SAR relative to the previous interrupted approach while maintaining image quality and vessel conspicuity. Furthermore, this had been the first successful use of a fat-suppressing RF excitation pulse in an uninterrupted bSSFP sequence for cardiac imaging, demonstrating that uninterrupted bSSFP can be used for cardiac MRI and addressing the problem of clinical sequence availability. Inspired by the feasibility of uninterrupted bSSFP for cardiac MRI, the second part investigated the potential of PLANET, a novel 3D multiparametric mapping technique, for free-running 5D myocardial mapping. PLANET utilizes a phase-cycled bSSFP acquisition and a direct ellipse-fitting algorithm to calculate T1 and T2 relaxation times, which suggested that it could be readily integrated into the free-running framework without interrupting the steady-state. After initially calibrating the acquisition, the possibility of accelerating the static PLANET acquisition was explored prior to applying it to the moving heart. It was shown that PLANET accuracy and precision could be maintained with two-fold acceleration with a 3D Cartesian spiral trajectory, suggesting that PLANET for myocardial mapping with the free-running 5D radial acquisition is feasible. Further work should investigate optimizing the reconstruction scheme, improving the coil sensitivity estimate, and examining the use of the radial trajectory with a view to implementing free-running 5D myocardial T1 and T2 mapping. This thesis presents two approaches utilizing RF-frequency-modulated steady-state techniques for cardiac MRI. The first approach involved the novel application of an uninterrupted bSSFP acquisition with off-resonant RF excitation for anatomical coronary imaging. The second approach investigated the use of phase-cycled bSSFP for free-running 5D myocardial T1 and T2 mapping. Both methods addressed the challenge of clinical availability of sequences in cardiac MRI, by showing that a common and simple sequence like bSSFP can be used for acquisition while the steps of motion compensation and reconstruction can be handled offline, and thus have the potential to improve adoption of cardiac MRI. -- Les maladies cardiovasculaires (MCV) représentent la principale cause de décès aux États-Unis et en Europe et génèrent des coûts de santé de plusieurs centaines de milliards de dollars par an. Les méthodes conventionnelles de diagnostic des MCV sont souvent invasives et comportent des risques pour le patient. Par exemple, la méthode de référence pour le diagnostic de la maladie coronarienne, une catégorie majeure de MCV, est la coronarographie par rayons X qui a comme inconvénients son caractère invasif, son coût, l’utilisation de rayonnements ionisants et le risque de complications. A l’inverse, l'angiographie coronarienne par résonance magnétique (ARM) n'utilise pas de rayonnements ionisants, permet de visualiser efficacement les tissus sans avoir recours à des agents de contraste exogènes et bénéficie d'une résolution temporelle ajustable. Cependant, le temps d'acquisition en IRM cardiaque est bien plus long que les échelles temporelles des mouvements cardiaques et respiratoires en jeu, ce qui rend la compensation de ces mouvements indispensable. Le cadre dit de « free -running » est un nouveau développement de notre laboratoire qui bénéficie des progrès réalisés au cours des trois dernières décennies et tente de remédier aux inconvénients des approches précédentes pour l'IRM cardiaque : il fournit une IRM cardiaque en cinq dimensions (5D) complètement « self-gated » , c’est-à-dire capable de détecter les mouvements cardiaques et respiratoires, forte d’une implémentation simplifiée, d’une plus grande facilité d'utilisation, d’une dépendance réduite vis-à-vis de l'opérateur et d’une détection automatique des mouvements spécifiques du patient. L'imagerie « free- running » augmente la quantité d'informations à disposition du clinicien et est suffisamment flexible pour être appliquée à différents domaines de l'IRM cardiaque. De plus, le « self-gating » du cadre « free-running » a découplé l'acquisition de la compensation de mouvement et a ainsi ouvert l'IRM cardiaque à la classe plus large des techniques basées sur l'état stationnaire utilisant des séquences de précession libre équilibrée en état stationnaire (bSSFP), qui se distinguent par leur simplicité d’utilisation et leur rapport signal sur bruit élevé. Le thème de cette thèse est donc l'application des techniques basées sur l'état stationnaire à l'IRM cardiaque. La première partie porte sur le long temps d'acquisition de l'actuel cadre « free-running» et se concentre sur l'imagerie anatomique coronaire. Le protocole publié utilise une acquisition bSSFP interrompue où des modules de saturation de graisse (CHESS) sont insérés de façon à fournir un contraste sang-graisse puisqu’ils suppriment le signal du tissu graisseux entourant les artères coronaires, et sont suivis par des impulsions en rampe pour réduire les artefacts résultant du retour à l'état stable. Cette acquisition interrompue souffre cependant d'un état d'équilibre interrompu, d'une efficacité temporelle réduite et d'un débit d'absorption spécifique (DAS) plus élevé. En utilisant les nouvelles impulsions d'excitation radiofréquence (RF) binomiales hors -résonance insensibles aux lipides (LIBRE) développées dans notre laboratoi re, ce premier projet montre que les impulsions LIBRE incorporées dans une séquence bSSFP ininterrompue et « free-running » peuvent être utilisées avec succès pour l'IRM cardiaque 5D à 1,5 T. L'approche « free-running LIBRE » permet de réduire le temps d'acquisition et le DAS par rapport à l'approche interrompue précédente, tout en maintenant la perceptibilité des artères coronariennes. En outre, il s'agit de la première utilisation réussie d'une impulsion d'excitation RF supprimant la graisse dans une séquence bSSFP ininterrompue pour l'imagerie cardiaque, ce qui démontre le potentiel d’utilisation de la séquence bSSFP ininterrompue pour l'IRM cardiaque et résout le problème de la disponibilité de la séquence en clinique. Inspirée par la faisabilité d’utilisation de la séquence bSSFP ininterrompue pour l'IRM cardiaque, la deuxième partie étudie le potentiel de PLANET, une nouvelle technique de cartographie 3D multiparamétrique, pour la cartographie 5D du myocarde via l’imagerie « free-running ». PLANET utilise une acquisition bSSFP à cycle de phase et un algorithme d'ajustement d'ellipse direct pour calculer les temps de relaxation T1 et T2, ce qui suggère que cette méthode pourrait être facilement intégrée au cadre « free - running » sans interruption de l’état d'équilibre. Après calibration de l'acquisition, nous explorons la possibilité d'accélérer l'acquisition statique de PLANET pour l'appliquer au cœur. Nous démontrons que l'exactitude et la précision de PLANET peuvent être maintenues pour une accélération double avec une trajectoire 3D cartésienne en spirale, ce qui suggère que PLANET est réalisable pour la cartographie du myocarde avec une acquisition radiale 5D « free-running ». D'autres travaux devraient porter sur l'optimisation du schéma de reconstruction, l'amélioration de l'estimation de la sensibilité de l’antenne et l'examen de l'utilisation de la trajectoire radiale en vue de la mise en œuvre de la cartographie 5D « free-running » T1 et T2 du myocarde. Cette thèse présente deux approches utilisant des techniques de modulation de fréquence radio en état stationnaire pour l'IRM cardiaque. La première approche implique l'application nouvelle d'une acquisition bSSFP ininterrompue avec une excitation RF hors résonance pour l'imagerie anatomique coronaire. La seconde approche porte sur l'utilisation d’une séquence bSSFP à cycle de phase pour la cartographie 5D T1 et T2 du myocarde. Ces deux méthodes permettent de répondre au défi posé par la disponibilité des séquences en IRM cardiaque en montrant qu'une séquence commune et simple comme la bSSFP peut être utilisée pour l'acquisition, tandis que les étapes de compensation du mouvement et de reconstruction peuvent être traitées hors ligne. Ainsi, ces méthodes ont le potentiel de favoriser l'adoption de l'IRM cardiaque

Acceleration of Subtractive Non-contrast-enhanced Magnetic Resonance Angiography

Although contrast-enhanced magnetic resonance angiography (CE-MRA) is widely established as a clinical examination for the diagnosis of human vascular diseases, non-contrast-enhanced MRA (NCE-MRA) techniques have drawn increasing attention in recent years. NCE-MRA is based on the intrinsic physical properties of blood and does not require the injection of any exogenous contrast agents. Subtractive NCE-MRA is a class of techniques that acquires two image sets with different vascular signal intensity, which are later subtracted to generate angiograms. The long acquisition time is an important drawback of NCE-MRA techniques, which not only limits the clinical acceptance of these techniques but also renders them sensitive to artefacts from patient motion. Another problem for subtractive NCE-MRA is the unwanted residual background signal caused by different static background signal levels on the two raw image sets. This thesis aims at improving subtractive NCE-MRA techniques by addressing both these limitations, with a particular focus on three-dimensional (3D) femoral artery fresh blood imaging (FBI). The structure of the thesis is as follows: Chapter 1 describes the anatomy and physiology of the vascular system, including the characteristics of arteries and veins, and the MR properties and flow characteristics of blood. These characteristics are the foundation of NCE-MRA technique development. Chapter 2 introduces commonly used diagnostic angiographic methods, particularly CE-MRA and NCE-MRA. Current NCE-MRA techniques are reviewed and categorised into different types. Their principles, implementations and limitations are summarised. Chapter 3 describes imaging acceleration theories including compressed sensing (CS), parallel imaging (PI) and partial Fourier (PF). The Split Bregman algorithm is described as an efficient CS reconstruction method. The SPIRiT reconstruction for PI and homodyne detection for PF are also introduced and combined with Split Bregman to form the basis of the reconstruction strategy for undersampled MR datasets. Four image quality metrics are presented for evaluating the quality of reconstructed images. In Chapter 4, an intensity correction method is proposed to improve background suppression for subtractive NCE-MRA techniques. Residual signals of background tissues are removed by performing a weighted subtraction, in which the weighting factor is obtained by a robust regression method. Image sparsity can also be increased and thereby potentially benefit CS reconstruction in the following chapters. Chapter 5 investigates the optimal k-space sampling patterns for the 3D accelerated femoral artery FBI sequence. A variable density Poisson-disk with a fully sampled centre region and missing partial Fourier fractions is employed for k-space undersampling in the ky-kz plane. Several key parameters in sampling pattern design, such as partial Fourier sampling ratios, fully sampled centre region size and density decay factor, are evaluated and optimised. Chapter 6 introduces several reconstruction strategies for accelerated subtractive NCE-MRA. A new reconstruction method, k-space subtraction with phase and intensity correction (KSPIC), is developed. By performing subtraction in k-space, KSPIC can exploit the sparsity of subtracted angiogram data and potentially improve the reconstruction performance. A phase correction procedure is used to restore the polarity of negative signals caused by subtraction. The intensity correction method proposed in Chapter 4 is also incorporated in KSPIC as it improves background suppression and thereby sparsity. The highly accelerated technique can be used not only to reduce the acquisition time, but also to enable imaging with increased resolution with no time penalty. A time-efficient high-resolution FBI technique is proposed in Chapter 7. By employing KSPIC and modifying the flow-compensation/spoiled gradients, the image matrix size can be increased from 256×256 to up to 512×512 without prolonging the acquisition time. Chapter 8 summarises the overall achievements and limitations of this thesis, as well as outlines potential future research directions.Cambridge Trust China Scholarship Council Addenbrooke’s Charitable Trust National Institute of Health Research, Cambridge Biomedical Research Cente

Specifics of cardiac magnetic resonance imaging in children

SummaryThis review points out three specific features of cardiac magnetic resonance imaging (MRI) in children: the small size of the heart modifies the usual balance between signal-to-noise ratio and spatial resolution; the higher and more variable heart rate limits tissue characterization and temporal resolution; and motion artefacts (notably respiratory motions) must be dealt with. In the second part of this review, we present the current and future practices of cardiac magnetic resonance (CMR) in children, based on the experience of all French paediatric cardiac MRI centres

Retrospective Motion Correction in Magnetic Resonance Imaging of the Brain

Magnetic Resonance Imaging (MRI) is a tremendously useful diagnostic imaging modality that provides outstanding soft tissue contrast. However, subject motion is a significant unsolved problem; motion during image acquisition can cause blurring and distortions in the image, limiting its diagnostic utility. Current techniques for addressing head motion include optical tracking which can be impractical in clinical settings due to challenges associated with camera cross-calibration and marker fixation. Another category of techniques is MRI navigators, which use specially acquired MRI data to track the motion of the head. This thesis presents two techniques for motion correction in MRI: the first is spherical navigator echoes (SNAVs), which are rapidly acquired k-space navigators. The second is a deep convolutional neural network trained to predict an artefact-free image from motion-corrupted data. Prior to this thesis, SNAVs had been demonstrated for motion measurement but not motion correction, and they required the acquisition of a 26s baseline scan during which the subject could not move. In this work, a novel baseline approach is developed where the acquisition is reduced to 2.6s. Spherical navigators were interleaved into a spoiled gradient echo sequence (SPGR) on a stand-alone MRI system and a turbo-FLASH sequence (tfl) on a hybrid PET/MRI system to enable motion measurement throughout image acquisition. The SNAV motion measurements were then used to retrospectively correct the image data. While MRI navigator methods, particularly SNAVs that can be acquired very rapidly, are useful for motion correction, they do require pulse sequence modifications. A deep learning technique may be a more general solution. In this thesis, a conditional generative adversarial network (cGAN) is trained to perform motion correction on image data with simulated motion artefacts. We simulate motion in previously acquired brain images and use the image pairs (corrupted + original) to train the cGAN. MR image data was qualitatively and quantitatively improved following correction using the SNAV motion estimates. This was also true for the simultaneously acquired MR and PET data on the hybrid system. Motion corrected images were more similar than the uncorrected to the no-motion reference images. The deep learning approach was also successful for motion correction. The trained cGAN was evaluated on 5 subjects; and artefact suppression was observed in all images

Development of whole-heart myocardial perfusion magnetic resonance imaging

Myocardial perfusion imaging is of huge importance for the detection of coronary artery disease (CAD), one of the leading causes of morbidity and mortality worldwide, as it can provide non-invasive detection at the early stages of the disease. Magnetic resonance imaging (MRI) can assess myocardial perfusion by capturing the rst-pass perfusion (FPP) of a gadolinium-based contrast agent (GBCA), which is now a well-established technique and compares well with other modalities. However, current MRI methods are restricted by their limited coverage of the left ventricle. Interest has therefore grown in 3D volumetric \whole-heart" FPP by MRI, although many challenges currently limit this. For this thesis, myocardial perfusion assessment in general, and 3D whole-heart FPP in particular, were reviewed in depth, alongside MRI techniques important for achieving 3D FPP. From this, a 3D `stack-of-stars' (SOS) FPP sequence was developed with the aim of addressing some current limitations. These included the breath-hold requirement during GBCA rst-pass, long 3D shot durations corrupted by cardiac motion, and a propensity for artefacts in FPP. Parallel imaging and compressed sensing were investigated for accelerating whole-heart FPP, with modi cations presented to potentially improve robustness to free-breathing. Novel sequences were developed that were capable of individually improving some current sequence limits, including spatial resolution and signal-to-noise ratio, although with some sacri ces. A nal 3D SOS FPP technique was developed and tested at stress during free-breathing examinations of CAD patients and healthy volunteers. This enabled the rst known detection of an inducible perfusion defect with a free-breathing, compressed sensing, 3D FPP sequence; however, further investigation into the diagnostic performance is required. Simulations were performed to analyse potential artefacts in 3D FPP, as well as to examine ways towards further optimisation of 3D SOS FPP. The nal chapter discusses some limitations of the work and proposes opportunities for further investigation.Open Acces

Hand classification of fMRI ICA noise components

We present a practical "how-to" guide to help determine whether single-subject fMRI independent components (ICs) characterise structured noise or not. Manual identification of signal and noise after ICA decomposition is required for efficient data denoising: to train supervised algorithms, to check the results of unsupervised ones or to manually clean the data. In this paper we describe the main spatial and temporal features of ICs and provide general guidelines on how to evaluate these. Examples of signal and noise components are provided from a wide range of datasets (3T data, including examples from the UK Biobank and the Human Connectome Project, and 7T data), together with practical guidelines for their identification. Finally, we discuss how the data quality, data type and preprocessing can influence the characteristics of the ICs and present examples of particularly challenging datasets