Attenuation correction for brain PET imaging using deep neural network based on dixon and ZTE MR images

Positron Emission Tomography (PET) is a functional imaging modality widely used in neuroscience studies. To obtain meaningful quantitative results from PET images, attenuation correction is necessary during image reconstruction. For PET/MR hybrid systems, PET attenuation is challenging as Magnetic Resonance (MR) images do not reflect attenuation coefficients directly. To address this issue, we present deep neural network methods to derive the continuous attenuation coefficients for brain PET imaging from MR images. With only Dixon MR images as the network input, the existing U-net structure was adopted and analysis using forty patient data sets shows it is superior than other Dixon based methods. When both Dixon and zero echo time (ZTE) images are available, we have proposed a modified U-net structure, named GroupU-net, to efficiently make use of both Dixon and ZTE information through group convolution modules when the network goes deeper. Quantitative analysis based on fourteen real patient data sets demonstrates that both network approaches can perform better than the standard methods, and the proposed network structure can further reduce the PET quantification error compared to the U-net structure.Comment: 15 pages, 12 figure

Multiresolution spatiotemporal mechanical model of the heart as a prior to constrain the solution for 4D models of the heart.

In several nuclear cardiac imaging applications (SPECT and PET), images are formed by reconstructing tomographic data using an iterative reconstruction algorithm with corrections for physical factors involved in the imaging detection process and with corrections for cardiac and respiratory motion. The physical factors are modeled as coefficients in the matrix of a system of linear equations and include attenuation, scatter, and spatially varying geometric response. The solution to the tomographic problem involves solving the inverse of this system matrix. This requires the design of an iterative reconstruction algorithm with a statistical model that best fits the data acquisition. The most appropriate model is based on a Poisson distribution. Using Bayes Theorem, an iterative reconstruction algorithm is designed to determine the maximum a posteriori estimate of the reconstructed image with constraints that maximizes the Bayesian likelihood function for the Poisson statistical model. The a priori distribution is formulated as the joint entropy (JE) to measure the similarity between the gated cardiac PET image and the cardiac MRI cine image modeled as a FE mechanical model. The developed algorithm shows the potential of using a FE mechanical model of the heart derived from a cardiac MRI cine scan to constrain solutions of gated cardiac PET images

MedGAN: Medical Image Translation using GANs

Image-to-image translation is considered a new frontier in the field of medical image analysis, with numerous potential applications. However, a large portion of recent approaches offers individualized solutions based on specialized task-specific architectures or require refinement through non-end-to-end training. In this paper, we propose a new framework, named MedGAN, for medical image-to-image translation which operates on the image level in an end-to-end manner. MedGAN builds upon recent advances in the field of generative adversarial networks (GANs) by merging the adversarial framework with a new combination of non-adversarial losses. We utilize a discriminator network as a trainable feature extractor which penalizes the discrepancy between the translated medical images and the desired modalities. Moreover, style-transfer losses are utilized to match the textures and fine-structures of the desired target images to the translated images. Additionally, we present a new generator architecture, titled CasNet, which enhances the sharpness of the translated medical outputs through progressive refinement via encoder-decoder pairs. Without any application-specific modifications, we apply MedGAN on three different tasks: PET-CT translation, correction of MR motion artefacts and PET image denoising. Perceptual analysis by radiologists and quantitative evaluations illustrate that the MedGAN outperforms other existing translation approaches.Comment: 16 pages, 8 figure

Effect of Time-of-Flight and Regularized Reconstructions on Quantitative Measurements and Qualitative Assessments in Newly Diagnosed Prostate Cancer With 18F-Fluorocholine Dual Time Point PET/MRI.

Recent technical advances in positron emission tomography/magnetic resonance imaging (PET/MRI) technology allow much improved time-of-flight (TOF) and regularized iterative PET reconstruction regularized iterative reconstruction (RIR) algorithms. We evaluated the effect of TOF and RIR on standardized uptake values (maximum and peak SUV [SUVmax and SUVpeak]) and their metabolic tumor volume dependencies and visual image quality for 18F-fluorocholine PET/MRI in patients with newly diagnosed prostate cancer. Fourteen patients were administered with 3 MBq/kg of 18F-fluorocholine and scanned dynamically for 30 minutes. Positron emission tomography images were divided to early and late time points (1-6 minutes summed and 7-30 minutes summed). The values of the different SUVs were documented for dominant PET-avid lesions, and metabolic tumor volume was estimated using a 50% isocontour and SUV threshold of 2.5. Image quality was assessed via visual acuity scoring (VAS). We found that incorporation of TOF or RIR increased lesion SUVs. The lesion to background ratio was not improved by TOF reconstruction, while RIR improved the lesion to background ratio significantly ( P < .05). The values of the different VAS were all significantly higher ( P < .05) for RIR images over TOF, RIR over non-TOF, and TOF over non-TOF. In conclusion, our data indicate that TOF or RIR should be incorporated into current protocols when available