Attenuation correction for brain PET imaging using deep neural network based on dixon and ZTE MR images

Positron Emission Tomography (PET) is a functional imaging modality widely used in neuroscience studies. To obtain meaningful quantitative results from PET images, attenuation correction is necessary during image reconstruction. For PET/MR hybrid systems, PET attenuation is challenging as Magnetic Resonance (MR) images do not reflect attenuation coefficients directly. To address this issue, we present deep neural network methods to derive the continuous attenuation coefficients for brain PET imaging from MR images. With only Dixon MR images as the network input, the existing U-net structure was adopted and analysis using forty patient data sets shows it is superior than other Dixon based methods. When both Dixon and zero echo time (ZTE) images are available, we have proposed a modified U-net structure, named GroupU-net, to efficiently make use of both Dixon and ZTE information through group convolution modules when the network goes deeper. Quantitative analysis based on fourteen real patient data sets demonstrates that both network approaches can perform better than the standard methods, and the proposed network structure can further reduce the PET quantification error compared to the U-net structure.Comment: 15 pages, 12 figure

Deep Boosted Regression for MR to CT Synthesis

Attenuation correction is an essential requirement of positron emission tomography (PET) image reconstruction to allow for accurate quantification. However, attenuation correction is particularly challenging for PET-MRI as neither PET nor magnetic resonance imaging (MRI) can directly image tissue attenuation properties. MRI-based computed tomography (CT) synthesis has been proposed as an alternative to physics based and segmentation-based approaches that assign a population-based tissue density value in order to generate an attenuation map. We propose a novel deep fully convolutional neural network that generates synthetic CTs in a recursive manner by gradually reducing the residuals of the previous network, increasing the overall accuracy and generalisability, while keeping the number of trainable parameters within reasonable limits. The model is trained on a database of 20 pre-acquired MRI/CT pairs and a four-fold random bootstrapped validation with a 80:20 split is performed. Quantitative results show that the proposed framework outperforms a state-of-the-art atlas-based approach decreasing the Mean Absolute Error (MAE) from 131HU to 68HU for the synthetic CTs and reducing the PET reconstruction error from 14.3% to 7.2%.Comment: Accepted at SASHIMI201

MR-based attenuation correction and scatter correction in neurological PET/MR imaging with 18F-FDG

The aim was to investigate the effects of MR-based attenuation correction (MRAC) and scatter correction to positron emission tomography (PET) image quantification in neurological PET/MR with 18F-FDG. A multi-center phantom study was conducted to investigate the effect of MRAC between PET/MR and PET/CT systems (I). An MRAC method to derive bone from T1-weighted MR images was developed (II, III). Finally, scatter correction accuracy with MRAC was investigated (IV). The results show that the quantitative accuracy in PET is well-comparable be-tween PET/MR and PET/CT systems when an attenuation correction method resembling CT-based attenuation correction (CTAC) is implemented. This al-lows achieving of a PET bias within standard uptake value (SUV) quantification repeatability (< 10 % error) and is within the repeatability of PET in most sys-tems and brain regions (< 5 % error). In addition, MRAC considering soft tissue, air and bone can be derived using T1-weighted images alone. The improved version of the MRAC method allows achieving a quantitative accuracy feasible for advanced applications (< 5 % error). MRAC has a minor effect on the scatter correction accuracy (< 3 % error), even when using MRAC without bone. In conclusion, MRAC can be considered the largest contributing factor to PET quantification bias in 18F-FDG neurological PET/MR. This finding is not explicitly limited only to 18F-FDG imaging. Once an MRAC method that performs close to CTAC is implemented, there is no reason why a PET/MR system would perform differently from a PET/CT system. Such an MRAC method has been developed and is freely available (http://bit.ly/2fx6Jjz). Scatter correction can be considered a non-issue in neurological PET/MR imaging when using 18F-FD

Deep MR to CT Synthesis for PET/MR Attenuation Correction

Positron Emission Tomography - Magnetic Resonance (PET/MR) imaging combines the functional information from PET with the flexibility of MR imaging. It is essential, however, to correct for photon attenuation when reconstructing PETs, which is challenging for PET/MR as neither modality directly image tissue attenuation properties. Classical MR-based computed tomography (CT) synthesis methods, such as multi-atlas propagation, have been the method of choice for PET attenuation correction (AC), however, these methods are slow and suffer from the poor ability to handle anatomical abnormalities. To overcome this limitation, this thesis explores the rising field of artificial intelligence in order to develop novel methods for PET/MR AC. Deep learning-based synthesis methods such as the standard U-Net architecture are not very stable, accurate, and robust to small variations in image appearance. Thus, the first proposed MR to CT synthesis method deploys a boosting strategy, where multiple weak predictors build a strong predictor providing a significant improvement in CT and PET reconstruction accuracy. Standard deep learning-based methods as well as more advanced methods like the first proposed method show issues in the presence of very complex imaging environments and large images such as whole-body images. The second proposed method learns the image context between whole-body MRs and CTs through multiple resolutions while simultaneously modelling uncertainty. Lastly, as the purpose of synthesizing a CT is to better reconstruct PET data, the use of CT-based loss functions is questioned within this thesis. Such losses fail to recognize the main objective of MR-based AC, which is to generate a synthetic CT that, when used for PET AC, makes the reconstructed PET as close as possible to the gold standard PET. The third proposed method introduces a novel PET-based loss that minimizes CT residuals with respect to the PET reconstruction

Potentials and caveats of AI in Hybrid Imaging

State-of-the-art patient management frequently mandates the investigation of both anatomy and physiology of the patients. Hybrid imaging modalities such as the PET/MRI, PET/CT and SPECT/CT have the ability to provide both structural and functional information of the investigated tissues in a single examination. With the introduction of such advanced hardware fusion, new problems arise such as the exceedingly large amount of multi-modality data that requires novel approaches of how to extract a maximum of clinical information from large sets of multi-dimensional imaging data. Artificial intelligence (AI) has emerged as one of the leading technologies that has shown promise in facilitating highly integrative analysis of multi-parametric data. Specifically, the usefulness of AI algorithms in the medical imaging field has been heavily investigated in the realms of (1) image acquisition and reconstruction, (2) post-processing and (3) data mining and modelling. Here, we aim to provide an overview of the challenges encountered in hybrid imaging and discuss how AI algorithms can facilitate potential solutions. In addition, we highlight the pitfalls and challenges in using advanced AI algorithms in the context of hybrid imaging and provide suggestions for building robust AI solutions that enable reproducible and transparent research

PET/MRI 및 MR-IGRT를 위한 MRI 기반 합성 CT 생성의 타당성 연구

학위논문 (박사) -- 서울대학교 대학원 : 의과대학 의과학과, 2020. 8. 이재성.Over the past decade, the application of magnetic resonance imaging (MRI) in the field of diagnosis and treatment has increased. MRI provides higher soft-tissue contrast, especially in the brain, abdominal organ, and bone marrow without the expose of ionizing radiation. Hence, simultaneous positron emission tomography/MR (PET/MR) system and MR-image guided radiation therapy (MR-IGRT) system has recently been emerged and currently available for clinical study. One major issue in PET/MR system is attenuation correction from MRI scans for PET quantification and a similar need for the assignment of electron densities to MRI scans for dose calculation can be found in MR-IGRT system. Because the MR signals are related to the proton density and relaxation properties of tissue, not to electron density. To overcome this problem, the method called synthetic CT (sCT), a pseudo CT derived from MR images, has been proposed. In this thesis, studies on generating synthetic CT and investigating the feasibility of using a MR-based synthetic CT for diagnostic and radiotherapy application were presented. Firstly, MR image-based attenuation correction (MR-AC) method using level-set segmentation for brain PET/MRI was developed. To resolve conventional inaccuracy MR-AC problem, we proposed an improved ultrashort echo time MR-AC method that was based on a multiphase level-set algorithm with main magnetic field inhomogeneity correction. We also assessed the feasibility of level-set based MR-AC method, compared with CT-AC and MR-AC provided by the manufacturer of the PET/MRI scanner. Secondly, we proposed sCT generation from the low field MR images using 2D convolution neural network model for MR-IGRT system. This sCT images were compared to the deformed CT generated using the deformable registration being used in the current system. We assessed the feasibility of using sCT for radiation treatment planning from each of the patients with pelvic, thoraic and abdominal region through geometric and dosimetric evaluation.지난 10년간 진단 및 치료분야에서 자기공명영상(Magnetic resonance imaging; MRI) 의 적용이 증가하였다. MRI는 CT와 비교해 추가적인 전리방사선의 피폭없이 뇌, 복부 기관 및 골수 등에서 더 높은 연조직 대비를 제공한다. 따라서 MRI를 적용한 양전자방출단층촬영(Positron emission tomography; PET)/MR 시스템과 MR 영상 유도 방사선 치료 시스템(MR-image guided radiation therapy; MR-IGRT)이 진단 및 치료 방사선분야에 등장하여 임상에 사용되고 있다. PET/MR 시스템의 한 가지 주요 문제는 PET 정량화를 위한 MRI 스캔으로부터의 감쇠 보정이며, MR-IGRT 시스템에서 선량 계산을 위해 MR 영상에 전자 밀도를 할당하는 것과 비슷한 필요성을 찾을 수 있다. 이는 MR 신호가 전자 밀도가 아닌 조직의 양성자 밀도 및 T1, T2 이완 특성과 관련이 있기 때문이다. 이 문제를 극복하기 위해, MR 이미지로부터 유래된 가상의 CT인 합성 CT라 불리는 방법이 제안되었다. 본 학위논문에서는 합성 CT 생성 방법 및 진단 및 방사선 치료에 적용을 위한 MR 영상 기반 합성 CT 사용의 임상적 타당성을 조사하였다. 첫째로, 뇌 PET/MR를 위한 레벨셋 분할을 이용한 MR 이미지 기반 감쇠 보정 방법을 개발하였다. MR 이미지 기반 감쇠 보정의 부정확성은 정량화 오류와 뇌 PET/MRI 연구에서 병변의 잘못된 판독으로 이어진다. 이 문제를 해결하기 위해, 자기장 불균일 보정을 포함한 다상 레벨셋 알고리즘에 기초한 개선된 초단파 에코 시간 MR-AC 방법을 제안하였다. 또한 CT-AC 및 PET/MRI 스캐너 제조업체가 제공한 MR-AC와 비교하여 레벨셋 기반 MR-AC 방법의 임상적 사용가능성을 평가하였다. 둘째로, MR-IGRT 시스템을 위한 심층 컨볼루션 신경망 모델을 사용하여 저필드 MR 이미지에서 생성된 합성 CT 방법를 제안하였다. 이 합성 CT 이미지를 변형 정합을 사용하여 생성된 변형 CT와 비교 하였다. 또한 골반, 흉부 및 복부 환자에서의 기하학적, 선량적 분석을 통해 방사선 치료계획에서의 합성 CT를 사용가능성을 평가하였다.Chapter 1. Introduction 1 1.1. Background 1 1.1.1. The Integration of MRI into Other Medical Devices 1 1.1.2. Chanllenges in the MRI Integrated System 4 1.1.3. Synthetic CT Generation 5 1.2. Purpose of Research 6 Chapter 2. MRI-based Attenuation Correction for PET/MRI 8 2.1. Background 8 2.2. Materials and Methods 10 2.2.1. Brain PET Dataset 19 2.2.2. MR-Based Attenuation Map using Level-Set Algorithm 12 2.2.3. Image Processing and Reconstruction 18 2.3. Results 20 2.4. Discussion 28 Chapter 3. MRI-based synthetic CT generation for MR-IGRT 30 3.1. Background 30 3.2. Materials and Methods 32 3.2.1. MR-dCT Paired DataSet 32 3.2.2. Synthetic CT Generation using 2D CNN 36 3.2.3. Data Analysis 38 3.3. Results 41 3.3.1. Image Comparison 41 3.3.2. Geometric Analysis 49 3.3.3. Dosimetric Analysis 49 3.4. Discussion 56 Chapter 4. Conclusions 59 Bibliography 60 Abstract in Korean (국문 초록) 64Docto