Lesion segmentation on 18F-fluciclovine PET/CT images using deep learning

Background and purposeA novel radiotracer, 18F-fluciclovine (anti-3-18F-FACBC), has been demonstrated to be associated with significantly improved survival when it is used in PET/CT imaging to guide postprostatectomy salvage radiotherapy for prostate cancer. We aimed to investigate the feasibility of using a deep learning method to automatically detect and segment lesions on 18F-fluciclovine PET/CT images.Materials and methodsWe retrospectively identified 84 patients who are enrolled in Arm B of the Emory Molecular Prostate Imaging for Radiotherapy Enhancement (EMPIRE-1) trial. All 84 patients had prostate adenocarcinoma and underwent prostatectomy and 18F-fluciclovine PET/CT imaging with lesions identified and delineated by physicians. Three different neural networks with increasing levels of complexity (U-net, Cascaded U-net, and a cascaded detection segmentation network) were trained and tested on the 84 patients with a fivefold cross-validation strategy and a hold-out test, using manual contours as the ground truth. We also investigated using both PET and CT or using PET only as input to the neural network. Dice similarity coefficient (DSC), 95th percentile Hausdorff distance (HD95), center-of-mass distance (CMD), and volume difference (VD) were used to quantify the quality of segmentation results against ground truth contours provided by physicians.ResultsAll three deep learning methods were able to detect 144/155 lesions and 153/155 lesions successfully when PET+CT and PET only, respectively, served as input. Quantitative results demonstrated that the neural network with the best performance was able to segment lesions with an average DSC of 0.68 ± 0.15 and HD95 of 4 ± 2 mm. The center of mass of the segmented contours deviated from physician contours by approximately 2 mm on average, and the volume difference was less than 1 cc. The novel network proposed by us achieves the best performance compared to current networks. The addition of CT as input to the neural network contributed to more cases of failure (DSC = 0), and among those cases of DSC > 0, it was shown to produce no statistically significant difference with the use of only PET as input for our proposed method.ConclusionQuantitative results demonstrated the feasibility of the deep learning methods in automatically segmenting lesions on 18F-fluciclovine PET/CT images. This indicates the great potential of 18F-fluciclovine PET/CT combined with deep learning for providing a second check in identifying lesions as well as saving time and effort for physicians in contouring

A convolutional neural network to filter artifacts in spectroscopic MRI

Purpose Proton MRSI is a noninvasive modality capable of generating volumetric maps of in vivo tissue metabolism without the need for ionizing radiation or injected contrast agent. Magnetic resonance spectroscopic imaging has been shown to be a viable imaging modality for studying several neuropathologies. However, a key hurdle in the routine clinical adoption of MRSI is the presence of spectral artifacts that can arise from a number of sources, possibly leading to false information. Methods A deep learning model was developed that was capable of identifying and filtering out poor quality spectra. The core of the model used a tiled convolutional neural network that analyzed frequency‐domain spectra to detect artifacts. Results When compared with a panel of MRS experts, our convolutional neural network achieved high sensitivity and specificity with an area under the curve of 0.95. A visualization scheme was implemented to better understand how the convolutional neural network made its judgement on single‐voxel or multivoxel MRSI, and the convolutional neural network was embedded into a pipeline capable of producing whole‐brain spectroscopic MRI volumes in real time. Conclusion The fully automated method for assessment of spectral quality provides a valuable tool to support clinical MRSI or spectroscopic MRI studies for use in fields such as adaptive radiation therapy planning

Image Registration with Auto-Mapped Control Volumes

Abstract of paper presented at the 47th Annual Meeting of the American Society for Therapeutic Radiology and Oncology

Multiscale Image Registration

A multiscale image registration technique is presented for the registration of medical images that contain significant levels of noise. An overview of the medical image registration problem is presented, and various registration techniques are discussed. Experiments using mean squares, normalized correlation, and mutual information optimal linear registration are presented that determine the noise levels at which registration using these techniques fails. Further experiments in which classical denoising algorithms are applied prior to registration are presented, and it is shown that registration fails in this case for significantly high levels of noise, as well. The hierarchical multiscale image decomposition of E. Tadmor, S. Nezzar, and L. Vese [20] is presented, and accurate registration of noisy images is achieved by obtaining a hierarchical multiscale decomposition of the images and registering the resulting components. This approach enables successful registration of images that contain noise levels well beyond the level at which ordinary optimal linear registration fails. Image registration experiments demonstrate the accuracy and efficiency of the multiscale registration technique, and for all noise levels, the multiscale technique is as accurate as or more accurate than ordinary registration techniques

Multiobjective Evolutionary Optimization of Number of Beams,

We propose a hybrid multiobjective (MO) evolutionary optimization algorithm (MOEA) for intensity modulated radiotherapy inverse planning and apply it to optimize the number of incident beams, their orientations and intensity profiles. The algorithm produces a set of efficient solutions, which represent different clinical tradeoffs and contains information such as variety of dose distributions and dosevolume histograms (DVH). No importance factors are required and solutions can be obtained in regions not accessible by conventional weighted sum approaches. The application of the algorithm using a test case, a prostate and a head and neck tumor case is shown. The results are compared with MO inverse planning using a gradient-based optimization algorithm

Improving the Convergence and Computational Efficiency of Deformable Image Registration Calculation by Incorporating Prior Knowledge

Abstract of a paper presented at the 48th Annual Meeting of the American Society for Therapeutic Radiology and Oncology

Automated Quality Assurance for Image-Guided Radiation Therapy

The use of image-guided patient positioning requires fast and reliable Quality Assurance (QA) methods to ensure the megavoltage (MV) treatment beam coincides with the integrated kilovoltage (kV) or volumetric cone-beam CT (CBCT) imaging and guidance systems. Current QA protocol is based on visually observing deviations of certain features in acquired kV in-room treatment images such as markers, distances, or HU values from phantom specifications. This is a timeconsuming and subjective task because these features are identified by human operators. The method implemented in this study automated an IGRT QA protocol by using specific image processing algorithms that rigorously detected phantom features and performed all measurements involved in a classical QA protocol. The algorithm was tested on four different IGRT QA phantoms. Image analysis algorithms were able to detect QA features with the same accuracy as the manual approach but significantly faster. All described tests were performed in a single procedure, with acquisition of the images taking approximately 5 minutes, and the automated software analysis taking less than 1 minute. The study showed that the automated image analysis based procedure may be used as a daily QA procedure because it is completely automated and uses a single phantom setup

MULTISCALE IMAGE REGISTRATION

(Communicated by Yang Kuang) Abstract. A multiscale image registration technique is presented for the registration of medical images that contain significant levels of noise. An overview of the medical image registration problem is presented, and various registration techniques are discussed. Experiments using mean squares, normalized correlation, and mutual information optimal linear registration are presented that determine the noise levels at which registration using these techniques fails. Further experiments in which classical denoising algorithms are applied prior to registration are presented, and it is shown that registration fails in this case for significantly high levels of noise, as well. The hierarchical multiscale image decomposition of E. Tadmor, S. Nezzar, and L. Vese [20] is presented, and accurate registration of noisy images is achieved by obtaining a hierarchical multiscale decomposition of the images and registering the resulting components. This approach enables successful registration of images that contain noise levels well beyond the level at which ordinary optimal linear registration fails. Image registration experiments demonstrate the accuracy and efficiency of the multiscale registration technique, and for all noise levels, the multiscale technique is as accurate as or more accurate than ordinary registration techniques