Neural networks-based regularization for large-scale medical image reconstruction

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks (NNs) and cascaded NNs have been reported to achieve state-of-the-art results with respect to various quantitative quality measures as PSNR, NRMSE and SSIM across different imaging modalities. However, the fact that these approaches employ the application of the forward and adjoint operators repeatedly in the network architecture requires the network to process the whole images or volumes at once, which for some applications is computationally infeasible. In this work, we follow a different reconstruction strategy by strictly separating the application of the NN, the regularization of the solution and the consistency with the measured data. The regularization is given in the form of an image prior obtained by the output of a previously trained NN which is used in a Tikhonov regularization framework. By doing so, more complex and sophisticated network architectures can be used for the removal of the artefacts or noise than it is usually the case in iterative NNs. Due to the large scale of the considered problems and the resulting computational complexity of the employed networks, the priors are obtained by processing the images or volumes as patches or slices. We evaluated the method for the cases of 3D cone-beam low dose CT and undersampled 2D radial cine MRI and compared it to a total variation-minimization-based reconstruction algorithm as well as to a method with regularization based on learned overcomplete dictionaries. The proposed method outperformed all the reported methods with respect to all chosen quantitative measures and further accelerates the regularization step in the reconstruction by several orders of magnitude

Fast myocardial T(1) mapping using cardiac motion correction

PURPOSE: To improve the efficiency of native and postcontrast high-resolution cardiac T(1) mapping by utilizing cardiac motion correction. METHODS: Common cardiac T(1) mapping techniques only acquire data in a small part of the cardiac cycle, leading to inefficient data sampling. Here, we present an approach in which 80% of each cardiac cycle is used for T(1) mapping by integration of cardiac motion correction. Golden angle radial data was acquired continuously for 8 s with in-plane resolution of 1.3 × 1.3 mm(2). Cine images were reconstructed for nonrigid cardiac motion estimation. Images at different TIs were reconstructed from the same data, and motion correction was performed prior to T(1) mapping. Native T(1) mapping was evaluated in healthy subjects. Furthermore, the technique was applied for postcontrast T(1) mapping in 5 patients with suspected fibrosis. RESULTS: Cine images with high contrast were obtained, leading to robust cardiac motion estimation. Motion-corrected T(1) maps showed myocardial T(1) times similar to cardiac-triggered T(1) maps obtained from the same data (1288 ± 49 ms and 1259 ± 55 ms, respectively) but with a 34% improved precision (spatial variation: 57.0 ± 12.5 ms and 94.8 ± 15.4 ms, respectively, P < 0.0001) due to the increased amount of data. In postcontrast T(1) maps, focal fibrosis could be confirmed with late contrast-enhancement images. CONCLUSION: The proposed approach provides high-resolution T(1) maps within 8 s. Data acquisition efficiency for T(1) mapping was improved by a factor of 5 by integration of cardiac motion correction, resulting in precise T(1) maps

Unrolled three-operator splitting for parameter-map learning in Low Dose X-ray CT reconstruction

We propose a method for fast and automatic estimation of spatially dependent regularization maps for total variation-based (TV) tomography reconstruction. The estimation is based on two distinct sub-networks, with the first sub-network estimating the regularization parameter-map from the input data while the second one unrolling T iterations of the Primal-Dual Three-Operator Splitting (PD3O) algorithm. The latter approximately solves the corresponding TV-minimization problem incorporating the previously estimated regularization parameter-map. The overall network is then trained end-to-end in a supervised learning fashion using pairs of clean-corrupted data but crucially without the need of having access to labels for the optimal regularization parameter-maps

Learning Regularization Parameter-Maps for Variational Image Reconstruction Using Deep Neural Networks and Algorithm Unrolling

We introduce a method for the fast estimation of data-adapted, spatially and temporally dependent regularization parameter-maps for variational image reconstruction, focusing on total variation (TV) minimization. The proposed approach is inspired by recent developments in algorithm unrolling using deep neural networks (NNs) and relies on two distinct subnetworks. The first subnetwork estimates the regularization parameter-map from the input data. The second subnetwork unrolls iterations of an iterative algorithm which approximately solves the corresponding TV-minimization problem incorporating the previously estimated regularization parameter-map. The overall network is then trained end-to-end in a supervised learning fashion using pairs of clean and corrupted data but crucially without the need for access to labels for the optimal regularization parameter-maps. We first prove consistency of the unrolled scheme by showing that the unrolled minimizing energy functional used for the supervised learning -converges, as tends to infinity, to the corresponding functional that incorporates the exact solution map of the TV-minimization problem. Then, we apply and evaluate the proposed method on a variety of large-scale and dynamic imaging problems with retrospectively simulated measurement data for which the automatic computation of such regularization parameters has been so far challenging using the state-of-the-art methods: a 2D dynamic cardiac magnetic resonance imaging (MRI) reconstruction problem, a quantitative brain MRI reconstruction problem, a low-dose computed tomography problem, and a dynamic image denoising problem. The proposed method consistently improves the TV reconstructions using scalar regularization parameters, and the obtained regularization parameter-maps adapt well to imaging problems and data by leading to the preservation of detailed features. Although the choice of the regularization parameter-maps is data-driven and based on NNs, the subsequent reconstruction algorithm is interpretable since it inherits the properties (e.g., convergence guarantees) of the iterative reconstruction method from which the network is implicitly defined

Clinical Study The Impact of Personality Traits on the Outcome of Total Knee Arthroplasty

Ten to twenty percent of patients with total knee arthroplasty (TKA) are dissatisfied with their clinical outcome. Aim of this study was to investigate the impact of personality traits on the subjective outcome of TKA. We investigated 80 patients with 86 computer navigated TKAs. We asked for patients satisfaction and divided patients into two groups (satisfied or dissatisfied). 12 personality traits were tested by the Freiburg Personality Inventory (FPI-R). Postoperative examination included Knee Society Score (KSS), Western Ontario and McMaster University Osteoarthritis Index (WOMAC), and the Visual Analogue Scale (VAS). Radiologic investigation was done in all patients. 84% of our patients were satisfied, while 16% were not satisfied. The FPI-R showed statistical significant influence of four personality traits on patient satisfaction: life satisfaction ( = 0.006), performance orientation ( = 0.015), somatic distress ( = 0.001), and emotional stability ( = 0.002). All clinical scores (VAS, WOMAC, and KSS) showed significantly better results in the satisfied patient. Radiological examination showed optimal alignment of all TKAs. There were no complications requiring revision surgery. The results of our study show that personality traits may influence patients satisfaction and clinical outcome after TKA. Therefore patients personality traits may be a useful predictive factor for postoperative satisfaction after TKA

Cardio-respiratory motion-corrected 3D cardiac water-fat MRI using model-based image reconstruction

PURPOSE: Myocardial fat infiltrations are associated with a range of cardiomyopathies. The purpose of this study was to perform cardio-respiratory motion-correction for model-based water-fat separation to image fatty infiltrations of the heart in a free-breathing, non-cardiac-triggered high-resolution 3D MRI acquisition. METHODS: Data were acquired in nine patients using a free-breathing, non-cardiac-triggered high-resolution 3D Dixon gradient-echo sequence and radial phase encoding trajectory. Motion correction was combined with a model-based water-fat reconstruction approach. Respiratory and cardiac motion models were estimated using a dual-mode registration algorithm incorporating both motion-resolved water and fat information. Qualitative comparisons of fat structures were made between 2D clinical routine reference scans and reformatted 3D motion-corrected images. To evaluate the effect of motion correction the local sharpness of epicardial fat structures was analyzed for motion-averaged and motion-corrected fat images. RESULTS: The reformatted 3D motion-corrected reconstructions yielded qualitatively comparable fat structures and fat structure sharpness in the heart as the standard 2D breath-hold. Respiratory motion correction improved the local sharpness on average by 32% ± 24% with maximum improvements of 81% and cardiac motion correction increased the sharpness further by another 15% ± 11% with maximum increases of 31%. One patient showed a fat infiltration in the myocardium and cardio-respiratory motion correction was able to improve its visualization in 3D. CONCLUSION: The 3D water-fat separated cardiac images were acquired during free-breathing and in a clinically feasible and predictable scan time. Compared to a motion-averaged reconstruction an increase in sharpness of fat structures by 51% ± 27% using the presented motion correction approach was observed for nine patients

3D model-based super-resolution motion-corrected cardiac T1 mapping

OBJECTIVE: To provide 3D high-resolution cardiac T1 maps using model-based super-resolution reconstruction (SRR). APPROACH: Due to signal-to-noise ratio (SNR) limitations and the motion of the heart during imaging, often 2D T1 maps with only low through-plane resolution (i.e. slice thickness of 6 to 8 mm) can be obtained. Here, a model-based SRR approach is presented, which combines multiple stacks of 2D acquisitions with 6 to 8 mm slice thickness and generates 3D high-resolution T1 maps with a slice thickness of 1.5 to 2 mm. Every stack was acquired in a different breath hold (BH) and any misalignment between BH was corrected retrospectively. The novelty of the proposed approach is the BH correction and the application of model-based SRR on cardiac T1 Mapping. The proposed approach was evaluated in numerical simulations and phantom experiments and demonstrated in four healthy subjects. MAIN RESULTS: Alignment of BH states was essential for SRR even in healthy volunteers. In simulations, respiratory motion could be estimated with an RMS error of 0.18 ± 0.28 mm. SRR improved the visualization of small structures. High accuracy and precision (average standard deviation of 69.62 ms) of the T1 values was ensured by SRR while the detectability of small structures increased by 40%. SIGNIFICANCE: The proposed SRR approach provided T1 maps with high in-plane and high through-plane resolution (1.3×1.3×1.5 to 2 mm(3)). The approach led to improvements in the visualization of small structures and precise T1 values

SIRF: Synergistic Image Reconstruction Framework

The combination of positron emission tomography (PET) with magnetic resonance (MR) imaging opens the way to more accurate diagnosis and improved patient management. At present, the data acquired by PET-MR scanners are essentially processed separately, but the opportunity to improve accuracy of the tomographic reconstruction via synergy of the two imaging techniques is an active area of research. In this paper, we present Release 2.1.0 of the CCP-PETMR Synergistic Image Reconstruction Framework (SIRF) software suite, providing an open-source software platform for efficient implementation and validation of novel reconstruction algorithms. SIRF provides user-friendly Python and MATLAB interfaces built on top of C++ libraries. SIRF uses advanced PET and MR reconstruction software packages and tools. Currently, for PET this is Software for Tomographic Image Reconstruction (STIR); for MR, Gadgetron and ISMRMRD; and for image registration tools, NiftyReg. The software aims to be capable of reconstructing images from acquired scanner data, whilst being simple enough to be used for educational purposes