Efficient cascaded V-net optimization for lower extremity CT segmentation validated using bone morphology assessment

Semantic segmentation of bone from lower extremity computerized tomography (CT) scans can improve and accelerate the visualization, diagnosis, and surgical planning in orthopaedics. However, the large field of view of these scans makes automatic segmentation using deep learning based methods challenging, slow and graphical processing unit (GPU) memory intensive. We investigated methods to more efficiently represent anatomical context for accurate and fast segmentation and compared these with state-of-the-art methodology. Six lower extremity bones from patients of two different datasets were manually segmented from CT scans, and used to train and optimize a cascaded deep learning approach. We varied the number of resolution levels, receptive fields, patch sizes, and number of V-net blocks. The best performing network used a multi-stage, cascaded V-net approach with 1283−643−323 voxel patches as input. The average Dice coefficient over all bones was 0.98 ± 0.01, the mean surface distance was 0.26 ± 0.12 mm and the 95th percentile Hausdorff distance 0.65 ± 0.28 mm. This was a significant improvement over the results of the state-of-the-art nnU-net, with only approximately 1/12th of training time, 1/3th of inference time and 1/4th of GPU memory required. Comparison of the morphometric measurements performed on automatic and manual segmentations showed good correlation (Intraclass Correlation Coefficient [ICC] >0.8) for the alpha angle and excellent correlation (ICC >0.95) for the hip-knee-ankle angle, femoral inclination, femoral version, acetabular version, Lateral Centre-Edge angle, acetabular coverage. The segmentations were generally of sufficient quality for the tested clinical applications and were performed accurately and quickly compared to state-of-the-art methodology from the literature

CT to MR registration of complex deformations in the knee joint through dual quaternion interpolation of rigid transforms

Purpose. To develop a method that enables computed tomography (CT) to magnetic resonance (MR) image registration of complex deformations typically encountered in rotating joints such as the knee joint. Methods. We propose a workflow, denoted quaternion interpolated registration (QIR), consisting of three steps, which makes use of prior knowledge of tissue properties to initialise deformable registration. In the first step, the rigid skeletal components were individually registered. Next, the deformation of soft tissue was estimated using a dual quaternion-based interpolation method. In the final step, the registration was fine-tuned with a rigidity-constrained deformable registration step. The method was applied to paired, unregistered CT and MR images of the knee of 92 patients. It was compared to registration using B-Splines (BS) and B-Splines with a rigidity penalty (BSRP). Registration accuracy was evaluated using mutual information, and by calculating Dice similarity coefficient (DSC), mean absolute surface distance (MASD) and 95th percentile Hausdorff distance (HD95) on bone, and DSC on water and fat dominated tissue. To evaluate the rigidity of bone in the registration, the Jacobian determinant (JD) was calculated. Results. QIR achieved improved results with 0.93, 0.76 mm and 1.88 mm on the DSC, MASD and HD95 metrics on bone, compared to 0.87, 1.40 mm and 4.99 mm for method and 0.87, 1.40 mm and 3.56 mm for the BSRP method. The average DSC of water and fat was 0.77 and 0.86 for the QIR, 0.75 and 0.84 for BS and 0.74 and 0.84 for BSRP. Comparison of the median JD and median interquartile (IQR) ranges of the JD indicated that the QIR (1.00 median, 0.03 IQR) resulted in higher rigidity in the rigid skeletal tissues compared to the BS (0.98 median, 0.19 IQR) and BSRP (1.00 median, 0.05 IQR) methods. Conclusion. This study showed that QIR could improve the outcome of complex registration problems, encountered in joints involving rigid and non-rigid bodies such as occur in the knee, as compared to a conventional registration approach

Impact of bone and cartilage segmentation from CT and MRI on both bone forearm osteotomy planning

Introduction: The use of MRI scans for pre-operative surgical planning of forearm osteotomies provides additional information of joint cartilage and soft tissue structures and reduces radiation exposure in comparison with the use of CT scans. In this study, we investigated whether using 3D information obtained from MRI with and without cartilage information leads to a different outcome of pre-operative planning. Methods: Bilateral CT and MRI scans of the forearms of 10 adolescent and young adult patients with a unilateral bone deformation were acquired in a prospective study. The bones were segmented from CT and MRI, and cartilage only from MRI. The deformed bones were virtually reconstructed, by registering the joint ends to the healthy contralateral side. An optimal osteotomy plane was determined that minimized the distance between the resulting fragments. This process was performed in threefold: using the CT and MRI bone segmentations, and the MRI cartilage segmentations. Results: Comparison of bone segmentation from MRI and CT scan resulted in a 0.95 ± 0.02 Dice Similarity Coefficient and 0.42 ± 0.07 mm Mean Absolute Surface Distance. All realignment parameters showed excellent reliability across the different segmentations. However, the mean differences in translational realignment between CT and MRI bone segmentations (4.5 ± 2.1 mm) and between MRI bone and MRI bone and cartilage segmentations (2.8 ± 2.1 mm) were shown to be clinically and statistically significant. A significant positive correlation was found between the translational realignment and the relative amount of cartilage. Conclusion: This study indicates that although bone realignment remained largely similar when using MRI with and without cartilage information compared to using CT, the small differences in segmentation could induce statistically and clinically significant differences in the osteotomy planning. We also showed that endochondral cartilage might be a non-negligible factor when planning osteotomies for young patients