U-Net and its variants for medical image segmentation: theory and applications

U-net is an image segmentation technique developed primarily for medical image analysis that can precisely segment images using a scarce amount of training data. These traits provide U-net with a very high utility within the medical imaging community and have resulted in extensive adoption of U-net as the primary tool for segmentation tasks in medical imaging. The success of U-net is evident in its widespread use in all major image modalities from CT scans and MRI to X-rays and microscopy. Furthermore, while U-net is largely a segmentation tool, there have been instances of the use of U-net in other applications. As the potential of U-net is still increasing, in this review we look at the various developments that have been made in the U-net architecture and provide observations on recent trends. We examine the various innovations that have been made in deep learning and discuss how these tools facilitate U-net. Furthermore, we look at image modalities and application areas where U-net has been applied.Comment: 42 pages, in IEEE Acces

Fully automated 3D segmentation and separation of multiple cervical vertebrae in CT images using a 2D convolutional neural network

Background and objective: We investigated a novel method using a 2D convolutional neural network (CNN) to identify superior and inferior vertebrae in a single slice of CT images, and a post-processing for 3D segmentation and separation of cervical vertebrae. Methods: The cervical spines of patients (N == 17, 1684 slices) from Severance and Gangnam Severance Hospitals (S/GSH) and healthy controls (N == 24, 3490 slices) from Seoul National University Bundang Hospital (SNUBH) were scanned by using various volumetric CT protocols. To prepare gold standard masks of cervical spine in CT images, each spine was segmented by using conventional image-processing methods and manually corrected by an expert. The gold standard masks were preprocessed and labeled into superior and inferior cervical vertebrae separately in the axial slices. The 2D U-Net model was trained by using the disease dataset (S/GSH) and additional validation was performed by using the healthy control dataset (SNUBH), and then the training and validation were repeated by switching the two datasets. Results: In case of the model was trained with the disease dataset (S/GSH) and validated with the healthy control (SNUBH), the mean and standard deviation (SD) of the Dice similarity coefficient (DSC), Jaccard similarity coefficient (JSC), mean surface distance (MSD), and Hausdorff surface distance (HSD) were 94.37%% ± 1.45%, 89.47%% ± 2.55%, 0.33 ± 0.12 mm and 20.89 ± 3.98 mm, and 88.67%% ± 5.82%, 80.83%% ± 8.09%, 1.05 ± 0.63 mm and 29.17 ± 19.74 mm, respectively. In case of the model was trained with the healthy control (SNUBH) and validated with the disease dataset (S/GSH), the mean and SD of DSC, JSC, MSD, and HSD were 96.23%% ± 1.55%, 92.95%% ± 2.58%, 0.39 ± 0.20 mm and 16.23 ± 6.72 mm, and 93.15%% ± 3.09%, 87.54%% ± 5.11%, 0.38 ± 0.17 mm and 20.85 ± 7.11 mm, respectively. Conclusions: The results demonstrated that our fully automated method achieved comparable accuracies with inter- and intra-observer variabilities of manual segmentation by human experts, which is time consuming.restrictio

Fully automated 3D segmentation and separation of multiple cervical vertebrae in CT images using a 2D convolutional neural network

Background and Objective: We investigated a novel method using a 2D convolutional neural network (CNN) to identify superior and inferior vertebrae in a single slice of CT images, and a post-processing for 3D segmentation and separation of cervical vertebrae. Methods: The cervical spines of patients (N == 17, 1684 slices) from Severance and Gangnam Severance Hospitals (S/GSH) and healthy controls (N == 24, 3490 slices) from Seoul National University Bundang Hospital (SNUBH) were scanned by using various volumetric CT protocols. To prepare gold standard masks of cervical spine in CT images, each spine was segmented by using conventional image-processing methods and manually corrected by an expert. The gold standard masks were preprocessed and labeled into superior and inferior cervical vertebrae separately in the axial slices. The 2D U-Net model was trained by using the disease dataset (S/GSH) and additional validation was performed by using the healthy control dataset (SNUBH), and then the training and validation were repeated by switching the two datasets. Results: In case of the model was trained with the disease dataset (S/GSH) and validated with the healthy control (SNUBH), the mean and standard deviation (SD) of the Dice similarity coefficient (DSC), Jaccard similarity coefficient USC), mean surface distance (MSD), and Hausdorff surface distance (HSD) were 94.37%% +/- 1.45%, 89.47%% +/- 2.55%, 0.33 +/- 0.12 mm and 20.89 I 3.98 mm, and 88.67%% +/- 5.82%, 80.83%% +/- 8.09%, 1.05 +/- 0.63 mm and 29.17 +/- 19.74 mm, respectively. In case of the model was trained with the healthy control (SNUBH) and validated with the disease dataset (S/GSH), the mean and SD of DSC, JSC, MSD, and HSD were 96.23%% +/- 1.55%, 92.95%% +/- 2.58%, 0.39 +/- 0.20 mm and 16.23 +/- 6.72 mm, and 93.15%% +/- 3.09%, 87.54%% +/- 5.11%, 0.38 +/- 0.17 mm and 20.85 +/- 7.11 mm, respectively. Conclusions: The results demonstrated that our fully automated method achieved comparable accuracies with inter- and intra-observer variabilities of manual segmentation by human experts, which is time consuming. (C) 2019 Elsevier B.V. All rights reserved.N