Automatic Liver Segmentation Using an Adversarial Image-to-Image Network

Automatic liver segmentation in 3D medical images is essential in many clinical applications, such as pathological diagnosis of hepatic diseases, surgical planning, and postoperative assessment. However, it is still a very challenging task due to the complex background, fuzzy boundary, and various appearance of liver. In this paper, we propose an automatic and efficient algorithm to segment liver from 3D CT volumes. A deep image-to-image network (DI2IN) is first deployed to generate the liver segmentation, employing a convolutional encoder-decoder architecture combined with multi-level feature concatenation and deep supervision. Then an adversarial network is utilized during training process to discriminate the output of DI2IN from ground truth, which further boosts the performance of DI2IN. The proposed method is trained on an annotated dataset of 1000 CT volumes with various different scanning protocols (e.g., contrast and non-contrast, various resolution and position) and large variations in populations (e.g., ages and pathology). Our approach outperforms the state-of-the-art solutions in terms of segmentation accuracy and computing efficiency.Comment: Accepted by MICCAI 201

A boundary optimization scheme for liver tumors from CT images

Liver CT scan image analysis plays an important role in clinical diagnosis and treatment. Accurate segmentation of liver tumor from CT images is the prerequisite for targeted therapy and liver resection. Existing semi-automatic segmentation based on graph cuts or fully automatic segmentation methods based on deep learning have reached the level close to that of radiologists. To improve tumor segmentation on liver CT images, we propose a simple post-processing scheme to optimize tumor boundaries. This method improves boundary prediction performance by optimizing a sequence of patches extracted along the initial predicted boundary. The proposed boundary refinement segmentation network obtains strong semantic information and precise location information through the information interaction between different branches, to achieve precise segmentation. The Liver Tumor Segmentation (LiTS) dataset is used to evaluate the relative segmentation performance obtaining an average dice score of 0.805 using the new method

Vessel segmentation for automatic registration of untracked laparoscopic ultrasound to CT of the liver

PURPOSE: Registration of Laparoscopic Ultrasound (LUS) to a pre-operative scan such as Computed Tomography (CT) using blood vessel information has been proposed as a method to enable image-guidance for laparoscopic liver resection. Currently, there are solutions for this problem that can potentially enable clinical translation by bypassing the need for a manual initialisation and tracking information. However, no reliable framework for the segmentation of vessels in 2D untracked LUS images has been presented. METHODS: We propose the use of 2D UNet for the segmentation of liver vessels in 2D LUS images. We integrate these results in a previously developed registration method, and show the feasibility of a fully automatic initialisation to the LUS to CT registration problem without a tracking device. RESULTS: We validate our segmentation using LUS data from 6 patients. We test multiple models by placing patient datasets into different combinations of training, testing and hold-out, and obtain mean Dice scores ranging from 0.543 to 0.706. Using these segmentations, we obtain registration accuracies between 6.3 and 16.6 mm in 50% of cases. CONCLUSIONS: We demonstrate the first instance of deep learning (DL) for the segmentation of liver vessels in LUS. Our results show the feasibility of UNet in detecting multiple vessel instances in 2D LUS images, and potentially automating a LUS to CT registration pipeline

Deep learning to segment liver metastases on CT images: Impact on a radiomics method to predict response to chemotherapy

Predicting response to neo-adjuvant chemotherapy of liver metastases (mts) using CT images is of key importance to provide personalized treatments. However, manual segmentation of mts should be avoid to develop methods that could be integrated into the clinical practice. The aim of this study is to evaluate if and how much automatic segmentation can affect a radiomics-based method to predict response to neoadjuvant chemotherapy of individual liver mts. To this scope, we developed an automatic deep learning method to segment liver mts, based on the U-net architecture, and we compared the classification results of a classifier fed with manual and automatic masks. In the validation set composed of 39 liver mts, the automatic deeplearning algorithm was able to detect 82% of mts, with a median precision of 67%. Using manual and automatic masks, we obtained the same classification in 19/32 mts. In case of mts with largest diameter > 20 mm, the precision of the segmentation does not impact the classification results and we obtained the same classification with both masks. Conversely, with smaller mts, we showed that a Dice coefficient of at least 0.5 should be obtained to extract the same information from the two segmentations. This are very important results in the perspective of using radiomics-based approach to predict response to therapy into clinical practice. Indeed, either precisely manually segment all lesions or refine them after automatic segmentation is a time-consuming task that cannot be performed on a daily basis

Advanced image processing methods for automatic liver segmentation

This paper presents advanced methods of image segmentation suitable for automatic recognition of the human liver and its vessel system, but in general could be used to segment any organ or body tissue. The comparison of studied methods is being made in terms of segmentation quality and algorithm speed. The main criterion for quality evaluation of each selected method is the level of conformity between the automatically recognized boundary and the reference boundary specified by experienced user. For all the tests sequences of CT and MRI images were used

Automatic Multi-organ Segmentation on Abdominal CT with Dense V-networks

Automatic segmentation of abdominal anatomy on computed tomography (CT) images can support diagnosis, treatment planning and treatment delivery workflows. Segmentation methods using statistical models and multi-atlas label fusion (MALF) require inter-subject image registrations which are challenging for abdominal images, but alternative methods without registration have not yet achieved higher accuracy for most abdominal organs. We present a registration-free deeplearning- based segmentation algorithm for eight organs that are relevant for navigation in endoscopic pancreatic and biliary procedures, including the pancreas, the GI tract (esophagus, stomach, duodenum) and surrounding organs (liver, spleen, left kidney, gallbladder). We directly compared the segmentation accuracy of the proposed method to existing deep learning and MALF methods in a cross-validation on a multi-centre data set with 90 subjects. The proposed method yielded significantly higher Dice scores for all organs and lower mean absolute distances for most organs, including Dice scores of 0.78 vs. 0.71, 0.74 and 0.74 for the pancreas, 0.90 vs 0.85, 0.87 and 0.83 for the stomach and 0.76 vs 0.68, 0.69 and 0.66 for the esophagus. We conclude that deep-learning-based segmentation represents a registration-free method for multi-organ abdominal CT segmentation whose accuracy can surpass current methods, potentially supporting image-guided navigation in gastrointestinal endoscopy procedures