Liver Segmentation and its Application to Hepatic Interventions

The thesis addresses the development of an intuitive and accurate liver segmentation approach, its integration into software prototypes for the planning of liver interventions, and research on liver regeneration. The developed liver segmentation approach is based on a combination of the live wire paradigm and shape-based interpolation. Extended with two correction modes and integrated into a user-friendly workflow, the method has been applied to more than 5000 data sets. The combination of the liver segmentation with image analysis of hepatic vessels and tumors allows for the computation of anatomical and functional remnant liver volumes. In several projects with clinical partners world-wide, the benefit of the computer-assisted planning was shown. New insights about the postoperative liver function and regeneration could be gained, and most recent investigations into the analysis of MRI data provide the option to further improve hepatic intervention planning

Hepatic Vessel Segmentation for 3D Planning of Liver Surgery

none8Rationale and Objectives: The aim of this study was to identify the optimal parameter configuration of a new algorithm for fully automatic segmentation of hepatic vessels, evaluating its accuracy in view of its use in a computer system for three-dimensional (3D) planning of liver surgery. Materials and Methods: A phantom reproduction of a human liver with vessels up to the fourth subsegment order, corresponding to a minimum diameter of 0.2 mm, was realized through stereolithography, exploiting a 3D model derived from a real human computed tomographic data set. Algorithm parameter configuration was experimentally optimized, and the maximum achievable segmentation accuracy was quantified for both single two-dimensional slices and 3D reconstruction of the vessel network, through an analytic comparison of the automatic segmentation performed on contrast-enhanced computed tomographic phantom images with actual model features. Results: The optimal algorithm configuration resulted in a vessel detection sensitivity of 100% for vessels > 1 mm in diameter, 50% in the range 0.5 to 1 mm, and 14% in the range 0.2 to 0.5 mm. An average area overlap of 94.9% was obtained between automatically and manually segmented vessel sections, with an average difference of 0.06 mm2. The average values of corresponding false-positive and false-negative ratios were 7.7% and 2.3%, respectively. Conclusions: A robust and accurate algorithm for automatic extraction of the hepatic vessel tree from contrast-enhanced computed tomographic volume images was proposed and experimentally assessed on a liver model, showing unprecedented sensitivity in vessel delineation. This automatic segmentation algorithm is promising for supporting liver surgery planning and for guiding intraoperative resections.Francesco Conversano;Roberto Franchini;Christian Demitri;Laurent Massoptier;Francesco Montagna;Alfonso Maffezzoli;Antonio Malvasi;Sergio CasciaroFrancesco, Conversano; Roberto, Franchini; Demitri, Christian; Laurent, Massoptier; Francesco, Montagna; Maffezzoli, Alfonso; Antonio, Malvasi; Sergio, Casciar

Use of the Resection Map system as guidance during hepatectomy

Industrial DesignIndustrial Design Engineerin

Segmentation and Deformable Modelling Techniques for a Virtual Reality Surgical Simulator in Hepatic Oncology

Liver surgical resection is one of the most frequently used curative therapies. However, resectability is problematic. There is a need for a computer-assisted surgical planning and simulation system which can accurately and efficiently simulate the liver, vessels and tumours in actual patients. The present project describes the development of these core segmentation and deformable modelling techniques. For precise detection of irregularly shaped areas with indistinct boundaries, the segmentation incorporated active contours - gradient vector flow (GVF) snakes and level sets. To improve efficiency, a chessboard distance transform was used to replace part of the GVF effort. To automatically initialize the liver volume detection process, a rotating template was introduced to locate the starting slice. For shape maintenance during the segmentation process, a simplified object shape learning step was introduced to avoid occasional significant errors. Skeletonization with fuzzy connectedness was used for vessel segmentation. To achieve real-time interactivity, the deformation regime of this system was based on a single-organ mass-spring system (MSS), which introduced an on-the-fly local mesh refinement to raise the deformation accuracy and the mesh control quality. This method was now extended to a multiple soft-tissue constraint system, by supplementing it with an adaptive constraint mesh generation. A mesh quality measure was tailored based on a wide comparison of classic measures. Adjustable feature and parameter settings were thus provided, to make tissues of interest distinct from adjacent structures, keeping the mesh suitable for on-line topological transformation and deformation. More than 20 actual patient CT and 2 magnetic resonance imaging (MRI) liver datasets were tested to evaluate the performance of the segmentation method. Instrument manipulations of probing, grasping, and simple cutting were successfully simulated on deformable constraint liver tissue models. This project was implemented in conjunction with the Division of Surgery, Hammersmith Hospital, London; the preliminary reality effect was judged satisfactory by the consultant hepatic surgeon

Clinical implementation of in-house developed MR-based patient-specific 3D models of liver anatomy

Knowledge of patient-specific liver anatomy is key to patient safety during major hepatobiliary surgery. Three-dimensional (3D) models of patient-specific liver anatomy based on diagnostic MRI images can provide essential vascular and biliary anatomical insight during surgery. However, a method for generating these is not yet publicly available. This paper describes how these 3D models of the liver can be generated using open source software, and then subsequently integrated into a sterile surgical environment. The most common image quality aspects that degrade the quality of the 3D models as well possible ways of eliminating these are also discussed. Per patient, a single diagnostic multiphase MRI scan with hepatospecific contrast agent was used for automated segmentation of liver contour, arterial, portal, and venous anatomy, and the biliary tree. Subsequently, lesions were delineated manually. The resulting interactive 3D model could be accessed during surgery on a sterile covered tablet. Up to now, such models have been used in 335 surgical procedures. Their use simplified the surgical treatment of patients with a high number of liver metastases and contributed to the localization of vanished lesions in cases of a radiological complete response to neoadjuvant treatment. They facilitated perioperative verification of the relationship of tumors and the surrounding vascular and biliary anatomy, and eased decision-making before and during surgery.Radiolog

Applying artificial intelligence to big data in hepatopancreatic and biliary surgery: a scoping review

Aim: Artificial Intelligence (AI) and its applications in healthcare are rapidly developing. The healthcare industry generates ever-increasing volumes of data that should be used to improve patient care. This review aims to examine the use of AI and its applications in hepatopancreatic and biliary (HPB) surgery, highlighting studies leveraging large datasets.Methods: A PRISMA-ScR compliant scoping review using Medline and Google Scholar databases was performed (5th August 2022). Studies focusing on the development and application of AI to HPB surgery were eligible for inclusion. We undertook a conceptual mapping exercise to identify key areas where AI is under active development for use in HPB surgery. We considered studies and concepts in the context of patient pathways - before surgery (including diagnostics), around the time of surgery (supporting interventions) and after surgery (including prognostication).Results: 98 studies were included. Most studies were performed in China or the USA (n = 45). Liver surgery was the most common area studied (n = 51). Research into AI in HPB surgery has increased rapidly in recent years, with almost two-thirds published since 2019 (61/98). Of these studies, 11 have focused on using “big data” to develop and apply AI models. Nine of these studies came from the USA and nearly all focused on the application of Natural Language Processing. We identified several critical conceptual areas where AI is under active development, including improving preoperative optimization, image guidance and sensor fusion-assisted surgery, surgical planning and simulation, natural language processing of clinical reports for deep phenotyping and prediction, and image-based machine learning.Conclusion: Applications of AI in HPB surgery primarily focus on image analysis and computer vision to address diagnostic and prognostic uncertainties. Virtual 3D and augmented reality models to support complex HPB interventions are also under active development and likely to be used in surgical planning and education. In addition, natural language processing may be helpful in the annotation and phenotyping of disease, leading to new scientific insights

Quantification of hepatic vascular regeneration after 70% partial hepatectomy in mice: tools and application

Liver regeneration consists of parenchymal regeneration and vascular growth. Due to technical limitation in quantifying vascular regeneration, more efforts were spent on studying parenchymal regeneration rather than vascular regeneration. However, vascular is crucial in liver regeneration. Thus, this study aims for improving techniques for quantifying hepatic vascular regeneration in mice. First, we established a delicate monitoring procedure suitable for mice for acquiring hepatic hemodynamic parameters. Portal blood flow and portal venous pressure were measured in normal and resected mice. Second, we adapted the silicone injection method for visualizing and quantifying the changes of vascular regenerative parameters after resection in mice. Maximal vessel length and in/outflow radius of right inferior portal vein were measured. Cumulative vascular regenerative parameters were calculated based on the vascular geometry. Moreover, the underlying growth pattern was explored. Forth, we applied the established work flow to visualize and quantify the vascular growth after modulating the CXCR4 signaling pathway by blocking CXCR4 and/or activating CXCR7. Despite the seemingly homogeneous 3D-growth, the observed vascular parameters were not compatible with the hypothesis of isotropic expansion of liver parenchyma and vascular structures. Liver regeneration was not affected by only blocking CXCR4 but was impaired after blocking CXCR4 in the meanwhile activating CXCR7, pointing to the relevance of this pathway for liver regeneration. In conclusion, we explored vascular liver regeneration in a meso- and macroscopic scale. Altogether, this study provides technical tools to further and deeper explore and understand hepatic vascular regeneration after liver resection

Dynamic And Quantitative Radiomics Analysis In Interventional Radiology

Interventional Radiology (IR) is a subspecialty of radiology that performs invasive procedures driven by diagnostic imaging for predictive and therapeutic purpose. The development of artificial intelligence (AI) has revolutionized the industry of IR. Researchers have created sophisticated models backed by machine learning algorithms and optimization methodologies for image registration, cellular structure detection and computer-aided disease diagnosis and prognosis predictions. However, due to the incapacity of the human eye to detect tiny structural characteristics and inter-radiologist heterogeneity, conventional experience-based IR visual evaluations may have drawbacks. Radiomics, a technique that utilizes machine learning, offers a practical and quantifiable solution to this issue. This technology has been used to evaluate the heterogeneity of malignancies that are difficult to detect by the human eye by creating an automated pipeline for the extraction and analysis of high throughput computational imaging characteristics from radiological medical pictures. However, it is a demanding task to directly put radiomics into applications in IR because of the heterogeneity and complexity of medical imaging data. Furthermore, recent radiomics studies are based on static images, while many clinical applications (such as detecting the occurrence and development of tumors and assessing patient response to chemotherapy and immunotherapy) is a dynamic process. Merely incorporating static features cannot comprehensively reflect the metabolic characteristics and dynamic processes of tumors or soft tissues. To address these issues, we proposed a robust feature selection framework to manage the high-dimensional small-size data. Apart from that, we explore and propose a descriptor in the view of computer vision and physiology by integrating static radiomics features with time-varying information in tumor dynamics. The major contributions to this study include: Firstly, we construct a result-driven feature selection framework, which could efficiently reduce the dimension of the original feature set. The framework integrates different feature selection techniques to ensure the distinctiveness, uniqueness, and generalization ability of the output feature set. In the task of classification hepatocellular carcinoma (HCC) and intrahepatic cholangiocarcinoma (ICC) in primary liver cancer, only three radiomics features (chosen from more than 1, 800 features of the proposed framework) can obtain an AUC of 0.83 in the independent dataset. Besides, we also analyze features’ pattern and contributions to the results, enhancing clinical interpretability of radiomics biomarkers. Secondly, we explore and build a pulmonary perfusion descriptor based on 18F-FDG whole-body dynamic PET images. Our major novelties include: 1) propose a physiology-and-computer-vision-interpretable descriptor construction framework by the decomposition of spatiotemporal information into three dimensions: shades of grey levels, textures, and dynamics. 2) The spatio-temporal comparison of pulmonary descriptor intra and inter patients is feasible, making it possible to be an auxiliary diagnostic tool in pulmonary function assessment. 3) Compared with traditional PET metabolic biomarker analysis, the proposed descriptor incorporates image’s temporal information, which enables a better understanding of the time-various mechanisms and detection of visual perfusion abnormalities among different patients. 4) The proposed descriptor eliminates the impact of vascular branching structure and gravity effect by utilizing time warping algorithms. Our experimental results showed that our proposed framework and descriptor are promising tools to medical imaging analysis