Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions

Integration of Absolute Orientation Measurements in the KinectFusion Reconstruction pipeline

In this paper, we show how absolute orientation measurements provided by low-cost but high-fidelity IMU sensors can be integrated into the KinectFusion pipeline. We show that integration improves both runtime, robustness and quality of the 3D reconstruction. In particular, we use this orientation data to seed and regularize the ICP registration technique. We also present a technique to filter the pairs of 3D matched points based on the distribution of their distances. This filter is implemented efficiently on the GPU. Estimating the distribution of the distances helps control the number of iterations necessary for the convergence of the ICP algorithm. Finally, we show experimental results that highlight improvements in robustness, a speed-up of almost 12%, and a gain in tracking quality of 53% for the ATE metric on the Freiburg benchmark.Comment: CVPR Workshop on Visual Odometry and Computer Vision Applications Based on Location Clues 201

In vivo measurement of human brain elasticity using a light aspiration device

The brain deformation that occurs during neurosurgery is a serious issue impacting the patient "safety" as well as the invasiveness of the brain surgery. Model-driven compensation is a realistic and efficient solution to solve this problem. However, a vital issue is the lack of reliable and easily obtainable patient-specific mechanical characteristics of the brain which, according to clinicians' experience, can vary considerably. We designed an aspiration device that is able to meet the very rigorous sterilization and handling process imposed during surgery, and especially neurosurgery. The device, which has no electronic component, is simple, light and can be considered as an ancillary instrument. The deformation of the aspirated tissue is imaged via a mirror using an external camera. This paper describes the experimental setup as well as its use during a specific neurosurgery. The experimental data was used to calibrate a continuous model. We show that we were able to extract an in vivo constitutive law of the brain elasticity: thus for the first time, measurements are carried out per-operatively on the patient, just before the resection of the brain parenchyma. This paper discloses the results of a difficult experiment and provide for the first time in-vivo data on human brain elasticity. The results point out the softness as well as the highly non-linear behavior of the brain tissue.Comment: Medical Image Analysis (2009) accept\'

A feasible and automatic free tool for T1 and ECV mapping

Purpose: Cardiac magnetic resonance (CMR) is a useful non-invasive tool for characterizing tissues and detecting myocardial fibrosis and edema. Estimation of extracellular volume fraction (ECV) using T1 sequences is emerging as an accurate biomarker in cardiac diseases associated with diffuse fibrosis. In this study, automatic software for T1 and ECV map generation consisting of an executable file was developed and validated using phantom and human data. Methods: T1 mapping was performed in phantoms and 30 subjects (22 patients and 8 healthy subjects) on a 1.5T MR scanner using the modified Look-Locker inversion-recovery (MOLLI) sequence prototype before and 15 min after contrast agent administration. T1 maps were generated using a Fast Nonlinear Least Squares algorithm. Myocardial ECV maps were generated using both pre- and post-contrast T1 image registration and automatic extraction of blood relaxation rates. Results: Using our software, pre- and post-contrast T1 maps were obtained in phantoms and healthy subjects resulting in a robust and reliable quantification as compared to reference software. Coregistration of pre- and post-contrast images improved the quality of ECV maps. Mean ECV value in healthy subjects was 24.5% ± 2.5%. Conclusions: This study demonstrated that it is possible to obtain accurate T1 maps and informative ECV maps using our software. Pixel-wise ECV maps obtained with this automatic software made it possible to visualize and evaluate the extent and severity of ECV alterations

Respiration-Induced Intraorgan Deformation of the Liver: Implications for Treatment Planning in Patients Treated With Fiducial Tracking.

Stereotactic body radiation therapy is a well-tolerated modality for the treatment of primary and metastatic liver lesions, and fiducials are often used as surrogates for tumor tracking during treatment. We evaluated respiratory-induced liver deformation by measuring the rigidity of the fiducial configuration during the breathing cycle. Seventeen patients, with 18 distinct treatment courses, were treated with stereotactic body radiosurgery using multiple fiducials. Liver deformation was empirically quantified by measuring the intrafiducial distances at different phases of respiration. Data points were collected at the 0%, 50%, and 100% inspiration points, and the distance between each pair of fiducials was measured at the 3 phases. The rigid body error was calculated as the maximum difference in the intrafiducial distances. Liver disease was calculated with Child-Pugh score using laboratory values within 3 months of initiation of treatment. A peripheral fiducial was defined as within 1.5 cm of the liver edge, and all other fiducials were classified as central. For 5 patients with only peripheral fiducials, the fiducial configuration had more deformation (average maximum rigid body error 7.11 mm, range: 1.89-11.35 mm) when compared to patients with both central and peripheral and central fiducials only (average maximum rigid body error 3.36 mm, range: 0.5-9.09 mm, P = .037). The largest rigid body errors (11.3 and 10.6 mm) were in 2 patients with Child-Pugh class A liver disease and multiple peripheral fiducials. The liver experiences internal deformation, and the fiducial configuration should not be assumed to act as a static structure. We observed greater deformation at the periphery than at the center of the liver. In our small data set, we were not able to identify cirrhosis, which is associated with greater rigidity of the liver, as predictive for deformation. Treatment planning based only on fiducial localization must take potential intraorgan deformation into account

On uncertainty propagation in image-guided renal navigation: Exploring uncertainty reduction techniques through simulation and in vitro phantom evaluation

Image-guided interventions (IGIs) entail the use of imaging to augment or replace direct vision during therapeutic interventions, with the overall goal is to provide effective treatment in a less invasive manner, as an alternative to traditional open surgery, while reducing patient trauma and shortening the recovery time post-procedure. IGIs rely on pre-operative images, surgical tracking and localization systems, and intra-operative images to provide correct views of the surgical scene. Pre-operative images are used to generate patient-specific anatomical models that are then registered to the patient using the surgical tracking system, and often complemented with real-time, intra-operative images. IGI systems are subject to uncertainty from several sources, including surgical instrument tracking / localization uncertainty, model-to-patient registration uncertainty, user-induced navigation uncertainty, as well as the uncertainty associated with the calibration of various surgical instruments and intra-operative imaging devices (i.e., laparoscopic camera) instrumented with surgical tracking sensors. All these uncertainties impact the overall targeting accuracy, which represents the error associated with the navigation of a surgical instrument to a specific target to be treated under image guidance provided by the IGI system. Therefore, understanding the overall uncertainty of an IGI system is paramount to the overall outcome of the intervention, as procedure success entails achieving certain accuracy tolerances specific to individual procedures. This work has focused on studying the navigation uncertainty, along with techniques to reduce uncertainty, for an IGI platform dedicated to image-guided renal interventions. We constructed life-size replica patient-specific kidney models from pre-operative images using 3D printing and tissue emulating materials and conducted experiments to characterize the uncertainty of both optical and electromagnetic surgical tracking systems, the uncertainty associated with the virtual model-to-physical phantom registration, as well as the uncertainty associated with live augmented reality (AR) views of the surgical scene achieved by enhancing the pre-procedural model and tracked surgical instrument views with live video views acquires using a camera tracked in real time. To better understand the effects of the tracked instrument calibration, registration fiducial configuration, and tracked camera calibration on the overall navigation uncertainty, we conducted Monte Carlo simulations that enabled us to identify optimal configurations that were subsequently validated experimentally using patient-specific phantoms in the laboratory. To mitigate the inherent accuracy limitations associated with the pre-procedural model-to-patient registration and their effect on the overall navigation, we also demonstrated the use of tracked video imaging to update the registration, enabling us to restore targeting accuracy to within its acceptable range. Lastly, we conducted several validation experiments using patient-specific kidney emulating phantoms using post-procedure CT imaging as reference ground truth to assess the accuracy of AR-guided navigation in the context of in vitro renal interventions. This work helped find answers to key questions about uncertainty propagation in image-guided renal interventions and led to the development of key techniques and tools to help reduce optimize the overall navigation / targeting uncertainty