Image-guided port placement for minimally invasive cardiac surgery

Minimally invasive surgery is becoming popular for a number of interventions. Use of robotic surgical systems in coronary artery bypass intervention offers many benefits to patients, but is however limited by remaining challenges in port placement. Choosing the entry ports for the robotic tools has a large impact on the outcome of the surgery, and can be assisted by pre-operative planning and intra-operative guidance techniques. In this thesis, pre-operative 3D computed tomography (CT) imaging is used to plan minimally invasive robotic coronary artery bypass (MIRCAB) surgery. From a patient database, port placement optimization routines are implemented and validated. Computed port placement configurations approximated past expert chosen configurations with an error of 13.7 ±5.1 mm. Following optimization, statistical classification was used to assess patient candidacy for MIRCAB. Various pattern recognition techniques were used to predict MIRCAB success, and could be used in the future to reduce conversion rates to conventional open-chest surgery. Gaussian, Parzen window, and nearest neighbour classifiers all proved able to detect ‘candidate’ and ‘non-candidate’ MIRCAB patients. Intra-operative registration and laser projection of port placements was validated on a phantom and then evaluated in four patient cases. An image-guided laser projection system was developed to map port placement plans from pre-operative 3D images. Port placement mappings on the phantom setup were accurate with an error of 2.4 ± 0.4 mm. In the patient cases, projections remained within 1 cm of computed port positions. Misregistered port placement mappings in human trials were due mainly to the rigid-body registration assumption and can be improved by non-rigid techniques. Overall, this work presents an integrated approach for: 1) pre-operative port placement planning and classification of incoming MIRCAB patients; and 2) intra-operative guidance of port placement. Effective translation of these techniques to the clinic will enable MIRCAB as a more efficacious and accessible procedure

Image Registration to Map Endoscopic Video to Computed Tomography for Head and Neck Radiotherapy Patients

The purpose of this work was to explore the feasibility of registering endoscopic video to radiotherapy treatment plans for patients with head and neck cancer without physical tracking of the endoscope during the examination. Endoscopy-CT registration would provide a clinical tool that could be used to enhance the treatment planning process and would allow for new methods to study the incidence of radiation-related toxicity. Endoscopic video frames were registered to CT by optimizing virtual endoscope placement to maximize the similarity between the frame and the virtual image. Virtual endoscopic images were rendered using a polygonal mesh created by segmenting the airways of the head and neck with a density threshold. The optical properties of the virtual endoscope were matched to a calibrated model of the real endoscope. A novel registration algorithm was developed that takes advantage of physical constraints on the endoscope to effectively search the airways of the head and neck for the desired virtual endoscope coordinates. This algorithm was tested on rigid phantoms with embedded point markers and protruding bolus material. In these tests, the median registration accuracy was 3.0 mm for point measurements and 3.5 mm for surface measurements. The algorithm was also tested on four endoscopic examinations of three patients, in which it achieved a median registration accuracy of 9.9 mm. The uncertainties caused by the non-rigid anatomy of the head and neck and differences in patient positioning between endoscopic examinations and CT scans were examined by taking repeated measurements after placing the virtual endoscope in surface meshes created from different CT scans. Non-rigid anatomy introduced errors on the order of 1-3 mm. Patient positioning had a larger impact, introducing errors on the order of 3.5-4.5 mm. Endoscopy-CT registration in the head and neck is possible, but large registration errors were found in patients. The uncertainty analyses suggest a lower limit of 3-5 mm. Further development is required to achieve an accuracy suitable for clinical use

Fringe Projection Profilometry in Production Metrology: A Multi-Scale Comparison in Sheet-Bulk Metal Forming

Fringe projection profilometry in combination with other optical measuring technologies has established itself over the last decades as an essential complement to conventional, tactile measuring devices. The non-contact, holistic reconstruction of complex geometries within fractions of a second in conjunction with the lightweight and transportable sensor design open up many fields of application in production metrology. Furthermore, triangulation-based measuring principles feature good scalability, which has led to 3D scanners for various scale ranges. Innovative and modern production processes, such as sheet-bulk metal forming, thus, utilize fringe projection profilometry in many respects to monitor the process, quantify possible wear and improve production technology. Therefore, it is essential to identify the appropriate 3D scanner for each application and to properly evaluate the acquired data. Through precise knowledge of the measurement volume and the relative uncertainty with respect to the specimen and scanner position, adapted measurement strategies and integrated production concepts can be realized. Although there are extensive industrial standards and guidelines for the quantification of sensor performance, evaluation and tolerancing is mainly global and can, therefore, neither provide assistance in the correct, application-specific positioning and alignment of the sensor nor reflect the local characteristics within the measuring volume. Therefore, this article compares fringe projection systems across various scale ranges by positioning and scanning a calibrated sphere in a high resolution grid

Development and evaluation of image-guided neuroendoscopy, with investigation of post-imaging brain distortion and accuracy of frameless stereotaxy

Neuroendoscopy enables a surgeon to operate deep within the brain whilst limiting morbidity through a minimally invasive approach. Technical advances in illumination, instrumentation and camera design, along with evidence for improved clinical outcome, have increased the indications for this technique and have ensured widespread popularity. However, broader application of neuroendoscopy is restricted by the necessity for direct vision of targets and by spatial disorientation. The aim of this investigation was to overcome these limitations by combining neuronavigation with neuroendoscopy to develop Image-Guided Neuroendoscopy (IGN). The strategy adopted for this was firstly to select, assess and validate a neuronavigation system, secondly to develop methods of endoscope tracking and frameless stereotactic implantation. Thirdly, to assess the impact of post-imaging brain distortion upon neuronavigation, fourthly to correct distortion of the endoscope image and finally to assess the use of graphics overlay in IGN. Laboratory phantom accuracy assessments revealed a mean point localisation error for the navigation system pointers of0.8mm (SD 0.4mm) with CT imaging, for the tracked endoscope of 1.5mm (SD 0.8mm) and for frameless stereotaxy of 1.3mm (SD 0.6mm). An in vivo study revealed a mean Euclidean error of 4.8mm (SD 2.0mm) for frame less stereotactic biopsy. The navigation system was evaluated through a clinical series of 100 cases, the frameless stereotactic technique was employed in 21 brain biopsy procedures and IGN evaluated in 5 procedures. The magnitude of post-imaging brain distortion was determined and correlations discovered with pre-operative image characteristics. The conclusions of this thesis are that IGN can be accomplished with acceptable accuracy, including frameless stereotactic implantation, and that the impact of postimaging brain distortion will not negate the value of IGN in most cases. Thus, the method developed for IGN has overcome both major constraints of neuroendoscopy, enabling endoscopic surgery to pass through and beyond the ventricular wall, to be undertaken safely in cases with distorted anatomy and opening the potential for wider application of these minimally invasive techniques

ToF/RGB Sensor Fusion for Augmented 3D Endoscopy using a Fully Automatic Calibration Scheme

Abstract. 3-D Endoscopy is an evolving field of research and offers great benefits for minimally invasive procedures. Besides the pure topology, color texture is an inevitable feature to provide an optimal visualization. Therefore, in this paper, we propose a sensor fusion of a Time-of-Flight (ToF) and an RGB sensor. This requires an intrinsic and extrinsic cal-ibration of both cameras. In particular, the low resolution of the ToF camera (64×50 px) and inhomogeneous illumination precludes the use of standard calibration techniques. By enhancing the image data the use of self-encoded markers for automatic checkerboard detection, a re-projection error of less than 0.23 px for the ToF camera was achieved. The relative transformation of both sensors for data fusion was calculated in an automatic manner.