The Next-Generation Surgical Robots

The chronicle of surgical robots is short but remarkable. Within 20 years since the regulatory approval of the first surgical robot, more than 3,000 units were installed worldwide, and more than half a million robotic surgical procedures were carried out in the past year alone. The exceptionally high speeds of market penetration and expansion to new surgical areas had raised technical, clinical, and ethical concerns. However, from a technological perspective, surgical robots today are far from perfect, with a list of improvements expected for the next-generation systems. On the other hand, robotic technologies are flourishing at ever-faster paces. Without the inherent conservation and safety requirements in medicine, general robotic research could be substantially more agile and explorative. As a result, various technical innovations in robotics developed in recent years could potentially be grafted into surgical applications and ignite the next major advancement in robotic surgery. In this article, the current generation of surgical robots is reviewed from a technological point of view, including three of possibly the most debated technical topics in surgical robotics: vision, haptics, and accessibility. Further to that, several emerging robotic technologies are highlighted for their potential applications in next-generation robotic surgery

A Magnetic Laser Scanner for Endoscopic Microsurgery

Laser scanners increase the quality of the laser microsurgery enabling fast tissue ablation with less thermal damage. Such technology is part of state-of-the-art freebeam surgical laser systems. However, laser scanning has not been incorporated to fiber-based lasers yet. This is a combination that has potential to greatly improve the quality of laser microsurgeries on difficult-to-reach surgical sites. Current fiberbased tissue ablations are performed in contact with the tissue, resulting in excessive thermal damage to healthy tissue in the vicinity of the ablated tissue. This is far from ideal for delicate microsurgeries, which require high-quality tissue incisions without any thermal damage or char formation. However, the possibility to perform scanning laser microsurgery in confined workspaces is restricted by the large size of currently available actuators, which are typically located outside the patient and require direct line-of-sight to the microsurgical area. Thus, it is desired to have the laser scanning feature in an endoscopic system to provide high incision quality in hard-to-reach surgical sites. This thesis aims to introduce a new endoscopic laser scanner to perform 2D position control and high-speed scanning of a fiber-based laser for operation in narrow workspaces. It also presents a technology concept aimed at assisting in incision depth control during soft-tissue microsurgery. The main objective of the work presented in this thesis is to bring the benefits of free-beam lasers to laser-based endoscopic surgery by designing an end-effector module to be placed at the distal tip of a flexible robot arm. To this end, the design and control of a magnetic laser scanner for endoscopic microsurgeries is presented. The system involves an optical fiber, electromagnetic coils, a permanent magnet and optical lenses in a compact system for laser beam deflection. The actuation mechanism is based on the interaction between the electromagnetic field and the permanent magnets. A cantilevered optical fiber is bended with the magnetic field induced by the electromagnetic coils by creating magnetic torque on the permanent magnet. The magnetic laser scanner provides 2D position control and high-speed scanning of the laser beam. The device includes laser focusing optics to allow non-contact incisions. A proof-of-concept device was manufactured and evaluated. It includes four electromagnetic coils and two plano-convex lenses, and has an external diameter of 13 mm. A 4 74 mm2 scanning range was achieved at a 30 mm distance from the scanner tip. Computer-controlled trajectory executions demonstrated repeatable results with 75 m precision for challenging trajectories. Frequency analysis demonstrated stable response up to 33 Hz for 3 dB limit. The system is able to ablate tissue substitutes with a 1940 nm wavelength surgical diode laser. Tablet-based control interface has been developed for intuitive teleoperation. The performance of the proof-of-concept device is analysed through control accuracy and usability studies. Teleoperation user trials consisting in trajectory-following tasks involved 12 subjects. Results demonstrated users could achieve an accuracy of 39 m with the magnetic laser scanner system. For minimally invasive surgeries, it is essential to perform accurate laser position control. Therefore, a model based feed-forward position control of magnetic laser scanner was developed for automated trajectory executions. First, the dynamical model of the system was identified using the electromagnets current (input) and the laser position (output). Then, the identified model was used to perform feedforward control. Validation experiments were performed with different trajectory types, frequencies and amplitudes. Results showed that desired trajectories can be executed in high-speed scanning mode with less than 90 m (1.4 mrad bending angle) accuracy for frequencies up to 15 Hz. State-of-the-art systems do not provide incision depth control, thus the quality of such control relies entirely on the experience and visual perception of the surgeons. In order to provide intuitive incision depth control in endoscopic microsurgeries, the concept of a technology was presented for the automated laser incisions given a desired depth based on a commercial laser scanner. The technology aims at automatically controlling laser incisions based on high-level commands from the surgeon, i.e. desired incision shape, length and depth. A feed-forward controller provides (i) commands to the robotic laser system and (ii) regulates the parameters of the laser source to achieve the desired results. The controller for the incision depth is extracted from experimental data. The required energy density and the number of passes are calculated to reach the targeted depth. Experimental results demonstrate that targeted depths can be achieved with \ub1100 m accuracy, which proves the feasibility of this approach. The proposed technology has the potential to facilitate the surgeon\u2019s control over laser incisions. The magnetic laser scanner enables high-speed laser positioning in narrow and difficult-to-reach workspaces, promising to bring the benefits of scanning laser microsurgery to flexible endoscopic procedures. In addition, the same technology can be potentially used for optical fiber based imaging, enabling for example the creation of new family of scanning endoscopic OCT or hyperspectral probes

Advanced cranial navigation

Neurosurgery is performed with extremely low margins of error. Surgical inaccuracy may have disastrous consequences. The overall aim of this thesis was to improve accuracy in cranial neurosurgical procedures by the application of new technical aids. Two technical methods were evaluated: augmented reality (AR) for surgical navigation (Papers I-II) and the optical technique of diffuse reflectance spectroscopy (DRS) for real-time tissue identification (Papers III-V). Minimally invasive skull-base endoscopy has several potential benefits compared to traditional craniotomy, but approaching the skull base through this route implies that at-risk organs and surgical targets are covered by bone and out of the surgeon’s direct line of sight. In Paper I, a new application for AR-navigated endoscopic skull-base surgery, based on an augmented-reality surgical navigation (ARSN) system, was developed. The accuracy of the system, defined by mean target registration error (TRE), was evaluated and found to be 0.55±0.24 mm, the lowest value reported error in the literature. As a first step toward the development of a cranial application for AR navigation, in Paper II this ARSN system was used to enable insertions of biopsy needles and external ventricular drainages (EVDs). The technical accuracy (i.e., deviation from the target or intended path) and efficacy (i.e., insertion time) were assessed on a 3D-printed realistic, anthropomorphic skull and brain phantom; Thirty cranial biopsies and 10 EVD insertions were performed. Accuracy for biopsy was 0.8±0.43 mm with a median insertion time of 149 (87-233) seconds, and for EVD accuracy was 2.9±0.8 mm at the tip with a median angular deviation of 0.7±0.5° and a median insertion time of 188 (135-400) seconds. Glial tumors grow diffusely in the brain, and patient survival is correlated with the extent of tumor removal. Tumor borders are often invisible. Resection beyond borders as defined by conventional methods may further improve a patient’s prognosis. In Paper III, DRS was evaluated for discrimination between glioma and normal brain tissue ex vivo. DRS spectra and histology were acquired from 22 tumor samples and 9 brain tissue samples retrieved from 30 patients. Sensitivity and specificity for the detection of low-grade gliomas were 82.0% and 82.7%, respectively, with an AUC of 0.91. Acute ischemic stroke caused by large vessel occlusion is treated with endovascular thrombectomy, but treatment failure can occur when clot composition and thrombectomy technique are mismatched. Intra-procedural knowledge of clot composition could guide the choice of treatment modality. In Paper IV, DRS, in vivo, was evaluated for intravascular clot characterization. Three types of clot analogs, red blood cell (RBC)-rich, fibrin-rich and mixed clots, were injected into the external carotids of a domestic pig. An intravascular DRS probe was used for in-situ measurements of clots, blood, and vessel walls, and the spectral data were analyzed. DRS could differentiate clot types, vessel walls, and blood in vivo (p<0,001). The sensitivity and specificity for detection were 73.8% and 98.8% for RBC clots, 100% and 100% for mixed clots, and 80.6% and 97.8% for fibrin clots, respectively. Paper V evaluated DRS for characterization of human clot composition ex vivo: 45 clot units were retrieved from 29 stroke patients and examined with DRS and histopathological evaluation. DRS parameters correlated with clot RBC fraction (R=81, p<0.001) and could be used for the classification of clot type with sensitivity and specificity rates for the detection of RBC-rich clots of 0.722 and 0.846, respectively. Applied in an intravascular probe, DRS may provide intra-procedural information on clot composition to improve endovascular thrombectomy efficiency

Medical Robotics

The first generation of surgical robots are already being installed in a number of operating rooms around the world. Robotics is being introduced to medicine because it allows for unprecedented control and precision of surgical instruments in minimally invasive procedures. So far, robots have been used to position an endoscope, perform gallbladder surgery and correct gastroesophogeal reflux and heartburn. The ultimate goal of the robotic surgery field is to design a robot that can be used to perform closed-chest, beating-heart surgery. The use of robotics in surgery will expand over the next decades without any doubt. Minimally Invasive Surgery (MIS) is a revolutionary approach in surgery. In MIS, the operation is performed with instruments and viewing equipment inserted into the body through small incisions created by the surgeon, in contrast to open surgery with large incisions. This minimizes surgical trauma and damage to healthy tissue, resulting in shorter patient recovery time. The aim of this book is to provide an overview of the state-of-art, to present new ideas, original results and practical experiences in this expanding area. Nevertheless, many chapters in the book concern advanced research on this growing area. The book provides critical analysis of clinical trials, assessment of the benefits and risks of the application of these technologies. This book is certainly a small sample of the research activity on Medical Robotics going on around the globe as you read it, but it surely covers a good deal of what has been done in the field recently, and as such it works as a valuable source for researchers interested in the involved subjects, whether they are currently “medical roboticists” or not

Development and evaluation of image-guided neuroendoscopy, with investigation of post-imaging brain distortion and accuracy of frameless stereotaxy

Neuroendoscopy enables a surgeon to operate deep within the brain whilst limiting morbidity through a minimally invasive approach. Technical advances in illumination, instrumentation and camera design, along with evidence for improved clinical outcome, have increased the indications for this technique and have ensured widespread popularity. However, broader application of neuroendoscopy is restricted by the necessity for direct vision of targets and by spatial disorientation. The aim of this investigation was to overcome these limitations by combining neuronavigation with neuroendoscopy to develop Image-Guided Neuroendoscopy (IGN). The strategy adopted for this was firstly to select, assess and validate a neuronavigation system, secondly to develop methods of endoscope tracking and frameless stereotactic implantation. Thirdly, to assess the impact of post-imaging brain distortion upon neuronavigation, fourthly to correct distortion of the endoscope image and finally to assess the use of graphics overlay in IGN. Laboratory phantom accuracy assessments revealed a mean point localisation error for the navigation system pointers of0.8mm (SD 0.4mm) with CT imaging, for the tracked endoscope of 1.5mm (SD 0.8mm) and for frameless stereotaxy of 1.3mm (SD 0.6mm). An in vivo study revealed a mean Euclidean error of 4.8mm (SD 2.0mm) for frame less stereotactic biopsy. The navigation system was evaluated through a clinical series of 100 cases, the frameless stereotactic technique was employed in 21 brain biopsy procedures and IGN evaluated in 5 procedures. The magnitude of post-imaging brain distortion was determined and correlations discovered with pre-operative image characteristics. The conclusions of this thesis are that IGN can be accomplished with acceptable accuracy, including frameless stereotactic implantation, and that the impact of postimaging brain distortion will not negate the value of IGN in most cases. Thus, the method developed for IGN has overcome both major constraints of neuroendoscopy, enabling endoscopic surgery to pass through and beyond the ventricular wall, to be undertaken safely in cases with distorted anatomy and opening the potential for wider application of these minimally invasive techniques

Image-guided surgery and medical robotics in the cranial area

Surgery in the cranial area includes complex anatomic situations with high-risk structures and high demands for functional and aesthetic results. Conventional surgery requires that the surgeon transfers complex anatomic and surgical planning information, using spatial sense and experience. The surgical procedure depends entirely on the manual skills of the operator. The development of image-guided surgery provides new revolutionary opportunities by integrating presurgical 3D imaging and intraoperative manipulation. Augmented reality, mechatronic surgical tools, and medical robotics may continue to progress in surgical instrumentation, and ultimately, surgical care. The aim of this article is to review and discuss state-of-the-art surgical navigation and medical robotics, image-to-patient registration, aspects of accuracy, and clinical applications for surgery in the cranial area

Endoscopic Optical Coherence Tomography: Design and Application

This thesis presents an investigation on endoscopic optical coherence tomography (OCT). As a noninvasive imaging modality, OCT emerges as an increasingly important diagnostic tool for many clinical applications. Despite of many of its merits, such as high resolution and depth resolvability, a major limitation is the relatively shallow penetration depth in tissue (about 2∼3 mm). This is mainly due to tissue scattering and absorption. To overcome this limitation, people have been developing many different endoscopic OCT systems. By utilizing a minimally invasive endoscope, the OCT probing beam can be brought to the close vicinity of the tissue of interest and bypass the scattering of intervening tissues so that it can collect the reflected light signal from desired depth and provide a clear image representing the physiological structure of the region, which can not be disclosed by traditional OCT. In this thesis, three endoscope designs have been studied. While they rely on vastly different principles, they all converge to solve this long-standing problem. A hand-held endoscope with manual scanning is first explored. When a user is holding a hand- held endoscope to examine samples, the movement of the device provides a natural scanning. We proposed and implemented an optical tracking system to estimate and record the trajectory of the device. By registering the OCT axial scan with the spatial information obtained from the tracking system, one can use this system to simply ‘paint’ a desired volume and get any arbitrary scanning pattern by manually waving the endoscope over the region of interest. The accuracy of the tracking system was measured to be about 10 microns, which is comparable to the lateral resolution of most OCT system. Targeted phantom sample and biological samples were manually scanned and the reconstructed images verified the method. Next, we investigated a mechanical way to steer the beam in an OCT endoscope, which is termed as Paired-angle-rotation scanning (PARS). This concept was proposed by my colleague and we further developed this technology by enhancing the longevity of the device, reducing the diameter of the probe, and shrinking down the form factor of the hand-piece. Several families of probes have been designed and fabricated with various optical performances. They have been applied to different applications, including the collector channel examination for glaucoma stent implantation, and vitreous remnant detection during live animal vitrectomy. Lastly a novel non-moving scanning method has been devised. This approach is based on the EO effect of a KTN crystal. With Ohmic contact of the electrodes, the KTN crystal can exhibit a special mode of EO effect, termed as space-charge-controlled electro-optic effect, where the carrier electron will be injected into the material via the Ohmic contact. By applying a high voltage across the material, a linear phase profile can be built under this mode, which in turn deflects the light beam passing through. We constructed a relay telescope to adapt the KTN deflector into a bench top OCT scanning system. One of major technical challenges for this system is the strong chromatic dispersion of KTN crystal within the wavelength band of OCT system. We investigated its impact on the acquired OCT images and proposed a new approach to estimate and compensate the actual dispersion. Comparing with traditional methods, the new method is more computational efficient and accurate. Some biological samples were scanned by this KTN based system. The acquired images justified the feasibility of the usage of this system into a endoscopy setting. My research above all aims to provide solutions to implement an OCT endoscope. As technology evolves from manual, to mechanical, and to electrical approaches, different solutions are presented. Since all have their own advantages and disadvantages, one has to determine the actual requirements and select the best fit for a specific application.</p

Cable-driven parallel robot for transoral laser phonosurgery

Transoral laser phonosurgery (TLP) is a common surgical procedure in otolaryngology. Currently, two techniques are commonly used: free beam and fibre delivery. For free beam delivery, in combination with laser scanning techniques, accurate laser pattern scanning can be achieved. However, a line-of-sight to the target is required. A suspension laryngoscope is adopted to create a straight working channel for the scanning laser beam, which could introduce lesions to the patient, and the manipulability and ergonomics are poor. For the fibre delivery approach, a flexible fibre is used to transmit the laser beam, and the distal tip of the laser fibre can be manipulated by a flexible robotic tool. The issues related to the limitation of the line-of-sight can be avoided. However, the laser scanning function is currently lost in this approach, and the performance is inferior to that of the laser scanning technique in the free beam approach. A novel cable-driven parallel robot (CDPR), LaryngoTORS, has been developed for TLP. By using a curved laryngeal blade, a straight suspension laryngoscope will not be necessary to use, which is expected to be less traumatic to the patient. Semi-autonomous free path scanning can be executed, and high precision and high repeatability of the free path can be achieved. The performance has been verified in various bench and ex vivo tests. The technical feasibility of the LaryngoTORS robot for TLP was considered and evaluated in this thesis. The LaryngoTORS robot has demonstrated the potential to offer an acceptable and feasible solution to be used in real-world clinical applications of TLP. Furthermore, the LaryngoTORS robot can combine with fibre-based optical biopsy techniques. Experiments of probe-based confocal laser endomicroscopy (pCLE) and hyperspectral fibre-optic sensing were performed. The LaryngoTORS robot demonstrates the potential to be utilised to apply the fibre-based optical biopsy of the larynx.Open Acces

Enhancing endoscopic navigation and polyp detection using artificial intelligence

Colorectal cancer (CRC) is one most common and deadly forms of cancer. It has a very high mortality rate if the disease advances to late stages however early diagnosis and treatment can be curative is hence essential to enhancing disease management. Colonoscopy is considered the gold standard for CRC screening and early therapeutic treatment. The effectiveness of colonoscopy is highly dependent on the operator’s skill, as a high level of hand-eye coordination is required to control the endoscope and fully examine the colon wall. Because of this, detection rates can vary between different gastroenterologists and technology have been proposed as solutions to assist disease detection and standardise detection rates. This thesis focuses on developing artificial intelligence algorithms to assist gastroenterologists during colonoscopy with the potential to ensure a baseline standard of quality in CRC screening. To achieve such assistance, the technical contributions develop deep learning methods and architectures for automated endoscopic image analysis to address both the detection of lesions in the endoscopic image and the 3D mapping of the endoluminal environment. The proposed detection models can run in real-time and assist visualization of different polyp types. Meanwhile the 3D reconstruction and mapping models developed are the basis for ensuring that the entire colon has been examined appropriately and to support quantitative measurement of polyp sizes using the image during a procedure. Results and validation studies presented within the thesis demonstrate how the developed algorithms perform on both general scenes and on clinical data. The feasibility of clinical translation is demonstrated for all of the models on endoscopic data from human participants during CRC screening examinations