Vision-based retargeting for endoscopic navigation

Endoscopy is a standard procedure for visualising the human gastrointestinal tract. With the advances in biophotonics, imaging techniques such as narrow band imaging, confocal laser endomicroscopy, and optical coherence tomography can be combined with normal endoscopy for assisting the early diagnosis of diseases, such as cancer. In the past decade, optical biopsy has emerged to be an effective tool for tissue analysis, allowing in vivo and in situ assessment of pathological sites with real-time feature-enhanced microscopic images. However, the non-invasive nature of optical biopsy leads to an intra-examination retargeting problem, which is associated with the difficulty of re-localising a biopsied site consistently throughout the whole examination. In addition to intra-examination retargeting, retargeting of a pathological site is even more challenging across examinations, due to tissue deformation and changing tissue morphologies and appearances. The purpose of this thesis is to address both the intra- and inter-examination retargeting problems associated with optical biopsy. We propose a novel vision-based framework for intra-examination retargeting. The proposed framework is based on combining visual tracking and detection with online learning of the appearance of the biopsied site. Furthermore, a novel cascaded detection approach based on random forests and structured support vector machines is developed to achieve efficient retargeting. To cater for reliable inter-examination retargeting, the solution provided in this thesis is achieved by solving an image retrieval problem, for which an online scene association approach is proposed to summarise an endoscopic video collected in the first examination into distinctive scenes. A hashing-based approach is then used to learn the intrinsic representations of these scenes, such that retargeting can be achieved in subsequent examinations by retrieving the relevant images using the learnt representations. For performance evaluation of the proposed frameworks, extensive phantom, ex vivo and in vivo experiments have been conducted, with results demonstrating the robustness and potential clinical values of the methods proposed.Open Acces

A Novel Continuum Overtube with Improved Triangulation for Flexible Robotic Endoscopy

This paper presents a novel continuum overtube that consists of a notched tendon-driven 2-DOF continuum joint and a distal deployable structure driven by a flexible screw rod. A smooth bending shape with constant curvature is achieved by adopting an overlapped area between notches to generate uniform stress distribution. The distal deployable structure provides an extensive triangulation for bimanual operations. The presented design achieves high flexibility, sufficient loading and anti-twisting capacity, and an improved layout of functional channels for flexible robotic endoscopy. Design optimization is performed to optimize structural parameters for performance investigation and improvement. The proposed continuum joint achieves an average distal positioning error of 1.48% and 1.20% within -115∘, 115∘ in the two bending planes with minor hysteresis errors of less than 1.5%, indicating the outstanding constant bending curvature characteristics for kinematic modeling and control. The loading capacity achieves 4.27N and provides significant advantages in terms of sufficient rigidity over the commercial endoscope. The designed deployable structure has significantly improved operational triangulation, which can effectively support bimanual operations with two instruments for complex operations. Meanwhile, the torsional stiffness of the designed continuum joint reaches a considerable value of 8.73mNm/∘ and provides stable support for instruments during operations. Ex-vivo experiments of gastric tissue biopsy have been performed to verify the feasibility of the presented design in a practical scenario

Swallowable Wireless Capsule Endoscopy: Progress and Technical Challenges

Wireless capsule endoscopy (WCE) offers a feasible noninvasive way to detect the whole gastrointestinal (GI) tract and revolutionizes the diagnosis technology. However, compared with wired endoscopies, the limited working time, the low frame rate, and the low image resolution limit the wider application. The progress of this new technology is reviewed in this paper, and the evolution tendencies are analyzed to be high image resolution, high frame rate, and long working time. Unfortunately, the power supply of capsule endoscope (CE) is the bottleneck. Wireless power transmission (WPT) is the promising solution to this problem, but is also the technical challenge. Active CE is another tendency and will be the next geneion of the WCE. Nevertheless, it will not come true shortly, unless the practical locomotion mechanism of the active CE in GI tract is achieved. The locomotion mechanism is the other technical challenge, besides the challenge of WPT. The progress about the WPT and the active capsule technology is reviewed

Cable-driven parallel mechanisms for minimally invasive robotic surgery

Minimally invasive surgery (MIS) has revolutionised surgery by providing faster recovery times, less post-operative complications, improved cosmesis and reduced pain for the patient. Surgical robotics are used to further decrease the invasiveness of procedures, by using yet smaller and fewer incisions or using natural orifices as entry point. However, many robotic systems still suffer from technical challenges such as sufficient instrument dexterity and payloads, leading to limited adoption in clinical practice. Cable-driven parallel mechanisms (CDPMs) have unique properties, which can be used to overcome existing challenges in surgical robotics. These beneficial properties include high end-effector payloads, efficient force transmission and a large configurable instrument workspace. However, the use of CDPMs in MIS is largely unexplored. This research presents the first structured exploration of CDPMs for MIS and demonstrates the potential of this type of mechanism through the development of multiple prototypes: the ESD CYCLOPS, CDAQS, SIMPLE, neuroCYCLOPS and microCYCLOPS. One key challenge for MIS is the access method used to introduce CDPMs into the body. Three different access methods are presented by the prototypes. By focusing on the minimally invasive access method in which CDPMs are introduced into the body, the thesis provides a framework, which can be used by researchers, engineers and clinicians to identify future opportunities of CDPMs in MIS. Additionally, through user studies and pre-clinical studies, these prototypes demonstrate that this type of mechanism has several key advantages for surgical applications in which haptic feedback, safe automation or a high payload are required. These advantages, combined with the different access methods, demonstrate that CDPMs can have a key role in the advancement of MIS technology.Open Acces

Soft Robot-Assisted Minimally Invasive Surgery and Interventions: Advances and Outlook

Since the emergence of soft robotics around two decades ago, research interest in the field has escalated at a pace. It is fuelled by the industry's appreciation of the wide range of soft materials available that can be used to create highly dexterous robots with adaptability characteristics far beyond that which can be achieved with rigid component devices. The ability, inherent in soft robots, to compliantly adapt to the environment, has significantly sparked interest from the surgical robotics community. This article provides an in-depth overview of recent progress and outlines the remaining challenges in the development of soft robotics for minimally invasive surgery

Medical Robotics for use in MRI Guided Endoscopy

Interventional Magnetic Resonance Imaging (MRI) is a developing field that aims to provide intra-operative MRI to a clinician to guide diagnostic or therapeutic medical procedures. MRI provides excellent soft tissue contrast at sub-millimetre resolution in both 2D and 3D without the need for ionizing radiation. Images can be acquired in near real-time for guidance purposes. Operating in the MR environment brings challenges due to the high static magnetic field, switching magnetic field gradients and RF excitation pulses. In addition high field closed bore scanners have spatial constraints that severely limit access to the patient. This thesis presents a system for MRI-guided Endoscopic Retrograde Cholangio-pancreatography (ERCP). This includes a remote actuation system that enables an MRI-compatible endoscope to be controlled whilst the patient is inside the MRI scanner, overcoming the spatial and procedural constraints imposed by the closed scanner bore. The modular system utilises non-magnetic ultrasonic motors and is designed for image-guided user-in-the-loop control. A novel miniature MRI compatible clutch has been incorporated into the design to reduce the need for multiple parallel motors. The actuation system is MRI compatible does not degrade the MR images below acceptable levels. User testing showed that the actuation system requires some degree of training but enables completion of a simulated ERCP procedure with no loss of performance. This was demonstrated using a tailored ERCP simulator and kinematic assessment tool, which was validated with users from a range of skill levels to ensure that it provides an objective measurement of endoscopic skill. Methods of tracking the endoscope in real-time using the MRI scanner are explored and presented here. Use of the MRI-guided ERCP system was shown to improve the operator’s ability to position the endoscope in an experimental environment compared with a standard fluoroscopic-guided system.Open Acces

A flexible access platform for robot-assisted minimally invasive surgery

Advances in Minimally Invasive Surgery (MIS) are driven by the clinical demand to reduce the invasiveness of surgical procedures so patients undergo less trauma and experience faster recoveries. These well documented benefits of MIS have been achieved through parallel advances in the technology and instrumentation used during procedures. The new and evolving field of Flexible Access Surgery (FAS), where surgeons access the operative site through a single incision or a natural orifice incision, is being promoted as the next potential step in the evolution of surgery. In order to achieve similar levels of success and adoption as MIS, technology again has its role to play in developing new instruments to solve the unmet clinical challenges of FAS. As procedures become less invasive, these instruments should not just address the challenges presented by the complex access routes of FAS, but should also build on the recent advances in pre- and intraoperative imaging techniques to provide surgeons with new diagnostic and interventional decision making capabilities. The main focus of this thesis is the development and applications of a flexible robotic device that is capable of providing controlled flexibility along curved pathways inside the body. The principal component of the device is its modular mechatronic joint design which utilises an embedded micromotor-tendon actuation scheme to provide independently addressable degrees of freedom and three internal working channels. Connecting multiple modules together allows a seven degree-of-freedom (DoF) flexible access platform to be constructed. The platform is intended for use as a research test-bed to explore engineering and surgical challenges of FAS. Navigation of the platform is realised using a handheld controller optimised for functionality and ergonomics, or in a "hands-free" manner via a gaze contingent control framework. Under this framework, the operator's gaze fixation point is used as feedback to close the servo control loop. The feasibility and potential of integrating multi-spectral imaging capabilities into flexible robotic devices is also demonstrated. A force adaptive servoing mechanism is developed to simplify the deployment, and improve the consistency of probe-based optical imaging techniques by automatically controlling the contact force between the probe tip and target tissue. The thesis concludes with the description of two FAS case studies performed with the platform during in-vivo porcine experiments. These studies demonstrate the ability of the platform to perform large area explorations within the peritoneal cavity and to provide a stable base for the deployment of interventional instruments and imaging probes

Current engineering developments for robotic systems in flexible endoscopy

The past four decades have seen an increase in the incidence of early-onset gastrointestinal cancer. Because early-stage cancer detection is vital to reduce mortality rate, mass screening colonoscopy provides the most effective prevention strategy. However, conventional endoscopy is a painful and technically challenging procedure that requires sedation and experienced endoscopists to be performed. To overcome the current limitations, technological innovation is needed in colonoscopy. In recent years, researchers worldwide have worked to enhance the diagnostic and therapeutic capabilities of endoscopes. The new frontier of endoscopic interventions is represented by robotic flexible endoscopy. Among all options, self-propelling soft endoscopes are particularly promising thanks to their dexterity and adaptability to the curvilinear gastrointestinal anatomy. For these devices to replace the standard endoscopes, integration with embedded sensors and advanced surgical navigation technologies must be investigated. In this review, the progress in robotic endoscopy was divided into the fundamental areas of design, sensing, and imaging. The article offers an overview of the most promising advancements on these three topics since 2018. Continuum endoscopes, capsule endoscopes, and add-on endoscopic devices were included, with a focus on fluid-driven, tendon-driven, and magnetic actuation. Sensing methods employed for the shape and force estimation of flexible endoscopes were classified into model- and sensor-based approaches. Finally, some key contributions in molecular imaging technologies, artificial neural networks, and software algorithms are described. Open challenges are discussed to outline a path toward clinical practice for the next generation of endoscopic devices