A review of modeling and control of remote-controlled capsule endoscopes.

INTRODUCTION: The significance of this review lies in addressing the limitations of passive locomotion in capsule endoscopes, hindering their widespread use in medical applications. The research focuses on evaluating existing miniature in vivo remote-controlled capsule endoscopes, examining their locomotion designs, and working theories to pave the way for overcoming challenges and enhancing their applicability in diagnostic and treatment settings. AREAS COVERED: This paper explores control methods and dynamic system modeling in the context of self-propelled remote-controlled capsule endoscopes with a two-mass arrangement. The literature search, conducted at Queen Mary University of London Library from 2000 to 2022, utilized a systematic approach starting with the broad keyword 'Capsule Endoscope' and progressively narrowing down to specific aspects such as 'Capsule Endoscope Control' and 'Self-propelled Capsule Endoscope' using various criteria. EXPERT OPINION: Efficiently driving and controlling remote-controlled capsule endoscopes have the potential to overcome the current limitations in medical technology, offering a viable solution for diagnosing and treating gastrointestinal diseases. Successful control of the remote-controlled capsule endoscope, as demonstrated in this review paper, will lead to a step change in medical engineering, establishing the remote-controlled capsule endoscope as a swift standard in the field

Doctor of Philosophy

dissertationThis dissertation presents results documenting advancements on the control of untethered magnetic devices, such as magnetic \microrobots" and magnetically actuated capsuleendoscopes, motivated by problems in minimally invasive medicine. This dissertationfocuses on applying rotating magnetic elds for magnetic manipulation. The contributions include advancements in the way that helical microswimmers (devices that mimicthe propulsion of bacterial agella) are controlled in the presence of gravitational forces, advancements in ways that groups of untethered magnetic devices can be dierentiated and semi-independently controlled, advancements in the way that untethered magnetic device can be controlled with a single rotating permanent magnet, and an improved understanding in the nature of the magnetic force applied to an untethered device by a rotating magnet

Doctor of Philosophy

dissertationClosed-loop control of wireless capsule endoscopes is an active area of research because it would drastically improve screening of the gastrointestinal tract. Traditional endoscopic procedures are unable to view the entire gastrointestinal tract and current commercial wireless capsule endoscopes are limited in their effectiveness due to their passive nature. This dissertation advances the field of active capsule endoscopy by developing methods to localize the full six-degree-of-freedom (6-DOF) pose of a screw-type magnetic capsule while it is being propelled through a lumen (such as the small intestines) using an external rotating magnetic dipole. The same external magnetic dipole is utilized for both propulsion and localization. Hardware was designed and constructed to enable testing of the magnetic localization and propulsion methods, including a robotic end-effector used as the external actuator magnet, and a prototype capsule embedded with Hall-effect sensors. Due to the use of a rotating magnetic field for propulsion, at any given time, the capsule can be in one of three regimes: synchronously rotating with the applied field, in "step-out" where it is free to move but the external field is rotating too quickly for the capsule to remain synchronously rotating, or completely stationary. We show that it is only necessary to distinguish whether or not the capsule is synchronously rotating (i.e., a single localization method can be used for a capsule in either the step-out or stationary regimes). Two magnetic localization methods are developed. The first uses nonlinear least squares to estimate the capsule's pose when it has no (or approximately no) net motion (e.g., to find the initial capsule pose or when it is stuck in an intestinal fold). The second method estimates the 6-DOF capsule pose as it synchronously rotates with the applied magnetic field using a square-root variant of the Unscented Kalman filter. A simple process model is adopted that restricts the capsule's movement to translation along and rotation about its principle axis. The capsule is actively propelled forward or backward, but it is not actively steered, rather, steering is provided by the lumen. The propulsion parameters that transform magnetic force and torque to the capsule's spatial velocity and angular velocity are estimated with an additional square-root Unscented Kalman filter to enable the capsule to navigate heterogeneous environments such as the small intestines. An optimized localization-propulsion system is described using the two localization algorithms and prior work in screw-type magnetic capsule propulsion with a single rotating dipole field. The capsule's regime is determined and the corresponding localization method is employed. Based on the capsule's estimated pose and the current estimates of its propulsion parameters, the actuator magnet's pose relative to the capsule is optimized to maximize the capsule's forward propulsion. Using this system, our prototype magnetic capsule successfully completed U-shaped and S-shaped trajectories in fresh bovine intestines with an average forward velocity of 5.5mm/s and 3.5 mm/s, respectively. At this rate it would take approximately 18-30 minutes to traverse the 6 meters of a typical human small intestine

Design, analysis and trajectory tracking control of underactuated mobile capsule robots.

The research on capsule robots (capsubots) has received attraction in recent years because of their compactness, simple structure and their potential use in medical diagnosis (e.g. capsule endoscopy), treatment and surgical assistance. The medical diagnostic capability of a capsule endoscope - which moves with the aid of visceral peristalsis - in the GI (gastro-intestinal) tract can be improved by adding propulsion to it e.g. legged, magnetic or capsubot-type propulsion. Driven by the above needs this thesis presents the design, analysis, trajectory tracking control and implementation of underactuated mobile capsule robots. These capsule robots can be modified and used in in-vivo medical applications. Researches on the capsubottype underactuated system focus on the stabilization of the robot and tracking the actuated configuration. However trajectory tracking control of an unactuated configuration (i.e. the robotmotion)was not considered in the literature though it is the primary requirement of any mobile robot and also crucial for many applications such as in-vivo inspection. Trajectory tracking control for this class of underactuated mechanical systems is still an open issue. This thesis presents a strategy to solve this issue. This thesis presents three robots namely a one-dimensional (1D) capsule robot, a 2D capsule robot and a 2D hybrid capsule robot with incremental capability. Two new acceleration profiles (utroque and contrarium) for the inner mass (IM) - internal moving part of the capsule robot - are proposed, analysed and implemented for the motion generation of the capsule robots. This thesis proposes a two-stage control strategy for the motion control of an underactuated capsule robot. A segment-wise trajectory tracking algorithm is developed for the 1D capsule robot. Theoretical analysis of the algorithm is presented and simulation is performed in the Matlab/Simulink environment based on the theoretical analysis. The algorithm is implemented in the developed capsule robot, the experimentation is performed and the results are critically analyzed. A trajectory tracking control algorithm combining segment-wise and behaviour-based control is proposed for the 2D capsule robot. Detailed theoretical analysis is presented and the simulation is performed to investigate the robustness of the trajectory tracking algorithm to friction uncertainties. A 2D capsule robot prototype is developed and the experimentation is performed. A novel 2D hybrid robot with four modes of operation - legless motion mode, legged motion mode, hybrid motion mode and anchoring mode - is also designed which uses one set of actuators in all operating modes. The theoretical analysis, modelling and simulation is performed. This thesis demonstrates effective ways of propulsion for in-vivo applications. The outer-shape of the 1D and 2D capsule robots can be customized according to the requirement of the applications, as the propulsion mechanisms are completely internal. These robots are also hermetically sealable (enclosed) which is a safety feature for the in-vivo robots. This thesis addresses the trajectory tracking control of the capsubot-type robot for the first time. During the experimentation the 1D robot prototype tracks the desired position trajectory with some error (relative mean absolute error: 16%). The trajectory tracking performance for the 2D capsubot improves as the segment time decreases whereas tracking performance declines as the friction uncertainty increases. The theoretical analysis, simulation and experimental results validate the proposed acceleration profiles and trajectory tracking control algorithms. The designed hybrid robot combines the best aspects of the legless and legged motions. The hybrid robot is capable of stopping in a suspected region and remain stationary for a prolonged observation for the in-vivo applications while withstanding the visceral peristalsis

Monolithic self-supportive bi-directional bending pneumatic bellows catheter

The minimally invasive surgery has proven to be advantageous over conventional open surgery in terms of reduction in recovery time, patient trauma, and overall cost of treatment. To perform a minimally invasive procedure, preliminary insertion of a flexible tube or catheter is crucial without sacrificing its ability to manoeuvre. Nevertheless, despite the vast amount of research reported on catheters, the ability to implement active catheters in the minimally invasive application is still limited. To date, active catheters are made of rigid structures constricted to the use of wires or on-board power supplies for actuation, which increases the risk of damaging the internal organs and tissues. To address this issue, an active catheter made of soft, flexible and biocompatible structure, driven via nonelectric stimulus is of utmost importance. This thesis presents the development of a novel monolithic self-supportive bi-directional bending pneumatic bellows catheter using a sacrificial molding technique. As a proof of concept, in order to understand the effects of structural parameters on the bending performance of a bellows-structured actuator, a single channel circular bellows pneumatic actuator was designed. The finite element analysis was performed in order to analyze the unidirectional bending performance, while the most optimal model was fabricated for experimental validation. Moreover, to attain biocompatibility and bidirectional bending, the novel monolithic polydimethylsiloxane (PDMS)-based dual-channel square bellows pneumatic actuator was proposed. The actuator was designed with an overall cross-sectional area of 5 x 5 mm2, while the input sequence and the number of bellows were characterized to identify their effects on the bending performance. A novel sacrificial molding technique was adopted for developing the monolithic-structured actuator, which enabled simple fabrication for complex designs. The experimental validation revealed that the actuator model with a size of5 x 5 x 68.4 mm3 i.e. having the highest number of bellows, attained optimal bi-directional bending with maximum angles of -65° and 75°, and force of 0.166 and 0.221 N under left and right channel actuation, respectively, at 100 kPa pressure. The bending performance characterization and thermal insusceptibility achieved by the developed pneumatic catheter presents a promising implementation of flexibility and thermal stability for various biomedical applications, such as dialysis and cardiac catheterization

From Concept to Market: Surgical Robot Development

Surgical robotics and supporting technologies have really become a prime example of modern applied information technology infiltrating our everyday lives. The development of these systems spans across four decades, and only the last few years brought the market value and saw the rising customer base imagined already by the early developers. This chapter guides through the historical development of the most important systems, and provide references and lessons learnt for current engineers facing similar challenges. A special emphasis is put on system validation, assessment and clearance, as the most commonly cited barrier hindering the wider deployment of a system

Mobility, Navigation and Localization Towards Robotic Endoscopy

With significant progress being made towards improving endoscope technology such as capsule endoscopy and robotic endoscopy, the development of advanced strategies for manipulating, controlling and more generally, easing the accessibility of these devices for physicians is an important next step. This work presents the development of several robotic platforms for experimentally testing navigation and localization strategies in robotic endoscopy followed by the development and testing of navigation strategies using these devices. Finally, visual and visual inertial localization and mapping is explored on two of these robotic systems. We first present a detailed description on the state-of-the-art with regard to minimally invasive robotic surgery and then follow this with in-depth description of our design and validation of two important systems, the Robotic Endoscope Platform (REP) and the Modular Endoscopy Simulation Apparatus (MESA), for exploring some of the challenges in robotic endoscopy. Following these descriptions we present a technique for autonomous navigation of the REP within the MESA as well as an attempt at applying Simultaneous Localization and Mapping (SLAM) to allow for the real-time localization of this system. Finally, we transition these techniques to the Endoculus, a complete robotic endoscope suitable for in vivo testing, and demonstrate both autonomous navigation for this device, and the implementation of three different SLAM systems for localization and mapping of the Endoculus system in real-time. Throughout these experiments we demonstrate the potential for advanced methods in computer vision along with other sensory techniques to substantially benefit endoscopy, enabling greater and greater autonomy of these systems and furthering the case for robotic endoscopy as a whole.</p

Surgical Subtask Automation for Intraluminal Procedures using Deep Reinforcement Learning

Intraluminal procedures have opened up a new sub-field of minimally invasive surgery that use flexible instruments to navigate through complex luminal structures of the body, resulting in reduced invasiveness and improved patient benefits. One of the major challenges in this field is the accurate and precise control of the instrument inside the human body. Robotics has emerged as a promising solution to this problem. However, to achieve successful robotic intraluminal interventions, the control of the instrument needs to be automated to a large extent. The thesis first examines the state-of-the-art in intraluminal surgical robotics and identifies the key challenges in this field, which include the need for safe and effective tool manipulation, and the ability to adapt to unexpected changes in the luminal environment. To address these challenges, the thesis proposes several levels of autonomy that enable the robotic system to perform individual subtasks autonomously, while still allowing the surgeon to retain overall control of the procedure. The approach facilitates the development of specialized algorithms such as Deep Reinforcement Learning (DRL) for subtasks like navigation and tissue manipulation to produce robust surgical gestures. Additionally, the thesis proposes a safety framework that provides formal guarantees to prevent risky actions. The presented approaches are evaluated through a series of experiments using simulation and robotic platforms. The experiments demonstrate that subtask automation can improve the accuracy and efficiency of tool positioning and tissue manipulation, while also reducing the cognitive load on the surgeon. The results of this research have the potential to improve the reliability and safety of intraluminal surgical interventions, ultimately leading to better outcomes for patients and surgeons

Cable-driven parallel mechanisms for minimally invasive robotic surgery

Minimally invasive surgery (MIS) has revolutionised surgery by providing faster recovery times, less post-operative complications, improved cosmesis and reduced pain for the patient. Surgical robotics are used to further decrease the invasiveness of procedures, by using yet smaller and fewer incisions or using natural orifices as entry point. However, many robotic systems still suffer from technical challenges such as sufficient instrument dexterity and payloads, leading to limited adoption in clinical practice. Cable-driven parallel mechanisms (CDPMs) have unique properties, which can be used to overcome existing challenges in surgical robotics. These beneficial properties include high end-effector payloads, efficient force transmission and a large configurable instrument workspace. However, the use of CDPMs in MIS is largely unexplored. This research presents the first structured exploration of CDPMs for MIS and demonstrates the potential of this type of mechanism through the development of multiple prototypes: the ESD CYCLOPS, CDAQS, SIMPLE, neuroCYCLOPS and microCYCLOPS. One key challenge for MIS is the access method used to introduce CDPMs into the body. Three different access methods are presented by the prototypes. By focusing on the minimally invasive access method in which CDPMs are introduced into the body, the thesis provides a framework, which can be used by researchers, engineers and clinicians to identify future opportunities of CDPMs in MIS. Additionally, through user studies and pre-clinical studies, these prototypes demonstrate that this type of mechanism has several key advantages for surgical applications in which haptic feedback, safe automation or a high payload are required. These advantages, combined with the different access methods, demonstrate that CDPMs can have a key role in the advancement of MIS technology.Open Acces