A continuum robotic platform for endoscopic non-contact laser surgery: design, control, and preclinical evaluation

The application of laser technologies in surgical interventions has been accepted in the clinical domain due to their atraumatic properties. In addition to manual application of fibre-guided lasers with tissue contact, non-contact transoral laser microsurgery (TLM) of laryngeal tumours has been prevailed in ENT surgery. However, TLM requires many years of surgical training for tumour resection in order to preserve the function of adjacent organs and thus preserve the patient’s quality of life. The positioning of the microscopic laser applicator outside the patient can also impede a direct line-of-sight to the target area due to anatomical variability and limit the working space. Further clinical challenges include positioning the laser focus on the tissue surface, imaging, planning and performing laser ablation, and motion of the target area during surgery. This dissertation aims to address the limitations of TLM through robotic approaches and intraoperative assistance. Although a trend towards minimally invasive surgery is apparent, no highly integrated platform for endoscopic delivery of focused laser radiation is available to date. Likewise, there are no known devices that incorporate scene information from endoscopic imaging into ablation planning and execution. For focusing of the laser beam close to the target tissue, this work first presents miniaturised focusing optics that can be integrated into endoscopic systems. Experimental trials characterise the optical properties and the ablation performance. A robotic platform is realised for manipulation of the focusing optics. This is based on a variable-length continuum manipulator. The latter enables movements of the endoscopic end effector in five degrees of freedom with a mechatronic actuation unit. The kinematic modelling and control of the robot are integrated into a modular framework that is evaluated experimentally. The manipulation of focused laser radiation also requires precise adjustment of the focal position on the tissue. For this purpose, visual, haptic and visual-haptic assistance functions are presented. These support the operator during teleoperation to set an optimal working distance. Advantages of visual-haptic assistance are demonstrated in a user study. The system performance and usability of the overall robotic system are assessed in an additional user study. Analogous to a clinical scenario, the subjects follow predefined target patterns with a laser spot. The mean positioning accuracy of the spot is 0.5 mm. Finally, methods of image-guided robot control are introduced to automate laser ablation. Experiments confirm a positive effect of proposed automation concepts on non-contact laser surgery.Die Anwendung von Lasertechnologien in chirurgischen Interventionen hat sich aufgrund der atraumatischen Eigenschaften in der Klinik etabliert. Neben manueller Applikation von fasergeführten Lasern mit Gewebekontakt hat sich die kontaktfreie transorale Lasermikrochirurgie (TLM) von Tumoren des Larynx in der HNO-Chirurgie durchgesetzt. Die TLM erfordert zur Tumorresektion jedoch ein langjähriges chirurgisches Training, um die Funktion der angrenzenden Organe zu sichern und damit die Lebensqualität der Patienten zu erhalten. Die Positionierung des mikroskopis chen Laserapplikators außerhalb des Patienten kann zudem die direkte Sicht auf das Zielgebiet durch anatomische Variabilität erschweren und den Arbeitsraum einschränken. Weitere klinische Herausforderungen betreffen die Positionierung des Laserfokus auf der Gewebeoberfläche, die Bildgebung, die Planung und Ausführung der Laserablation sowie intraoperative Bewegungen des Zielgebietes. Die vorliegende Dissertation zielt darauf ab, die Limitierungen der TLM durch robotische Ansätze und intraoperative Assistenz zu adressieren. Obwohl ein Trend zur minimal invasiven Chirurgie besteht, sind bislang keine hochintegrierten Plattformen für die endoskopische Applikation fokussierter Laserstrahlung verfügbar. Ebenfalls sind keine Systeme bekannt, die Szeneninformationen aus der endoskopischen Bildgebung in die Ablationsplanung und -ausführung einbeziehen. Für eine situsnahe Fokussierung des Laserstrahls wird in dieser Arbeit zunächst eine miniaturisierte Fokussieroptik zur Integration in endoskopische Systeme vorgestellt. Experimentelle Versuche charakterisieren die optischen Eigenschaften und das Ablationsverhalten. Zur Manipulation der Fokussieroptik wird eine robotische Plattform realisiert. Diese basiert auf einem längenveränderlichen Kontinuumsmanipulator. Letzterer ermöglicht in Kombination mit einer mechatronischen Aktuierungseinheit Bewegungen des Endoskopkopfes in fünf Freiheitsgraden. Die kinematische Modellierung und Regelung des Systems werden in ein modulares Framework eingebunden und evaluiert. Die Manipulation fokussierter Laserstrahlung erfordert zudem eine präzise Anpassung der Fokuslage auf das Gewebe. Dafür werden visuelle, haptische und visuell haptische Assistenzfunktionen eingeführt. Diese unterstützen den Anwender bei Teleoperation zur Einstellung eines optimalen Arbeitsabstandes. In einer Anwenderstudie werden Vorteile der visuell-haptischen Assistenz nachgewiesen. Die Systemperformanz und Gebrauchstauglichkeit des robotischen Gesamtsystems werden in einer weiteren Anwenderstudie untersucht. Analog zu einem klinischen Einsatz verfolgen die Probanden mit einem Laserspot vorgegebene Sollpfade. Die mittlere Positioniergenauigkeit des Spots beträgt dabei 0,5 mm. Zur Automatisierung der Ablation werden abschließend Methoden der bildgestützten Regelung vorgestellt. Experimente bestätigen einen positiven Effekt der Automationskonzepte für die kontaktfreie Laserchirurgie

On the Statics, Dynamics, and Stability of Continuum Robots: Model Formulations and Efficient Computational Schemes

This dissertation presents advances in continuum-robotic mathematical-modeling techniques. Specifically, problems of statics, dynamics, and stability are studied for robots with slender elastic links. The general procedure within each topic is to develop a continuous theory describing robot behavior, develop a discretization strategy to enable simulation and control, and to validate simulation predictions against experimental results.Chapter 1 introduces the basic concept of continuum robotics and reviews progress in the field. It also introduces the mathematical modeling used to describe continuum robots and explains some notation used throughout the dissertation.The derivation of Cosserat rod statics, the coupling of rods to form a parallel continuum robot (PCR), and solution of the kinematics problem are reviewed in Chapter 2. With this foundation, soft real-time teleoperation of a PCR is demonstrated and a miniature prototype robot with a grasper is controlled.Chapter 3 reviews the derivation of Cosserat rod dynamics and presents a discretization strategy having several desirable features, such as generality, accuracy, and potential for good computational efficiency. The discretized rod model is validated experimentally using high speed camera footage of a cantilevered rod. The discretization strategy is then applied to simulate continuum robot dynamics for several classes of robot, including PCRs, tendon-driven robots, fluidic actuators, and concentric tube robots.In Chapter 4, the stability of a PCR is analyzed using optimal control theory. Conditions of stability are gradually developed starting from a single planar rod and finally arriving at a stability test for parallel continuum robots. The approach is experimentally validated using a camera tracking system.Chapter 5 provides closing discussion and proposes potential future work

Modeling, Calibration, and Evaluation of a Tendon-Actuated Planar Parallel Continuum Robot

In this work, a novel planar parallel continuum robot (PCR) is introduced, consisting of three kinematic chains that are coupled at a triangular end-effector platform and include tendon-actuated continuum segments. The kinematics of the resulting structure are derived by adapting the descriptions for conventional planar parallel manipulators to include constant curvature bending of the utilized continuous segments. To account for friction and non-linear material effects, a data-driven model is used to relate tendon displacements and curvature of the utilized continuum segments. A calibration of the derived kinematic model is conducted to specifically represent the constructed prototype. This includes the calibration of geometric parameters for each kinematic chain and for the end-effector platform. During evaluation, positioning repeatability of 1.0% in relation to one continuum segment length of the robot, and positioning accuracy of 1.4%, are achieved. These results are comparable to commonly used kineto-static modeling approaches for PCR. The presented model achieves high path accuracies regarding the robot's end-effector pose in an open-loop control scenario

Modeling, Sensorization and Control of Concentric-Tube Robots

Since the concept of the Concentric-Tube Robot (CTR) was proposed in 2006, CTRs have been a popular research topic in the field of surgical robotics. The unique mechanical design of this robot allows it to navigate through narrow channels in the human anatomy and operate in highly constrained environments. It is therefore likely to become the next generation of surgical robots to overcome the challenges that cannot be addressed by current technologies. In CSTAR, we have had ongoing work over the past several years aimed at developing novel techniques and technologies for CTRs. This thesis describes the contributions made in this context, focusing primarily on topics such as modeling, sensorization, and control of CTRs. Prior to this work, one of the main challenges in CTRs was to develop a kinematic model that achieves a balance between the numerical accuracy and computational efficiency for surgical applications. In this thesis, a fast kinematic model of CTRs is proposed, which can be solved at a comparatively fast rate (0.2 ms) with minimal loss of accuracy (0.1 mm) for a 3-tube CTR. A Jacobian matrix is derived based on this model, leading to the development of a real-time trajectory tracking controller for CTRs. For tissue-robot interactions, a force-rejection controller is proposed for position control of CTRs under time-varying force disturbances. In contrast to rigid-link robots, instability of position control could be caused by non-unique solutions to the forward kinematics of CTRs. This phenomenon is modeled and analyzed, resulting in design criteria that can ensure kinematic stability of a CTR in its entire workspace. Force sensing is another major difficulty for CTRs. To address this issue, commercial force/torque sensors (Nano43, ATI Industrial Automation, United States) are integrated into one of our CTR prototypes. These force/torque sensors are replaced by Fiber-Bragg Grating (FBG) sensors that are helically-wrapped and embedded in CTRs. A strain-force calculation algorithm is proposed, to convert the reflected wavelength of FBGs into force measurements with 0.1 N force resolution at 100 Hz sampling rate. In addition, this thesis reports on our innovations in prototyping drive units for CTRs. Three designs of CTR prototypes are proposed, the latest one being significantly more compact and cost efficient in comparison with most designs in the literature. All of these contributions have brought this technology a few steps closer to being used in operating rooms. Some of the techniques and technologies mentioned above are not merely limited to CTRs, but are also suitable for problems arising in other types of surgical robots, for example, for sensorizing da Vinci surgical instruments for force sensing (see Appendix A)

Robotic technology and endoluminal surgery in digestive surgery

BACKGROUND. Colorectal cancer (CRC) is the third most common cancer in males and second in females, and the fourth most common cause of cancer death worldwide. The implementation of screening programs has allowed to the identification of an increasing number of early-stage neoplastic lesions. Presently, superficial colorectal neoplasms (including precancerous lesions and early cancer) can be resected in the colon by Endoscopic Mucosal Resection (EMR) and Endoscopic Submucosal Dissection (ESD), while in the rectum by Transanal Endoscopic Microsurgery (TEM). They are the preferred choices inside of the minimally invasive panorama regarding the CRC treatment. TEM technique offers more advantages than EMR and ESD, but it can’t overcome the recto-sigmoid junction. Many authors, research institutes and biomedical industries have proposed different solutions for microsurgery dissection of early lesions in the colon, but all these proposals have in common the development of platforms expressly designed for this use, with significant purchasing and management costs. The aim of our research project is to develop a robotic platform that allows to treat lesions throughout the colon limiting the costs of management and purchasing. This new robotic platform, developed in collaboration with Scuola Superiore Sant’Anna in Pisa, is called RED (Robot for Endoscopic Dissection). At the tip of a standard endoscope a hood (RED) is placed. RED is equipped by two extractable teleoperated robotic arms (i.e., diathermic hook and gripper); their motion is provided by onboard miniaturized commercial motors and a dedicated external platform. The endoscopist holds the endoscope near the lesion, while the operator drives the robotic arms through a remote control. MATERIALS AND METHODS. Several preliminary studies have been conducted in the following order. A first test was conducted for identification of force value for lifting and pulling maneuvers using a modified TEM instrument. A CAD study was conducted to determine the maximum size that the hood must have in order to overcome the critical angle represented by the splenic flexure. Several tests were conducted to determine the degrees of freedom of each robotic arm, starting with the CAD drawing to make subsequently the mock-ups of each configuration. Finally, a 3D mock-up was produced that was assembled on an endoscope to perform the in vitro test to evaluate the workspace and field of view using a pelvic trainer for TEM. RESULTS. The first test shown that the minimum force that the gripper will have to develop with the push-pull is 1.5N. The CAD study shown that the maximum dimensions the hood must have to overcome splenic flexure are: maximum diameter 28mm, maximum length 57mm. After several configurations was been tested, the final prototype features are: gripper arm with pitch sliding and open/close of the tip and diathermic hook arm with pitch, roll and sliding. There will be 6 such distributed motors: 3 external motors for the gripper arm that will operate through cables contained in a sheath adherent to colonscope and 3 embedded motors for diathermic hook arm (one integrated on the hood for the sliding degree of motion and the other two inside of the arm). The in-vitro test has been carried out to evaluate the workspace and they proved that the operating field vision is not obstructed by the hood and the working range is sufficiently wide to perform a dissection. CONCLUSION. Tests conducted up to this point have allowed us to identify the overall layout of the RED: dimensions, degrees of freedom, number and distribution of motors needed for the operation of robotic arms; moreover, it is proved that the device, once assembled, maintained the visual and operational field characteristics necessary to perform an accurate dissection. The next step will be to realize a RED steel final prototype and in-vivo tests will be carry out to replicate an endoscopic dissection into the colon

A Review of Pneumatic Actuators Used for the Design of Medical Simulators and Medical Tools

International audienc

Modeling and Force Estimation of Cardiac Catheters for Haptics-enabled Tele-intervention

Robot-assisted cardiovascular intervention (RCI) systems have shown success in reducing the x-ray exposure to surgeons and patients during cardiovascular interventional procedures. RCI systems typically are teleoperated systems with leader-follower architecture. With such system architecture, the surgeon is placed out of the x-ray exposure zone and uses a console to control the robot remotely. Despite its success in reducing x-ray exposure, clinicians have identified the lack of force feedback as to its main technological limitation that can lead to vascular perforation of the patient’s vessels and even their death. The objective of this thesis was to develop, verify, and validate mechatronics technology for real-time accurate and robust haptic feedback rendering for RCI systems. To attain the thesis objective, first, a thorough review of the state-of-the-art clinical requirements, modeling approaches and methods, and current knowledge gaps for the provision of force feedback for RCI systems was performed. Afterward, a real-time tip force estimation method based on image-based shape-sensing and learning-from-simulation was developed and validated. The learning-based model was fairly accurate but required a large database for training which was computationally expensive. Next, a new mechanistic model, i.e., finite arc method (FAM) for soft robots was proposed, formulated, solved, and validated that allowed for fast and accurate modeling of catheter deformation. With FAM, the required training database for the proposed learning-from-simulation method would be generated with high speed and accuracy. In the end, to robustly relay the estimated forces from real-time imaging from the follower robot to the leader haptic device, a novel impedance-based force feedback rendering modality was proposed and implemented on a representative teleoperated RCI system for experimental validation. The proposed method was compared with the classical direct force reflection method and showed enhanced stability, robustness, and accuracy in the presence of communication disruption. The results of this thesis showed that the performance of the proposed integrated force feedback rendering system was in fair compliance with the clinical requirements and had superior robustness compared to the classical direct force reflection method

Kinematic Analysis of a Tendon-Driven Hybrid Rigid–Flexible Four-Bar; Application to Optimum Dimensional Synthesis

In design matters, mechanisms with deformable elements are a step behind those with rigid bars, particularly if dimensional synthesis is considered a fundamental part of mechanism design. For the purposes of this work, a hybrid rigid–flexible four-bar mechanism has been chosen, the input bar being a continuum tendon of constant curvature. The coupler curves are noticeably more complex but offer more possibilities than the classical rigid four-bar counterpart. One of the objectives of this work is to completely characterize the coupler curves of this hybrid rigid–flexible mechanism, determining the number and type of circuits as well as constituent branches. Another important aim is to apply optimization techniques to the dimensional synthesis of path generation. Considerable progress in finding the best design solutions can be obtained if all the acquired knowledge about the coupler curves of this hybrid mechanism is integrated into the optimization algorithm.This research was funded by the Spanish government through the Ministerio de Ciencia e Innovación (Project PID2020-116176GB-I00), financed by MCIN/AEI/10.13039/501100011033, and funded by the Departamento de Educación from the Regional Basque Government through Project IT1480-22

Modeling, Analysis, Force Sensing and Control of Continuum Robots for Minimally Invasive Surgery

This dissertation describes design, modeling and application of continuum robotics for surgical applications, specifically parallel continuum robots (PCRs) and concentric tube manipulators (CTMs). The introduction of robotics into surgical applications has allowed for a greater degree of precision, less invasive access to more remote surgical sites, and user-intuitive interfaces with enhanced vision systems. The most recent developments have been in the space of continuum robots, whose exible structure create an inherent safety factor when in contact with fragile tissues. The design challenges that exist involve balancing size and strength of the manipulators, controlling the manipulators over long transmission pathways, and incorporating force sensing and feedback from the manipulators to the user. Contributions presented in this work include: (1) prototyping, design, force sensing, and force control investigations of PCRs, and (2) prototyping of a concentric tube manipulator for use in a standard colonoscope. A general kinetostatic model is presented for PCRs along with identification of multiple physical constraints encountered in design and construction. Design considerations and manipulator capabilities are examined in the form of matrix metrics and ellipsoid representations. Finally, force sensing and control are explored and experimental results are provided showing the accuracy of force estimates based on actuation force measurements and control capabilities. An overview of the design requirements, manipulator construction, analysis and experimental results are provided for a CTM used as a tool manipulator in a traditional colonoscope. Currently, tools used in colonoscopic procedures are straight and exit the front of the scope with 1 DOF of operation (jaws of a grasper, tightening of a loop, etc.). This research shows that with a CTM deployed, the dexterity of these tools can be increased dramatically, increasing accuracy of tool operation, ease of use and safety of the overall procedure. The prototype investigated in this work allows for multiple tools to be used during a single procedure. Experimental results show the feasibility and advantages of the newly-designed manipulators