Context-aware learning for robot-assisted endovascular catheterization

Endovascular intervention has become a mainstream treatment of cardiovascular diseases. However, multiple challenges remain such as unwanted radiation exposures, limited two-dimensional image guidance, insufficient force perception and haptic cues. Fast evolving robot-assisted platforms improve the stability and accuracy of instrument manipulation. The master-slave system also removes radiation to the operator. However, the integration of robotic systems into the current surgical workflow is still debatable since repetitive, easy tasks have little value to be executed by the robotic teleoperation. Current systems offer very low autonomy, potential autonomous features could bring more benefits such as reduced cognitive workloads and human error, safer and more consistent instrument manipulation, ability to incorporate various medical imaging and sensing modalities. This research proposes frameworks for automated catheterisation with different machine learning-based algorithms, includes Learning-from-Demonstration, Reinforcement Learning, and Imitation Learning. Those frameworks focused on integrating context for tasks in the process of skill learning, hence achieving better adaptation to different situations and safer tool-tissue interactions. Furthermore, the autonomous feature was applied to next-generation, MR-safe robotic catheterisation platform. The results provide important insights into improving catheter navigation in the form of autonomous task planning, self-optimization with clinical relevant factors, and motivate the design of intelligent, intuitive, and collaborative robots under non-ionizing image modalities.Open Acces

Using the Fringe Field of MRI Scanner for the Navigation of Microguidewires in the Vascular System

Le traitement du cancer, la prévention des accidents vasculaires cérébraux et le diagnostic ou le traitement des maladies vasculaires périphériques sont tous des cas d'application d'interventions à base de cathéter par le biais d'un traitement invasif minimal. Cependant, la pratique du cathétérisme est généralement pratiquée manuellement et dépend fortement de l'expérience et des compétences de l'interventionniste. La robotisation du cathétérisme a été étudiée pour faciliter la procédure en augmentant les niveaux d’autonomie par rapport à cette pratique clinique. En ce qui concerne ce problème, un des problèmes concerne le placement super sélectif du cathéter dans les artères plus étroites nécessitant une miniaturisation de l'instrument cathéter / fil de guidage attaché. Un microguide qui fonctionne dans des vaisseaux sanguins étroits et tortueux subit différentes forces mécaniques telles que le frottement avec la paroi du vaisseau. Ces forces peuvent empêcher la progression de la pointe du fil de guidage dans les vaisseaux. Une méthode proposée consiste à appliquer une force de traction à la pointe du microguide pour diriger et insérer le dispositif tout en poussant l’instrument attaché à partir de l’autre extrémité n’est plus pratique, et à exploiter le gradient du champ de franges IRM surnommé Fringe Field Navigation (FFN ) est proposée comme solution pour assurer cet actionnement. Le concept de FFN repose sur le positionnement d'un patient sur six DOF dans le champ périphérique du scanner IRM afin de permettre un actionnement directionnel pour la navigation du fil-guide. Ce travail rend compte des développements requis pour la mise en oeuvre de la FFN et l’étude du potentiel et des possibilités qu’elle offre au cathétérisme, en veillant au renforcement de l’autonomie. La cartographie du champ de franges d'un scanner IRM 3T est effectuée et la structure du champ de franges en ce qui concerne son uniformité locale est examinée. Une méthode pour la navigation d'un fil de guidage le long d'un chemin vasculaire souhaité basée sur le positionnement robotique du patient à six DOF est développée. Des expériences de FFN guidées par rayons X in vitro et in vivo sur un modèle porcin sont effectuées pour naviguer dans un fil de guidage dans la multibifurcation et les vaisseaux étroits. Une caractéristique unique de FFN est le haut gradient du champ magnétique. Il est démontré in vitro et in vivo que cette force surmonte le problème de l'insertion d'un fil microguide dans des vaisseaux tortueux et étroits pour permettre de faire avancer le fil-guide avec une distale douce au-delà de la limite d'insertion manuelle. La robustesse de FFN contre les erreurs de positionnement du patient est étudiée en relation avec l'uniformité locale dans le champ périphérique. La force élevée du champ magnétique disponible dans le champ de franges IRM peut amener les matériaux magnétiques doux à son état de saturation. Ici, le concept d'utilisation d'un ressort est présenté comme une alternative vi déformable aux aimants permanents solides pour la pointe du fil-guide. La navigation d'un microguide avec une pointe de ressort en structure vasculaire complexe est également réalisée in vitro. L'autonomie de FFN en ce qui concerne la planification d'une procédure avec autonomie de tâche obtenue dans ce travail augmente le potentiel de FFN en automatisant certaines étapes d'une procédure. En conclusion, FFN pour naviguer dans les microguides dans la structure vasculaire complexe avec autonomie pour effectuer le positionnement du patient et contrôler l'insertion du fil de guidage - avec démonstration in vivo dans un modèle porcin - peut être considéré comme un nouvel outil robotique facilitant le cathétérisme vasculaire. tout en aidant à cibler les vaisseaux lointains dans le système vasculaire.----------ABSTRACT Treatment of cancer, prevention of stroke, and diagnosis or treatment of peripheral vascular diseases are all the cases of application of catheter-based interventions through a minimal-invasive treatment. However, performing catheterization is generally practiced manually, and it highly depends on the experience and the skills of the interventionist. Robotization of catheterization has been investigated to facilitate the procedure by increasing the levels of autonomy to this clinical practice. Regarding it, one issue is the super selective placement of the catheter in the narrower arteries that require miniaturization of the tethered catheter/guidewire instrument. A microguidewire that operates in narrow and tortuous blood vessels experiences different mechanical forces like friction with the vessel wall. These forces can prevent the advancement of the tip of the guidewire in the vessels. A proposed method is applying a pulling force at the tip of the microguidewire to steer and insert the device while pushing the tethered instrument from the other end is no longer practical, and exploiting the gradient of the MRI fringe field dubbed as Fringe Field Navigation (FFN) is proposed as a solution to provide this actuation. The concept of FFN is based on six DOF positioning of a patient in the fringe field of the MRI scanner to enable directional actuation for the navigation of the guidewire. This work reports on the required developments for implementing FFN and investigating the potential and the possibilities that FFN introduces to the catheterization, with attention to enhancing the autonomy. Mapping the fringe field of a 3T MRI scanner is performed, and the structure of the fringe field regarding its local uniformity is investigated. A method for the navigation of a guidewire along a desired vascular path based on six DOF robotic patient positioning is developed. In vitro and in vivo x-ray Guided FFN experiments on a swine model of are performed to navigate a guidewire in the multibifurcation and narrow vessels. A unique feature of FFN is the high gradient of the magnetic field. It is demonstrated in vitro and in vivo that this force overcomes the issue of insertion of a microguidewire in tortuous and narrow vessels to enable advancing the guidewire with a soft distal beyond the limit of manual insertion. Robustness of FFN against the error in the positioning of the patient is investigated in relation to the local uniformity in the fringe field. The high strength of the magnetic field available in MRI fringe field can bring soft magnetic materials to its saturation state. Here, the concept of using a spring is introduced as a deformable alternative to solid permanent magnets for the tip of the guidewire. Navigation of a microguidewire with a viii spring tip in complex vascular structure is also performed in vitro. The autonomy of FFN regarding planning a procedure with Task Autonomy achieved in this work enhances the potential of FFN by automatization of certain steps of a procedure. As a conclusion, FFN to navigate microguidewires in the complex vascular structure with autonomy in performing tasks of patient positioning and controlling the insertion of the guidewire – with in vivo demonstration in swine model – can be considered as a novel robotic tool for facilitating the vascular catheterization while helping to target remote vessels in the vascular system

Position-based dynamics simulator of vessel deformations for path planning in robotic endovascular catheterization

A major challenge during autonomous navigation in endovascular interventions is the complexity of operating in a deformable but constrained workspace with an instrument. Simulation of deformations for it can provide a cost-effective training platform for path planning. Aim of this study is to develop a realistic, auto-adaptive, and visually plausible simulator to predict vessels’ global deformation induced by the robotic catheter’s contact and cyclic heartbeat motion. Based on a Position-based Dynamics (PBD) approach for vessel modeling, Particle Swarm Optimization (PSO) algorithm is employed for an auto-adaptive calibration of PBD deformation parameters and of the vessels movement due to a heartbeat. In-vitro experiments were conducted and compared with in-silico results. The end-user evaluation results were reported through quantitative performance metrics and a 5-Point Likert Scale questionnaire. Compared with literature, this simulator has an error of 0.23±0.13% for deformation and 0.30±0.85mm for the aortic root displacement. In-vitro experiments show an error of 1.35±1.38mm for deformation prediction. The end-user evaluation results show that novices are more accustomed to using joystick controllers, and cardiologists are more satisfied with the visual authenticity. The real-time and accurate performance of the simulator make this framework suitable for creating a dynamic environment for autonomous navigation of robotic catheters

Evaluation of robotic catheter technology in complex endovascular intervention

The past four decades have witnessed tremendous strides in the evolution of endovascular devices and techniques. Catheter-based intervention has revolutionized the management of arterial disease allowing treatment of aortic and peripheral pathologies via a minimally invasive approach. Despite the exponential advances in endovascular equipment, devices and techniques, catheter-based endovascular intervention has certain morphological and technological constraints. Complex patient anatomy, technological impediments and suboptimal fluoroscopic imaging, can make endovascular intervention challenging using traditional endovascular means. Conventional endovascular catheters lack active manoeuvrability of the tip. Manual control can hinder overall stability and control at key target areas, leading to significantly prolonged overall procedure and fluoroscopic times. Repeated instrumentation increases the risk of vessel trauma and distal embolization. More importantly, guidewire-catheter skills are not necessarily intuitive but must be developed and are highly dependent on operator skill with long training pathways as a result. Recognizing the pressing need to address some of the limitations of standard catheter technology this thesis aims to evaluate the role of advanced robotic endovascular catheters in the aortic arch and the visceral segment. Clinical use of this technology is currently limited to transvenous cardiac mapping and ablation procedures. A comprehensive pre-clinical comparison and analysis of robotic versus manual catheter techniques is presented to reveal both their advantages and limitations, with particular emphasis on the potential of robotic catheter technology to reduce the manual skill required for complex tasks, improve stability at key target areas, reduce the risk of vessel trauma, embolization and radiation exposure, whilst improving overall operator performance. The worlds first clinical report of robot-assisted aortic aneurysm repair, a “proof - of - concept” resulting from this research, is also presented, and the potential for future advanced applications in order to increase the applicability of endovascular therapy to a larger cohort of patients discussed

A Magnetically Controlled Soft Microrobot Steering a Guidewire in a Three-Dimensional Phantom Vascular Network

Magnetically actuated soft robots may improve the treatment of disseminated intravascular coagulation. Significant progress has been made in the development of soft robotic systems that steer catheters. A more challenging task, however, is the development of systems that steer sub-millimeter-diameter guidewires during intravascular treatments; a novel microrobotic approach is required for steering. In this article, we develop a novel, magnetically actuated, soft microrobotic system, increasing the steerability of a conventional guidewire. The soft microrobot is attached to the tip of the guidewire, and it is magnetically steered by changing the direction and intensity of an external magnetic field. The microrobot is fabricated via replica molding and features a soft body made of polydimethylsiloxane, two permanent magnets, and a microspring. We developed a mathematical model mapping deformation of the soft microrobot using a feed-forward approach toward steering. Then, we used the model to steer a guidewire. The angulation of the microrobot can be controlled from 21.1° to 132.7° by using a magnetic field of an intensity of 15 mT. Steerability was confirmed by two-dimensional in vitro tracking. Finally, a guidewire with the soft microrobot was tested by using a three-dimensional (3D) phantom of the coronary artery to verify steerability in 3D space

Surgical Subtask Automation for Intraluminal Procedures using Deep Reinforcement Learning

Intraluminal procedures have opened up a new sub-field of minimally invasive surgery that use flexible instruments to navigate through complex luminal structures of the body, resulting in reduced invasiveness and improved patient benefits. One of the major challenges in this field is the accurate and precise control of the instrument inside the human body. Robotics has emerged as a promising solution to this problem. However, to achieve successful robotic intraluminal interventions, the control of the instrument needs to be automated to a large extent. The thesis first examines the state-of-the-art in intraluminal surgical robotics and identifies the key challenges in this field, which include the need for safe and effective tool manipulation, and the ability to adapt to unexpected changes in the luminal environment. To address these challenges, the thesis proposes several levels of autonomy that enable the robotic system to perform individual subtasks autonomously, while still allowing the surgeon to retain overall control of the procedure. The approach facilitates the development of specialized algorithms such as Deep Reinforcement Learning (DRL) for subtasks like navigation and tissue manipulation to produce robust surgical gestures. Additionally, the thesis proposes a safety framework that provides formal guarantees to prevent risky actions. The presented approaches are evaluated through a series of experiments using simulation and robotic platforms. The experiments demonstrate that subtask automation can improve the accuracy and efficiency of tool positioning and tissue manipulation, while also reducing the cognitive load on the surgeon. The results of this research have the potential to improve the reliability and safety of intraluminal surgical interventions, ultimately leading to better outcomes for patients and surgeons

FROM CONCEPT, TO DESIGN, EVALUATION AND FIRST IN VIVO DEMONSTRATION OF A TELE-OPERATED CATHETER NAVIGATION SYSTEM

Percutaneous transluminal catheter (PTC) intervention is a medical technique used to assess and treat vascular and cardiac diseases, including electrophysiological conditions. A Interventional specialists use the vasculature as a passageway to guide the catheter to the site of interest, using fluoroscopic x-ray imaging for image-guidance. Common PTC procedures include: vascular angiography, inflating balloons and stents, depositing coils, and the treatment of cardiac arrhythmia via catheter ablation. Catheter ablation has gained prevalence over the last two decades, as the treatment success rate for atrial fibrillation reaches 100%. The close proximity between the interventionalist and the radiation source combined with the increased number of procedures performed annually has lead to increased lifetime exposure; escalating the interventionalist probability of developing cancer, cataracts or passing genetic defects to offspring. Furthermore, the lead garments that protect the interventionalist can lead to musculoskeletal injury. Both these factors have lead to increased occupational risk. Catheter navigation systems are commercially available to reduce these risks. Lack of intuitive design is a common failing among these systems. iii This thesis presents the design and validation of a remote catheter navigation system (RCNS) that utilizes dexterous skills of the interventionalist during remote navigation, by keeping the catheter in their hands of the interventionalist during remote navigation. For remote catheter manipulation, the interventionalist pushes, pulls, and twists an input catheter, which is placed inside an electromechanical sensor (CS). Position changes of the input catheter are transferred to a second electromechanical (CM) that replicates the sensed motion with a second, remote catheter. Design of this system begins with understanding the dynamic forces applied to the catheter during intravascular navigation. These dynamics were quantified and then used as operating parameters in the mechanical design of the CM. In a laboratory setting, motion sensed and replicated by the RCNS was found to be 1 mm in the axial direction, 1° in the radial direction, with a latency of 180 ms. In a multi-operator, comparative study using a specially constructed multi-path vessel phantom, comparable navigation efficacy was demonstrated between the RCNS and conventional catheter manipulation, with the RCNS requiring only 9s longer to complete the same tasks. Finally, remote navigation was performed in vivo to fully demonstrate the application of this system towards the diagnosis and treatment of cardiac arrhythmia

Modeling and Control of Steerable Ablation Catheters

Catheters are long, flexible tubes that are extensively used in vascular and cardiac interventions, e.g., cardiac ablation, coronary angiography and mitral valve annuloplasty. Catheter-based cardiac ablation is a well-accepted treatment for atrial fibrillation, a common type of cardiac arrhythmia. During this procedure, a steerable ablation catheter is guided through the vasculature to the left atrium to correct the signal pathways inside the heart and restore normal heart rhythm. The outcome of the ablation procedure depends mainly on the correct positioning of the catheter tip at the target location inside the heart and also on maintaining a consistent contact between the catheter tip and cardiac tissue. In the presence of cardiac and respiratory motions, achieving these goals during the ablation procedure is very challenging without proper 3D visualization, dexterous control of the flexible catheter and an estimate of the catheter tip/tissue contact force. This research project provides the required basis for developing a robotics-assisted catheter manipulation system with contact force control for use in cardiac ablation procedures. The behavior of the catheter is studied in free space as well in contact with the environment to develop mathematical models of the catheter tip that are well suited for developing control systems. The validity of the proposed modeling approaches and the performance of the suggested control techniques are evaluated experimentally. As the first step, the static force-deflection relationship for ablation catheters is described with a large-deflection beam model and an optimized pseudo-rigid-body 3R model. The proposed static model is then used in developing a control system for controlling the contact force when the catheter tip is interacting with a static environment. Our studies also showed that it is possible to estimate the tip/tissue contact force by analyzing the shape of the catheter without installing a force sensor on the catheter. During cardiac ablation, the catheter tip is in contact with a relatively fast moving environment (cardiac tissue). Robotic manipulation of the catheter has the potential to improve the quality of contact between the catheter tip and cardiac tissue. To this end, the frequency response of the catheter is investigated and a control technique is proposed to compensate for the cardiac motion and to maintain a constant tip/tissue contact force. Our study on developing a motion compensated robotics-assisted catheter manipulation system suggests that redesigning the actuation mechanism of current ablation catheters would provide a major improvement in using these catheters in robotics-assisted cardiac ablation procedures