Teleoperation of MRI-Compatible Robots with Hybrid Actuation and Haptic Feedback

Image guided surgery (IGS), which has been developing fast recently, benefits significantly from the superior accuracy of robots and magnetic resonance imaging (MRI) which is a great soft tissue imaging modality. Teleoperation is especially desired in the MRI because of the highly constrained space inside the closed-bore MRI and the lack of haptic feedback with the fully autonomous robotic systems. It also very well maintains the human in the loop that significantly enhances safety. This dissertation describes the development of teleoperation approaches and implementation on an example system for MRI with details of different key components. The dissertation firstly describes the general teleoperation architecture with modular software and hardware components. The MRI-compatible robot controller, driving technology as well as the robot navigation and control software are introduced. As a crucial step to determine the robot location inside the MRI, two methods of registration and tracking are discussed. The first method utilizes the existing Z shaped fiducial frame design but with a newly developed multi-image registration method which has higher accuracy with a smaller fiducial frame. The second method is a new fiducial design with a cylindrical shaped frame which is especially suitable for registration and tracking for needles. Alongside, a single-image based algorithm is developed to not only reach higher accuracy but also run faster. In addition, performance enhanced fiducial frame is also studied by integrating self-resonant coils. A surgical master-slave teleoperation system for the application of percutaneous interventional procedures under continuous MRI guidance is presented. The slave robot is a piezoelectric-actuated needle insertion robot with fiber optic force sensor integrated. The master robot is a pneumatic-driven haptic device which not only controls the position of the slave robot, but also renders the force associated with needle placement interventions to the surgeon. Both of master and slave robots mechanical design, kinematics, force sensing and feedback technologies are discussed. Force and position tracking results of the master-slave robot are demonstrated to validate the tracking performance of the integrated system. MRI compatibility is evaluated extensively. Teleoperated needle steering is also demonstrated under live MR imaging. A control system of a clinical grade MRI-compatible parallel 4-DOF surgical manipulator for minimally invasive in-bore prostate percutaneous interventions through the patient’s perineum is discussed in the end. The proposed manipulator takes advantage of four sliders actuated by piezoelectric motors and incremental rotary encoders, which are compatible with the MRI environment. Two generations of optical limit switches are designed to provide better safety features for real clinical use. The performance of both generations of the limit switch is tested. MRI guided accuracy and MRI-compatibility of whole robotic system is also evaluated. Two clinical prostate biopsy cases have been conducted with this assistive robot

Using the Fringe Field of MRI Scanner for the Navigation of Microguidewires in the Vascular System

Le traitement du cancer, la prévention des accidents vasculaires cérébraux et le diagnostic ou le traitement des maladies vasculaires périphériques sont tous des cas d'application d'interventions à base de cathéter par le biais d'un traitement invasif minimal. Cependant, la pratique du cathétérisme est généralement pratiquée manuellement et dépend fortement de l'expérience et des compétences de l'interventionniste. La robotisation du cathétérisme a été étudiée pour faciliter la procédure en augmentant les niveaux d’autonomie par rapport à cette pratique clinique. En ce qui concerne ce problème, un des problèmes concerne le placement super sélectif du cathéter dans les artères plus étroites nécessitant une miniaturisation de l'instrument cathéter / fil de guidage attaché. Un microguide qui fonctionne dans des vaisseaux sanguins étroits et tortueux subit différentes forces mécaniques telles que le frottement avec la paroi du vaisseau. Ces forces peuvent empêcher la progression de la pointe du fil de guidage dans les vaisseaux. Une méthode proposée consiste à appliquer une force de traction à la pointe du microguide pour diriger et insérer le dispositif tout en poussant l’instrument attaché à partir de l’autre extrémité n’est plus pratique, et à exploiter le gradient du champ de franges IRM surnommé Fringe Field Navigation (FFN ) est proposée comme solution pour assurer cet actionnement. Le concept de FFN repose sur le positionnement d'un patient sur six DOF dans le champ périphérique du scanner IRM afin de permettre un actionnement directionnel pour la navigation du fil-guide. Ce travail rend compte des développements requis pour la mise en oeuvre de la FFN et l’étude du potentiel et des possibilités qu’elle offre au cathétérisme, en veillant au renforcement de l’autonomie. La cartographie du champ de franges d'un scanner IRM 3T est effectuée et la structure du champ de franges en ce qui concerne son uniformité locale est examinée. Une méthode pour la navigation d'un fil de guidage le long d'un chemin vasculaire souhaité basée sur le positionnement robotique du patient à six DOF est développée. Des expériences de FFN guidées par rayons X in vitro et in vivo sur un modèle porcin sont effectuées pour naviguer dans un fil de guidage dans la multibifurcation et les vaisseaux étroits. Une caractéristique unique de FFN est le haut gradient du champ magnétique. Il est démontré in vitro et in vivo que cette force surmonte le problème de l'insertion d'un fil microguide dans des vaisseaux tortueux et étroits pour permettre de faire avancer le fil-guide avec une distale douce au-delà de la limite d'insertion manuelle. La robustesse de FFN contre les erreurs de positionnement du patient est étudiée en relation avec l'uniformité locale dans le champ périphérique. La force élevée du champ magnétique disponible dans le champ de franges IRM peut amener les matériaux magnétiques doux à son état de saturation. Ici, le concept d'utilisation d'un ressort est présenté comme une alternative vi déformable aux aimants permanents solides pour la pointe du fil-guide. La navigation d'un microguide avec une pointe de ressort en structure vasculaire complexe est également réalisée in vitro. L'autonomie de FFN en ce qui concerne la planification d'une procédure avec autonomie de tâche obtenue dans ce travail augmente le potentiel de FFN en automatisant certaines étapes d'une procédure. En conclusion, FFN pour naviguer dans les microguides dans la structure vasculaire complexe avec autonomie pour effectuer le positionnement du patient et contrôler l'insertion du fil de guidage - avec démonstration in vivo dans un modèle porcin - peut être considéré comme un nouvel outil robotique facilitant le cathétérisme vasculaire. tout en aidant à cibler les vaisseaux lointains dans le système vasculaire.----------ABSTRACT Treatment of cancer, prevention of stroke, and diagnosis or treatment of peripheral vascular diseases are all the cases of application of catheter-based interventions through a minimal-invasive treatment. However, performing catheterization is generally practiced manually, and it highly depends on the experience and the skills of the interventionist. Robotization of catheterization has been investigated to facilitate the procedure by increasing the levels of autonomy to this clinical practice. Regarding it, one issue is the super selective placement of the catheter in the narrower arteries that require miniaturization of the tethered catheter/guidewire instrument. A microguidewire that operates in narrow and tortuous blood vessels experiences different mechanical forces like friction with the vessel wall. These forces can prevent the advancement of the tip of the guidewire in the vessels. A proposed method is applying a pulling force at the tip of the microguidewire to steer and insert the device while pushing the tethered instrument from the other end is no longer practical, and exploiting the gradient of the MRI fringe field dubbed as Fringe Field Navigation (FFN) is proposed as a solution to provide this actuation. The concept of FFN is based on six DOF positioning of a patient in the fringe field of the MRI scanner to enable directional actuation for the navigation of the guidewire. This work reports on the required developments for implementing FFN and investigating the potential and the possibilities that FFN introduces to the catheterization, with attention to enhancing the autonomy. Mapping the fringe field of a 3T MRI scanner is performed, and the structure of the fringe field regarding its local uniformity is investigated. A method for the navigation of a guidewire along a desired vascular path based on six DOF robotic patient positioning is developed. In vitro and in vivo x-ray Guided FFN experiments on a swine model of are performed to navigate a guidewire in the multibifurcation and narrow vessels. A unique feature of FFN is the high gradient of the magnetic field. It is demonstrated in vitro and in vivo that this force overcomes the issue of insertion of a microguidewire in tortuous and narrow vessels to enable advancing the guidewire with a soft distal beyond the limit of manual insertion. Robustness of FFN against the error in the positioning of the patient is investigated in relation to the local uniformity in the fringe field. The high strength of the magnetic field available in MRI fringe field can bring soft magnetic materials to its saturation state. Here, the concept of using a spring is introduced as a deformable alternative to solid permanent magnets for the tip of the guidewire. Navigation of a microguidewire with a viii spring tip in complex vascular structure is also performed in vitro. The autonomy of FFN regarding planning a procedure with Task Autonomy achieved in this work enhances the potential of FFN by automatization of certain steps of a procedure. As a conclusion, FFN to navigate microguidewires in the complex vascular structure with autonomy in performing tasks of patient positioning and controlling the insertion of the guidewire – with in vivo demonstration in swine model – can be considered as a novel robotic tool for facilitating the vascular catheterization while helping to target remote vessels in the vascular system

Haptic Interface for the Simulation of Endovascular Interventions

Endovascular interventions are minimally invasive surgical procedures that are performed to diagnose and treat vascular diseases. These interventions use a combination of long and flexible instruments known as guidewire and catheter. A popular method of developing the skills required to manipulate the instruments successfully is through the use of virtual reality (VR) simulators. However, the interfaces of current VR simulators have several shortcomings due to limitations in the instrument tracking and haptic feedback systems design. A major challenge of developing physics-based training simulations of endovascular interventional procedures is to unobtrusively access the central, co-axial guidewire for tracking and haptics. This work sets out to explore the state of the art, to identify and develop novel solutions to this concentric occlusion problem, and to perform a validation of a proof of concept prototype. This multi port haptic interface prototype has been integrated with a 3-D virtual environment and features novel instrument tracking and haptic feedback actuation systems. The former involves the use of an optical sensor to detect guidewire movements through a clear catheter, whereas the latter utilises the placement of a customised electromagnetic actuator within the catheter hub. During the proof of concept validation process, both systems received positive reviews. Whilst the haptic interface prototype designed in this work has met the original objectives, there are still important aspects which need to be addressed to improve its content and face validity. With further development, the prototype has the potential to evolve and become a significant improvement over the haptic interfaces that exist today.Open Acces

DEVELOPMENT OF A KINETIC MODEL FOR STEERABLE CATHETERS FOR MINIMALLY INVASIVE SURGERY

The steerable catheters have demonstrated many advantages to overcome the limitations of the conventional catheters in the minimally invasive surgery. The motion and force transmission from the proximal end to distal tip of the catheter have significant effects to the efficiency and safety of surgery. While the force information between the catheter and the body (e.g., vessel) can be obtained by mounting sensors on the distal tip of the catheter, this would be more intrusive and less reliable than the one without the sensors, which is described in this disseration. In addition, the small diameters of the catheters may also restrict the idea of mounting sensors on the distal tip. The other approach to obtain the force information is to infer it from the information outside the body. This will demand an accurate mathematical model that describes the force and motion relation called kinetic model, and unfortunately, such a kinetic model is not available in the literature. In this dissertation, a kinetic model for steerable catheters is presented wich captures the following characteristics of the steerable catheter, namely (1) the geometrical non-linear behavior of the catheter in motion, (2) the deformable pathway, (3) the friction between the catheter and the pathyway, and (4) the contact between the catheter and pathway. A non-linear finite element system (SPACAR) was employed to capture these characteristics. A test-bed was built and an experiment was carried out to verify the developed kinetic model. The following conclusions can be drawn from this dissertation: (1) the developed kinetic model is accurte in comparison with those in literature; (2) the Dahl friction model, the LuGre friction model and the simplified LuGre friction model are able to capture the friction behavior between the catheter and the pathway but the Coulomb friction model fails (as it cannot capture the hysteresis property which has a significant influence on the behavior of the catheter); (3) the developed kinetic model has the potential of being used to optimize the design and operation of steerable catheters with several salient findings that (3a) the maximal contact force between the catheter and the pathway occurs on the tip of the distal part or the connecting part between the distal part and catheter body of the catheter and (3b) the rigidity and length of the distal part are crucial structural parameters that affect the motion and force transmission significantly. There are several contributions made by this dissertation. In the field of the steerable catheter, biomechanics and bio-instrumentation, the contributions are summarized in the following: (1) the approach to develop the kinetic model of the steerable catheter in a complex work environment is useful to model other similar compliant medical devices, such as endoscope; (2) the kinetic model of the steerable catheter can provide the force information to improve the efficiency and safety of MIS (minimally invastive surgery) and to realize the “doctor-assisted” catheter-based MIS procedure; (3) the kinetic model can provide accurate data for developing other simplified models for the steerable catheters in their corresponding work environments for realizing the robotic-based fully automated MIS procedure. (4) The kinetic model of the steerable catheter and the test-bed with the corresponding instruments and methods for the kinetic and kinematic measurements are a useful design validation in the steerable catheter technology as well as for the training of physicians to perform the catheter-based interventional procedure by adding more complex anatomic phantoms. In the field of continuum manipulator and continuum robots, the approach to develop the kinetic model is useful to model other manipulators and robots, such as snake-like robots

Design, Modeling and Control of Micro-scale and Meso-scale Tendon-Driven Surgical Robots

Manual manipulation of passive surgical tools is time consuming with uncertain results in cases of navigating tortuous anatomy, avoiding critical anatomical landmarks, and reaching targets not located in the linear range of these tools. For example, in many cardiovascular procedures, manual navigation of a micro-scale passive guidewire results in increased procedure times and radiation exposure. This thesis introduces the design of two steerable guidewires: 1) A two degree-of-freedom (2-DoF) robotic guidewire with orthogonally oriented joints to access points in a three dimensional workspace, and 2) a micro-scale coaxially aligned steerable (COAST) guidewire robot that demonstrates variable and independently controlled bending length and curvature of the distal end. The 2-DoF guidewire features two micromachined joints from a tube of superelastic nitinol of outer diameter 0.78 mm. Each joint is actuated with two nitinol tendons. The joints that are used in this robot are called bidirectional asymmetric notch (BAN) joints, and the advantages of these joints are explored and analyzed. The design of the COAST robotic guidewire involves three coaxially aligned tubes with a single tendon running centrally through the length of the robot. The outer tubes are made from micromachined nitinol allowing for tendon-driven bending of the robot at variable bending curvatures, while an inner stainless steel tube controls the bending length of the robot. By varying the lengths of the tubes as well as the tendon, and by insertion and retraction of the entire assembly, various joint lengths and curvatures may be achieved. Kinematic and static models, a compact actuation system, and a controller for this robot are presented. The capability of the robot to accurately navigate through phantom anatomical bifurcations and tortuous angles is also demonstrated in three dimensional phantom vasculature. At the meso-scale, manual navigation of passive pediatric neuroendoscopes for endoscopic third ventriculostomy may not reach target locations in the patient's ventricle. This work introduces the design, analysis and control of a meso-scale two degree-of-freedom robotic bipolar electrocautery tool that increases the workspace of the neurosurgeon. A static model is proposed for the robot joints that avoids problems arising from pure kinematic control. Using this model, a control system is developed that comprises of a disturbance observer to provide precise force control and compensate for joint hysteresis. A handheld controller is developed and demonstrated in this thesis. To allow the clinician to estimate the shape of the steerable tools within the anatomy for both micro-scale and meso-scale tools, a miniature tendon force sensor and a high deflection shape sensor are proposed and demonstrated. The force sensor features a compact design consisting of a single LED, dual-phototransistor, and a dual-screen arrangement to increase the linear range of sensor output and compensate for external disturbances, thereby allowing force measurement of up to 21 N with 99.58 % accuracy. The shape sensor uses fiber Bragg grating based optical cable mounted on a micromachined tube and is capable of measuring curvatures as high as 145 /m. These sensors were incorporated and tested in the guidewire and the neuroendoscope tool robots and can provide robust feedback for closed-loop control of these devices in the future.Ph.D

OPTICAL COHERENCE TOMOGRAPHY FOR NEUROSURGEY AND CANCER RESEARCH

Optical Coherence Tomography (OCT) provides non-labeling, real-time and high resolution images, which has the potential to transform the paradigm of surgical guidance and preclinical animal studies. The design and development of OCT devices for neurosurgery guidance and novel imaging algorithms for monitoring anti-cancer therapy have been pursued in this work. A forward-imaging needle-type OCT probe was developed which can fit into minimally invasive tools (I.D. ~ 1mm), detect the at-risk blood vessels, and identify tissue micro-landmarks. This promising guidance tool improves the safety and the accuracy of needle-based procedures, which are currently performed without imaging feedback. Despite the great imaging capability, OCT is limited by the shallow imaging depth (1-2 mm). In order to address this issue, the first MRI compatible OCT system has been developed. The multi-scale and multi-contrast MRI/OCT imaging combination significantly improves the accuracy of intra-operative MRI by two orders (from 1mm to 0.01 mm). In contrast to imaging systems, a thin (0.125 mm), low-cost (1/10 cost of OCT system) and simple fiber sensor technology called coherence gated Doppler (CGD) was developed which can be integrated with many surgical tools and aid in the avoidance of intracranial hemorrhage. Furthermore, intra-vital OCT is a powerful tool to study the mechanism of anti-cancer therapy. Photo-immunotherapy (PIT) is a low-side-effect cancer therapy based on an armed antibody conjugate that induces highly selective cancer cell necrosis after exposure to near infrared light both in vitro and in vivo. With novel algorithms that remove the bulk motion and track the vessel lumen automatically, OCT reveals dramatic hemodynamic changes during PIT and helps to elucidate the mechanisms behind the PIT treatment. The transformative guidance tools and the novel image processing algorithms pave a new avenue to better clinical outcomes and preclinical animal studies

Imaging Sensors and Applications

In past decades, various sensor technologies have been used in all areas of our lives, thus improving our quality of life. In particular, imaging sensors have been widely applied in the development of various imaging approaches such as optical imaging, ultrasound imaging, X-ray imaging, and nuclear imaging, and contributed to achieve high sensitivity, miniaturization, and real-time imaging. These advanced image sensing technologies play an important role not only in the medical field but also in the industrial field. This Special Issue covers broad topics on imaging sensors and applications. The scope range of imaging sensors can be extended to novel imaging sensors and diverse imaging systems, including hardware and software advancements. Additionally, biomedical and nondestructive sensing applications are welcome

Advanced Applications of Rapid Prototyping Technology in Modern Engineering

Rapid prototyping (RP) technology has been widely known and appreciated due to its flexible and customized manufacturing capabilities. The widely studied RP techniques include stereolithography apparatus (SLA), selective laser sintering (SLS), three-dimensional printing (3DP), fused deposition modeling (FDM), 3D plotting, solid ground curing (SGC), multiphase jet solidification (MJS), laminated object manufacturing (LOM). Different techniques are associated with different materials and/or processing principles and thus are devoted to specific applications. RP technology has no longer been only for prototype building rather has been extended for real industrial manufacturing solutions. Today, the RP technology has contributed to almost all engineering areas that include mechanical, materials, industrial, aerospace, electrical and most recently biomedical engineering. This book aims to present the advanced development of RP technologies in various engineering areas as the solutions to the real world engineering problems

Proceedings of the 2018 Canadian Society for Mechanical Engineering (CSME) International Congress

Published proceedings of the 2018 Canadian Society for Mechanical Engineering (CSME) International Congress, hosted by York University, 27-30 May 2018

On semi-active inerters for improving machining productivity

The inerter is a mechanical element, synthesised in 2002 as an analogue to the electrical capacitor. Originally used in Formula 1 racing as the `J-damper', its potential has since been explored in other vehicles, as well as for vibration control of civil structures. In very recent years, some study has been given to the design and control of semi-active inerters. Such devices would be capable of varying their inertance in response to a control signal. To date, no study has been made of the semi-active inerter in the context of machining chatter. This undesirable form of vibration, leading to poor surface finish on machined parts, is a major issue in machining. The growing requirements of high speed machining of lightweight, flexible parts mean that the need to develop new strategies to tackle chatter will only increase. This thesis seeks to fill this gap in the literature. As a feasibility study, two chatter suppression strategies are developed using a simplified single degree of freedom chatter model. Both strategies assume the existence of an ideal semi-active inerter placed between the vibrating element and ground, allowing the natural frequency to be adjusted on-line. The first of these strategies, discrete inertance variation, is analogous to an existing lobe seeking strategy conducted by changing the spindle speed. It is shown that, with relatively modest ranges of inertance, this is an achievable strategy for high speed machining. The second strategy relies on cyclically adjusting the natural frequency to disrupt self-excited vibration. It is found that the amplitude of this variation is the important characteristic, rather than the ratio of the frequency of inertance variation to the tooth passing frequency. In both cases, the need to be able to rapidly control inertance is noted. The design needs of a semi-active helical inerter are considered, with magnetorheological fluid providing the semi-active control. Three different layouts are studied using quasi-static models. The bypass valve type layout is selected as the most promising for future study. The design of the valve is considered and a new optimisation scheme is developed which better suits the need of the bypass valve than previous schemes. The inerter model is extended into a quasi-dynamic model, which allows the varying inertance to be considered. This model would be key for developing any practical control scheme. Prototype inerters were designed and tested. Initially an oil-based designed is built, followed by a design using magnetorheological fluid. The prototype was tested using a servo-hydraulic actuator, with the goal of validating the models developed in the previous chapter. Unfortunately, trapped air in both systems led to these results being inconclusive in both cases. The use of magnetorheological fluid for flow directional control in this way is unusual at this scale and this work is important for any future researchers who wish to work with the fluid in this way. With this in mind, the issues encountered with the experimental rig are further analysed. Improvements to the design and filling method are proposed. Some more substantial design changes are also presented. Finally, some focus is given to the practical issues of implementing semi-active inerters in machining. The need to miniaturise the design to fit into modern machine tools is highlighted. Two areas in which this would be less of an issue -- fixturing and robotic machining -- are discussed. Notably, key challenges for robotic machining include the number and placement of the inerters, and whether new strategies would be needed to tackle mode-coupling chatter