Robotics-Assisted Needle Steering for Percutaneous Interventions: Modeling and Experiments

Needle insertion and guidance plays an important role in medical procedures such as brachytherapy and biopsy. Flexible needles have the potential to facilitate precise targeting and avoid collisions during medical interventions while reducing trauma to the patient and post-puncture issues. Nevertheless, error introduced during guidance degrades the effectiveness of the planned therapy or diagnosis. Although steering using flexible bevel-tip needles provides great mobility and dexterity, a major barrier is the complexity of needle-tissue interaction that does not lend itself to intuitive control. To overcome this problem, a robotic system can be employed to perform trajectory planning and tracking by manipulation of the needle base. This research project focuses on a control-theoretic approach and draws on the rich literature from control and systems theory to model needle-tissue interaction and needle flexion and then design a robotics-based strategy for needle insertion/steering. The resulting solutions will directly benefit a wide range of needle-based interventions. The outcome of this computer-assisted approach will not only enable us to perform efficient preoperative trajectory planning, but will also provide more insight into needle-tissue interaction that will be helpful in developing advanced intraoperative algorithms for needle steering. Experimental validation of the proposed methodologies was carried out on a state of-the-art 5-DOF robotic system designed and constructed in-house primarily for prostate brachytherapy. The system is equipped with a Nano43 6-DOF force/torque sensor (ATI Industrial Automation) to measure forces and torques acting on the needle shaft. In our setup, an Aurora electromagnetic tracker (Northern Digital Inc.) is the sensing device used for measuring needle deflection. A multi-threaded application for control, sensor readings, data logging and communication over the ethernet was developed using Microsoft Visual C 2005, MATLAB 2007 and the QuaRC Toolbox (Quanser Inc.). Various artificial phantoms were developed so as to create a realistic medium in terms of elasticity and insertion force ranges; however, they simulated a uniform environment without exhibiting complexities of organic tissues. Experiments were also conducted on beef liver and fresh chicken breast, beef, and ham, to investigate the behavior of a variety biological tissues

Robot Autonomy for Surgery

Autonomous surgery involves having surgical tasks performed by a robot operating under its own will, with partial or no human involvement. There are several important advantages of automation in surgery, which include increasing precision of care due to sub-millimeter robot control, real-time utilization of biosignals for interventional care, improvements to surgical efficiency and execution, and computer-aided guidance under various medical imaging and sensing modalities. While these methods may displace some tasks of surgical teams and individual surgeons, they also present new capabilities in interventions that are too difficult or go beyond the skills of a human. In this chapter, we provide an overview of robot autonomy in commercial use and in research, and present some of the challenges faced in developing autonomous surgical robots

Towards Closed-loop, Robot Assisted Percutaneous Interventions under MRI Guidance

Image guided therapy procedures under MRI guidance has been a focused research area over past decade. Also, over the last decade, various MRI guided robotic devices have been developed and used clinically for percutaneous interventions, such as prostate biopsy, brachytherapy, and tissue ablation. Though MRI provides better soft tissue contrast compared to Computed Tomography and Ultrasound, it poses various challenges like constrained space, less ergonomic patient access and limited material choices due to its high magnetic field. Even after, advancements in MRI compatible actuation methods and robotic devices using them, most MRI guided interventions are still open-loop in nature and relies on preoperative or intraoperative images. In this thesis, an intraoperative MRI guided robotic system for prostate biopsy comprising of an MRI compatible 4-DOF robotic manipulator, robot controller and control application with Clinical User Interface (CUI) and surgical planning applications (3DSlicer and RadVision) is presented. This system utilizes intraoperative images acquired after each full or partial needle insertion for needle tip localization. Presented system was approved by Institutional Review Board at Brigham and Women\u27s Hospital(BWH) and has been used in 30 patient trials. Successful translation of such a system utilizing intraoperative MR images motivated towards the development of a system architecture for close-loop, real-time MRI guided percutaneous interventions. Robot assisted, close-loop intervention could help in accurate positioning and localization of the therapy delivery instrument, improve physician and patient comfort and allow real-time therapy monitoring. Also, utilizing real-time MR images could allow correction of surgical instrument trajectory and controlled therapy delivery. Two of the applications validating the presented architecture; closed-loop needle steering and MRI guided brain tumor ablation are demonstrated under real-time MRI guidance

Full 3D motion control for programmable bevel-tip steerable needles

Minimally invasive surgery has been in the focus of many researchers due to its reduced intra- and post-operative risks when compared to an equivalent open surgery approach. In the context of minimally invasive surgery, percutaneous intervention, and particularly, needle insertions, are of great importance in tumour-related therapy and diagnosis. However, needle and tissue deformation occurring during needle insertion often results in misplacement of the needles, which leads to complications, such as unsuccessful treatment and misdiagnosis. To this end, steerable needles have been proposed to compensate for placement errors by allowing curvilinear navigation. A particular type of steerable needle is the programmable bevel-tip steerable needle (PBN), which is a bio-inspired needle that consists of relatively soft and slender segments. Due to its flexibility and bevel-tip segments, it can navigate through 3D curvilinear paths. In PBNs, steering in a desired direction is performed by actuating particular PBN segments. Therefore, the pose of each segment is needed to ensure that the correct segment is actuated. To this end, in this thesis, proprioceptive sensing methods for PBNs were investigated. Two novel methods, an electromagnetic (EM)-based tip pose estimation method and a fibre Bragg grating (FBG)-based full shape sensing method, were presented and evaluated. The error in position was observed to be less than 1.08 mm and 5.76 mm, with the proposed EM-based tip tracking and FBG-based shape reconstruction methods, respectively. Moreover, autonomous path-following controllers for PBNs were also investigated. A closed-loop, 3D path-following controller, which was closed via feedback from FBG-inscribed multi-core fibres embedded within the needle, was presented. The nonlinear guidance law, which is a well-known approach for path-following control of aerial vehicles, and active disturbance rejection control (ADRC), which is known for its robustness within hard-to-model environments, were chosen as the control methods. Both linear and nonlinear ADRC were investigated, and the approaches were validated in both ex vivo brain and phantom tissue, with some of the experiments involving moving targets. The tracking error in position was observed to be less than 6.56 mm.Open Acces

Avancées du framework de simulation biomécanique inverse pour le pilotage automatique d’aiguilles robotisé

International audienc

Sensorisation of a novel biologically inspired flexible needle

Percutaneous interventions are commonly performed during minimally invasive brain surgery, where a straight rigid instrument is inserted through a small incision to access a deep lesion in the brain. Puncturing a vessel during this procedure can be a life-threatening complication. Embedding a forward-looking sensor in a rigid needle has been proposed to tackle this problem; however, using a rigid needle, the procedure needs to be interrupted if a vessel is detected. Steerable needle technology could be used to avoid obstacles, such as blood vessels, due to its ability to follow curvilinear paths, but research to date was lacking in this respect. This thesis aims to investigate the deployment of forward-looking sensors for vessel detection in a steerable needle. The needle itself is based on a bioinspired programmable bevel-tip needle (PBN), a multi-segment design featuring four hollow working channels. In this thesis, laser Doppler flowmetry (LDF) is initially characterised to ensure that the sensor fulfils the minimum requirements for it to be used in conjunction with the needle. Subsequently, vessel reconstruction algorithms are proposed. To determine the axial and off-axis position of the vessel with respect to the probe, successive measurements of the LDF sensor are used. Ideally, full knowledge of the vessel orientation is required to execute an avoidance strategy. Using two LDF probes and a novel signal processing method described in this thesis, the predicted possible vessel orientations can be reduced to four, a setup which is explored here to demonstrate viable obstacle detection with only partial sensor information. Relative measurements from four LDF sensors are also explored to classify possible vessel orientations in full and without ambiguity, but under the assumption that the vessel is perpendicular to the needle insertion axis. Experimental results on a synthetic grey matter phantom are presented, which confirm these findings. To release the perpendicularity assumption, the thesis concludes with the description of a machine learning technique based on a Long Short-term memory network, which enables a vessel's spatial position, cross-sectional diameter and full pose to be predicted with sub-millimetre accuracy. Simulated and in-vitro examinations of vessel detection with this approach are used to demonstrate effective predictive ability. Collectively, these results demonstrate that the proposed steerable needle sensorisation is viable and could lead to improved safety during robotic assisted needle steering interventions.Open Acces

On the Application of Mechanical Vibration in Robotics-Assisted Soft Tissue Intervention

Mechanical vibration as a way of transmitting energy has been an interesting subject to study. While cyclic oscillation is usually associated with fatigue effect, and hence a detrimental factor in failure of structures and machineries, by controlled transmission of vibration, energy can be transferred from the source to the target. In this thesis, the application of such mechanical vibration in a few surgical procedures is demonstrated. Three challenges associated with lung cancer diagnosis and treatment are chosen for this purpose, namely, Motion Compensation, tumor targeting in lung Needle Insertion and Soft Tissue Dissection: A robotic solution is proposed for compensating for the undesirable oscillatory motion of soft tissue (caused by heart beat and respiration) during needle insertion in the lung. An impedance control strategy based on a mechanical vibratory system is implemented to minimize the tissue deformation during needle insertion. A prototype was built to evaluate the proposed approach using: 1) two Mitsubishi PA10-7C robots, one for manipulating the macro part and the other for mimicking the tissue motion, 2) one motorized linear stage to handle the micro part, and 3) a Phantom Omni haptic device for remote manipulation. Experimental results are given to demonstrate the performance of the motion compensation system. A vibration-assisted needle insertion technique has been proposed in order to reduce needle–tissue friction. The LuGre friction model is employed as a basis for the study and the model is extended and analyzed to include the impact of high-frequency vibration on translational friction. Experiments are conducted to evaluate the role of insertion speed as well as vibration frequency on frictional effects. In the experiments conducted, an 18 GA brachytherapy needle was vibrated and inserted into an ex-vivo soft tissue sample using a pair of amplified piezoelectric actuators. Analysis demonstrates that the translational friction can be reduced by introducing a vibratory low-amplitude motion onto a regular insertion profile, which is usually performed at a constant rate. A robotics-assisted articulating ultrasonic surgical scalpel for minimally invasive soft tissue cutting and coagulation is designed and developed. For this purpose, the optimal design of a Langevin transducer with stepped horn profile is presented for internal-body applications. The modeling, optimization and design of the ultrasonic scalpel are performed through equivalent circuit theory and verified by finite element analysis. Moreover, a novel surgical wrist, compatible with the da Vinci® surgical system, with decoupled two degrees-of-freedom (DOFs) is developed that eliminates the strain of pulling cables and electrical wires. The developed instrument is then driven using the dVRK (da Vinci® research kit) and the Classic da Vinci® surgical system

下腹部を対象とした極細針によるCTガイド下高正確度穿刺プランニング

早大学位記番号:新8149早稲田大

Image-Guided Robot-Assisted Needle Intervention Devices and Methods to Improve Targeting Accuracy

This dissertation addresses the development of medical devices, image-guided robots, and their application in needle-based interventions, as well as methods to improve accuracy and safety in clinical procedures. Needle access is an essential component of minimally invasive diagnostic and therapeutic procedures. Image-guiding devices are often required to help physicians handle the needle based on the images. Integrating robotic accuracy and precision with digital medical imaging has the potential to improve the clinical outcomes. The dissertation presents two robotic devices for interventions under Magnetic Resonance Imaging (MRI) respectively Computed Tomography (CT) – Ultrasound(US) cross modality guidance. The MRI robot is a MR Safe Remote Center of Motion (RCM) robot for direct image-guided needle interventions such as brain surgery. The dissertation also presents the integration of the robot with an intraoperative MRI scanner, and preclinical tests for deep brain needle access. The CT-Ultrasound guidance uses a robotic manipulator to handle an US probe within a CT scanner. The dissertation presents methods related to the co-registration of multi-image spaces with an intermediary frame, experiments for needle targeting. The dissertation also presents method on using optical tracking measurements specifically for medical robots. The method was derived to test the robots presented above. With advanced image-guidance, such as the robotic approaches, needle targeting accuracy may still be deteriorated by errors related to needle defections. Methods and associated devices for needle steering on the straight path are presented. These are a robotic approach that uses real-time ultrasound guidance to steer the needle; Modeling and testing of a method to markedly reduce targeting errors with bevel-point needles; Dynamic design, manufacturing, and testing of a novel core biopsy needle with straighter path, power assistance, reduced noise, and safer operation. Overall, the dissertation presents several developments that contribute to the field of medical devices, image-guided robots, and needle interventions. These include robot testing methods that can be used by other researchers, needle steering methods that can be used directly by physicians or for robotic devices, as well as several methods to improve the accuracy in image-guided interventions. Collectively, these contribute to the field and may have a significant clinical impact