An Open-Source 7-Axis, Robotic Platform to Enable Dexterous Procedures within CT Scanners

This paper describes the design, manufacture, and performance of a highly dexterous, low-profile, 7 Degree-of-Freedom (DOF) robotic arm for CT-guided percutaneous needle biopsy. Direct CT guidance allows physicians to localize tumours quickly; however, needle insertion is still performed by hand. This system is mounted to a fully active gantry superior to the patient's head and teleoperated by a radiologist. Unlike other similar robots, this robot's fully serial-link approach uses a unique combination of belt and cable drives for high-transparency and minimal-backlash, allowing for an expansive working area and numerous approach angles to targets all while maintaining a small in-bore cross-section of less than $16cm^2$. Simulations verified the system's expansive collision free work-space and ability to hit targets across the entire chest, as required for lung cancer biopsy. Targeting error is on average $<1mm$ on a teleoperated accuracy task, illustrating the system's sufficient accuracy to perform biopsy procedures. The system is designed for lung biopsies due to the large working volume that is required for reaching peripheral lung lesions, though, with its large working volume and small in-bore cross-sectional area, the robotic system is effectively a general-purpose CT-compatible manipulation device for percutaneous procedures. Finally, with the considerable development time undertaken in designing a precise and flexible-use system and with the desire to reduce the burden of other researchers in developing algorithms for image-guided surgery, this system provides open-access, and to the best of our knowledge, is the first open-hardware image-guided biopsy robot of its kind.Comment: 8 pages, 9 figures, final submission to IROS 201

SMART IMAGE-GUIDED NEEDLE INSERTION FOR TISSUE BIOPSY

M.S

下腹部を対象とした極細針によるCTガイド下高正確度穿刺プランニング

早大学位記番号:新8149早稲田大

Development of an online progressive mathematical model of needle deflection for application to robotic-assisted percutaneous interventions

A highly flexible multipart needle is under development in the Mechatronics in Medicine Laboratory at Imperial College, with the aim to achieve multi-curvature trajectories inside biological soft tissue, such as to avoid obstacles during surgery. Currently, there is no dedicated software or analytical methodology for the analysis of the needle’s behaviour during the insertion process, which is instead described empirically on the basis of experimental trials on synthetic tissue phantoms. This analysis is crucial for needle and insertion trajectory design purposes. It is proposed that a real-time, progressive, mathematical model of the needle deflection during insertion be developed. This model can serve three purposes, namely, offline needle and trajectory design in a forward solution of the model, when the loads acting on needle from the substrate are known; online, real-time identification of the loads that act on the needle in a reverse solution, when the deflections at discrete points along the needle length are known; and the development of a sensitivity matrix, which enables the calculation of the corrective loads that are required to drive the needle back on track, if any deviations occur away from a predefined trajectory. Previously developed mathematical models of needle deflection inside soft tissue are limited to small deflection and linear strain. In some cases, identical tip path and body shape after full insertion of the needle are assumed. Also, the axial load acting on the needle is either ignored or is calculated from empirical formulae, while its inclusion would render the model nonlinear even for small deflection cases. These nonlinearities are a result of the effects of the axial and transverse forces at the tip being co-dependent, restricting the calculation of the independent effects of each on the needle’s deflection. As such, a model with small deflection assumptions incorporating tip axial forces can be called “quasi-nonlinear” and a methodology is proposed here to tackle the identification of such axial force in the linear range. During large deflection of the needle, discrepancies between the shape of the needle after the insertion and its tip path, computed during the insertion, also significantly increase, causing errors in a model based on the assumption that they are the same. Some of the models developed to date have also been dependent on existing or experimentally derived material models of soft tissue developed offline, which is inefficient for surgical applications, where the biological soft tissue can change radically and experimentation on the patient is limited. Conversely, a model is proposed in this thesis which, when solved inversely, provides an estimate for the contact stiffness of the substrate in a real-time manner. The study and the proposed model and techniques involved are limited to two dimensional projections of the needle movements, but can be easily extended to the 3-dimensional case. Results which demonstrate the accuracy and validity of the models developed are provided on the basis of simulations and via experimental trials of a multi-part 2D steering needle in gelatine.Open Acces

Robotics-Assisted Needle Steering for Percutaneous Interventions: Modeling and Experiments

Needle insertion and guidance plays an important role in medical procedures such as brachytherapy and biopsy. Flexible needles have the potential to facilitate precise targeting and avoid collisions during medical interventions while reducing trauma to the patient and post-puncture issues. Nevertheless, error introduced during guidance degrades the effectiveness of the planned therapy or diagnosis. Although steering using flexible bevel-tip needles provides great mobility and dexterity, a major barrier is the complexity of needle-tissue interaction that does not lend itself to intuitive control. To overcome this problem, a robotic system can be employed to perform trajectory planning and tracking by manipulation of the needle base. This research project focuses on a control-theoretic approach and draws on the rich literature from control and systems theory to model needle-tissue interaction and needle flexion and then design a robotics-based strategy for needle insertion/steering. The resulting solutions will directly benefit a wide range of needle-based interventions. The outcome of this computer-assisted approach will not only enable us to perform efficient preoperative trajectory planning, but will also provide more insight into needle-tissue interaction that will be helpful in developing advanced intraoperative algorithms for needle steering. Experimental validation of the proposed methodologies was carried out on a state of-the-art 5-DOF robotic system designed and constructed in-house primarily for prostate brachytherapy. The system is equipped with a Nano43 6-DOF force/torque sensor (ATI Industrial Automation) to measure forces and torques acting on the needle shaft. In our setup, an Aurora electromagnetic tracker (Northern Digital Inc.) is the sensing device used for measuring needle deflection. A multi-threaded application for control, sensor readings, data logging and communication over the ethernet was developed using Microsoft Visual C 2005, MATLAB 2007 and the QuaRC Toolbox (Quanser Inc.). Various artificial phantoms were developed so as to create a realistic medium in terms of elasticity and insertion force ranges; however, they simulated a uniform environment without exhibiting complexities of organic tissues. Experiments were also conducted on beef liver and fresh chicken breast, beef, and ham, to investigate the behavior of a variety biological tissues

A mechanics-based model for simulation and control of flexible needle insertion in soft tissue

AbstractIn needle-based medical procedures, beveled-tip exible needles are steered inside soft tissue with the aim of reaching pre-dened target locations. The efciency of needle-based interventions depends on accurate control of the needle tip. This paper presents a comprehensive mechanics-based model for simulation of planar needle insertion in soft tissue. The proposed model for needle deection is based on beam theory, works in real-time, and accepts the insertion velocity as an input that can later be used as a control command for needle steering. The model takes into account the effects of tissue deformation, needle-tissue friction, tissue cutting force, and needle bevel angle on needle deection. Using a robot that inserts a exible needle into a phantom tissue, various experiments are conducted to separately identify different subsets of the model parameters. The validity of the proposed model is veried by comparing the simulation results to the empirical data. The results demonstrate the accuracy of the proposed model in predicting the needle tip deection for different insertion velocities. I

Semi-Automated Needle Steering in Biological Tissue Using an Ultrasound-Based Deflection Predictor

The performance of needle-based interventions depends on the accuracy of needle tip positioning. Here, a novel needle steering strategy is proposed that enhances accuracy of needle steering. In our approach the surgeon is in charge of needle insertion to ensure the safety of operation, while the needle tip bevel location is robotically controlled to minimize the targeting error. The system has two main components: (1) a real-time predictor for estimating future needle deflection as it is steered inside soft tissue, and (2) an online motion planner that calculates control decisions and steers the needle toward the target by iterative optimization of the needle deflection predictions. The predictor uses the ultrasound-based curvature information to estimate the needle deflection. Given the specification of anatomical obstacles and a target from preoperative images, the motion planner uses the deflection predictions to estimate control actions, i.e., the depth(s) at which the needle should be rotated to reach the target. Ex-vivo needle insertions are performed with and without obstacle to validate our approach. The results demonstrate the needle steering strategy guides the needle to the targets with a maximum error of 1.22 mm

Needle Tip Force Estimation using an OCT Fiber and a Fused convGRU-CNN Architecture

Needle insertion is common during minimally invasive interventions such as biopsy or brachytherapy. During soft tissue needle insertion, forces acting at the needle tip cause tissue deformation and needle deflection. Accurate needle tip force measurement provides information on needle-tissue interaction and helps detecting and compensating potential misplacement. For this purpose we introduce an image-based needle tip force estimation method using an optical fiber imaging the deformation of an epoxy layer below the needle tip over time. For calibration and force estimation, we introduce a novel deep learning-based fused convolutional GRU-CNN model which effectively exploits the spatio-temporal data structure. The needle is easy to manufacture and our model achieves a mean absolute error of 1.76 +- 1.5 mN with a cross-correlation coefficient of 0.9996, clearly outperforming other methods. We test needles with different materials to demonstrate that the approach can be adapted for different sensitivities and force ranges. Furthermore, we validate our approach in an ex-vivo prostate needle insertion scenario.Comment: Accepted for Publication at MICCAI 201