Sensorless Motion Planning for Medical Needle Insertion in Deformable Tissues

Minimally invasive medical procedures such as biopsies, anesthesia drug injections, and brachytherapy cancer treatments require inserting a needle to a specific target inside soft tissues. This is difficult because needle insertion displaces and deforms the surrounding soft tissues causing the target to move during the procedure. To facilitate physician training and preoperative planning for these procedures, we develop a needle insertion motion planning system based on an interactive simulation of needle insertion in deformable tissues and numerical optimization to reduce placement error. We describe a 2-D physically based, dynamic simulation of needle insertion that uses a finite-element model of deformable soft tissues and models needle cutting and frictional forces along the needle shaft. The simulation offers guarantees on simulation stability for mesh modications and achieves interactive, real-time performance on a standard PC. Using texture mapping, the simulation provides visualization comparable to ultrasound images that the physician would see during the procedure. We use the simulation as a component of a sensorless planning algorithm that uses numerical optimization to compute needle insertion offsets that compensate for tissue deformations. We apply the method to radioactive seed implantation during permanent seed prostate brachytherapy to minimize seed placement error

Real-time Error Control for Surgical Simulation

Objective: To present the first real-time a posteriori error-driven adaptive finite element approach for real-time simulation and to demonstrate the method on a needle insertion problem. Methods: We use corotational elasticity and a frictional needle/tissue interaction model. The problem is solved using finite elements within SOFA. The refinement strategy relies upon a hexahedron-based finite element method, combined with a posteriori error estimation driven local $h$-refinement, for simulating soft tissue deformation. Results: We control the local and global error level in the mechanical fields (e.g. displacement or stresses) during the simulation. We show the convergence of the algorithm on academic examples, and demonstrate its practical usability on a percutaneous procedure involving needle insertion in a liver. For the latter case, we compare the force displacement curves obtained from the proposed adaptive algorithm with that obtained from a uniform refinement approach. Conclusions: Error control guarantees that a tolerable error level is not exceeded during the simulations. Local mesh refinement accelerates simulations. Significance: Our work provides a first step to discriminate between discretization error and modeling error by providing a robust quantification of discretization error during simulations.Comment: 12 pages, 16 figures, change of the title, submitted to IEEE TBM

Observations and models for needle-tissue interactions

The asymmetry of a bevel-tip needle results in the needle naturally bending when it is inserted into soft tissue. In this study we present a mechanics-based model that calculates the deflection of the needle embedded in an elastic medium. Microscopic observations for several needle- gel interactions were used to characterize the interactions at the bevel tip and along the needle shaft. The model design was guided by microscopic observations of several needle- gel interactions. The energy-based model formulation incor- porates tissue-specific parameters such as rupture toughness, nonlinear material elasticity, and interaction stiffness, and needle geometric and material properties. Simulation results follow similar trends (deflection and radius of curvature) to those observed in macroscopic experimental studies of a robot- driven needle interacting with different kinds of gels. These results contribute to a mechanics-based model of robotic needle steering, extending previous work on kinematic models

Controlling the Error on Target Motion through Real-time Mesh Adaptation: Applications to Deep Brain Stimulation

We present an error-controlled mesh refinement procedure for needle insertion simulation and apply it to the simulation of electrode implantation for deep brain stimulation, including brain shift. Our approach enables to control the error in the computation of the displacement and stress fields around the needle tip and needle shaft by suitably refining the mesh, whilst maintaining a coarser mesh in other parts of the domain. We demonstrate through academic and practical examples that our approach increases the accuracy of the displacement and stress fields around the needle without increasing the computational expense. This enables real-time simulations. The proposed methodology has direct implications to increase the accuracy and control the computational expense of the simulation of percutaneous procedures such as biopsy, brachytherapy, regional anesthesia, or cryotherapy and can be essential to the development of robotic guidance.Comment: 21 pages, 14 figure

Preliminary Implementation of the Next Generation Cannulation Simulator

© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Extracorporeal Membrane Oxygenation (ECMO) is a highly complex/critical lifesaving procedure known to support patients with cardiac and respiratory issues. Patients on ECMO are monitored 24/7 by a team of highly trained ECMO team comprising nurses, physicians, respiratory therapists, and perfusionists promptly intervening to any potential emergency situation. Simulation-Based Training (SBT) allows clinicians to experience and practice realistic hands-on procedures and scenarios without any risk. In ECMO, cannulation is a critical procedure performed to externally reroute the blood flow so it can be re-oxygenated by the ECMO machine before being recirculated through the patient's body. In a close collaboration with Hamad Medical Corporation (HMC), this project aims to develop a cost effective, realistic, and user-friendly ECMO simulator focusing on the venous and arterial cannulation procedure, The main features of this simulator include cannulation emergencies caused by low pressure flow, excessive force, recirculation, or mispositioned wire/cannula. Therefore, the ECMO cannulation simulator will not only greatly contribute to the initial and ongoing local training of HMC ECMO clinicians but also contribute to improving patient care by lowering the risks associated with the cannulation process

Affordable interactive virtual reality system for the Dynamic Hip Screw surgery training in vitro

Interactive virtual reality systems provide safe and cost-effective training environment to improve the technical skills and competence of surgeons. The trainees can have as many practice sessions, without need to the trainer all the time, before even start carrying out the procedure on any real patient. In this paper, we present an affordable interactive virtual reality system for the Dynamic Hip Screw (DHS) surgery training in vitro, through 3D tracking. The system facilitates a safe (in vitro / off patient) training to improve the cognitive coordination of trainees and junior surgeons, in particular the Hands, Eyes and Brain coordination. The system is based on very cheap commercial off-the-shelf (COT) components, which are very affordable, and needs minimum setup effort and knowledge. It also provides a range of visual and quantitative feedback information and measures, such as position, orientation, insertion point, and depth of drilling. It is envisaged that improving this level of coordination, through the training system, will contribute to reducing the failure rate of the DHS procedure. This means better treatment for patients and less costs for the Health services systems (e.g. UK's NHS system)

Prevalence of haptic feedback in robot-mediated surgery : a systematic review of literature

© 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of an article published in Journal of Robotic Surgery. The final authenticated version is available online at: https://doi.org/10.1007/s11701-017-0763-4With the successful uptake and inclusion of robotic systems in minimally invasive surgery and with the increasing application of robotic surgery (RS) in numerous surgical specialities worldwide, there is now a need to develop and enhance the technology further. One such improvement is the implementation and amalgamation of haptic feedback technology into RS which will permit the operating surgeon on the console to receive haptic information on the type of tissue being operated on. The main advantage of using this is to allow the operating surgeon to feel and control the amount of force applied to different tissues during surgery thus minimising the risk of tissue damage due to both the direct and indirect effects of excessive tissue force or tension being applied during RS. We performed a two-rater systematic review to identify the latest developments and potential avenues of improving technology in the application and implementation of haptic feedback technology to the operating surgeon on the console during RS. This review provides a summary of technological enhancements in RS, considering different stages of work, from proof of concept to cadaver tissue testing, surgery in animals, and finally real implementation in surgical practice. We identify that at the time of this review, while there is a unanimous agreement regarding need for haptic and tactile feedback, there are no solutions or products available that address this need. There is a scope and need for new developments in haptic augmentation for robot-mediated surgery with the aim of improving patient care and robotic surgical technology further.Peer reviewe