Prevalence of haptic feedback in robot-mediated surgery : a systematic review of literature

© 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of an article published in Journal of Robotic Surgery. The final authenticated version is available online at: https://doi.org/10.1007/s11701-017-0763-4With the successful uptake and inclusion of robotic systems in minimally invasive surgery and with the increasing application of robotic surgery (RS) in numerous surgical specialities worldwide, there is now a need to develop and enhance the technology further. One such improvement is the implementation and amalgamation of haptic feedback technology into RS which will permit the operating surgeon on the console to receive haptic information on the type of tissue being operated on. The main advantage of using this is to allow the operating surgeon to feel and control the amount of force applied to different tissues during surgery thus minimising the risk of tissue damage due to both the direct and indirect effects of excessive tissue force or tension being applied during RS. We performed a two-rater systematic review to identify the latest developments and potential avenues of improving technology in the application and implementation of haptic feedback technology to the operating surgeon on the console during RS. This review provides a summary of technological enhancements in RS, considering different stages of work, from proof of concept to cadaver tissue testing, surgery in animals, and finally real implementation in surgical practice. We identify that at the time of this review, while there is a unanimous agreement regarding need for haptic and tactile feedback, there are no solutions or products available that address this need. There is a scope and need for new developments in haptic augmentation for robot-mediated surgery with the aim of improving patient care and robotic surgical technology further.Peer reviewe

Towards Closed-loop, Robot Assisted Percutaneous Interventions under MRI Guidance

Image guided therapy procedures under MRI guidance has been a focused research area over past decade. Also, over the last decade, various MRI guided robotic devices have been developed and used clinically for percutaneous interventions, such as prostate biopsy, brachytherapy, and tissue ablation. Though MRI provides better soft tissue contrast compared to Computed Tomography and Ultrasound, it poses various challenges like constrained space, less ergonomic patient access and limited material choices due to its high magnetic field. Even after, advancements in MRI compatible actuation methods and robotic devices using them, most MRI guided interventions are still open-loop in nature and relies on preoperative or intraoperative images. In this thesis, an intraoperative MRI guided robotic system for prostate biopsy comprising of an MRI compatible 4-DOF robotic manipulator, robot controller and control application with Clinical User Interface (CUI) and surgical planning applications (3DSlicer and RadVision) is presented. This system utilizes intraoperative images acquired after each full or partial needle insertion for needle tip localization. Presented system was approved by Institutional Review Board at Brigham and Women\u27s Hospital(BWH) and has been used in 30 patient trials. Successful translation of such a system utilizing intraoperative MR images motivated towards the development of a system architecture for close-loop, real-time MRI guided percutaneous interventions. Robot assisted, close-loop intervention could help in accurate positioning and localization of the therapy delivery instrument, improve physician and patient comfort and allow real-time therapy monitoring. Also, utilizing real-time MR images could allow correction of surgical instrument trajectory and controlled therapy delivery. Two of the applications validating the presented architecture; closed-loop needle steering and MRI guided brain tumor ablation are demonstrated under real-time MRI guidance

SMART IMAGE-GUIDED NEEDLE INSERTION FOR TISSUE BIOPSY

M.S

Medical Robotics for use in MRI Guided Endoscopy

Interventional Magnetic Resonance Imaging (MRI) is a developing field that aims to provide intra-operative MRI to a clinician to guide diagnostic or therapeutic medical procedures. MRI provides excellent soft tissue contrast at sub-millimetre resolution in both 2D and 3D without the need for ionizing radiation. Images can be acquired in near real-time for guidance purposes. Operating in the MR environment brings challenges due to the high static magnetic field, switching magnetic field gradients and RF excitation pulses. In addition high field closed bore scanners have spatial constraints that severely limit access to the patient. This thesis presents a system for MRI-guided Endoscopic Retrograde Cholangio-pancreatography (ERCP). This includes a remote actuation system that enables an MRI-compatible endoscope to be controlled whilst the patient is inside the MRI scanner, overcoming the spatial and procedural constraints imposed by the closed scanner bore. The modular system utilises non-magnetic ultrasonic motors and is designed for image-guided user-in-the-loop control. A novel miniature MRI compatible clutch has been incorporated into the design to reduce the need for multiple parallel motors. The actuation system is MRI compatible does not degrade the MR images below acceptable levels. User testing showed that the actuation system requires some degree of training but enables completion of a simulated ERCP procedure with no loss of performance. This was demonstrated using a tailored ERCP simulator and kinematic assessment tool, which was validated with users from a range of skill levels to ensure that it provides an objective measurement of endoscopic skill. Methods of tracking the endoscope in real-time using the MRI scanner are explored and presented here. Use of the MRI-guided ERCP system was shown to improve the operator’s ability to position the endoscope in an experimental environment compared with a standard fluoroscopic-guided system.Open Acces

下腹部を対象とした極細針によるCTガイド下高正確度穿刺プランニング

早大学位記番号:新8149早稲田大

Teleoperation of MRI-Compatible Robots with Hybrid Actuation and Haptic Feedback

Image guided surgery (IGS), which has been developing fast recently, benefits significantly from the superior accuracy of robots and magnetic resonance imaging (MRI) which is a great soft tissue imaging modality. Teleoperation is especially desired in the MRI because of the highly constrained space inside the closed-bore MRI and the lack of haptic feedback with the fully autonomous robotic systems. It also very well maintains the human in the loop that significantly enhances safety. This dissertation describes the development of teleoperation approaches and implementation on an example system for MRI with details of different key components. The dissertation firstly describes the general teleoperation architecture with modular software and hardware components. The MRI-compatible robot controller, driving technology as well as the robot navigation and control software are introduced. As a crucial step to determine the robot location inside the MRI, two methods of registration and tracking are discussed. The first method utilizes the existing Z shaped fiducial frame design but with a newly developed multi-image registration method which has higher accuracy with a smaller fiducial frame. The second method is a new fiducial design with a cylindrical shaped frame which is especially suitable for registration and tracking for needles. Alongside, a single-image based algorithm is developed to not only reach higher accuracy but also run faster. In addition, performance enhanced fiducial frame is also studied by integrating self-resonant coils. A surgical master-slave teleoperation system for the application of percutaneous interventional procedures under continuous MRI guidance is presented. The slave robot is a piezoelectric-actuated needle insertion robot with fiber optic force sensor integrated. The master robot is a pneumatic-driven haptic device which not only controls the position of the slave robot, but also renders the force associated with needle placement interventions to the surgeon. Both of master and slave robots mechanical design, kinematics, force sensing and feedback technologies are discussed. Force and position tracking results of the master-slave robot are demonstrated to validate the tracking performance of the integrated system. MRI compatibility is evaluated extensively. Teleoperated needle steering is also demonstrated under live MR imaging. A control system of a clinical grade MRI-compatible parallel 4-DOF surgical manipulator for minimally invasive in-bore prostate percutaneous interventions through the patient’s perineum is discussed in the end. The proposed manipulator takes advantage of four sliders actuated by piezoelectric motors and incremental rotary encoders, which are compatible with the MRI environment. Two generations of optical limit switches are designed to provide better safety features for real clinical use. The performance of both generations of the limit switch is tested. MRI guided accuracy and MRI-compatibility of whole robotic system is also evaluated. Two clinical prostate biopsy cases have been conducted with this assistive robot

Optical fiber technology enables smart needles for epidurals. An in-vivo swine study

Nowadays, epidural space identification is made by using subjective and manual techniques characterized by failure rates up to 7%. In this work, we propose a fiber optic sensor technology based needle guidance system, that is directly inspired by the most common technique currently used for epidurals; through real-time strain measurements, the fiber Bragg grating integrated inside the needle lumen is able to effectively perceive the typical force drop occurring when the needle enters the epidural space. An in vivo swine study demonstrates the validity of our approach, paving the way for the development of lab-in-a-needle systems