A surgical system for automatic registration, stiffness mapping and dynamic image overlay

In this paper we develop a surgical system using the da Vinci research kit (dVRK) that is capable of autonomously searching for tumors and dynamically displaying the tumor location using augmented reality. Such a system has the potential to quickly reveal the location and shape of tumors and visually overlay that information to reduce the cognitive overload of the surgeon. We believe that our approach is one of the first to incorporate state-of-the-art methods in registration, force sensing and tumor localization into a unified surgical system. First, the preoperative model is registered to the intra-operative scene using a Bingham distribution-based filtering approach. An active level set estimation is then used to find the location and the shape of the tumors. We use a recently developed miniature force sensor to perform the palpation. The estimated stiffness map is then dynamically overlaid onto the registered preoperative model of the organ. We demonstrate the efficacy of our system by performing experiments on phantom prostate models with embedded stiff inclusions.Comment: International Symposium on Medical Robotics (ISMR 2018

An Experimental and Numerical Study on Tactile Neuroimaging: A Novel Minimally Invasive Technique for Intraoperative Brain Imaging

This is the peer reviewed version of the following article: Moslem Sadeghi-Goughari, Yanjun Qian, Soo Jeon, Sohrab Sadeghi and Hyock-Ju Kwon, “An Experimental and Numerical Study on Tactile Neuroimaging: A Novel Minimally Invasive Technique for Intraoperative Brain Imaging,” accepted to The International Journal of Medical Robotics and Computer Assisted Surgery which has been published in final form at: https://doi.org/10.1002/rcs.1893. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving.Background The success of tumor neurosurgery is highly dependent on the ability to accurately localize the operative target, which may be shifted during the operation. Performing an intraoperative brain imaging is crucial in minimally invasive neurosurgery to detect the effect of brain shift on the tumor’s location, and to maximize the efficiency of tumor resection. Method The major objective of this research is to introduce the tactile neuroimaging as a novel minimally invasive technique for intraoperative brain imaging. To investigate the feasibility of the proposed method, an experimental and numerical study was first performed on silicone phantoms mimicking the brain tissue with a tumor. Then the study was extended to a clinical model with the meningioma tumor. Results The stress distribution on the brain surface has high potential to intraoperatively localize the tumor. Conclusion Results suggest that tactile neuroimaging can be used to provide a non-invasive, and real-time intraoperative data on tumor’s features.Natural Sciences and Engineering Research Council || RGPIN/2015-05273, RGPIN/2015-04118, RGPAS/354703-201

Prevalence of haptic feedback in robot-mediated surgery : a systematic review of literature

© 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of an article published in Journal of Robotic Surgery. The final authenticated version is available online at: https://doi.org/10.1007/s11701-017-0763-4With the successful uptake and inclusion of robotic systems in minimally invasive surgery and with the increasing application of robotic surgery (RS) in numerous surgical specialities worldwide, there is now a need to develop and enhance the technology further. One such improvement is the implementation and amalgamation of haptic feedback technology into RS which will permit the operating surgeon on the console to receive haptic information on the type of tissue being operated on. The main advantage of using this is to allow the operating surgeon to feel and control the amount of force applied to different tissues during surgery thus minimising the risk of tissue damage due to both the direct and indirect effects of excessive tissue force or tension being applied during RS. We performed a two-rater systematic review to identify the latest developments and potential avenues of improving technology in the application and implementation of haptic feedback technology to the operating surgeon on the console during RS. This review provides a summary of technological enhancements in RS, considering different stages of work, from proof of concept to cadaver tissue testing, surgery in animals, and finally real implementation in surgical practice. We identify that at the time of this review, while there is a unanimous agreement regarding need for haptic and tactile feedback, there are no solutions or products available that address this need. There is a scope and need for new developments in haptic augmentation for robot-mediated surgery with the aim of improving patient care and robotic surgical technology further.Peer reviewe

Haptics-Enabled Teleoperation for Robotics-Assisted Minimally Invasive Surgery

The lack of force feedback (haptics) in robotic surgery can be considered to be a safety risk leading to accidental tissue damage and puncturing of blood vessels due to excessive forces being applied to tissue and vessels or causing inefficient control over the instruments because of insufficient applied force. This project focuses on providing a satisfactory solution for introducing haptic feedback in robotics-assisted minimally invasive surgical (RAMIS) systems. The research addresses several key issues associated with the incorporation of haptics in a master-slave (teleoperated) robotic environment for minimally invasive surgery (MIS). In this project, we designed a haptics-enabled dual-arm (two masters - two slaves) robotic MIS testbed to investigate and validate various single-arm as well as dual-arm teleoperation scenarios. The most important feature of this setup is the capability of providing haptic feedback in all 7 degrees of freedom (DOF) required for RAMIS (3 translations, 3 rotations and pinch motion of the laparoscopic tool). The setup also enables the evaluation of the effect of replacing haptic feedback by other sensory cues such as visual representation of haptic information (sensory substitution) and the hypothesis that surgical outcomes may be improved by substituting or augmenting haptic feedback by such sensory cues

A Framework for Tumor Localization in Robot-Assisted Minimally Invasive Surgery

Manual palpation of tissue is frequently used in open surgery, e.g., for localization of tumors and buried vessels and for tissue characterization. The overall objective of this work is to explore how tissue palpation can be performed in Robot-Assisted Minimally Invasive Surgery (RAMIS) using laparoscopic instruments conventionally used in RAMIS. This thesis presents a framework where a surgical tool is moved teleoperatively in a manner analogous to the repetitive pressing motion of a finger during manual palpation. We interpret the changes in parameters due to this motion such as the applied force and the resulting indentation depth to accurately determine the variation in tissue stiffness. This approach requires the sensorization of the laparoscopic tool for force sensing. In our work, we have used a da Vinci needle driver which has been sensorized in our lab at CSTAR for force sensing using Fiber Bragg Grating (FBG). A computer vision algorithm has been developed for 3D surgical tool-tip tracking using the da Vinci \u27s stereo endoscope. This enables us to measure changes in surface indentation resulting from pressing the needle driver on the tissue. The proposed palpation framework is based on the hypothesis that the indentation depth is inversely proportional to the tissue stiffness when a constant pressing force is applied. This was validated in a telemanipulated setup using the da Vinci surgical system with a phantom in which artificial tumors were embedded to represent areas of different stiffnesses. The region with high stiffness representing tumor and region with low stiffness representing healthy tissue showed an average indentation depth change of 5.19 mm and 10.09 mm respectively while maintaining a maximum force of 8N during robot-assisted palpation. These indentation depth variations were then distinguished using the k-means clustering algorithm to classify groups of low and high stiffnesses. The results were presented in a colour-coded map. The unique feature of this framework is its use of a conventional laparoscopic tool and minimal re-design of the existing da Vinci surgical setup. Additional work includes a vision-based algorithm for tracking the motion of the tissue surface such as that of the lung resulting from respiratory and cardiac motion. The extracted motion information was analyzed to characterize the lung tissue stiffness based on the lateral strain variations as the surface inflates and deflates

Wireless Tissue Palpation for Intraoperative Detection of Lumps in the Soft Tissue

In an open surgery, identification of precise margins for curative tissue resection is performed by manual palpation. This is not the case for minimally invasive and robotic procedures, where tactile feedback is either distorted or not available. In this paper, we introduce the concept of intraoperative wireless tissue palpation. The wireless palpation probe (WPP) is a cylindrical device (15 mm in diameter, 60 mm in length) that can be deployed through a trocar incision and directly controlled by the surgeon to create a volumetric stiffness distribution map of the region of interest. This map can then be used to guide the tissue resection to minimize healthy tissue loss. The wireless operation prevents the need for a dedicated port and reduces the chance of instrument clashing in the operating field. The WPP is able to measure in real time the indentation pressure with a sensitivity of 34 Pa, the indentation depth with an accuracy of 0.68 mm, and the probe position with a maximum error of 11.3 mm in a tridimensional workspace. The WPP was assessed on the benchtop in detecting the local stiffness of two different silicone tissue simulators (elastic modulus ranging from 45 to 220 kPa), showing a maximum relative error below 5%. Then, in vivo trials were aimed to identify an agar-gel lump injected into a porcine liver and to assess the device usability within the frame of a laparoscopic procedure. The stiffness map created intraoperatively by the WPP was compared with a map generated ex vivo by a standard uniaxial material tester, showing less than 8% local stiffness error at the site of the lump