A surgical system for automatic registration, stiffness mapping and dynamic image overlay

In this paper we develop a surgical system using the da Vinci research kit (dVRK) that is capable of autonomously searching for tumors and dynamically displaying the tumor location using augmented reality. Such a system has the potential to quickly reveal the location and shape of tumors and visually overlay that information to reduce the cognitive overload of the surgeon. We believe that our approach is one of the first to incorporate state-of-the-art methods in registration, force sensing and tumor localization into a unified surgical system. First, the preoperative model is registered to the intra-operative scene using a Bingham distribution-based filtering approach. An active level set estimation is then used to find the location and the shape of the tumors. We use a recently developed miniature force sensor to perform the palpation. The estimated stiffness map is then dynamically overlaid onto the registered preoperative model of the organ. We demonstrate the efficacy of our system by performing experiments on phantom prostate models with embedded stiff inclusions.Comment: International Symposium on Medical Robotics (ISMR 2018

A Non-linear Model for Predicting Tip Position of a Pliable Robot Arm Segment Using Bending Sensor Data

Using pliable materials for the construction of robot bodies presents new and interesting challenges for the robotics community. Within the EU project entitled STIFFness controllable Flexible & Learnable manipulator for surgical Operations (STIFF-FLOP), a bendable, segmented robot arm has been developed. The exterior of the arm is composed of a soft material (silicone), encasing an internal structure that contains air-chamber actuators and a variety of sensors for monitoring applied force, position and shape of the arm as it bends. Due to the physical characteristics of the arm, a proper model of robot kinematics and dynamics is difficult to infer from the sensor data. Here we propose a non-linear approach to predicting the robot arm posture, by training a feed-forward neural network with a structured series of pressures values applied to the arm's actuators. The model is developed across a set of seven different experiments. Because the STIFF-FLOP arm is intended for use in surgical procedures, traditional methods for position estimation (based on visual information or electromagnetic tracking) will not be possible to implement. Thus the ability to estimate pose based on data from a custom fiber-optic bending sensor and accompanying model is a valuable contribution. Results are presented which demonstrate the utility of our non-linear modelling approach across a range of data collection procedures

An Experimental and Numerical Study on Tactile Neuroimaging: A Novel Minimally Invasive Technique for Intraoperative Brain Imaging

This is the peer reviewed version of the following article: Moslem Sadeghi-Goughari, Yanjun Qian, Soo Jeon, Sohrab Sadeghi and Hyock-Ju Kwon, “An Experimental and Numerical Study on Tactile Neuroimaging: A Novel Minimally Invasive Technique for Intraoperative Brain Imaging,” accepted to The International Journal of Medical Robotics and Computer Assisted Surgery which has been published in final form at: https://doi.org/10.1002/rcs.1893. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving.Background The success of tumor neurosurgery is highly dependent on the ability to accurately localize the operative target, which may be shifted during the operation. Performing an intraoperative brain imaging is crucial in minimally invasive neurosurgery to detect the effect of brain shift on the tumor’s location, and to maximize the efficiency of tumor resection. Method The major objective of this research is to introduce the tactile neuroimaging as a novel minimally invasive technique for intraoperative brain imaging. To investigate the feasibility of the proposed method, an experimental and numerical study was first performed on silicone phantoms mimicking the brain tissue with a tumor. Then the study was extended to a clinical model with the meningioma tumor. Results The stress distribution on the brain surface has high potential to intraoperatively localize the tumor. Conclusion Results suggest that tactile neuroimaging can be used to provide a non-invasive, and real-time intraoperative data on tumor’s features.Natural Sciences and Engineering Research Council || RGPIN/2015-05273, RGPIN/2015-04118, RGPAS/354703-201

Pseudo-Haptics for Rigid Tool/Soft Object Interaction Feedback in Virtual Environments

This paper proposes a novel pseudo-haptics soft object stiffness simulation technique which is a marked improvement to currently used simulation methods and an effective low-cost alternative to expensive 3-DOF haptic devices. Soft object stiffness simulation is achieved by maneuvering an indenter avatar over the surface of a virtual soft object by means of an input device, such as a mouse, a joystick, or a touch-sensitive tablet. The alterations to the indenter avatar behavior produced by the proposed technique create for the user the illusion of interaction with a hard inclusion embedded in the soft object. The proposed pseudo-haptics technique is validated with a series of experiments conducted by employing three types of 2-DOF force-sensitive haptic surfaces, including a touchpad, a tablet with an S-pen input, and a tablet with a bare finger input. It is found that both the sensitivity and the positive predictive value of hard inclusion detection can be significantly improved by 33.3% and 13.9% respectively by employing tablet computers. Using tablet computers could produce results comparable to direct hand touch in detecting hard inclusions in a soft object. The experimental results presented here confirm the potential of the proposed technique for conveying haptic information in rigid tool / soft object interaction in virtual environments

Feasibility study on a robot-assisted procedure for tumor localization using needle-rotation force signals

Accurate tumor localization is critical to early-stage cancer diagnosis and therapy. The recent force-guided technique allows to determine the depth of a suspicious tumor on the insertion path, while the spatial localization is still a great challenge. In this paper, a novel force-guided procedure was proposed to identify spatial tumor location using force signals during needle rotation. When there is a harder tumorous tissue around the needle rotation, an abnormal force signal will point to the location of the suspicious tissue. Finite element simulation and phantom experiment were conducted to test the feasibility of the procedure for the tumor localization. The simulation results showed that the harder tumorous tissue made a significant difference on the stress and deformation distributions for the surroundings, changing the needle-rotation force signals when the needle rotated towards the harder tissue. The experimental results indicated that the direction of the tumor location can be identified by the rotation-needle force signals. The intersection point of the two identified directions, derived from force signals of twice needle rotations, determined the tumor location ultimately. Also, parametric sensitivity tests were performed to examine the effective distance of the tumor location centre and the needle insertion point for the tumor localization. This procedure is expected to be used in robot-assisted system for cancer biopsy and brachytherapy