The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review

BACKGROUND: Virtual reality (VR) as surgical training tool has become a state-of-the-art technique in training and teaching skills for minimally invasive surgery (MIS). Although intuitively appealing, the true benefits of haptic (VR training) platforms are unknown. Many questions about haptic feedback in the different areas of surgical skills (training) need to be answered before adding costly haptic feedback in VR simulation for MIS training. This study was designed to review the current status and value of haptic feedback in conventional and robot-assisted MIS and training by using virtual reality simulation. METHODS: A systematic review of the literature was undertaken using PubMed and MEDLINE. The following search terms were used: Haptic feedback OR Haptics OR Force feedback AND/OR Minimal Invasive Surgery AND/OR Minimal Access Surgery AND/OR Robotics AND/OR Robotic Surgery AND/OR Endoscopic Surgery AND/OR Virtual Reality AND/OR Simulation OR Surgical Training/Education. RESULTS: The results were assessed according to level of evidence as reflected by the Oxford Centre of Evidence-based Medicine Levels of Evidence. CONCLUSIONS: In the current literature, no firm consensus exists on the importance of haptic feedback in performing minimally invasive surgery. Although the majority of the results show positive assessment of the benefits of force feedback, results are ambivalent and not unanimous on the subject. Benefits are least disputed when related to surgery using robotics, because there is no haptic feedback in currently used robotics. The addition of haptics is believed to reduce surgical errors resulting from a lack of it, especially in knot tying. Little research has been performed in the area of robot-assisted endoscopic surgical training, but results seem promising. Concerning VR training, results indicate that haptic feedback is important during the early phase of psychomotor skill acquisitio

Medical Robotics

The first generation of surgical robots are already being installed in a number of operating rooms around the world. Robotics is being introduced to medicine because it allows for unprecedented control and precision of surgical instruments in minimally invasive procedures. So far, robots have been used to position an endoscope, perform gallbladder surgery and correct gastroesophogeal reflux and heartburn. The ultimate goal of the robotic surgery field is to design a robot that can be used to perform closed-chest, beating-heart surgery. The use of robotics in surgery will expand over the next decades without any doubt. Minimally Invasive Surgery (MIS) is a revolutionary approach in surgery. In MIS, the operation is performed with instruments and viewing equipment inserted into the body through small incisions created by the surgeon, in contrast to open surgery with large incisions. This minimizes surgical trauma and damage to healthy tissue, resulting in shorter patient recovery time. The aim of this book is to provide an overview of the state-of-art, to present new ideas, original results and practical experiences in this expanding area. Nevertheless, many chapters in the book concern advanced research on this growing area. The book provides critical analysis of clinical trials, assessment of the benefits and risks of the application of these technologies. This book is certainly a small sample of the research activity on Medical Robotics going on around the globe as you read it, but it surely covers a good deal of what has been done in the field recently, and as such it works as a valuable source for researchers interested in the involved subjects, whether they are currently “medical roboticists” or not

Design and Development of a Tele-operated Surgical Simulation Environment

With the introduction of robots into laparoscopic surgery, surgeons have difficulties in selecting the placement of the incisions required to insert the robots instruments into the body and also determine which patients are suitable for robotically assisted surgery. Poor selection of these two items mentioned above can result in a conversion to a more invasive form of surgery during the procedure. This work introduces the design and development of a surgical simulation environment to assist in the research for optimal incision placement and patient selection. The simulator allows importing any serial link robot that was designed in a computer aided modelling package. With minimal added information, the imported robot can be controlled using a multi-degree of freedom user input device. The simulator allows for importing patient geometries along with the robot to allow for the simulation of surgical procedures. A Jacobian transpose algorithm was added onto the simulator in a modular format to control the simulated robots, as well as to allow for other control systems to be created and implemented. Experiments were performed to determine the effects of patient geometry models on rendering speeds. The control system could control the tested robots with a maximum lag time of 15 ms between moving the input device and the simulated robot moving to the correct desired position. The simulator makes importing and controlling robots a simple and intuitive matter, without putting a large restriction on the type of robots to be simulated. The simulator also allows for importing models of a patient, to make real world analysis of a patient possible. Further improvements on the presented simulator include the addition of collision detection and more testing on the control system for stability and response over a larger range of robots

Image-guided port placement for minimally invasive cardiac surgery

Minimally invasive surgery is becoming popular for a number of interventions. Use of robotic surgical systems in coronary artery bypass intervention offers many benefits to patients, but is however limited by remaining challenges in port placement. Choosing the entry ports for the robotic tools has a large impact on the outcome of the surgery, and can be assisted by pre-operative planning and intra-operative guidance techniques. In this thesis, pre-operative 3D computed tomography (CT) imaging is used to plan minimally invasive robotic coronary artery bypass (MIRCAB) surgery. From a patient database, port placement optimization routines are implemented and validated. Computed port placement configurations approximated past expert chosen configurations with an error of 13.7 ±5.1 mm. Following optimization, statistical classification was used to assess patient candidacy for MIRCAB. Various pattern recognition techniques were used to predict MIRCAB success, and could be used in the future to reduce conversion rates to conventional open-chest surgery. Gaussian, Parzen window, and nearest neighbour classifiers all proved able to detect ‘candidate’ and ‘non-candidate’ MIRCAB patients. Intra-operative registration and laser projection of port placements was validated on a phantom and then evaluated in four patient cases. An image-guided laser projection system was developed to map port placement plans from pre-operative 3D images. Port placement mappings on the phantom setup were accurate with an error of 2.4 ± 0.4 mm. In the patient cases, projections remained within 1 cm of computed port positions. Misregistered port placement mappings in human trials were due mainly to the rigid-body registration assumption and can be improved by non-rigid techniques. Overall, this work presents an integrated approach for: 1) pre-operative port placement planning and classification of incoming MIRCAB patients; and 2) intra-operative guidance of port placement. Effective translation of these techniques to the clinic will enable MIRCAB as a more efficacious and accessible procedure

Prevalence of haptic feedback in robot-mediated surgery : a systematic review of literature

© 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of an article published in Journal of Robotic Surgery. The final authenticated version is available online at: https://doi.org/10.1007/s11701-017-0763-4With the successful uptake and inclusion of robotic systems in minimally invasive surgery and with the increasing application of robotic surgery (RS) in numerous surgical specialities worldwide, there is now a need to develop and enhance the technology further. One such improvement is the implementation and amalgamation of haptic feedback technology into RS which will permit the operating surgeon on the console to receive haptic information on the type of tissue being operated on. The main advantage of using this is to allow the operating surgeon to feel and control the amount of force applied to different tissues during surgery thus minimising the risk of tissue damage due to both the direct and indirect effects of excessive tissue force or tension being applied during RS. We performed a two-rater systematic review to identify the latest developments and potential avenues of improving technology in the application and implementation of haptic feedback technology to the operating surgeon on the console during RS. This review provides a summary of technological enhancements in RS, considering different stages of work, from proof of concept to cadaver tissue testing, surgery in animals, and finally real implementation in surgical practice. We identify that at the time of this review, while there is a unanimous agreement regarding need for haptic and tactile feedback, there are no solutions or products available that address this need. There is a scope and need for new developments in haptic augmentation for robot-mediated surgery with the aim of improving patient care and robotic surgical technology further.Peer reviewe

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions

Human performance in the task of port placement for biosensor use

Background We conducted a study of participants' abilities to place a laparoscopic port for in vivo biosensor use. Biosensors have physical limitations that make port placement crucial to proper data collection. A new port placement algorithm enabled evaluation of port locations, using segmented patient data in a virtual environment. Methods Port placement scoring algorithms were integrated into an image-guided surgery system. Virtual test scenes were created to evaluate various scenarios encountered during biosensor use. Participants were scored based on their ability to choose a port location from which points of interest could be scanned with a biosensor. Participants' scores were also compared to those of a port placement algorithm. Results The port placement algorithm consistently outscored participants by 10–25%. Participants were inconsistent from trial to trial and from participant to participant. Conclusion Port placement for biosensor procedures could be improved through training or augmentation. Copyright © 2010 John Wiley & Sons, Ltd.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/75793/1/300_ftp.pd

Robot-assisted unicompartmental knee arthroplasty can reduce radiologic outliers compared to conventional techniques

BACKGROUND: The aim of this study was to compare the clinical and radiologic outcomes of robot-assisted unicompartmental knee arthroplasty (UKA) to those of conventional UKA in Asian patients. METHODS: Fifty-five patients underwent robot-assisted UKA and 57 patients underwent conventional UKA were assessed in this study. Preoperative and postoperative range of motion (ROM), American Knee Society (AKS) score, Western Ontario McMaster University Osteoarthritis Index scale score (WOMAC), and patellofemoral (PF) score values were compared between the two groups. The mechanical femorotibial angle (mFTA) and Kennedy zone were also measured. Coronal alignments of the femoral and tibial components and posterior slopes of the tibial component were compared. Additionally, polyethylene (PE) liner thicknesses were compared. RESULTS: There was no significant difference between the two groups regarding postoperative ROM, AKS, WOMAC and PF score. Robot group showed fewer radiologic outliers in terms of mFTA and coronal alignment of tibial and femoral components (p = 0.022, 0.037, 0.003). The two groups showed significantly different PE liner thicknesses (8.4 ± 0.8 versus 8.8 ± 0.9, p = 0.035). Robot group was the only influencing factor for reducing radiologic outlier (postoperative mFTA) in multivariate model (odds ratio: 2.833, p = 0.037). CONCLUSION: In this study, robot-assisted UKA had many advantages over conventional UKA, such as its ability to achieve precise implant insertion and reduce radiologic outliers. Although the clinical outcomes of robot-assisted UKA over a short-term follow-up period were not significantly different compared to those of conventional UKA, longer follow-up period is needed to determine whether the improved radiologic accuracy of the components in robotic-assisted UKA will lead to better clinical outcomes and improved long-term survival.ope

FPGA-based High-Performance Collision Detection: An Enabling Technique for Image-Guided Robotic Surgery

Collision detection, which refers to the computational problem of finding the relative placement or con-figuration of two or more objects, is an essential component of many applications in computer graphics and robotics. In image-guided robotic surgery, real-time collision detection is critical for preserving healthy anatomical structures during the surgical procedure. However, the computational complexity of the problem usually results in algorithms that operate at low speed. In this paper, we present a fast and accurate algorithm for collision detection between Oriented-Bounding-Boxes (OBBs) that is suitable for real-time implementation. Our proposed Sweep and Prune algorithm can perform a preliminary filtering to reduce the number of objects that need to be tested by the classical Separating Axis Test algorithm, while the OBB pairs of interest are preserved. These OBB pairs are re-checked by the Separating Axis Test algorithm to obtain accurate overlapping status between them. To accelerate the execution, our Sweep and Prune algorithm is tailor-made for the proposed method. Meanwhile, a high performance scalable hardware architecture is proposed by analyzing the intrinsic parallelism of our algorithm, and is implemented on FPGA platform. Results show that our hardware design on the FPGA platform can achieve around 8X higher running speed than the software design on a CPU platform. As a result, the proposed algorithm can achieve a collision frame rate of 1 KHz, and fulfill the requirement for the medical surgery scenario of Robot Assisted Laparoscopy.published_or_final_versio