Haptics in Robot-Assisted Surgery: Challenges and Benefits

Robotic surgery is transforming the current surgical practice, not only by improving the conventional surgical methods but also by introducing innovative robot-enhanced approaches that broaden the capabilities of clinicians. Being mainly of man-machine collaborative type, surgical robots are seen as media that transfer pre- and intra-operative information to the operator and reproduce his/her motion, with appropriate filtering, scaling, or limitation, to physically interact with the patient. The field, however, is far from maturity and, more critically, is still a subject of controversy in medical communities. Limited or absent haptic feedback is reputed to be among reasons that impede further spread of surgical robots. In this paper objectives and challenges of deploying haptic technologies in surgical robotics is discussed and a systematic review is performed on works that have studied the effects of providing haptic information to the users in major branches of robotic surgery. It has been tried to encompass both classical works and the state of the art approaches, aiming at delivering a comprehensive and balanced survey both for researchers starting their work in this field and for the experts

Augmentation Of Human Skill In Microsurgery

Surgeons performing highly skilled microsurgery tasks can benefit from information and manual assistance to overcome technological and physiological limitations to make surgery safer, efficient, and more successful. Vitreoretinal surgery is particularly difficult due to inherent micro-scale and fragility of human eye anatomy. Additionally, surgeons are challenged by physiological hand tremor, poor visualization, lack of force sensing, and significant cognitive load while executing high-risk procedures inside the eye, such as epiretinal membrane peeling. This dissertation presents the architecture and the design principles for a surgical augmentation environment which is used to develop innovative functionality to address the fundamental limitations in vitreoretinal surgery. It is an inherently information driven modular system incorporating robotics, sensors, and multimedia components. The integrated nature of the system is leveraged to create intuitive and relevant human-machine interfaces and generate a particular system behavior to provide active physical assistance and present relevant sensory information to the surgeon. These include basic manipulation assistance, audio-visual and haptic feedback, intraoperative imaging and force sensing. The resulting functionality, and the proposed architecture and design methods generalize to other microsurgical procedures. The system's performance is demonstrated and evaluated using phantoms and in vivo experiments

Control and Estimation Methods Towards Safe Robot-assisted Eye Surgery

Vitreoretinal surgery is among the most delicate surgical tasks in which physiological hand tremor may severely diminish surgeon performance and put the eye at high risk of injury. Unerring targeting accuracy is required to perform precise operations on micro-scale tissues. Tool tip to tissue interaction forces are usually below human tactile perception, which may result in exertion of excessive forces to the retinal tissue leading to irreversible damages. Notable challenges during retinal surgery lend themselves to robotic assistance which has proven beneficial in providing a safe steady-hand manipulation. Efficient assistance from the robots heavily relies on accurate sensing and intelligent control algorithms of important surgery states and situations (e.g. instrument tip position measurements and control of interaction forces). This dissertation provides novel control and state estimation methods to improve safety during robot-assisted eye surgery. The integration of robotics into retinal microsurgery leads to a reduction in surgeon perception of tool-to-tissue forces at sclera. This blunting of human tactile sensory input, which is due to the inflexible inertia of the robot, is a potential iatrogenic risk during robotic eye surgery. To address this issue, a sensorized surgical instrument equipped with Fiber Bragg Grating (FBG) sensors, which is capable of measuring the sclera forces and instrument insertion depth into the eye, is integrated to the Steady-Hand Eye Robot (SHER). An adaptive control scheme is then customized and implemented on the robot that is intended to autonomously mitigate the risk of unsafe scleral forces and excessive insertion of the instrument. Various preliminary and multi-user clinician studies are then conducted to evaluate the effectiveness of the control method during mock retinal surgery procedures. In addition, due to inherent flexibility and the resulting deflection of eye surgical instruments as well as the need for targeting accuracy, we have developed a method to enhance deflected instrument tip position estimation. Using an iterative method and microscope data, we develop a calibration- and registration-independent (RI) framework to provide online estimates of the instrument stiffness (least squares and adaptive). The estimations are then combined with a state-space model for tip position evolution obtained based on the forward kinematics (FWK) of the robot and FBG sensor measurements. This is accomplished using a Kalman Filtering (KF) approach to improve the instrument tip position estimation during robotic surgery. The entire framework is independent of camera-to-robot coordinate frame registration and is evaluated during various phantom experiments to demonstrate its effectiveness

Fiber bragg gratings for medical applications and future challenges: A review

In the last decades, fiber Bragg gratings (FBGs) have become increasingly attractive to medical applications due to their unique properties such as small size, biocompatibility, immunity to electromagnetic interferences, high sensitivity and multiplexing capability. FBGs have been employed in the development of surgical tools, assistive devices, wearables, and biosensors, showing great potentialities for medical uses. This paper reviews the FBG-based measuring systems, their principle of work, and their applications in medicine and healthcare. Particular attention is given to sensing solutions for biomechanics, minimally invasive surgery, physiological monitoring, and medical biosensing. Strengths, weaknesses, open challenges, and future trends are also discussed to highlight how FBGs can meet the demands of next-generation medical devices and healthcare system

Fiber Bragg Gratings for Medical Applications and Future Challenges: A Review

[EN] In the last decades, fiber Bragg gratings (FBGs) have become increasingly attractive to medical applications due to their unique properties such as small size, biocompatibility, immunity to electromagnetic interferences, high sensitivity and multiplexing capability. FBGs have been employed in the development of surgical tools, assistive devices, wearables, and biosensors, showing great potentialities for medical uses. This paper reviews the FBG-based measuring systems, their principle of work, and their applications in medicine and healthcare. Particular attention is given to sensing solutions for biomechanics, minimally invasive surgery, physiological monitoring, and medical biosensing. Strengths, weaknesses, open challenges, and future trends are also discussed to highlight how FBGs can meet the demands of next-generation medical devices and healthcare system.This work was supported in part by INAIL (the Italian National Institute for Insurance against Accident at Work), through the BRIC (Bando ricerche in collaborazione) 2018 SENSE-RISC (Sviluppo di abiti intelligENti Sensorizzati per prevenzione e mitigazione di Rischi per la SiCurezza dei lavoratori) Project under Grant ID10/2018, in part by the UCBM (Universita Campus Bio-Medico di Roma) under the University Strategic HOPE (HOspital to the PatiEnt) Project, in part by the EU Framework Program H2020-FETPROACT-2018-01 NeuHeart Project under Grant GA 824071, by FCT/MEC (Fundacao para a Ciencia e Tecnologia) under the Projects UIDB/50008/2020 - UIDP/50008/2020, and by REACT (Development of optical fiber solutions for Rehabilitation and e-Health applications) FCT-IT-LA scientific action.Lo Presti, D.; Massaroni, C.; Leitao, CSJ.; Domingues, MDF.; Sypabekova, M.; Barrera, D.; Floris, I.... (2020). Fiber Bragg Gratings for Medical Applications and Future Challenges: A Review. IEEE Access. 8:156863-156888. https://doi.org/10.1109/ACCESS.2020.3019138S156863156888

From teleoperation to autonomous robot-assisted microsurgery: A survey

Robot-assisted microsurgery (RAMS) has many benefits compared to traditional microsurgery. Microsurgical platforms with advanced control strategies, high-quality micro-imaging modalities and micro-sensing systems are worth developing to further enhance the clinical outcomes of RAMS. Within only a few decades, microsurgical robotics has evolved into a rapidly developing research field with increasing attention all over the world. Despite the appreciated benefits, significant challenges remain to be solved. In this review paper, the emerging concepts and achievements of RAMS will be presented. We introduce the development tendency of RAMS from teleoperation to autonomous systems. We highlight the upcoming new research opportunities that require joint efforts from both clinicians and engineers to pursue further outcomes for RAMS in years to come

Non linear force feedback enhancement for cooperative robotic neurosurgery enforces virtual boundaries on cortex surface

Surgeons can benefit from the cooperation with a robotic assistant during the repetitive execution of precise targeting tasks on soft tissues, such as brain cortex stimulation procedures in open-skull neurosurgery. Position-based force-to-motion control schemes may not be satisfactory solution to provide the manipulator with the high compliance desirable during guidance along wide trajectories. A new torque controller with non-linear force feedback enhancement (FFE) is presented to provide augmented haptic perception to the operator from instrument-tissue interaction. Simulation tests were performed to evaluate the system stability according to different non-linear force modulation functions (power, sigmoidal and arc tangent). The FFE controller with power modulation was experimentally validated with a pool of non-expert users using brain-mimicking gelatin phantoms (8%-16% concentration). Besides providing hand tremor rejection for a stable holding of the tool, the FFE controller was proven to allow for a safer tissue contact with respect to both robotic assistance without force feedback and freehand executions (50% and 75% reduction of the indentation depth, respectively). Future work will address the evaluation of the safety features of the FFE controller with expert surgeons on a realistic brain phantom, also accounting for unpredictable tissue's motions as during seizures due to cortex stimulation

Vision-and-Force-Based Compliance Control for a Posterior Segment Ophthalmic Surgical Robot

In ophthalmic surgery, particularly in procedures involving the posterior segment, clinicians face significant challenges in maintaining precise control of hand-held instruments without damaging the fundus tissue. Typical targets of this type of surgery are the internal limiting membrane (ILM) and the epiretinal membrane (ERM) which have an average thickness of only 60 μm and 2 μm , respectively, making it challenging, even for experienced clinicians utilising dedicated ophthalmic surgical robots, to peel these delicate membranes successfully without damaging the healthy tissue. Minimal intra-operative motion errors when driving both hand-held and robotic-assisted surgical tools may result in significant stress on the delicate tissue of the fundus, potentially causing irreversible damage to the eye. To address these issues, this work proposes an intra-operative vision-and-force-based compliance control method for a posterior segment ophthalmic surgical robot. This method aims to achieve compliance control of the surgical instrument in contact with the tissue to minimise the risk of tissue damage. In this work we demonstrate that we can achieve a maximum motion error for the end effector (EE) of our ophthalmic robot of just 8 μm , resulting in a 64 % increase in motion accuracy compared to our previous work where the system was firstly introduced. The results of the proposed compliance control demonstrate consistent performance in the force range of 40 mN during membrane tearing

Force-Sensing-Based Multi-Platform Robotic Assistance for Vitreoretinal Surgery

Vitreoretinal surgery aims to treat disorders of the retina, vitreous body, and macula, such as retinal detachment, diabetic retinopathy, macular hole, epiretinal membrane and retinal vein occlusion. Challenged by several technical and human limitations, vitreoretinal practice currently ranks amongst the most demanding fields in ophthalmic surgery. Of vitreoretinal procedures, membrane peeling is the most common to be performed, over 0.5 million times annually, and among the most prone to complications. It requires an extremely delicate tissue manipulation by various micron scale maneuvers near the retina despite the physiological hand tremor of the operator. In addition, to avoid injuries, the applied forces on the retina need to be kept at a very fine level, which is often well below the tactile sensory threshold of the surgeon. Retinal vein cannulation is another demanding procedure where therapeutic agents are injected into occluded retinal veins. The feasibility of this treatment is limited due to challenges in identifying the moment of venous puncture, achieving cannulation and maintaining it throughout the drug delivery period. Recent advancements in medical robotics have significant potential to address most of the challenges in vitreoretinal practice, and therefore to prevent traumas, lessen complications, minimize intra-operative surgeon effort, maximize surgeon comfort, and promote patient safety. This dissertation presents the development of novel force-sensing tools that can easily be used on various robotic platforms, and robot control methods to produce integrated assistive surgical systems that work in partnership with surgeons against the current limitations in vitreoretinal surgery, specifically focusing on membrane peeling and vein cannulation procedures. Integrating high sensitivity force sensing into the ophthalmic instruments enables precise quantitative monitoring of applied forces. Auditory feedback based upon the measured forces can inform (and warn) the surgeon quickly during the surgery and help prevent injury due to excessive forces. Using these tools on a robotic platform can attenuate hand tremor of the surgeon, which effectively promotes tool manipulation accuracy. In addition, based upon certain force signatures, the robotic system can precisely identify critical instants, such as the venous puncture in retinal vein cannulation, and actively guide the tool towards clinical targets, compensate any involuntary motion of the surgeon, or generate additional motion that will make the surgical task easier. The experimental results using two distinct robotic platforms, the Steady-Hand Eye Robot and Micron, in combination with the force-sensing ophthalmic instruments, show significant performance improvement in artificial dry phantoms and ex vivo biological tissues