Prevalence of haptic feedback in robot-mediated surgery : a systematic review of literature

© 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of an article published in Journal of Robotic Surgery. The final authenticated version is available online at: https://doi.org/10.1007/s11701-017-0763-4With the successful uptake and inclusion of robotic systems in minimally invasive surgery and with the increasing application of robotic surgery (RS) in numerous surgical specialities worldwide, there is now a need to develop and enhance the technology further. One such improvement is the implementation and amalgamation of haptic feedback technology into RS which will permit the operating surgeon on the console to receive haptic information on the type of tissue being operated on. The main advantage of using this is to allow the operating surgeon to feel and control the amount of force applied to different tissues during surgery thus minimising the risk of tissue damage due to both the direct and indirect effects of excessive tissue force or tension being applied during RS. We performed a two-rater systematic review to identify the latest developments and potential avenues of improving technology in the application and implementation of haptic feedback technology to the operating surgeon on the console during RS. This review provides a summary of technological enhancements in RS, considering different stages of work, from proof of concept to cadaver tissue testing, surgery in animals, and finally real implementation in surgical practice. We identify that at the time of this review, while there is a unanimous agreement regarding need for haptic and tactile feedback, there are no solutions or products available that address this need. There is a scope and need for new developments in haptic augmentation for robot-mediated surgery with the aim of improving patient care and robotic surgical technology further.Peer reviewe

Toward a Millimeter-Scale Tendon-Driven Continuum Wrist with Integrated Gripper for Microsurgical Applications

Microsurgery is a particularly impactful yet challenging form of surgery. Robot assisted microsurgery has the potential to improve surgical dexterity and enable precise operation on such small scales in ways not previously possible. Intraocular microsurgery is a particularly challenging domain in part due to the lack of dexterity that is achievable with rigid instruments inserted through the eye. In this work, we present a new design for a millimeter-scale, dexterous wrist intended for microsurgery applications. The wrist is created via a state-of-the-art two-photon-polymerization (2PP) microfabrication technique, enabling the wrist to be constructed of flexible material with complex internal geometries and critical features at the micron-scale. The wrist features a square cross section with side length of 1.25 mm and total length of 3.75 mm. The wrist has three tendons routed down its length which, when actuated by small-scale linear actuators, enable bending in any plane. We present an integrated gripper actuated by a fourth tendon routed down the center of the robot. We evaluate the wrist and gripper by characterizing its bend-angle. We achieve more than 90 degrees bending in both axes. We demonstrate out of plane bending as well as the robot's ability to grip while actuated. Our integrated gripper/tendon-driven continuum robot design and meso-scale assembly techniques have the potential to enable small-scale wrists with more dexterity than has been previously demonstrated. Such a wrist could improve surgeon capabilities during teleoperation with the potential to improve patient outcomes in a variety of surgical applications, including intraocular surgery.Comment: 2 pages, 3 figures, submitted to the 2023 Hamlyn Symposium on Medical Robotics conferenc

Workshop on "Control issues in the micro / nano - world".

International audienceDuring the last decade, the need of systems with micro/nanometers accuracy and fast dynamics has been growing rapidly. Such systems occur in applications including 1) micromanipulation of biological cells, 2) micrassembly of MEMS/MOEMS, 3) micro/nanosensors for environmental monitoring, 4) nanometer resolution imaging and metrology (AFM and SEM). The scale and requirement of such systems present a number of challenges to the control system design that will be addressed in this workshop. Working in the micro/nano-world involves displacements from nanometers to tens of microns. Because of this precision requirement, environmental conditions such as temperature, humidity, vibration, could generate noise and disturbance that are in the same range as the displacements of interest. The so-called smart materials, e.g., piezoceramics, magnetostrictive, shape memory, electroactive polymer, have been used for actuation or sensing in the micro/nano-world. They allow high resolution positioning as compared to hinges based systems. However, these materials exhibit hysteresis nonlinearity, and in the case of piezoelectric materials, drifts (called creep) in response to constant inputs In the case of oscillating micro/nano-structures (cantilever, tube), these nonlinearities and vibrations strongly decrease their performances. Many MEMS and NEMS applications involve gripping, feeding, or sorting, operations, where sensor feedback is necessary for their execution. Sensors that are readily available, e.g., interferometer, triangulation laser, and machine vision, are bulky and expensive. Sensors that are compact in size and convenient for packaging, e.g., strain gage, piezoceramic charge sensor, etc., have limited performance or robustness. To account for these difficulties, new control oriented techniques are emerging, such as[d the combination of two or more ‘packageable' sensors , the use of feedforward control technique which does not require sensors, and the use of robust controllers which account the sensor characteristics. The aim of this workshop is to provide a forum for specialists to present and overview the different approaches of control system design for the micro/nano-world and to initiate collaborations and joint projects

Effects of environmental noise on the accuracy of millimeter sized grippers in cantilever configuration and active stabilisation.

International audienceThis paper presents a study about the effects of environmental noise on millimeter sized grippers in cantilever configuration. The study is motivated and conducted aiming at assessing the level of accuracy loss when performing micromanipulation/ microassembly tasks in noisy environments as well in typical microrobotics laboratories as in industrial locations or operating rooms. Ground motion and acoustic noises within a typical microrobotic laboratory are characterized in the frequency domain and their effects on cantilevers of different lengths are inspected. The relevance of a typical vibration isolation table is evaluated and the effects of low and high acoustic noises are assessed. A modeling of a cantilever with base excitation is thereafter conducted in the state space using finite difference formulation and a stabilization of a disturbed cantilever is obtained at the nanometer level in noisy environments allowing perspectives to high precision micromanipulation tasks in hostile locations

A Review of Haptic Feedback Teleoperation Systems for Micromanipulation and Microassembly

International audienceThis paper presents a review of the major haptic feedback teleoperation systems for micromanipulation. During the last decade, the handling of micrometer-sized objects has become a critical issue. Fields of application from material science to electronics demonstrate an urgent need for intuitive and flexible manipulation systems able to deal with small-scale industrial projects and assembly tasks. Two main approaches have been considered: fully automated tasks and manual operation. The first one require fully pre determined tasks, while the later necessitates highly trained operators. To overcome these issues the use of haptic feedback teleoperation where the user manipulates the tool through a joystick whilst feeling a force feedback, appears to be a promising solution as it allows high intuitiveness and flexibility. Major advances have been achieved during this last decade, starting with systems that enable the operator to feel the substrate topology, to the current state-of-the-art where 3D haptic feedback is provided to aid manipulation tasks. This paper details the major achievements and the solutions that have been developed to propose 3D haptic feedback for tools that often lack 3D force measurements. The use of virtual reality to enhance the immersion is also addressed. The strategies developed provide haptic feedback teleoperation systems with a high degree of assistance and for a wide range of micromanipulation tools. Based on this expertise on haptic for micromanipulation and virtual reality assistance it is now possible to propose microassembly systems for objects as small as 1 to 10 micrometers. This is a mature field and will benefit small-scale industrial projects where precision and flexibility in microassembly are required

Automatic Microassembly System for tissue engineering- Assisted with top-view and force control

Master'sMASTER OF ENGINEERIN

Force Sensing and Control in Micromanipulation

Ph.DDOCTOR OF PHILOSOPH

Magnetic Levitation of Polymeric Photo-thermal Microgrippers

Precise manipulation of micro objects became great interest in engineering and science with the advancements in microengineering and microfabrication. In this thesis, a magnetically levitated microgripper is presented for microhandling tasks. The use of magnetic levitation for positioning reveals the problems associated with modeling of complex surface forces and the use of jointed parts or wires. The power required for the levitation of the microgripper is generated by an external drive unit that makes further minimization of the gripper possible. The gripper is made of a biocompatible material and can be activated remotely. These key features make the microgripper a great candidate for manipulation of micro components and biomanipulation. In order to achieve magnetic levitation of microrobots, the magnetic field generated by the magnetic levitation setup is simulated. The magnetic flux density in the air gap region is improved by the integration of permanent magnets and an additional electromagnet to the magnetic loop assembly. The levitation performance is evaluated with millimeter size permanent magnets. An eddy current damping method is implemented and the levitation accuracy is doubled by reducing the positioning error to 20.3 µm. For a MEMS-compatible microrobot design, the electrodeposition of Co-Ni-Mn-P magnetic thin films is demonstrated. Magnetic films are deposited on silicon substrate to form the magnetic portion of the microrobot. The electrodeposited films are extensively characterized. The relationship between the deposition parameters and structural properties is discussed leading to an understanding of the effect of deposition parameters on the magnetic properties. It is shown that both in-plane and out-of-plane magnetized films can be obtained using electrodeposition with slightly differentiated deposition parameters. The levitation of the electrodeposited magnetic samples shows a great promise toward the fabrication of levitating MEMS devices. The end-effector tool of the levitating microrobot is selected as a microgripper that can achieve various manipulation operations such as pulling, pushing, tapping, grasping and repositioning. The microgripper is designed based on a bent-beam actuation technique. The motion of the gripper fingers is achieved by thermal expansion through laser heat absorption. This technique provided non-contact actuation for the levitating microgripper. The analytical model of the displacement of the bent-beam actuator is developed. Different designs of microgripper are fabricated and thoroughly characterized experimentally and numerically. The two microgripper designs that lead to the maximum gripper deflection are adapted for the levitating microrobot. The experimental results show that the levitating microrobot can be positioned in a volume of 3 x 3 x 2 cm^3. The positioning error is measured as 34.3 µm and 13.2 µm when electrodeposited magnets and commercial permanent magnets are used, respectively. The gripper fingers are successfully operated on-the-fly by aligning a visible wavelength laser beam on the gripper. Micromanipulation of 100 µm diameter electrical wire, 125 µm diameter optical fiber and 1 mm diameter cable strip is demonstrated. The microgripper is also positioned in a closed chamber without sacrificing the positioning accuracy

Modeling and experimental validation of a parallel microrobot for biomanipulation

The main purpose of this project is the development of a commercial micropositioner's (SmarPod 115.25, SmarAct GmbH) geometrical model. SmarPod is characterized by parallel kinematics and is employed for precise and accurate sample's positioning under SEM microscope, being vacuum-compatible, for various applications. Geometrical modeling represents the preliminar step to fully understand, and possibly improve, robot's closed loop behaviour in terms of task's quality precision, when enterprises does not provide sufficient documentation. The robotic system, in fact, represents in this case a "black box" from which it's possible to extract information. This step is essential in order to improve, consequently, the reliability of bio-microsystem manipulation and characterization. Disposing of a detailed microrobot's model becomes essential to deal with the typical lack of sensing at microscale, as it allows a 3D precise and adequate reconstruction, realized through proper softwares, of the manipulation set-up. The roles of Virtual Reality (VR) and of simulations, carried out, in this case, in Blender environment, are asserted as well as an essential helping tool in mycrosystem's task planning. Blender is a professional free and open-source 3D computer graphics software and it is proven to be a basic instrument to validate microrobot's model, even to simplify it in case of complex system's geometries