Observer based dynamic control model for bilaterally controlled MU-lapa robot: Surgical tool force limiting

During laparoscopic surgeries, primary surgical tool insertion is the demanding and strenuous task. As the surgeon is unaware of the type of the tissue and associated parameters to conduct the insertion, therefore, to ease the procedure, the movement of the surgical tool needs to be controlled. It’s the operational capabilities that are to be manipulated to perform a smooth surgery even from a distant location. In this study, a robot system is being introduced for laparoscopic primary surgical tool insertion. It will incorporate a novel observer based dynamic control along with robot assisted bilateral control. Moreover, a virtual spring damper force lock system is introduced through which the slave system will notify the master regarding the target achieved and excessive force. The validation of the proposed control system is experimented with bilaterally controlled MU-LapaRobot. The experiment is comprising 3 cases of bilateral control criteria which are non-contact motion, contact motion, and limit force locking. The results defined the same value for contact and non-contact motion by 0.3N. The results depicted a force error of 3.6% and a position error of 5.8% which validated the proposed algorithm

Haptics-Enabled Teleoperation for Robotics-Assisted Minimally Invasive Surgery

The lack of force feedback (haptics) in robotic surgery can be considered to be a safety risk leading to accidental tissue damage and puncturing of blood vessels due to excessive forces being applied to tissue and vessels or causing inefficient control over the instruments because of insufficient applied force. This project focuses on providing a satisfactory solution for introducing haptic feedback in robotics-assisted minimally invasive surgical (RAMIS) systems. The research addresses several key issues associated with the incorporation of haptics in a master-slave (teleoperated) robotic environment for minimally invasive surgery (MIS). In this project, we designed a haptics-enabled dual-arm (two masters - two slaves) robotic MIS testbed to investigate and validate various single-arm as well as dual-arm teleoperation scenarios. The most important feature of this setup is the capability of providing haptic feedback in all 7 degrees of freedom (DOF) required for RAMIS (3 translations, 3 rotations and pinch motion of the laparoscopic tool). The setup also enables the evaluation of the effect of replacing haptic feedback by other sensory cues such as visual representation of haptic information (sensory substitution) and the hypothesis that surgical outcomes may be improved by substituting or augmenting haptic feedback by such sensory cues

Medical Robotics

The first generation of surgical robots are already being installed in a number of operating rooms around the world. Robotics is being introduced to medicine because it allows for unprecedented control and precision of surgical instruments in minimally invasive procedures. So far, robots have been used to position an endoscope, perform gallbladder surgery and correct gastroesophogeal reflux and heartburn. The ultimate goal of the robotic surgery field is to design a robot that can be used to perform closed-chest, beating-heart surgery. The use of robotics in surgery will expand over the next decades without any doubt. Minimally Invasive Surgery (MIS) is a revolutionary approach in surgery. In MIS, the operation is performed with instruments and viewing equipment inserted into the body through small incisions created by the surgeon, in contrast to open surgery with large incisions. This minimizes surgical trauma and damage to healthy tissue, resulting in shorter patient recovery time. The aim of this book is to provide an overview of the state-of-art, to present new ideas, original results and practical experiences in this expanding area. Nevertheless, many chapters in the book concern advanced research on this growing area. The book provides critical analysis of clinical trials, assessment of the benefits and risks of the application of these technologies. This book is certainly a small sample of the research activity on Medical Robotics going on around the globe as you read it, but it surely covers a good deal of what has been done in the field recently, and as such it works as a valuable source for researchers interested in the involved subjects, whether they are currently “medical roboticists” or not

Scalability study for robotic hand platform

The goal of this thesis project was to determine the lower limit of scale for the RIT robotic grasping hand. This was accomplished using a combination of computer simulation and experimental studies. A force analysis was conducted to determine the size of air muscles required to achieve appropriate contact forces at a smaller scale. Input variables, such as the actuation force and tendon return force, were determined experimentally. A dynamic computer model of the hand system was then created using Recurdyn. This was used to predict the contact (grasping) force of the fingers at full-scale, half-scale, and quarter-scale. Correlation between the computer model and physical testing was achieved for both a life-size and half-scale finger assembly. To further demonstrate the scalability of the hand design, both half and quarter-scale robotic hand rapid prototype assemblies were built using 3D printing techniques. This thesis work identified the point where further miniaturization would require a change in the manufacturing process to micro-fabrication. Several techniques were compared as potential methods for making a production intent quarter-scale robotic hand. Investment casting, Swiss machining, and Selective Laser Sintering were the manufacturing techniques considered. A quarter-scale robotic hand tested the limits of each technology. Below this scale, micro-machining would be required. The break point for the current actuation method, air muscles, was also explored. Below the quarter-scale, an alternative actuation method would also be required. Electroactive Polymers were discussed as an option for the micro-scale. In summary, a dynamic model of the RIT robotic grasping hand was created and validated as scalable at full and half-scales. The model was then used to predict finger contact forces at the quarter-scale. The quarter-scale was identified as the break point in terms of the current RIT robotic grasping hand based on both manufacturing and actuation. A novel, prototype quarter-scale robotic hand assembly was successfully built by an additive manufacturing process, a high resolution 3D printer. However, further miniaturization would require alternate manufacturing techniques and actuation mechanisms

Factors of Micromanipulation Accuracy and Learning

Micromanipulation refers to the manipulation under a microscope in order to perform delicate procedures. It is difficult for humans to manipulate objects accurately under a microscope due to tremor and imperfect perception, limiting performance. This project seeks to understand factors affecting accuracy in micromanipulation, and to propose strategies for learning improving accuracy. Psychomotor experiments were conducted using computer-controlled setups to determine how various feedback modalities and learning methods can influence micromanipulation performance. In a first experiment, static and motion accuracy of surgeons, medical students and non-medical students under different magniification levels and grip force settings were compared. A second experiment investigated whether the non-dominant hand placed close to the target can contribute to accurate pointing of the dominant hand. A third experiment tested a training strategy for micromanipulation using unstable dynamics to magnify motion error, a strategy shown to be decreasing deviation in large arm movements. Two virtual reality (VR) modules were then developed to train needle grasping and needle insertion tasks, two primitive tasks in a microsurgery suturing procedure. The modules provided the trainee with a visual display in stereoscopic view and information on their grip, tool position and angles. Using the VR module, a study examining effects of visual cues was conducted to train tool orientation. Results from these studies suggested that it is possible to learn and improve accuracy in micromanipulation using appropriate sensorimotor feedback and training

Augmentation Of Human Skill In Microsurgery

Surgeons performing highly skilled microsurgery tasks can benefit from information and manual assistance to overcome technological and physiological limitations to make surgery safer, efficient, and more successful. Vitreoretinal surgery is particularly difficult due to inherent micro-scale and fragility of human eye anatomy. Additionally, surgeons are challenged by physiological hand tremor, poor visualization, lack of force sensing, and significant cognitive load while executing high-risk procedures inside the eye, such as epiretinal membrane peeling. This dissertation presents the architecture and the design principles for a surgical augmentation environment which is used to develop innovative functionality to address the fundamental limitations in vitreoretinal surgery. It is an inherently information driven modular system incorporating robotics, sensors, and multimedia components. The integrated nature of the system is leveraged to create intuitive and relevant human-machine interfaces and generate a particular system behavior to provide active physical assistance and present relevant sensory information to the surgeon. These include basic manipulation assistance, audio-visual and haptic feedback, intraoperative imaging and force sensing. The resulting functionality, and the proposed architecture and design methods generalize to other microsurgical procedures. The system's performance is demonstrated and evaluated using phantoms and in vivo experiments

On the application and generation of subsensory electrical nerve stimulation for the improvement of vibration perception in patients with HIV-related sensory neuropathy

This work investigates the application of Subsensory Electrical Noise Stimulation (SENS) to improve symptoms of HIV-related peripheral sensory neuropathy (HIVPN). HIV-PN occurs in roughly half of the 5 million people in South Africa with HIV. The disease has been shown to reduce quality of life and increase the risk of secondary ailments. Currently there is no treatment available. Previously, SENS has shown promise to improve tactile sensitivity in healthy populations and elderly individuals with peripheral neuropathic desensitisation. This work first establishes if SENS can improve the peripheral sensitivity of patients with HIV-PN, and secondly addresses practical aspects of using SENS in a therapeutic context. The vibrotactile sensitivity deficits of participants with HIV-PN and a matched control cohort is documented and analysed. It is found that HIV-PN participants have reduced sensitivity at all tested vibration frequencies (25 Hz, 50 Hz and 128 Hz), but especially at low frequencies. The interaction with vibration frequency indicates that HIV-PN may interact differently with different types of peripheral mechanoreceptors. SENS is then applied at four different amplitudes in an attempt to improve perception thresholds of the three vibration frequencies. SENS was shown to generally have a beneficial effect on 50 Hz vibration sensitivity for low SENS amplitudes. It had no effect, or a detrimental effect, at high SENS amplitudes, and also for 25 Hz and 128 Hz vibration frequencies. This work is also the first to document measures of pain with interventions of this type. No clear effects of SENS on sensations of pain were observed, which is a vital outcome if the therapy is to be developed further, since neuropathic pain is a frequent symptom of HIV-PN. The application of SENS as a practical therapy requires the accurate measurement of the participant’s electrical perception threshold, and a wearable device to apply the electrical signal on an ongoing basis. Research into the stability of electrical perception thresholds specifically aimed at subthreshold signals that would improve tactile sensitivity is presented. It was found that these thresholds vary wildly and correlated very little with possible explanatory variables, which introduces a new challenge for the development of SENS in future research. Currently there are no devices available to apply SENS in non-laboratory settings or for continuous use. The electronic design of a stimulator for using SENS as a wearable intervention is presented and characterised. The circuit is an efficient, low-power voltage to current converter that generates high voltages (120 V peak to peak) from a small, low-voltage rechargeable battery. The design and testing of control and instrumentation circuitry, as well as the addition of various safety and interface features is also documented. The battery life of the circuit is tested to operate for up to 33 hours and the circuit is tested to operate as expected in vivo. The results of this work demonstrate the potential viability of SENS as a therapy for HIV-PN, reveals the variability of electrical perception thresholds, explores the measures of pain for SENS interventions, and provides a complete and thoroughly tested design and implementation of an unparalleled electronic stimulator for nonlaboratory environments. The conclusions of this work form both a strong theoretical and practical basis for future SENS intervention research

Proceedings of the NASA Conference on Space Telerobotics, volume 1

The theme of the Conference was man-machine collaboration in space. Topics addressed include: redundant manipulators; man-machine systems; telerobot architecture; remote sensing and planning; navigation; neural networks; fundamental AI research; and reasoning under uncertainty

A continuum robotic platform for endoscopic non-contact laser surgery: design, control, and preclinical evaluation

The application of laser technologies in surgical interventions has been accepted in the clinical domain due to their atraumatic properties. In addition to manual application of fibre-guided lasers with tissue contact, non-contact transoral laser microsurgery (TLM) of laryngeal tumours has been prevailed in ENT surgery. However, TLM requires many years of surgical training for tumour resection in order to preserve the function of adjacent organs and thus preserve the patient’s quality of life. The positioning of the microscopic laser applicator outside the patient can also impede a direct line-of-sight to the target area due to anatomical variability and limit the working space. Further clinical challenges include positioning the laser focus on the tissue surface, imaging, planning and performing laser ablation, and motion of the target area during surgery. This dissertation aims to address the limitations of TLM through robotic approaches and intraoperative assistance. Although a trend towards minimally invasive surgery is apparent, no highly integrated platform for endoscopic delivery of focused laser radiation is available to date. Likewise, there are no known devices that incorporate scene information from endoscopic imaging into ablation planning and execution. For focusing of the laser beam close to the target tissue, this work first presents miniaturised focusing optics that can be integrated into endoscopic systems. Experimental trials characterise the optical properties and the ablation performance. A robotic platform is realised for manipulation of the focusing optics. This is based on a variable-length continuum manipulator. The latter enables movements of the endoscopic end effector in five degrees of freedom with a mechatronic actuation unit. The kinematic modelling and control of the robot are integrated into a modular framework that is evaluated experimentally. The manipulation of focused laser radiation also requires precise adjustment of the focal position on the tissue. For this purpose, visual, haptic and visual-haptic assistance functions are presented. These support the operator during teleoperation to set an optimal working distance. Advantages of visual-haptic assistance are demonstrated in a user study. The system performance and usability of the overall robotic system are assessed in an additional user study. Analogous to a clinical scenario, the subjects follow predefined target patterns with a laser spot. The mean positioning accuracy of the spot is 0.5 mm. Finally, methods of image-guided robot control are introduced to automate laser ablation. Experiments confirm a positive effect of proposed automation concepts on non-contact laser surgery.Die Anwendung von Lasertechnologien in chirurgischen Interventionen hat sich aufgrund der atraumatischen Eigenschaften in der Klinik etabliert. Neben manueller Applikation von fasergeführten Lasern mit Gewebekontakt hat sich die kontaktfreie transorale Lasermikrochirurgie (TLM) von Tumoren des Larynx in der HNO-Chirurgie durchgesetzt. Die TLM erfordert zur Tumorresektion jedoch ein langjähriges chirurgisches Training, um die Funktion der angrenzenden Organe zu sichern und damit die Lebensqualität der Patienten zu erhalten. Die Positionierung des mikroskopis chen Laserapplikators außerhalb des Patienten kann zudem die direkte Sicht auf das Zielgebiet durch anatomische Variabilität erschweren und den Arbeitsraum einschränken. Weitere klinische Herausforderungen betreffen die Positionierung des Laserfokus auf der Gewebeoberfläche, die Bildgebung, die Planung und Ausführung der Laserablation sowie intraoperative Bewegungen des Zielgebietes. Die vorliegende Dissertation zielt darauf ab, die Limitierungen der TLM durch robotische Ansätze und intraoperative Assistenz zu adressieren. Obwohl ein Trend zur minimal invasiven Chirurgie besteht, sind bislang keine hochintegrierten Plattformen für die endoskopische Applikation fokussierter Laserstrahlung verfügbar. Ebenfalls sind keine Systeme bekannt, die Szeneninformationen aus der endoskopischen Bildgebung in die Ablationsplanung und -ausführung einbeziehen. Für eine situsnahe Fokussierung des Laserstrahls wird in dieser Arbeit zunächst eine miniaturisierte Fokussieroptik zur Integration in endoskopische Systeme vorgestellt. Experimentelle Versuche charakterisieren die optischen Eigenschaften und das Ablationsverhalten. Zur Manipulation der Fokussieroptik wird eine robotische Plattform realisiert. Diese basiert auf einem längenveränderlichen Kontinuumsmanipulator. Letzterer ermöglicht in Kombination mit einer mechatronischen Aktuierungseinheit Bewegungen des Endoskopkopfes in fünf Freiheitsgraden. Die kinematische Modellierung und Regelung des Systems werden in ein modulares Framework eingebunden und evaluiert. Die Manipulation fokussierter Laserstrahlung erfordert zudem eine präzise Anpassung der Fokuslage auf das Gewebe. Dafür werden visuelle, haptische und visuell haptische Assistenzfunktionen eingeführt. Diese unterstützen den Anwender bei Teleoperation zur Einstellung eines optimalen Arbeitsabstandes. In einer Anwenderstudie werden Vorteile der visuell-haptischen Assistenz nachgewiesen. Die Systemperformanz und Gebrauchstauglichkeit des robotischen Gesamtsystems werden in einer weiteren Anwenderstudie untersucht. Analog zu einem klinischen Einsatz verfolgen die Probanden mit einem Laserspot vorgegebene Sollpfade. Die mittlere Positioniergenauigkeit des Spots beträgt dabei 0,5 mm. Zur Automatisierung der Ablation werden abschließend Methoden der bildgestützten Regelung vorgestellt. Experimente bestätigen einen positiven Effekt der Automationskonzepte für die kontaktfreie Laserchirurgie