A First Evaluation of a Multi-Modal Learning System to Control Surgical Assistant Robots via Action Segmentation

The next stage for robotics development is to introduce autonomy and cooperation with human agents in tasks that require high levels of precision and/or that exert considerable physical strain. To guarantee the highest possible safety standards, the best approach is to devise a deterministic automaton that performs identically for each operation. Clearly, such approach inevitably fails to adapt itself to changing environments or different human companions. In a surgical scenario, the highest variability happens for the timing of different actions performed within the same phases. This paper presents a cognitive control architecture that uses a multi-modal neural network trained on a cooperative task performed by human surgeons and produces an action segmentation that provides the required timing for actions while maintaining full phase execution control via a deterministic Supervisory Controller and full execution safety by a velocity-constrained Model-Predictive Controller

Gesture Recognition and Control for Semi-Autonomous Robotic Assistant Surgeons

The next stage for robotics development is to introduce autonomy and cooperation with human agents in tasks that require high levels of precision and/or that exert considerable physical strain. To guarantee the highest possible safety standards, the best approach is to devise a deterministic automaton that performs identically for each operation. Clearly, such approach inevitably fails to adapt itself to changing environments or different human companions. In a surgical scenario, the highest variability happens for the timing of different actions performed within the same phases. This thesis explores the solutions adopted in pursuing automation in robotic minimally-invasive surgeries (R-MIS) and presents a novel cognitive control architecture that uses a multi-modal neural network trained on a cooperative task performed by human surgeons and produces an action segmentation that provides the required timing for actions while maintaining full phase execution control via a deterministic Supervisory Controller and full execution safety by a velocity-constrained Model-Predictive Controller

Outcomes of a virtual-reality simulator-training programme on basic surgical skills in robot-assisted laparoscopic surgery

Background The utility of the virtual-reality robotic simulator in training programmes has not been clearly evaluated. Our aim was to evaluate the impact of a virtual-reality robotic simulator-training programme on basic surgical skills. Methods A simulator-training programme in robotic surgery, using the da Vinci Skills Simulator, was evaluated in a population including junior and seasoned surgeons, and non-physicians. Their performances on robotic dots and suturing-skin pod platforms before and after virtual-simulation training were rated anonymously by surgeons experienced in robotics. Results 39 participants were enrolled: 14 medical students and residents in surgery, 14 seasoned surgeons, 11 non-physicians. Junior and seasoned surgeons’ performances on platforms were not significantly improved after virtual-reality robotic simulation in any of the skill domains, in contrast to non-physicians. Conclusions The benefits of virtual-reality simulator training on several tasks to basic skills in robotic surgery were not obvious among surgeons in our initial and early experience with the simulator

Robot Autonomy for Surgery

Autonomous surgery involves having surgical tasks performed by a robot operating under its own will, with partial or no human involvement. There are several important advantages of automation in surgery, which include increasing precision of care due to sub-millimeter robot control, real-time utilization of biosignals for interventional care, improvements to surgical efficiency and execution, and computer-aided guidance under various medical imaging and sensing modalities. While these methods may displace some tasks of surgical teams and individual surgeons, they also present new capabilities in interventions that are too difficult or go beyond the skills of a human. In this chapter, we provide an overview of robot autonomy in commercial use and in research, and present some of the challenges faced in developing autonomous surgical robots

Implementation of a Surgical Robot Dynamical Simulation and Motion Planning Framework

The daVinci Research Kit (dVRK) is a research platform that consists of the clinical daVinci surgical robot, provided by Intuitive Surgical to Academic Institutions. It provides an open source software and hardware platform for researchers to study and analyze the current architecture and expand the capabilities of the existing technology. The line between general purpose robotics and medical robotics has segregated the two fields. A significant part of the segregation lies at the software end, where new tools and methods developed in general purpose robotics cannot make it to medical robotics in a short amount of time. This research focuses on the integration of a widely used software architecture for general purpose robotics with the dVRK with the hope of utilizing the research and development from one field to the other. As a first step towards this bridging, a motion planning framework and a dynamic simulator has been developed for the dVRK using ROS. The motion planning framework is aimed to assist the surgeon in performing task with additional safety and machine intelligence. A few use cases have been proposed as well. Lastly, a Matlab Interface has been developed that is standalone in terms of usage and provides capabilities to interact with dVRK

Medical Robotics

The first generation of surgical robots are already being installed in a number of operating rooms around the world. Robotics is being introduced to medicine because it allows for unprecedented control and precision of surgical instruments in minimally invasive procedures. So far, robots have been used to position an endoscope, perform gallbladder surgery and correct gastroesophogeal reflux and heartburn. The ultimate goal of the robotic surgery field is to design a robot that can be used to perform closed-chest, beating-heart surgery. The use of robotics in surgery will expand over the next decades without any doubt. Minimally Invasive Surgery (MIS) is a revolutionary approach in surgery. In MIS, the operation is performed with instruments and viewing equipment inserted into the body through small incisions created by the surgeon, in contrast to open surgery with large incisions. This minimizes surgical trauma and damage to healthy tissue, resulting in shorter patient recovery time. The aim of this book is to provide an overview of the state-of-art, to present new ideas, original results and practical experiences in this expanding area. Nevertheless, many chapters in the book concern advanced research on this growing area. The book provides critical analysis of clinical trials, assessment of the benefits and risks of the application of these technologies. This book is certainly a small sample of the research activity on Medical Robotics going on around the globe as you read it, but it surely covers a good deal of what has been done in the field recently, and as such it works as a valuable source for researchers interested in the involved subjects, whether they are currently “medical roboticists” or not