Development and Validation of a Hybrid Virtual/Physical Nuss Procedure Surgical Trainer

With continuous advancements and adoption of minimally invasive surgery, proficiency with nontrivial surgical skills involved is becoming a greater concern. Consequently, the use of surgical simulation has been increasingly embraced by many for training and skill transfer purposes. Some systems utilize haptic feedback within a high-fidelity anatomically-correct virtual environment whereas others use manikins, synthetic components, or box trainers to mimic primary components of a corresponding procedure. Surgical simulation development for some minimally invasive procedures is still, however, suboptimal or otherwise embryonic. This is true for the Nuss procedure, which is a minimally invasive surgery for correcting pectus excavatum (PE) – a congenital chest wall deformity. This work aims to address this gap by exploring the challenges of developing both a purely virtual and a purely physical simulation platform of the Nuss procedure and their implications in a training context. This work then describes the development of a hybrid mixed-reality system that integrates virtual and physical constituents as well as an augmentation of the haptic interface, to carry out a reproduction of the primary steps of the Nuss procedure and satisfy clinically relevant prerequisites for its training platform. Furthermore, this work carries out a user study to investigate the system’s face, content, and construct validity to establish its faithfulness as a training platform

A Novel Haptic Simulator for Evaluating and Training Salient Force-Based Skills for Laparoscopic Surgery

Laparoscopic surgery has evolved from an \u27alternative\u27 surgical technique to currently being considered as a mainstream surgical technique. However, learning this complex technique holds unique challenges to novice surgeons due to their \u27distance\u27 from the surgical site. One of the main challenges in acquiring laparoscopic skills is the acquisition of force-based or haptic skills. The neglect of popular training methods (e.g., the Fundamentals of Laparoscopic Surgery, i.e. FLS, curriculum) in addressing this aspect of skills training has led many medical skills professionals to research new, efficient methods for haptic skills training. The overarching goal of this research was to demonstrate that a set of simple, simulator-based haptic exercises can be developed and used to train users for skilled application of forces with surgical tools. A set of salient or core haptic skills that underlie proficient laparoscopic surgery were identified, based on published time-motion studies. Low-cost, computer-based haptic training simulators were prototyped to simulate each of the identified salient haptic skills. All simulators were tested for construct validity by comparing surgeons\u27 performance on the simulators with the performance of novices with no previous laparoscopic experience. An integrated, \u27core haptic skills\u27 simulator capable of rendering the three validated haptic skills was built. To examine the efficacy of this novel salient haptic skills training simulator, novice participants were tested for training improvements in a detailed study. Results from the study demonstrated that simulator training enabled users to significantly improve force application for all three haptic tasks. Research outcomes from this project could greatly influence surgical skills simulator design, resulting in more efficient training

The Design of a Haptic Device for Training and Evaluating Surgeon and Novice Laparoscopic Movement Skills

As proper levels of force application are necessary to ensure patient safety, and training hours with an expert on live subjects are difficult, enhanced computer-based training is needed to teach the next generation of surgeons. Considering the role of touch in surgery, there is a need for a device capable of discerning the haptic ability of surgical trainees. This need is amplified by minimally invasive surgical techniques where a surgeon\u27s sense of tissue properties comes not directly through their own hands but indirectly through the tools. A haptic device capable of producing a realistic range of forces and motions that can be used to test the ability of users to replicate salient forces in specific maneuvers is proposed. This device also provides the opportunity to use inexpensive haptic trainers to educate surgeons about proper force application. A novel haptic device was designed and built to provide a simplified analogy of the forces and torques felt during free tool motion and constrained pushing, sweep with laparoscopic instruments. The device is realized as a single-degree-of-freedom robotic system controlled using real-time computer hardware and software. The details of the device design and the results of testing the design against the specifications are presented. A significant achievement in the design is the use of a two-camera vision system to sense the user placement of the input device. The capability of the device as a first-order screening tool to distinguish between novices and expert surgeons is described

Micro-motion controller

Micro-motions in surgical applications are small motions in the range of a few millimeters and are common in ophthalmic surgery, neurosurgery, and other surgeries which require precise manipulation over short distances. Robotic surgery is replacing traditional open surgery at a rapid pace due to the obvious health benefits, however, most of the robotic surgical tools use robotic motion controllers that are designed to work over a large portion of the human body, thus involving motion of the entire human arm at shoulder joint. This requirement to move a large inertial mass results in undesirable, unwanted, and imprecise motion. This senior design project has created a 2-axis micro-motion “capable” platform, where the device studies the most common linear, 2-D surgical micro-motion of pinched human fingers in a damped and un-damped state. Through a system of printed and modeled parts in combination with motors and encoders a microsurgical controller was developed which can provide location-based output on a screen. Mechanical damping was introduced to research potential stability of micro-motion in any surgeon’s otherwise unsteady hand. The device is to also serve as a starter set for future biomedical device research projects in Santa Clara University’s bioengineering department. Further developments in the microsurgical controller such as further scaling, addition of a third axis, haptic feedback through the microcontroller, and component encasing to allow productization for use on an industrial robotic surgical device for clinical applications

Haptics-Enabled Teleoperation for Robotics-Assisted Minimally Invasive Surgery

The lack of force feedback (haptics) in robotic surgery can be considered to be a safety risk leading to accidental tissue damage and puncturing of blood vessels due to excessive forces being applied to tissue and vessels or causing inefficient control over the instruments because of insufficient applied force. This project focuses on providing a satisfactory solution for introducing haptic feedback in robotics-assisted minimally invasive surgical (RAMIS) systems. The research addresses several key issues associated with the incorporation of haptics in a master-slave (teleoperated) robotic environment for minimally invasive surgery (MIS). In this project, we designed a haptics-enabled dual-arm (two masters - two slaves) robotic MIS testbed to investigate and validate various single-arm as well as dual-arm teleoperation scenarios. The most important feature of this setup is the capability of providing haptic feedback in all 7 degrees of freedom (DOF) required for RAMIS (3 translations, 3 rotations and pinch motion of the laparoscopic tool). The setup also enables the evaluation of the effect of replacing haptic feedback by other sensory cues such as visual representation of haptic information (sensory substitution) and the hypothesis that surgical outcomes may be improved by substituting or augmenting haptic feedback by such sensory cues

Haptic Enhancement of Sensorimotor Learning for Clinical Training Applications

Modern surgical training requires radical change with the advent of increasingly complex procedures, restricted working hours, and reduced ‘hands-on’ training in the operating theatre. Moreover, an increased focus on patient safety means there is a greater need to objectively measure proficiency in trainee surgeons. Indeed, the existing evidence suggests that surgical sensorimotor skill training is not adequate for modern surgery. This calls for new training methodologies which can increase the acquisition rate of sensorimotor skill. Haptic interventions offer one exciting possible avenue for enhancing surgical skills in a safe environment. Nevertheless, the best approach for implementing novel training methodologies involving haptic intervention within existing clinical training curricula has yet to be determined. This thesis set out to address this issue. In Chapter 2, the development of two novel tools which enable the implementation of bespoke visuohaptic environments within robust experimental protocols is described. Chapters 3 and 4 report the effects of intensive, long-term training on the acquisition of a compliance discrimination skill. The results indicate that active behaviour is intrinsically linked to compliance perception, and that long-term training can help to improve the ability of detecting compliance differences. Chapter 5 explores the effects of error augmentation and parameter space exploration on the learning of a complex novel task. The results indicate that error augmentation can help improve learning rate, and that physical workspace exploration may be a driver for motor learning. This research is a first step towards the design of objective haptic intervention strategies to help support the rapid acquisition of sensorimotor skill. The work has applications in clinical settings such as surgical training, dentistry and physical rehabilitation, as well as other areas such as sport

Serious Games and Mixed Reality Applications for Healthcare

Virtual reality (VR) and augmented reality (AR) have long histories in the healthcare sector, offering the opportunity to develop a wide range of tools and applications aimed at improving the quality of care and efficiency of services for professionals and patients alike. The best-known examples of VR–AR applications in the healthcare domain include surgical planning and medical training by means of simulation technologies. Techniques used in surgical simulation have also been applied to cognitive and motor rehabilitation, pain management, and patient and professional education. Serious games are ones in which the main goal is not entertainment, but a crucial purpose, ranging from the acquisition of knowledge to interactive training.These games are attracting growing attention in healthcare because of their several benefits: motivation, interactivity, adaptation to user competence level, flexibility in time, repeatability, and continuous feedback. Recently, healthcare has also become one of the biggest adopters of mixed reality (MR), which merges real and virtual content to generate novel environments, where physical and digital objects not only coexist, but are also capable of interacting with each other in real time, encompassing both VR and AR applications.This Special Issue aims to gather and publish original scientific contributions exploring opportunities and addressing challenges in both the theoretical and applied aspects of VR–AR and MR applications in healthcare

Augmented reality (AR) for surgical robotic and autonomous systems: State of the art, challenges, and solutions

Despite the substantial progress achieved in the development and integration of augmented reality (AR) in surgical robotic and autonomous systems (RAS), the center of focus in most devices remains on improving end-effector dexterity and precision, as well as improved access to minimally invasive surgeries. This paper aims to provide a systematic review of different types of state-of-the-art surgical robotic platforms while identifying areas for technological improvement. We associate specific control features, such as haptic feedback, sensory stimuli, and human-robot collaboration, with AR technology to perform complex surgical interventions for increased user perception of the augmented world. Current researchers in the field have, for long, faced innumerable issues with low accuracy in tool placement around complex trajectories, pose estimation, and difficulty in depth perception during two-dimensional medical imaging. A number of robots described in this review, such as Novarad and SpineAssist, are analyzed in terms of their hardware features, computer vision systems (such as deep learning algorithms), and the clinical relevance of the literature. We attempt to outline the shortcomings in current optimization algorithms for surgical robots (such as YOLO and LTSM) whilst providing mitigating solutions to internal tool-to-organ collision detection and image reconstruction. The accuracy of results in robot end-effector collisions and reduced occlusion remain promising within the scope of our research, validating the propositions made for the surgical clearance of ever-expanding AR technology in the future