Prevalence of haptic feedback in robot-mediated surgery : a systematic review of literature

© 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of an article published in Journal of Robotic Surgery. The final authenticated version is available online at: https://doi.org/10.1007/s11701-017-0763-4With the successful uptake and inclusion of robotic systems in minimally invasive surgery and with the increasing application of robotic surgery (RS) in numerous surgical specialities worldwide, there is now a need to develop and enhance the technology further. One such improvement is the implementation and amalgamation of haptic feedback technology into RS which will permit the operating surgeon on the console to receive haptic information on the type of tissue being operated on. The main advantage of using this is to allow the operating surgeon to feel and control the amount of force applied to different tissues during surgery thus minimising the risk of tissue damage due to both the direct and indirect effects of excessive tissue force or tension being applied during RS. We performed a two-rater systematic review to identify the latest developments and potential avenues of improving technology in the application and implementation of haptic feedback technology to the operating surgeon on the console during RS. This review provides a summary of technological enhancements in RS, considering different stages of work, from proof of concept to cadaver tissue testing, surgery in animals, and finally real implementation in surgical practice. We identify that at the time of this review, while there is a unanimous agreement regarding need for haptic and tactile feedback, there are no solutions or products available that address this need. There is a scope and need for new developments in haptic augmentation for robot-mediated surgery with the aim of improving patient care and robotic surgical technology further.Peer reviewe

Methods and Tools for Objective Assessment of Psychomotor Skills in Laparoscopic Surgery

Training and assessment paradigms for laparoscopic surgical skills are evolving from traditional mentor–trainee tutorship towards structured, more objective and safer programs. Accreditation of surgeons requires reaching a consensus on metrics and tasks used to assess surgeons’ psychomotor skills. Ongoing development of tracking systems and software solutions has allowed for the expansion of novel training and assessment means in laparoscopy. The current challenge is to adapt and include these systems within training programs, and to exploit their possibilities for evaluation purposes. This paper describes the state of the art in research on measuring and assessing psychomotor laparoscopic skills. It gives an overview on tracking systems as well as on metrics and advanced statistical and machine learning techniques employed for evaluation purposes. The later ones have a potential to be used as an aid in deciding on the surgical competence level, which is an important aspect when accreditation of the surgeons in particular, and patient safety in general, are considered. The prospective of these methods and tools make them complementary means for surgical assessment of motor skills, especially in the early stages of training. Successful examples such as the Fundamentals of Laparoscopic Surgery should help drive a paradigm change to structured curricula based on objective parameters. These may improve the accreditation of new surgeons, as well as optimize their already overloaded training schedules

HUMAN-ROBOT COLLABORATION IN ROBOTIC-ASSISTED SURGICAL TRAINING

Ph.DDOCTOR OF PHILOSOPH

Robocatch: Design and Making of a Hand-Held Spillage-Free Specimen Retrieval Robot for Laparoscopic Surgery

Specimen retrieval is an important step in laparoscopy, a minimally invasive surgical procedure performed to diagnose and treat a myriad of medical pathologies in fields ranging from gynecology to oncology. Specimen retrieval bags (SRBs) are used to facilitate this task, while minimizing contamination of neighboring tissues and port-sites in the abdominal cavity. This manual surgical procedure requires usage of multiple ports, creating a traffic of simultaneous operations of multiple instruments in a limited shared workspace. The skill-demanding nature of this procedure makes it time-consuming, leading to surgeons’ fatigue and operational inefficiency. This thesis presents the design and making of RoboCatch, a novel hand-held robot that aids a surgeon in performing spillage-free retrieval of operative specimens in laparoscopic surgery. The proposed design significantly modifies and extends conventional instruments that are currently used by surgeons for the retrieval task: The core instrumentation of RoboCatch comprises a webbed three-fingered grasper and atraumatic forceps that are concentrically situated in a folded configuration inside a trocar. The specimen retrieval task is achieved in six stages: 1) The trocar is introduced into the surgical site through an instrument port, 2) the three webbed fingers slide out of the tube and simultaneously unfold in an umbrella like-fashion, 3) the forceps slide toward, and grasp, the excised specimen, 4) the forceps retract the grasped specimen into the center of the surrounding grasper, 5) the grasper closes to achieve a secured containment of the specimen, and 6) the grasper, along with the contained specimen, is manually removed from the abdominal cavity. The resulting reduction in the number of active ports reduces obstruction of the port-site and increases the procedure’s efficiency. The design process was initiated by acquiring crucial parameters from surgeons and creating a design table, which informed the CAD modeling of the robot structure and selection of actuation units and fabrication material. The robot prototype was first examined in CAD simulation and then fabricated using an Objet30 Prime 3D printer. Physical validation experiments were conducted to verify the functionality of different mechanisms of the robot. Further, specimen retrieval experiments were conducted with porcine meat samples to test the feasibility of the proposed design. Experimental results revealed that the robot was capable of retrieving masses of specimen ranging from 1 gram to 50 grams. The making of RoboCatch represents a significant step toward advancing the frontiers of hand-held robots for performing specimen retrieval tasks in minimally invasive surgery

Skill-based human-robot cooperation in tele-operated path tracking

This work proposes a shared-control tele-operation framework that adapts its cooperative properties to the estimated skill level of the operator. It is hypothesized that different aspects of an operatorâ\u80\u99s performance in executing a tele-operated path tracking task can be assessed through conventional machine learning methods using motion-based and task-related features. To identify performance measures that capture motor skills linked to the studied task, an experiment is conducted where users new to tele-operation, practice towards motor skill proficiency in 7 training sessions. A set of classifiers are then learned from the acquired data and selected features, which can generate a skill profile that comprises estimations of userâ\u80\u99s various competences. Skill profiles are exploited to modify the behavior of the assistive robotic system accordingly with the objective of enhancing user experience by preventing unnecessary restriction for skilled users. A second experiment is implemented in which novice and expert users execute the path tracking on different pathways while being assisted by the robot according to their estimated skill profiles. Results validate the skill estimation method and hint at feasibility of shared-control customization in tele-operated path tracking

TRAINING AND ASSESSMENT OF HAND-EYE COORDINATION WITH ELECTROENCEPHALOGRAPHY

Ph.DDOCTOR OF PHILOSOPH

Development and Validation of a Hybrid Virtual/Physical Nuss Procedure Surgical Trainer

With continuous advancements and adoption of minimally invasive surgery, proficiency with nontrivial surgical skills involved is becoming a greater concern. Consequently, the use of surgical simulation has been increasingly embraced by many for training and skill transfer purposes. Some systems utilize haptic feedback within a high-fidelity anatomically-correct virtual environment whereas others use manikins, synthetic components, or box trainers to mimic primary components of a corresponding procedure. Surgical simulation development for some minimally invasive procedures is still, however, suboptimal or otherwise embryonic. This is true for the Nuss procedure, which is a minimally invasive surgery for correcting pectus excavatum (PE) – a congenital chest wall deformity. This work aims to address this gap by exploring the challenges of developing both a purely virtual and a purely physical simulation platform of the Nuss procedure and their implications in a training context. This work then describes the development of a hybrid mixed-reality system that integrates virtual and physical constituents as well as an augmentation of the haptic interface, to carry out a reproduction of the primary steps of the Nuss procedure and satisfy clinically relevant prerequisites for its training platform. Furthermore, this work carries out a user study to investigate the system’s face, content, and construct validity to establish its faithfulness as a training platform

Clinical Considerations for Flexible Access Surgery

The expectation of excellence in health care in modern times continues to be challenged. Government and patients alike continue to demand superior health care with excellent treatment outcomes at minimal expense to their time and convenience. Although surgery is the most definitive treatment option in modern medicine, it can be the most demanding both physically and psychologically. The less invasive the procedure offered the more acceptable it has been shown to be to the patient more often with fewer complications attributed and a faster return to health (1). The positive impact of the minimally invasive concept on the healthcare system has been unfathomable. The domino effect created by the early results from laparoscopic surgery was felt not only across the surgical community but also the medical. Across different specialties, alternative novel therapeutic techniques were devised to overcome problems relating to the large operative procedures which struggled to cross over to the laparoscopic approach. The best example of this is in cardiovascular surgery, where image guided endovascular techniques have overcome the need for many of the once extensive operative procedures including the abdominal aortic aneurysm repair and the coronary bypass procedure. The risks and complications from these operative interventions remain significant and are still performed, though far less frequently than in the past. Selective aneurysms as well as primary coronary events are managed routinely through the endovascular technique with surgery being retained for the complex cases or the non-responders. It seems obvious in hindsight that given the choice of a small 5mm groin incision over a large 30cm open chest or abdominal incision which the public would choose, even with the greater long term benefits sometimes favoring the open approaches. Gastrointestinal endoscopy has the potential to move in the same direction. The use of the endoscope as a surgical tool rather than simply an investigative device has only recently been recognized, promoted through the concept of Natural Orifice Translumenal Endoscopic Surgery (NOTES). The technique aims to provide a cosmetic enhancement to routine surgical procedures by creating the access incision within a natural orifice. The endoscope provides the vision and the biopsy channels in-built are able to guide operative instruments to the target site to enable a therapeutic procedure to be undertaken. However, it would be naïve to believe that in the current state NOTES is anything but a fashionable research technique and far from routine clinical use. However, it’s most superior element, which has the potential to extend the boundaries of surgery aside from all else, is the flexibility of the platform. This thesis provides a detailed investigation into the use of the flexible endoscope as a surgical platform. It defines Flexible Access Surgery (FAS) as an all encompassing surgical technique which utilizes flexible platforms at its heart, describes some novel applications representative as examplars of the technique and explores the significant challenges which would hinder clinical translation. These challenges are described and integrated into two novel enhanced mechatronic flexible access surgical platforms which are further validated and trialed within the pre-clinical in-vivo setting as the future of flexible surgery. The major original contributions of this thesis include the description and definition of the flexible access technique with novel clinical applications. The design, construction and validation of a flexible access box simulator for describing flexible endoscopic navigation within a spatial environment highlighting the challenge this encompasses for many clinicians. The instrumental requirements are explored through the evaluation of the force requirements within the preclinical setting and the instrument refinement both in design and practice that can be adopted to optimize the force delivery particularly when relating to novel flexible platform designs. Finally, the thesis describes the integrated clinical design and validation of two enhanced mechatronic flexible access platforms and describes their clinically driven construction through a series of pre-clinical live in-vivo trials. The evolution of each device is described with performance evaluation and clinical exemplars undertaken. The impact of the results presented within this thesis and the potential for further high impact research is centered on the design and integration of future flexible robotic platforms for minimally invasive surgery. The clinical and mechanical requirements essential for optimal clinical performance will enable designs to be more clinically relevant and ultimately more clinically translatable in the future. Defining these requirements has entailed the use of mapping and sensing the relevant tools which has in turn exposed future potential research avenues to be opened into the perhaps more relevant real time evaluation of the surgical workflow, enabling clinical skills to be more reliably quantified during laparoscopic and endoscopic procedures

Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review

It is generally accepted that augmented feedback, provided by a human expert or a technical display, effectively enhances motor learning. However, discussion of the way to most effectively provide augmented feedback has been controversial. Related studies have focused primarily on simple or artificial tasks enhanced by visual feedback. Recently, technical advances have made it possible also to investigate more complex, realistic motor tasks and to implement not only visual, but also auditory, haptic, or multimodal augmented feedback. The aim of this review is to address the potential of augmented unimodal and multimodal feedback in the framework of motor learning theories. The review addresses the reasons for the different impacts of feedback strategies within or between the visual, auditory, and haptic modalities and the challenges that need to be overcome to provide appropriate feedback in these modalities, either in isolation or in combination. Accordingly, the design criteria for successful visual, auditory, haptic, and multimodal feedback are elaborate

Virtual reality training for micro-robotic cell injection

This research was carried out to fill the gap within existing knowledge on the approaches to supplement the training for micro-robotic cell injection procedure by utilising virtual reality and haptic technologies