CathSim: An Open-source Simulator for Autonomous Cannulation

Autonomous robots in endovascular operations have the potential to navigate circulatory systems safely and reliably while decreasing the susceptibility to human errors. However, there are numerous challenges involved with the process of training such robots such as long training duration due to sample inefficiency of machine learning algorithms and safety issues arising from the interaction between the catheter and the endovascular phantom. Physics simulators have been used in the context of endovascular procedures, but they are typically employed for staff training and generally do not conform to the autonomous cannulation goal. Furthermore, most current simulators are closed-source which hinders the collaborative development of safe and reliable autonomous systems. In this work, we introduce CathSim, an open-source simulation environment that accelerates the development of machine learning algorithms for autonomous endovascular navigation. We first simulate the high-fidelity catheter and aorta with the state-of-the-art endovascular robot. We then provide the capability of real-time force sensing between the catheter and the aorta in the simulation environment. We validate our simulator by conducting two different catheterisation tasks within two primary arteries using two popular reinforcement learning algorithms, Proximal Policy Optimization (PPO) and Soft Actor-Critic (SAC). The experimental results show that using our open-source simulator, we can successfully train the reinforcement learning agents to perform different autonomous cannulation tasks

Skill-based human-robot cooperation in tele-operated path tracking

This work proposes a shared-control tele-operation framework that adapts its cooperative properties to the estimated skill level of the operator. It is hypothesized that different aspects of an operatorâ\u80\u99s performance in executing a tele-operated path tracking task can be assessed through conventional machine learning methods using motion-based and task-related features. To identify performance measures that capture motor skills linked to the studied task, an experiment is conducted where users new to tele-operation, practice towards motor skill proficiency in 7 training sessions. A set of classifiers are then learned from the acquired data and selected features, which can generate a skill profile that comprises estimations of userâ\u80\u99s various competences. Skill profiles are exploited to modify the behavior of the assistive robotic system accordingly with the objective of enhancing user experience by preventing unnecessary restriction for skilled users. A second experiment is implemented in which novice and expert users execute the path tracking on different pathways while being assisted by the robot according to their estimated skill profiles. Results validate the skill estimation method and hint at feasibility of shared-control customization in tele-operated path tracking

Virtual reality training platform for flexible ureterorenoscopy interventions with a minimally invasive surgical robot

The total number of ureteroscopy (URS) interventions during the past years has dramatically increased due to the ongoing technological advances and the benefits associated with these techniques. However, the current URS procedure presents some drawbacks to urologic surgeons. The LITHOS project was created with the main objective of developing a surgical robotic system for flexible ureterorenoscopic lithotripsy interventions, offering a technological solution that meets the real needs of both patients and surgeons in this type of procedures. In this paper, a virtual reality environment for flexible ureterorenoscopy interventions is presented. The proposed environment provides a suitable training platform for surgeons manipulating the surgical robotic system

Superiority of Simulator-Based Training Compared With Conventional Training Methodologies in the Performance of Transseptal Catheterization

ObjectivesThis study aims to compare the performance of electrophysiology fellows in transseptal catheterization (TSP-C) after conventional (Conv-T) or simulator training (Sim-T).BackgroundCurrent training for TSP-C, an increasingly used procedure, relies on performance on patients with supervision by an experienced operator. Virtual reality, a new training option, could improve post-training performance.MethodsFellows inexperienced in TSP-C were enrolled and randomly assigned to Conv-T or Sim-T. The post-training performance of each fellow was evaluated and scored in 3 consecutive patient-based procedures by an experienced operator blinded to the fellow's training assignment.ResultsFourteen fellows were randomized to Conv-T (n = 7) or to Sim-T (n = 7) and, after training, performed 42 TSP-Cs independently. Training time was significantly longer for Conv-T than for Sim-T (median 30 days vs. 4 days; p = 0.0175). The Conv-T fellows had significantly lower post-training performance scores (median 68 vs. 95; p = 0.0001) and a higher number of recurrent errors (median 3 vs. 0; p = 0.0006) when compared with Sim-T fellows.ConclusionsThe TSP-C training with virtual reality results in shorter training times and superior post-training performance

A sensorized modular training platform to reduce vascular damage in endovascular surgery

Purpose Endovascular interventions require intense practice to develop sufficient dexterity in catheter handling within the human body. Therefore, we present a modular training platform, featuring 3D-printed vessel phantoms with patient-specific anatomy and integrated piezoresistive impact force sensing of instrument interaction at clinically relevant locations for feedback-based skill training to detect and reduce damage to the delicate vascular wall. Methods The platform was fabricated and then evaluated in a user study by medical (n=10) and non-medical (n=10) users. The users had to navigate a set of guidewire and catheter through a parkour of 3 modules including an aneurismatic abdominal aorta, while impact force and completion time were recorded. Eventually, a questionnaire was conducted. Results The platform allowed to perform more than 100 runs in which it proved capable to distinguish between users of different experience levels. Medical experts in the fields of vascular and visceral surgery had a strong performance assessment on the platform. It could be shown, that medical students could improve runtime and impact over 5 runs. The platform was well received and rated as promising for medical education despite the experience of higher friction compared to real human vessels. Conclusion We investigated an authentic patient-specific training platform with integrated sensor-based feedback functionality for individual skill training in endovascular surgery. The presented method for phantom manufacturing is easily applicable to arbitrary patient-individual imaging data. Further work shall address the implementation of smaller vessel branches, as well as real-time feedback and camera imaging for further improved training experience

An Inexpensive Cardiovascular Flow Simulator for Cardiac Catheterization Procedure Using a Pulmonary Artery Catheter

Cardiac catheterization associated with central vein cannulation can involve potential thrombotic and infectious complications due to multiple cannulation trials or improper placement. To minimize the risks, medical simulators are used for training. Simulators are also employed to test medical devices such as catheters before performing animal tests because they are more cost-effective and still reveal necessary improvements. However, commercial simulators are expensive, simplified for their purpose, and provide limited access sites. Inexpensive and anatomical cardiovascular simulators with central venous access for cannulation are sparse. Here, we developed an anatomically and physiologically accurate cardiovascular flow simulator to help train medical professionals and test medical devices. Our simulator includes an anatomical right atrium/ventricle, femoral and radial access sites, and considers the variability of arm position. It simulates physiological pulsatile blood flow with a setting for constant flow from 3 to 6 L/min and mimics physiological temperature (37◦C). We demonstrated simulation by inserting a catheter into the system at radial/femoral access sites, passing it through the vasculature, and advancing it into the heart. We expect that our simulator can be used as an educational tool for cardiac catheterization as well as a testing tool that will allow for design iteration before moving to animal trials

The Use of Tactile Sensors in Oral and Maxillofacial Surgery: An Overview

Background: This overview aimed to characterize the type, development, and use of haptic technologies for maxillofacial surgical purposes. The work aim is to summarize and evaluate current advantages, drawbacks, and design choices of presented technologies for each field of application in order to address and promote future research as well as to provide a global view of the issue. Methods: Relevant manuscripts were searched electronically through Scopus, MEDLINE/PubMed, and Cochrane Library databases until 1 November 2022. Results: After analyzing the available literature, 31 articles regarding tactile sensors and interfaces, sensorized tools, haptic technologies, and integrated platforms in oral and maxillofacial surgery have been included. Moreover, a quality rating is provided for each article following appropriate evaluation metrics. Discussion: Many efforts have been made to overcome the technological limits of computed assistant diagnosis, surgery, and teaching. Nonetheless, a research gap is evident between dental/maxillofacial surgery and other specialties such as endovascular, laparoscopic, and microsurgery; especially for what concerns electrical and optical-based sensors for instrumented tools and sensorized tools for contact forces detection. The application of existing technologies is mainly focused on digital simulation purposes, and the integration into Computer Assisted Surgery (CAS) is far from being widely actuated. Virtual reality, increasingly adopted in various fields of surgery (e.g., sino-nasal, traumatology, implantology) showed interesting results and has the potential to revolutionize teaching and learning. A major concern regarding the actual state of the art is the absence of randomized control trials and the prevalence of case reports, retrospective cohorts, and experimental studies. Nonetheless, as the research is fast growing, we can expect to see many developments be incorporated into maxillofacial surgery practice, after adequate evaluation by the scientific community

Development and evaluation of hand-held robotic technology for safe and successful peripheral intravenous catheterization on pediatric patients

Peripheral IntraVenous Catheterization (PIVC) is often required in hospitals to fulfil urgent needs of blood sampling or fluid/medication administration. Despite of the importance of a high success rate, the conventional PIVC operation suffers from low insertion accuracy especially on young pediatric patients. On average, each pediatric patient is submitted to 2.1 attempts before venous access is obtained, with around 50% failure for the first attempt. The risks of such multiple attempts can be severe and life-threatening as they can cause serious extravasation injuries. Given the levels of precision and controllability needed for PIVC, robotic systems show a good potential to effectively assist the operation and improve its success rate. Therefore, this study aims to provide such robotic assistance by focusing on the most challenging and error-prone parts of the operation. In order to understand the difficulties of a pediatric PIVC, a survey investigation is conducted with specialists at the beginning of this research. The feedbacks from this survey indicates an urgent need of a hand-held robot to assist in the catheter insertion control to precisely access the target vein. To achieve the above goal, a novel venipuncture detection system based on sensing the electrical impedance of the contacting tissue at the needle tip has been proposed and developed. Then several ex-vivo and in-vivo experiments were conducted to assess this detection system. Experimental results show that this system can be highly effective to detect venipuncture. Subsequently, based on this venipuncture detection system, four different handheld robots have been developed to provide different levels of autonomy and assistance while executing a PIVC insertion: 1. SVEI, short for \u2018Smart Venous Enter Indicator\u2019, is the simplest device without actuation. The user needs to do the whole PIVC operation, and this device only provides an indication of venipuncture by lighting up an LED. 5 2. SAID, short for \u2018Semi-Autonomous Intravenous access Device\u2019, integrates a motor to control the catheter insertion. The user is required to hold the device still and target it to a vein site. He/She then activates the device. The device inserts the catheter automatically and stops it when venipuncture is detected. 3. SDOP, short for \u2018Smart hand-held Device for Over-puncture Prevention\u2019, integrates a latch-based disengage mechanism to prevent over-puncture during PIVC. The user can keep the conventional way of operation and do the insertion manually. At the moment of venipuncture, the device automatically activates the disengage mechanism to stop further advancement of the catheter. 4. CathBot represents \u2018hand-held roBot for peripheral intravenous Catheterization\u2019. The device uses a crank-slider mechanism and a solenoid actuator to convert the complicated intravenous catheterization motion to a simple linear forward motion. The user just needs to push the device\u2019s handle forwards and the device completes the whole PIVC insertion procedure automatically. All the devices were characterized to ensure they can satisfy the design specifications. Then a series of comparative experiments were conducted to assess each of them. In the first experiment, 25 na\uefve subjects were invited to perform 10 trials of PIVC on a realistic baby arm phantom. The subjects were divided into 5 groups, and each group was asked to do the PIVC with one device only (SVEI, SAID, SDOP, CathBot and regular iv catheter). The experimental results show that all devices can provide the needed assistance to significantly facilitate and improve the success rates compared to the conventional method. People who have no experience of PIVC operation before can achieve considerably high success rates in robot-assisted PIVC (86% with SVEI, 80% with SAID, 78% with SDOP and 84% with CathBot) compared to the control group (12%) who used a regular iv catheter. Also, all 5 subjects using SVEI, 3 out of 5 subjects using SAID, 2 out of 5 subjects using SDOP and 4 out of 5 subjects using CathBot were able to successfully catheterize the baby arm phantom on their first attempt, while no subjects in the control group succeeded in their first attempts. Since SVEI showed the best results, it was selected for the second round of evaluation. In the second experiment, clinicians including both PIVC experts and general clinicians were invited to perform PIVC on a realistic baby arm phantom with 3 trials using SVEI and 3 trials in the conventional way. The results demonstrate that SVEI can bring great benefits to both specialists and general clinicians. The average success rates were found to be significantly improved from 48.3% to 71.7% when SVEI was used. The experimental results reveal that all experts achieved better or equal results with SVEI compared to the conventional method, and 9 out of 12 non-experts also had better or equal performance when SVEI was used. Finally, subjective feedback acquired through post-trial questionnaires showed that all devices were highly rated in terms of usability. Overall, the results of this doctoral research support continued investment in the technology to bring the handheld robotic devices closer to clinical us

Virtual and Augmented Reality in Medical Education

Virtual reality (VR) and augmented reality (AR) are two contemporary simulation models that are currently upgrading medical education. VR provides a 3D and dynamic view of structures and the ability of the user to interact with them. The recent technological advances in haptics, display systems, and motion detection allow the user to have a realistic and interactive experience, enabling VR to be ideal for training in hands-on procedures. Consequently, surgical and other interventional procedures are the main fields of application of VR. AR provides the ability of projecting virtual information and structures over physical objects, thus enhancing or altering the real environment. The integration of AR applications in the understanding of anatomical structures and physiological mechanisms seems to be beneficial. Studies have tried to demonstrate the validity and educational effect of many VR and AR applications, in many different areas, employed via various hardware platforms. Some of them even propose a curriculum that integrates these methods. This chapter provides a brief history of VR and AR in medicine, as well as the principles and standards of their function. Finally, the studies that show the effect of the implementation of these methods in different fields of medical training are summarized and presented