A Review of Pneumatic Actuators Used for the Design of Medical Simulators and Medical Tools

International audienc

Surgical Subtask Automation for Intraluminal Procedures using Deep Reinforcement Learning

Intraluminal procedures have opened up a new sub-field of minimally invasive surgery that use flexible instruments to navigate through complex luminal structures of the body, resulting in reduced invasiveness and improved patient benefits. One of the major challenges in this field is the accurate and precise control of the instrument inside the human body. Robotics has emerged as a promising solution to this problem. However, to achieve successful robotic intraluminal interventions, the control of the instrument needs to be automated to a large extent. The thesis first examines the state-of-the-art in intraluminal surgical robotics and identifies the key challenges in this field, which include the need for safe and effective tool manipulation, and the ability to adapt to unexpected changes in the luminal environment. To address these challenges, the thesis proposes several levels of autonomy that enable the robotic system to perform individual subtasks autonomously, while still allowing the surgeon to retain overall control of the procedure. The approach facilitates the development of specialized algorithms such as Deep Reinforcement Learning (DRL) for subtasks like navigation and tissue manipulation to produce robust surgical gestures. Additionally, the thesis proposes a safety framework that provides formal guarantees to prevent risky actions. The presented approaches are evaluated through a series of experiments using simulation and robotic platforms. The experiments demonstrate that subtask automation can improve the accuracy and efficiency of tool positioning and tissue manipulation, while also reducing the cognitive load on the surgeon. The results of this research have the potential to improve the reliability and safety of intraluminal surgical interventions, ultimately leading to better outcomes for patients and surgeons

Shared-Control Teleoperation Paradigms on a Soft Growing Robot Manipulator

Semi-autonomous telerobotic systems allow both humans and robots to exploit their strengths, while enabling personalized execution of a task. However, for new soft robots with degrees of freedom dissimilar to those of human operators, it is unknown how the control of a task should be divided between the human and robot. This work presents a set of interaction paradigms between a human and a soft growing robot manipulator, and demonstrates them in both real and simulated scenarios. The robot can grow and retract by eversion and inversion of its tubular body, a property we exploit to implement interaction paradigms. We implemented and tested six different paradigms of human-robot interaction, beginning with full teleoperation and gradually adding automation to various aspects of the task execution. All paradigms were demonstrated by two expert and two naive operators. Results show that humans and the soft robot manipulator can split control along degrees of freedom while acting simultaneously. In the simple pick-and-place task studied in this work, performance improves as the control is gradually given to the robot, because the robot can correct certain human errors. However, human engagement and enjoyment may be maximized when the task is at least partially shared. Finally, when the human operator is assisted by haptic feedback based on soft robot position errors, we observed that the improvement in performance is highly dependent on the expertise of the human operator.Comment: 15 pages, 14 figure

Determination of critical factors for fast and accurate 2D medical image deformation

The advent of medical imaging technology enabled physicians to study patient anatomy non-invasively and revolutionized the medical community. As medical images have become digitized and the resolution of these images has increased, software has been developed to allow physicians to explore their patients\u27 image studies in an increasing number of ways by allowing viewing and exploration of reconstructed three-dimensional models. Although this has been a boon to radiologists, who specialize in interpreting medical images, few software packages exist that provide fast and intuitive interaction for other physicians. In addition, although the users of these applications can view their patient data at the time the scan was taken, the placement of the tissues during a surgical intervention is often different due to the position of the patient and methods used to provide a better view of the surgical field. None of the commonly available medical image packages allow users to predict the deformation of the patient\u27s tissues under those surgical conditions. This thesis analyzes the performance and accuracy of a less computationally intensive yet physically-based deformation algorithm- the extended ChainMail algorithm. The proposed method allows users to load DICOM images from medical image studies, interactively classify the tissues in those images according to their properties under deformation, deform the tissues in two dimensions, and visualize the result. The method was evaluated using data provided by the Truth Cube experiment, where a phantom made of material with properties similar to liver under deformation was placed under varying amounts of uniaxial strain. CT scans were before and after the deformations. The deformation was performed on a single DICOM image from the study that had been manually classified as well as on data sets generated from that original image. These generated data sets were ideally segmented versions of the phantom images that had been scaled to varying fidelities in order to evaluate the effect of image size on the algorithm\u27s accuracy and execution time. Two variations of the extended ChainMail algorithm parameters were also implemented for each of the generated data sets in order to examine the effect of the parameters. The resultant deformations were compared with the actual deformations as determined by the Truth Cube experimenters. For both variations of the algorithm parameters, the predicted deformations at 5% uniaxial strain had an RMS error of a similar order of magnitude to the errors in a finite element analysis performed by the truth cube experimenters for the deformations at 18.25% strain. The average error was able to be reduced by approximately between 10-20% for the lower fidelity data sets through the use of one of the parameter schemes, although the benefit decreased as the image size increased. When the algorithm was evaluated under 18.25% strain, the average errors were more than 8 y times that of the errors in the finite element analysis. Qualitative analysis of the deformed images indicated differing degrees of accuracy across the ideal image set, with the largest displacements estimated closer to the initial point of deformation. This is hypothesized to be a result of the order in which deformation was processed for points in the image. The algorithm execution time was examined for the varying generated image fidelities. For a generated image that was approximately 18.5% of the size of the tissue in the original image, the execution time was less than 15 seconds. In comparison, the algorithm processing time for the full-scale image was over 3 y hours. The analysis of the extended ChainMail algorithm for use in medical image deformation emphasizes the importance of the choice of algorithm parameters on the accuracy of the deformations and of data set size on the processing time

Control of Nonlinear Mechatronic Systems

This dissertation is divided into four self-contained chapters. In Chapter 1, an adaptive nonlinear tracking controller for kinematically redundant robot manipulators is presented. Past research efforts have focused on the end-effector tracking control of redundant robots because of their increased dexterity over their non-redundant counterparts. This work utilizes an adaptive full-state feedback quaternion based controller developed in [1] and focuses on the design of a general sub-task controller. This sub-task controller does not affect the position and orientation tracking control objectives, but instead projects a preference on the configuration of the manipulator based on sub-task objectives such as the following: singularity avoidance, joint limit avoidance, bounding the impact forces, and bounding the potential energy. In Chapter 2, two controllers are developed for nonlinear haptic and teleoperator systems for coordination of the master and slave systems. The first controller is proven to yield a semi-global asymptotic result in the presence of parametric uncertainty in the master and the slave dynamic models provided the user and the environmental input forces are measurable. The second controller yields a global asymptotic result despite unmeasurable user and environmental input forces provided the dynamic models of the master and slave systems are known. These controllers rely on a transformation and a flexible target system to allow the master system\u27s impedance to be easily adjusted so that it matches a desired target system. This work also offers a structure to encode a velocity field assist mechanism to provide the user help in controlling the slave system in completing a pre-defined contour following task. For each controller, Lyapunov-based techniques are used to prove that both controllers provide passive coordination of the haptic/teleoperator system when the velocity field assist mechanism is disabled. When the velocity field assist mechanism is enabled, the analysis proves the coordination of the haptic/teleoperator system. Simulation results are presented for both controllers. In Chapter 3, two controllers are developed for flat multi-input/multi-output nonlinear systems. First, a robust adaptive controller is proposed and proven to yield semi-global asymptotic tracking in the presence of additive disturbances and parametric uncertainty. In addition to guaranteeing an asymptotic output tracking result, it is also proven that the parameter estimate vector is driven to a constant vector. In the second part of the chapter, a learning controller is designed and proven to yield a semi-global asymptotic tracking result in the presence of additive disturbances where the desired trajectory is periodic. A continuous nonlinear integral feedback component is utilized in the design of both controllers and Lyapunov-based techniques are used to guarantee that the tracking error is asymptotically driven to zero. Numerical simulation results are presented for both controllers. In Chapter 4, a new dynamic model for continuum robot manipulators is derived. The dynamic model is developed based on the geometric model of extensible continuum robot manipulators with no torsional effects. The development presented in this chapter is an extension of the dynamic model proposed in [2] (by Mochiyama and Suzuki) to include a class of extensible continuum robot manipulators. First, the kinetic energy of a slice of the continuum robot is evaluated. Next, the total kinetic energy of the manipulator is obtained by utilizing a limit operation (i.e., sum of the kinetic energy of all the slices). Then, the gravitational potential energy of the manipulator is derived. Next, the elastic potential energy of the manipulator is derived for both bending and extension. Finally, the dynamic model of a planar 3-section extensible continuum robot manipulator is derived by utilizing the Lagrange representation. Numerical simulation results are presented for a planar 3-section extensible continuum robot manipulator