Efficient RRT*-based Safety-Constrained Motion Planning for Continuum Robots in Dynamic Environments

Continuum robots, characterized by their high flexibility and infinite degrees of freedom (DoFs), have gained prominence in applications such as minimally invasive surgery and hazardous environment exploration. However, the intrinsic complexity of continuum robots requires a significant amount of time for their motion planning, posing a hurdle to their practical implementation. To tackle these challenges, efficient motion planning methods such as Rapidly Exploring Random Trees (RRT) and its variant, RRT*, have been employed. This paper introduces a unique RRT*-based motion control method tailored for continuum robots. Our approach embeds safety constraints derived from the robots' posture states, facilitating autonomous navigation and obstacle avoidance in rapidly changing environments. Simulation results show efficient trajectory planning amidst multiple dynamic obstacles and provide a robust performance evaluation based on the generated postures. Finally, preliminary tests were conducted on a two-segment cable-driven continuum robot prototype, confirming the effectiveness of the proposed planning approach. This method is versatile and can be adapted and deployed for various types of continuum robots through parameter adjustments

Annual Report 2018-2019

LETTER FROM THE DEAN I am pleased to share with you the 2018-19 College of Computing and Digital Media (CDM) annual report, highlighting the important work done by our faculty, students, and staff. We’ve said this before, and we’ll say it again: it was a big year. In 2018-19, programs across all three of our schools (Computing, Cinematic Arts, and Design) were ranked nationally. Our faculty were published in dozens of scholarly journals, screened their films over 100 times, and had their work exhibited globally. Student and alumni accomplishments included an Emmy nomination, a first place win in a Department of Energy competition, and features in trade publications--to name just a few. We worked to create new programs (including undergraduate and graduate comedy filmmaking programs in collaboration with The Second City) and continued our work in others (our NSF- funded Medical Informatics Experiences program celebrated its fifteenth year). Our makerspace, the Idea Realization Lab, clocked its 10,000th visit as we made plans to open a new IRL in Lincoln Park. And, we will continue to create the innovative programs and facilities that make us CDM. You can look forward to new programs like industrial design, and new labs that focus on everything from Internet of Things to design industry collaborations. I am proud of our CDM community, and I hope you feel that same sense of pride as you read through this report. David MillerDeanhttps://via.library.depaul.edu/cdmannual/1002/thumbnail.jp

Developing Intuitive, Closed-Loop, Teleoperative Control of Continuum Robotic Systems

This thesis presents a series of related new results in the area of continuum robot teleoperation and control. A new nonlinear control strategy for the teleoperation of extensible continuum robots is described. Previous attempts at controlling continuum robots have proven difficult due to the complexity of their system dynamics. Taking advantage of a previously developed dynamic model for a three-section, planar, continuum manipulator, we present an adaptation control-inspired law. Simulation and experimental results of a teleoperation scheme between a master device and an extensible continuum slave manipulator using the new controller are presented. Two novel user interface approaches to the teleoperation of continuum robots are also presented. In the first, mappings from a six Degree-of-Freedom (DoF) rigid-link robotic arm to a nine degree-of-freedom continuum robot are synthesized, analyzed, and implemented, focusing on their potential for creating an intuitive operational interface. Tests were conducted across a range of planar and spatial tasks, using fifteen participant operators. The results demonstrate the feasibility of the approach, and suggest that it can be effective independent of the prior robotics, gaming, or teleoperative experience of the operator. In the second teleoperation approach, a novel nine degree-of-freedom input device for the teleoperation of extensible continuum robots is introduced. As opposed to previous works limited by kinematically dissimilar master devices or restricted degrees-of-freedom, the device is capable of achieving configurations identical to a three section continuum robot, and simplifying the control of such manipulators. The thesis discusses the design of the control device and its construction. The implementation of the new master device is discussed and the effectiveness of the system is reported

Robotic manipulators for in situ inspections of jet engines

Jet engines need to be inspected periodically and, in some instances, repaired. Currently, some of these maintenance operations require the engine to be removed from the wing and dismantled, which has a significant associated cost. The capability of performing some of these inspections and repairs while the engine is on-wing could lead to important cost savings. However, existing technology for on-wing operations is limited, and does not suffice to satisfy some of the needs. In this work, the problem of performing on-wing operations such as inspection and repair is analysed, and after an extensive literature review, a novel robotic system for the on-wing insertion and deployment of probes or other tools is proposed. The system consists of a fine-positioner, which is a miniature and dexterous robotic manipulator; a gross-positioner, which is a device to insert the fine-positioner to the engine region of interest; an end-effector, such as a probe; a deployment mechanism, which is a passive device to ensure correct contact between probe and component; and a feedback system that provides information about the robot state for control. The research and development work conducted to address the main challenges to create this robotic system is presented in this thesis. The work is focussed on the fine-positioner, as it is the most relevant and complex part of the system. After a literature review of relevant work, and as part of the exploration of potential robot concepts for the system, the kinematic capabilities of concentric tube robots (CTRs) are first investigated. The complete set of stable trajectories that can be traced in follow-the-leader motion is discovered. A case study involving simulations and an experiment is then presented to showcase and verify the work. The research findings indicate that CTRs are not suitable for the fine-positioner. However, they show that CTRs with non-annular cross section can be used for the gross-positioner. In addition, the new trajectories discovered show promise in minimally invasive surgery (MIS). Soft robotic manipulators with fluidic actuation are then selected as the most suitable concept for the fine-positioner. The design of soft robotic manipulators with fluidic actuation is investigated from a general perspective. A general framework for the design of these devices is proposed, and a set of design principles are derived. These principles are first applied in a MIS case study to illustrate and verify the work. Finite element (FE) simulations are then reported to perform design optimisation, and thus complete the case study. The design study is then applied to determine the most suitable design for the fine-positioner. An additional analytical derivation is developed, followed by FE simulations, which extend those of the case study. Eventually, this work yields a final design of the fine-positioner. The final design found is different from existing ones, and is shown to provide an important performance improvement with respect to existing soft robots in terms of wrenches it can support. The control of soft and continuum robots relevant to the fine-positioner is also studied. The full kinematics of continuum robots with constant curvature bending and extending capabilities are first investigated, which correspond to a preliminary design concept conceived for the fine-positioner. Closed-form solutions are derived, closing an open problem. These kinematics, however, do not exactly match the final fine-positioner design selected. Thus, an alternative control approach based on closed-loop control laws is then adopted. For this, a mechanical model is first developed. Closed-loop control laws are then derived based on this mechanical model for planar operation of a segment of the fine-positioner. The control laws obtained represent the foundation for the subsequent development of control laws for a full fine-positioner operating in 3D. Furthermore, work on path planning for nonholonomic systems is also reported, and a new algorithm is presented, which can be applied for the insertion of the overall robotic system. Solutions to the other parts of the robotic system for on-wing operations are also reported. A gross-positioner consisting of a non-annular CTR is proposed. Solutions for a deployment mechanism are also presented. Potential feedback systems are outlined. In addition, methods for the fabrication of the systems are reported, and the electronics and systems required for the assembly of the different parts are described. Finally, the use of the robotic system to perform on-wing inspections in a representative case study is studied to determine the viability. Inspection strategies are shortlisted, and simulations and experiments are used to study them. The results, however, indicate that inspection is not viable since the signal to noise ratio is excessively low. Nonetheless, the robotic system proposed, and the research conducted, are still expected to be useful to perform a range of on-wing operations that require the insertion and deployment of a probe or other end-effector. In addition, the trajectories discovered for CTRs, the design found for the fine-positioner, and the advances on control, also have significant potential in MIS, where there is an important need for miniature robotic manipulators and similar devices.Open Acces

A continuum robotic platform for endoscopic non-contact laser surgery: design, control, and preclinical evaluation

The application of laser technologies in surgical interventions has been accepted in the clinical domain due to their atraumatic properties. In addition to manual application of fibre-guided lasers with tissue contact, non-contact transoral laser microsurgery (TLM) of laryngeal tumours has been prevailed in ENT surgery. However, TLM requires many years of surgical training for tumour resection in order to preserve the function of adjacent organs and thus preserve the patient’s quality of life. The positioning of the microscopic laser applicator outside the patient can also impede a direct line-of-sight to the target area due to anatomical variability and limit the working space. Further clinical challenges include positioning the laser focus on the tissue surface, imaging, planning and performing laser ablation, and motion of the target area during surgery. This dissertation aims to address the limitations of TLM through robotic approaches and intraoperative assistance. Although a trend towards minimally invasive surgery is apparent, no highly integrated platform for endoscopic delivery of focused laser radiation is available to date. Likewise, there are no known devices that incorporate scene information from endoscopic imaging into ablation planning and execution. For focusing of the laser beam close to the target tissue, this work first presents miniaturised focusing optics that can be integrated into endoscopic systems. Experimental trials characterise the optical properties and the ablation performance. A robotic platform is realised for manipulation of the focusing optics. This is based on a variable-length continuum manipulator. The latter enables movements of the endoscopic end effector in five degrees of freedom with a mechatronic actuation unit. The kinematic modelling and control of the robot are integrated into a modular framework that is evaluated experimentally. The manipulation of focused laser radiation also requires precise adjustment of the focal position on the tissue. For this purpose, visual, haptic and visual-haptic assistance functions are presented. These support the operator during teleoperation to set an optimal working distance. Advantages of visual-haptic assistance are demonstrated in a user study. The system performance and usability of the overall robotic system are assessed in an additional user study. Analogous to a clinical scenario, the subjects follow predefined target patterns with a laser spot. The mean positioning accuracy of the spot is 0.5 mm. Finally, methods of image-guided robot control are introduced to automate laser ablation. Experiments confirm a positive effect of proposed automation concepts on non-contact laser surgery.Die Anwendung von Lasertechnologien in chirurgischen Interventionen hat sich aufgrund der atraumatischen Eigenschaften in der Klinik etabliert. Neben manueller Applikation von fasergeführten Lasern mit Gewebekontakt hat sich die kontaktfreie transorale Lasermikrochirurgie (TLM) von Tumoren des Larynx in der HNO-Chirurgie durchgesetzt. Die TLM erfordert zur Tumorresektion jedoch ein langjähriges chirurgisches Training, um die Funktion der angrenzenden Organe zu sichern und damit die Lebensqualität der Patienten zu erhalten. Die Positionierung des mikroskopis chen Laserapplikators außerhalb des Patienten kann zudem die direkte Sicht auf das Zielgebiet durch anatomische Variabilität erschweren und den Arbeitsraum einschränken. Weitere klinische Herausforderungen betreffen die Positionierung des Laserfokus auf der Gewebeoberfläche, die Bildgebung, die Planung und Ausführung der Laserablation sowie intraoperative Bewegungen des Zielgebietes. Die vorliegende Dissertation zielt darauf ab, die Limitierungen der TLM durch robotische Ansätze und intraoperative Assistenz zu adressieren. Obwohl ein Trend zur minimal invasiven Chirurgie besteht, sind bislang keine hochintegrierten Plattformen für die endoskopische Applikation fokussierter Laserstrahlung verfügbar. Ebenfalls sind keine Systeme bekannt, die Szeneninformationen aus der endoskopischen Bildgebung in die Ablationsplanung und -ausführung einbeziehen. Für eine situsnahe Fokussierung des Laserstrahls wird in dieser Arbeit zunächst eine miniaturisierte Fokussieroptik zur Integration in endoskopische Systeme vorgestellt. Experimentelle Versuche charakterisieren die optischen Eigenschaften und das Ablationsverhalten. Zur Manipulation der Fokussieroptik wird eine robotische Plattform realisiert. Diese basiert auf einem längenveränderlichen Kontinuumsmanipulator. Letzterer ermöglicht in Kombination mit einer mechatronischen Aktuierungseinheit Bewegungen des Endoskopkopfes in fünf Freiheitsgraden. Die kinematische Modellierung und Regelung des Systems werden in ein modulares Framework eingebunden und evaluiert. Die Manipulation fokussierter Laserstrahlung erfordert zudem eine präzise Anpassung der Fokuslage auf das Gewebe. Dafür werden visuelle, haptische und visuell haptische Assistenzfunktionen eingeführt. Diese unterstützen den Anwender bei Teleoperation zur Einstellung eines optimalen Arbeitsabstandes. In einer Anwenderstudie werden Vorteile der visuell-haptischen Assistenz nachgewiesen. Die Systemperformanz und Gebrauchstauglichkeit des robotischen Gesamtsystems werden in einer weiteren Anwenderstudie untersucht. Analog zu einem klinischen Einsatz verfolgen die Probanden mit einem Laserspot vorgegebene Sollpfade. Die mittlere Positioniergenauigkeit des Spots beträgt dabei 0,5 mm. Zur Automatisierung der Ablation werden abschließend Methoden der bildgestützten Regelung vorgestellt. Experimente bestätigen einen positiven Effekt der Automationskonzepte für die kontaktfreie Laserchirurgie

A New Approach towards Non-holonomic Path Planning of Car-like Robots using Rapidly Random Tree Fixed Nodes(RRT*FN)

Autonomous car driving is gaining attention in industry and is also an ongoing research in scientific community. Assuming that the cars moving on the road are all autonomous, this thesis introduces an elegant approach to generate non-holonomic collision-free motion of a car connecting any two poses (configurations) set by the user. Particularly this thesis focusses research on "path-planning" of car-like robots in the presence of static obstacles. Path planning of car-like robots can be done using RRT and RRT*. Instead of generating the non-holonomic path between two sampled configurations in RRT, our approach finds a small incremental step towards the next random configuration. Since the incremental step can be in any direction we use RRT to guide the robot from start configuration to end configuration. This "easy-to-implement" mechanism provides flexibility for enabling standard plan- ners to solve for non-holonomic robots without much modifications. Thus, strength of such planners for car path planning can be easily realized. This thesis demon- strates this point by applying this mechanism for an effective variant of RRT called as RRT - Fixed Nodes (RRT*FN). Experiments are conducted by incorporating our mechanism into RRT*FN (termed as RRT*FN-NH) to show the effectiveness and quality of non-holonomic path gener- ated. The experiments are conducted for typical benchmark static environments and the results indicate that RRT*FN-NH is mostly finding the feasible non-holonomic solutions with a fixed number of nodes (satisfying memory requirements) at the cost of increased number of iterations in multiples of 10k. Thus, this thesis proves the applicability of mechanism for a highly constrained planner like RRT*-FN, where the path needs to be found with a fixed number of nodes. Although, comparing the algorithm (RRT*FN-NH) with other existing planners is not the focus of this thesis there are considerable advantages of the mechanism when applied to a planner. They are a) instantaneous non-holonomoic path generation using the strengths of that particular planner, b) ability to modify on-the-fly non-holomic paths, and c) simple to integrate with most of the existing planners. Moreover, applicability of this mechanism using RRT*-FN for non-holonomic path generation of a car is shown for a more realistic urban environments that have typical narrow curved roads. The experiments were done for actual road map obtained from google maps and the feasibility of non-holonomic path generation was shown for such environments. The typical number of iterations needed for finding such feasible solutions were also in multiple of 10k. Increasing speed profiles of the car was tested by limiting max speed and acceleration to see the effect on the number of iterations

Experiments in quasi-static manipulation of an elastic rod

The purpose of this dissertation is to experimentally validate a new approach to robotic manipulation of deformable objects. As a case study, it will focus on the manipulation of objects that can be modeled as Kirchhoff elastic rods, for example a metal wire that is held at each end by robotic grippers. Any curve traced by this wire when in static equilibrium can be described as the solution to an optimal control problem with boundary conditions that vary with the position and orientation of each gripper. Recent work has shown that the set of all local solutions to this problem over all possible boundary conditions is a smooth manifold of finite dimension that can be parameterized by a single chart, the coordinates for which have a direct interpretation as forces and torques. These coordinates-in principle-allow the problem of manipulation planning to be formulated as finding a path of the wire through its set of equilibrium configurations, something that was previously thought impossible and that has significant advantages. However, this approach has never before been applied to hardware experiments. We begin by considering a metal wire that is confined to a planar workspace. We derive global coordinates for this wire and characterize the extent to which they accurately describe its shape during robotic manipulation. In particular, we show that differences between predicted and observed manipulation (which can be quite large) derive primarily from small errors in the position and orientation of each robotic gripper. We reduce these differences in two ways. First, we give an algorithm for manipulation planning that locally minimizes sensitivity to errors in gripper placement. Second, we give a feedback control policy (based on force sensor data as well as on position and orientation estimates) that locally minimizes the sum-squared error between planned and observed paths in our global coordinate chart for the wire. We conclude by showing-again, with hardware experiments-that these results extend directly to enable robotic manipulation of a metal wire in a three-dimensional workspace

Improving Strength and Stability in Continuum Robots

Continuum robots, which are bio-inspired ’trunk-like’ robots, are characterized for their inherent compliance and range of motion. One of the key challenges in continuum robotics research is developing robots with sufficient strength and stability without adding additional weight or complexity to the design. The research conducted in this dissertation encompasses design and modeling strategies that address these challenges in strength and stability. This work improves three continuum robot actuation paradigms: (1) tendon-driven continuum robots (TDCR), (2) concentric tube robots (CTR), and (3) concentric push-pull robots (CPPR). The first chapter of contribution covers strategies for improving strength in TDCRs. The payload capacity and torsional stiffness of the robot can be improved by leveraging the geometry of the backbone design and tendon routing, with design choices experimentally validated on a robot prototype. The second chapter covers a new bending actuator, concentric precurved bellows (CPB), that are based upon CTR actuation. The high torsional stiffness of bellows geometry virtually eliminates the torsional compliance instability found in CTRs. Two bellows designs are developed for 3D printing and the mechanical properties of these designs are characterized through experiments on prototypes and in static finite element analysis. A torsionally rigid kinematic model is derived and validated on 3D printed prototypes. The third chapter of contribution covers the development and validation of a mechanics-based CPPR kinematics model. CPPRs are constructed from concentrically nested, asymmetrically patterned tubes that are fixed together at their distal tips. Relative translations between the tubes induces bending shapes from the robot. The model expands the possible design space of CPPRs by enabling the modeling of external loads, non-planar bending shapes, and CPPRs with more than two tubes. The model is validated on prototypes in loaded and unloaded experiments