Modeling, Control, and Motion Analysis of a Class of Extensible Continuum Manipulators

In this dissertation, the development of a kinematic model, a configuration-space controller, a master-slave teleoperation controller, along with the analysis of the self-motion properties for redundant, extensible, continuous backbone (continuum) ``trunk and tentacle\u27 manipulators are detailed. Unlike conventional rigid-link robots, continuum manipulators are robots that can bend at any point along their backbone, resulting in new and unique modeling and control issues. Taken together, these chapters represent one of the first efforts towards devising model-based controllers of such robots, as well as characterizing their self-motion in its simplest form. Chapter 2 describes the development of a convenient set of generalized, spatial forward kinematics for extensible continuum manipulators based on the robot\u27s measurable variables. This development, takes advantage of the standard constant curvature assumption made for such manipulators and is simpler and more intuitive than the existing kinematic derivations which utilize a pseudo-rigid link manipulator. In Chapter 3, a new control strategy for continuum robots is presented. Control of this emerging new class of robots has proved difficult due to the inherent complexity of their dynamics. Using a recently established full Lagrangian dynamic model, a new nonlinear model-based control strategy (sliding-mode control) for continuum robots is introduced. Simulation results are illustrated using the dynamic model of a three-section, six Degree-of-Freedom, planar continuum robot and an experiment was conducted on the OctArm 9 Degree-of-Freedom continuum manipulator. In both the simulation and experiment, the results of the sliding-mode controller were found to be significantly better than a standard inverse-dynamics PD controller. In Chapter 4, the nature of continuum manipulator self-motion is studied. While use of the redundant continuum manipulator self-motion property (configuration changes which leave the end-effector location fixed) has been proposed, the nature of their null-spaces has not previously been explored. The manipulator related resolved-motion rate inverse kinematics which are based on the forward kinematics described in Chapter 2, are used. Based on these derivations, the self-motion of a 2-section, extensible redundant continuum manipulator in planar and spatial situations (generalizable to n-sections) is analyzed. The existence of a single self-motion manifold underlying the structures is proven, and simple self-motion cases spanning the null-space are introduced. The results of this analysis allow for a better understanding of general continuum robot self-motions and relate their underlying structure to real world examples and applications. The results are supported by experimental validation of the self-motion properties on the 9 Degree-of-Freedom OctArm continuum manipulator. In Chapter 5, teleoperation control of a kinematically redundant, continuum slave robot by a non-redundant, rigid-link master system is described. This problem is novel because the self-motion of the redundant robot can be utilized to achieve secondary control objectives while allowing the user to only control the tip of the slave system. To that end, feedback linearizing controllers are proposed for both the master and slave systems, whose effectiveness is demonstrated using numerical simulations and experimental results (using the 9 Degree-of-Freedom OctArm continuum manipulator as the slave system) for trajectory tracking as well as singularity avoidance subtask

Developing Intuitive, Closed-Loop, Teleoperative Control of Continuum Robotic Systems

This thesis presents a series of related new results in the area of continuum robot teleoperation and control. A new nonlinear control strategy for the teleoperation of extensible continuum robots is described. Previous attempts at controlling continuum robots have proven difficult due to the complexity of their system dynamics. Taking advantage of a previously developed dynamic model for a three-section, planar, continuum manipulator, we present an adaptation control-inspired law. Simulation and experimental results of a teleoperation scheme between a master device and an extensible continuum slave manipulator using the new controller are presented. Two novel user interface approaches to the teleoperation of continuum robots are also presented. In the first, mappings from a six Degree-of-Freedom (DoF) rigid-link robotic arm to a nine degree-of-freedom continuum robot are synthesized, analyzed, and implemented, focusing on their potential for creating an intuitive operational interface. Tests were conducted across a range of planar and spatial tasks, using fifteen participant operators. The results demonstrate the feasibility of the approach, and suggest that it can be effective independent of the prior robotics, gaming, or teleoperative experience of the operator. In the second teleoperation approach, a novel nine degree-of-freedom input device for the teleoperation of extensible continuum robots is introduced. As opposed to previous works limited by kinematically dissimilar master devices or restricted degrees-of-freedom, the device is capable of achieving configurations identical to a three section continuum robot, and simplifying the control of such manipulators. The thesis discusses the design of the control device and its construction. The implementation of the new master device is discussed and the effectiveness of the system is reported

Nonlinear Control Techniques for Robot Manipulators

This Masters thesis describes the design and implementation of control strategies for the following topics of research: i) Whole Arm Grasping Control for Redundant Robot Manipulators, ii) Neural Network Grasping Controller for Continuum Robots and, iii) Coordination Control for Haptic and Teleoperator Systems. An approach to whole arm grasping of objects using redundant robot manipulators is presented. A kinematic control which facilitates the encoding of both the end-effector position, as well as body self-motion positioning information as a desired trajectory signal for the manipulator joints is developed. An approach is presented to whole arm grasping control for continuum robots. The grasping controller is developed in two stages; high level path planning for the grasping objective, and a low level joint controller using a neural network feedforward component to compensate for dynamic uncertainties. Lastly, two controllers are developed for nonlinear haptic and teleoperator systems for coordination of the master and slave systems

Control of Nonlinear Mechatronic Systems

This dissertation is divided into four self-contained chapters. In Chapter 1, an adaptive nonlinear tracking controller for kinematically redundant robot manipulators is presented. Past research efforts have focused on the end-effector tracking control of redundant robots because of their increased dexterity over their non-redundant counterparts. This work utilizes an adaptive full-state feedback quaternion based controller developed in [1] and focuses on the design of a general sub-task controller. This sub-task controller does not affect the position and orientation tracking control objectives, but instead projects a preference on the configuration of the manipulator based on sub-task objectives such as the following: singularity avoidance, joint limit avoidance, bounding the impact forces, and bounding the potential energy. In Chapter 2, two controllers are developed for nonlinear haptic and teleoperator systems for coordination of the master and slave systems. The first controller is proven to yield a semi-global asymptotic result in the presence of parametric uncertainty in the master and the slave dynamic models provided the user and the environmental input forces are measurable. The second controller yields a global asymptotic result despite unmeasurable user and environmental input forces provided the dynamic models of the master and slave systems are known. These controllers rely on a transformation and a flexible target system to allow the master system\u27s impedance to be easily adjusted so that it matches a desired target system. This work also offers a structure to encode a velocity field assist mechanism to provide the user help in controlling the slave system in completing a pre-defined contour following task. For each controller, Lyapunov-based techniques are used to prove that both controllers provide passive coordination of the haptic/teleoperator system when the velocity field assist mechanism is disabled. When the velocity field assist mechanism is enabled, the analysis proves the coordination of the haptic/teleoperator system. Simulation results are presented for both controllers. In Chapter 3, two controllers are developed for flat multi-input/multi-output nonlinear systems. First, a robust adaptive controller is proposed and proven to yield semi-global asymptotic tracking in the presence of additive disturbances and parametric uncertainty. In addition to guaranteeing an asymptotic output tracking result, it is also proven that the parameter estimate vector is driven to a constant vector. In the second part of the chapter, a learning controller is designed and proven to yield a semi-global asymptotic tracking result in the presence of additive disturbances where the desired trajectory is periodic. A continuous nonlinear integral feedback component is utilized in the design of both controllers and Lyapunov-based techniques are used to guarantee that the tracking error is asymptotically driven to zero. Numerical simulation results are presented for both controllers. In Chapter 4, a new dynamic model for continuum robot manipulators is derived. The dynamic model is developed based on the geometric model of extensible continuum robot manipulators with no torsional effects. The development presented in this chapter is an extension of the dynamic model proposed in [2] (by Mochiyama and Suzuki) to include a class of extensible continuum robot manipulators. First, the kinetic energy of a slice of the continuum robot is evaluated. Next, the total kinetic energy of the manipulator is obtained by utilizing a limit operation (i.e., sum of the kinetic energy of all the slices). Then, the gravitational potential energy of the manipulator is derived. Next, the elastic potential energy of the manipulator is derived for both bending and extension. Finally, the dynamic model of a planar 3-section extensible continuum robot manipulator is derived by utilizing the Lagrange representation. Numerical simulation results are presented for a planar 3-section extensible continuum robot manipulator

Analysis and Experiments for Tendril-Type Robots

New models for the Tendril continuous backbone robot, and other similarly constructed robots, are introduced and expanded upon in this thesis. The ability of the application of geometric models to result in more precise control of the Tendril manipulator is evaluated on a Tendril prototype. We examine key issues underlying the design and operation of \u27soft\u27 robots featuring continuous body (\u27continuum\u27) elements. Inspiration from nature is used to develop new methods of operation for continuum robots. These new methods of operation are tested in experiments to evaluate their effectiveness and potential

A continuum robotic platform for endoscopic non-contact laser surgery: design, control, and preclinical evaluation

The application of laser technologies in surgical interventions has been accepted in the clinical domain due to their atraumatic properties. In addition to manual application of fibre-guided lasers with tissue contact, non-contact transoral laser microsurgery (TLM) of laryngeal tumours has been prevailed in ENT surgery. However, TLM requires many years of surgical training for tumour resection in order to preserve the function of adjacent organs and thus preserve the patient’s quality of life. The positioning of the microscopic laser applicator outside the patient can also impede a direct line-of-sight to the target area due to anatomical variability and limit the working space. Further clinical challenges include positioning the laser focus on the tissue surface, imaging, planning and performing laser ablation, and motion of the target area during surgery. This dissertation aims to address the limitations of TLM through robotic approaches and intraoperative assistance. Although a trend towards minimally invasive surgery is apparent, no highly integrated platform for endoscopic delivery of focused laser radiation is available to date. Likewise, there are no known devices that incorporate scene information from endoscopic imaging into ablation planning and execution. For focusing of the laser beam close to the target tissue, this work first presents miniaturised focusing optics that can be integrated into endoscopic systems. Experimental trials characterise the optical properties and the ablation performance. A robotic platform is realised for manipulation of the focusing optics. This is based on a variable-length continuum manipulator. The latter enables movements of the endoscopic end effector in five degrees of freedom with a mechatronic actuation unit. The kinematic modelling and control of the robot are integrated into a modular framework that is evaluated experimentally. The manipulation of focused laser radiation also requires precise adjustment of the focal position on the tissue. For this purpose, visual, haptic and visual-haptic assistance functions are presented. These support the operator during teleoperation to set an optimal working distance. Advantages of visual-haptic assistance are demonstrated in a user study. The system performance and usability of the overall robotic system are assessed in an additional user study. Analogous to a clinical scenario, the subjects follow predefined target patterns with a laser spot. The mean positioning accuracy of the spot is 0.5 mm. Finally, methods of image-guided robot control are introduced to automate laser ablation. Experiments confirm a positive effect of proposed automation concepts on non-contact laser surgery.Die Anwendung von Lasertechnologien in chirurgischen Interventionen hat sich aufgrund der atraumatischen Eigenschaften in der Klinik etabliert. Neben manueller Applikation von fasergeführten Lasern mit Gewebekontakt hat sich die kontaktfreie transorale Lasermikrochirurgie (TLM) von Tumoren des Larynx in der HNO-Chirurgie durchgesetzt. Die TLM erfordert zur Tumorresektion jedoch ein langjähriges chirurgisches Training, um die Funktion der angrenzenden Organe zu sichern und damit die Lebensqualität der Patienten zu erhalten. Die Positionierung des mikroskopis chen Laserapplikators außerhalb des Patienten kann zudem die direkte Sicht auf das Zielgebiet durch anatomische Variabilität erschweren und den Arbeitsraum einschränken. Weitere klinische Herausforderungen betreffen die Positionierung des Laserfokus auf der Gewebeoberfläche, die Bildgebung, die Planung und Ausführung der Laserablation sowie intraoperative Bewegungen des Zielgebietes. Die vorliegende Dissertation zielt darauf ab, die Limitierungen der TLM durch robotische Ansätze und intraoperative Assistenz zu adressieren. Obwohl ein Trend zur minimal invasiven Chirurgie besteht, sind bislang keine hochintegrierten Plattformen für die endoskopische Applikation fokussierter Laserstrahlung verfügbar. Ebenfalls sind keine Systeme bekannt, die Szeneninformationen aus der endoskopischen Bildgebung in die Ablationsplanung und -ausführung einbeziehen. Für eine situsnahe Fokussierung des Laserstrahls wird in dieser Arbeit zunächst eine miniaturisierte Fokussieroptik zur Integration in endoskopische Systeme vorgestellt. Experimentelle Versuche charakterisieren die optischen Eigenschaften und das Ablationsverhalten. Zur Manipulation der Fokussieroptik wird eine robotische Plattform realisiert. Diese basiert auf einem längenveränderlichen Kontinuumsmanipulator. Letzterer ermöglicht in Kombination mit einer mechatronischen Aktuierungseinheit Bewegungen des Endoskopkopfes in fünf Freiheitsgraden. Die kinematische Modellierung und Regelung des Systems werden in ein modulares Framework eingebunden und evaluiert. Die Manipulation fokussierter Laserstrahlung erfordert zudem eine präzise Anpassung der Fokuslage auf das Gewebe. Dafür werden visuelle, haptische und visuell haptische Assistenzfunktionen eingeführt. Diese unterstützen den Anwender bei Teleoperation zur Einstellung eines optimalen Arbeitsabstandes. In einer Anwenderstudie werden Vorteile der visuell-haptischen Assistenz nachgewiesen. Die Systemperformanz und Gebrauchstauglichkeit des robotischen Gesamtsystems werden in einer weiteren Anwenderstudie untersucht. Analog zu einem klinischen Einsatz verfolgen die Probanden mit einem Laserspot vorgegebene Sollpfade. Die mittlere Positioniergenauigkeit des Spots beträgt dabei 0,5 mm. Zur Automatisierung der Ablation werden abschließend Methoden der bildgestützten Regelung vorgestellt. Experimente bestätigen einen positiven Effekt der Automationskonzepte für die kontaktfreie Laserchirurgie

Dynamic Active Constraints for Surgical Robots using Vector Field Inequalities

Robotic assistance allows surgeons to perform dexterous and tremor-free procedures, but robotic aid is still underrepresented in procedures with constrained workspaces, such as deep brain neurosurgery and endonasal surgery. In these procedures, surgeons have restricted vision to areas near the surgical tooltips, which increases the risk of unexpected collisions between the shafts of the instruments and their surroundings. In this work, our vector-field-inequalities method is extended to provide dynamic active-constraints to any number of robots and moving objects sharing the same workspace. The method is evaluated with experiments and simulations in which robot tools have to avoid collisions autonomously and in real-time, in a constrained endonasal surgical environment. Simulations show that with our method the combined trajectory error of two robotic systems is optimal. Experiments using a real robotic system show that the method can autonomously prevent collisions between the moving robots themselves and between the robots and the environment. Moreover, the framework is also successfully verified under teleoperation with tool-tissue interactions.Comment: Accepted on T-RO 2019, 19 Page

Robotic manipulators for single access surgery

This thesis explores the development of cooperative robotic manipulators for enhancing surgical precision and patient outcomes in single-access surgery and, specifically, Transanal Endoscopic Microsurgery (TEM). During these procedures, surgeons manipulate a heavy set of instruments via a mechanical clamp inserted in the patient’s body through a surgical port, resulting in imprecise movements, increased patient risks, and increased operating time. Therefore, an articulated robotic manipulator with passive joints is initially introduced, featuring built-in position and force sensors in each joint and electronic joint brakes for instant lock/release capability. The articulated manipulator concept is further improved with motorised joints, evolving into an active tool holder. The joints allow the incorporation of advanced robotic capabilities such as ultra-lightweight gravity compensation and hands-on kinematic reconfiguration, which can optimise the placement of the tool holder in the operating theatre. Due to the enhanced sensing capabilities, the application of the active robotic manipulator was further explored in conjunction with advanced image guidance approaches such as endomicroscopy. Recent advances in probe-based optical imaging such as confocal endomicroscopy is making inroads in clinical uses. However, the challenging manipulation of imaging probes hinders their practical adoption. Therefore, a combination of the fully cooperative robotic manipulator with a high-speed scanning endomicroscopy instrument is presented, simplifying the incorporation of optical biopsy techniques in routine surgical workflows. Finally, another embodiment of a cooperative robotic manipulator is presented as an input interface to control a highly-articulated robotic instrument for TEM. This master-slave interface alleviates the drawbacks of traditional master-slave devices, e.g., using clutching mechanics to compensate for the mismatch between slave and master workspaces, and the lack of intuitive manipulation feedback, e.g. joint limits, to the user. To address those drawbacks a joint-space robotic manipulator is proposed emulating the kinematic structure of the flexible robotic instrument under control.Open Acces

Proceedings of the NASA Conference on Space Telerobotics, volume 2

These proceedings contain papers presented at the NASA Conference on Space Telerobotics held in Pasadena, January 31 to February 2, 1989. The theme of the Conference was man-machine collaboration in space. The Conference provided a forum for researchers and engineers to exchange ideas on the research and development required for application of telerobotics technology to the space systems planned for the 1990s and beyond. The Conference: (1) provided a view of current NASA telerobotic research and development; (2) stimulated technical exchange on man-machine systems, manipulator control, machine sensing, machine intelligence, concurrent computation, and system architectures; and (3) identified important unsolved problems of current interest which can be dealt with by future research