Teleoperability and dynamic teleoperability

Teleoperated systems are used in many hostile environments and are therefore very complex. Current design procedures select kinematic configurations based on the designer\u27s past experience and some standard practice guidelines. Yet, no unifying theory exists to quantifiably discern between competing kinematic designs and guide in the selection of key operational strategies such as indexing, length scaling, and mass scaling. Manipulability and dynamic manipulability theory attempt to present a quantitative measure which can be used to evaluate a robotic manipulator. This thesis expands this theory to teleoperability and dynamic teleoperability which can be used to evaluate teleoperated manipulator systems. The mathematical developments of teleoperability and dynamic teleoperability are presented. The behavior of the teleoperability and dynamic teleoperability measures in various operational conditions is presented. Special attention is given to the effects of indexing, length scaling, and mass scaling between the master and slave. Simple experimental results validate the theory. Teleoperability, dynamic teleoperability and the associated ellipsoids and measures are useful concepts for the design, implementation, and selection of teleoperated systems. Specifically, this theory can be used in the selection of master and slave configurations, guide in control system design, and provide insight into necessary and/or helpful operational features for teleoperated and telerobotic systems

Multi-robot cooperative platform : a task-oriented teleoperation paradigm

This thesis proposes the study and development of a teleoperation system based on multi-robot cooperation under the task oriented teleoperation paradigm: Multi-Robot Cooperative Paradigm, MRCP. In standard teleoperation, the operator uses the master devices to control the remote slave robot arms. These arms reproduce the desired movements and perform the task. With the developed work, the operator can virtually manipulate an object. MRCP automatically generates the arms orders to perform the task. The operator does not have to solve situations arising from possible restrictions that the slave arms may have. The research carried out is therefore aimed at improving the accuracy teleoperation tasks in complex environments, particularly in the field of robot assisted minimally invasive surgery. This field requires patient safety and the workspace entails many restrictions to teleoperation. MRCP can be defined as a platform composed of several robots that cooperate automatically to perform a teleoperated task, creating a robotic system with increased capacity (workspace volume, accessibility, dexterity ...). The cooperation is based on transferring the task between robots when necessary to enable a smooth task execution. The MRCP control evaluates the suitability of each robot to continue with the ongoing task and the optimal time to execute a task transfer between the current selected robot and the best candidate to continue with the task. From the operator¿s point of view, MRCP provides an interface that enables the teleoperation though the task-oriented paradigm: operator orders are translated into task actions instead of robot orders. This thesis is structured as follows: The first part is dedicated to review the current solutions in the teleoperation of complex tasks and compare them with those proposed in this research. The second part of the thesis presents and reviews in depth the different evaluation criteria to determine the suitability of each robot to continue with the execution of a task, considering the configuration of the robots and emphasizing the criterion of dexterity and manipulability. The study reviews the different required control algorithms to enable the task oriented telemanipulation. This proposed teleoperation paradigm is transparent to the operator. Then, the Thesis presents and analyses several experimental results using MRCP in the field of minimally invasive surgery. These experiments study the effectiveness of MRCP in various tasks requiring the cooperation of two hands. A type task is used: a suture using minimally invasive surgery technique. The analysis is done in terms of execution time, economy of movement, quality and patient safety (potential damage produced by undesired interaction between the tools and the vital tissues of the patient). The final part of the thesis proposes the implementation of different virtual aids and restrictions (guided teleoperation based on haptic visual and audio feedback, protection of restricted workspace regions, etc.) using the task oriented teleoperation paradigm. A framework is defined for implementing and applying a basic set of virtual aids and constraints within the framework of a virtual simulator for laparoscopic abdominal surgery. The set of experiments have allowed to validate the developed work. The study revealed the influence of virtual aids in the learning process of laparoscopic techniques. It has also demonstrated the improvement of learning curves, which paves the way for its implementation as a methodology for training new surgeons.Aquesta tesi doctoral proposa l'estudi i desenvolupament d'un sistema de teleoperació basat en la cooperació multi-robot sota el paradigma de la teleoperació orientada a tasca: Multi-Robot Cooperative Paradigm, MRCP. En la teleoperació clàssica, l'operador utilitza els telecomandaments perquè els braços robots reprodueixin els seus moviments i es realitzi la tasca desitjada. Amb el treball realitzat, l'operador pot manipular virtualment un objecte i és mitjançant el MRCP que s'adjudica a cada braç les ordres necessàries per realitzar la tasca, sense que l'operador hagi de resoldre les situacions derivades de possibles restriccions que puguin tenir els braços executors. La recerca desenvolupada està doncs orientada a millorar la teleoperació en tasques de precisió en entorns complexos i, en particular, en el camp de la cirurgia mínimament invasiva assistida per robots. Aquest camp imposa condicions de seguretat del pacient i l'espai de treball comporta moltes restriccions a la teleoperació. MRCP es pot definir com a una plataforma formada per diversos robots que cooperen de forma automàtica per dur a terme una tasca teleoperada, generant un sistema robòtic amb capacitats augmentades (volums de treball, accessibilitat, destresa,...). La cooperació es basa en transferir la tasca entre robots a partir de determinar quin és aquell que és més adequat per continuar amb la seva execució i el moment òptim per realitzar la transferència de la tasca entre el robot actiu i el millor candidat a continuar-la. Des del punt de vista de l'operari, MRCP ofereix una interfície de teleoperació que permet la realització de la teleoperació mitjançant el paradigma d'ordres orientades a la tasca: les ordres es tradueixen en accions sobre la tasca en comptes d'estar dirigides als robots. Aquesta tesi està estructurada de la següent manera: Primerament es fa una revisió de l'estat actual de les diverses solucions desenvolupades actualment en el camp de la teleoperació de tasques complexes, comparant-les amb les proposades en aquest treball de recerca. En el segon bloc de la tesi es presenten i s'analitzen a fons els diversos criteris per determinar la capacitat de cada robot per continuar l'execució d'una tasca, segons la configuració del conjunt de robots i fent especial èmfasi en el criteri de destresa i manipulabilitat. Seguint aquest estudi, es presenten els diferents processos de control emprats per tal d'assolir la telemanipulació orientada a tasca de forma transparent a l'operari. Seguidament es presenten diversos resultats experimentals aplicant MRCP al camp de la cirurgia mínimament invasiva. En aquests experiments s'estudia l'eficàcia de MRCP en diverses tasques que requereixen de la cooperació de dues mans. S'ha escollit una tasca tipus: sutura amb tècnica de cirurgia mínimament invasiva. L'anàlisi es fa en termes de temps d'execució, economia de moviment, qualitat i seguretat del pacient (potencials danys causats per la interacció no desitjada entre les eines i els teixits vitals del pacient). Finalment s'ha estudiat l'ús de diferents ajudes i restriccions virtuals (guiat de la teleoperació via retorn hàptic, visual o auditiu, protecció de regions de l'espai de treball, etc) dins el paradigma de teleoperació orientada a tasca. S'ha definint un marc d'aplicació base i implementant un conjunt de restriccions virtuals dins el marc d'un simulador de cirurgia laparoscòpia abdominal. El conjunt d'experiments realitzats han permès validar el treball realitzat. Aquest estudi ha permès determinar la influencia de les ajudes virtuals en el procés d'aprenentatge de les tècniques laparoscòpiques. S'ha evidenciat una millora en les corbes d'aprenentatge i obre el camí a la seva implantació com a metodologia d'entrenament de nous cirurgians.Postprint (published version

Haptische Mensch-Maschine-Schnittstelle für ein laparoskopisches Chirurgie-System

Für eine Vielzahl von Operationen im Bauchraum ist heute die Laparoskopie Stand der Technik, so z.B. die Cholezytektomie zur Entfernung der Gallenblase. Hierbei handelt es sich um ein minimalinvasives Verfahren bei dem der Zugang zum Operationsgebiet durch kleinste Schnitte in der Bauchdecke des Patienten erfolgt. Bei der Operation kommen lange starre Instrumente zu Einsatz. Im Gegensatz zu einer offenen Operation haben die Hände des Chirurgen keinen direkten Zugang zum operierten Gewebe. Ein Abtasten des Gewebes ist nicht möglich, der haptische Sinn zur Diagnose und Navigation im Operationsgebiet steht dem Operateur folglich nicht zur Verfügung. Diese Einschränkung erhöht die Komplexität laparoskopischer Eingriffe erheblich. Auch die Beweglichkeit im Operationsfeld ist stark eingeschränkt. Eine technische Antwort auf diese Einschränkungen sind haptische Telemanipulationssysteme. Sie bestehen aus einer angetriebenen Instrumentenspitze sowie einem haptischen Bedienelement, das die Kontaktkräfte zwischen Instrumentenspitze und Gewebe an den Bediener meldet. Hierzu erfasst ein Kraftsensor an der Instrumentenspitze die auftretenden Kontaktkräfte. Antriebe im Bedienelement erzeugen daraus eine Kraftinformation und leiten sie über einen Mechanismus an den Bediener weiter. Die vorliegende Arbeit befasst sich mit der Erweiterung der Entwurfsmethodik für haptische Bedienelemente und der Realisierung eines neuartigen Bedienelements. Basis ist eine Analyse des chirurgischen Szenarios in der minimalinvasiven Leberchirurgie. Daraus leitet sich das Entwurfsziel eines haptischen Bedienelementes mit drei kartesischen Freiheitsgraden ab. Auf Grund ihrer guten dynamischen Eigenschaften sind besonders parallelkinematische Mechanismen zur Übertragung haptischer Informationen geeignet. Sie zeichnen sich durch eine große Struktursteifigkeit und geringe bewegte Massen aus. Ihr kinematisches Übertragungsverhalten ist hingegen meist komplex. Aus der Analyse der kinematischen Bedingungen für ein rein kartesisches Ausgangsverhalten ergibt sich ein möglicher Lösungsraum geeigneter Topologien. Alle bestehen aus drei Beinen mit je 5 Gelenkfreiheitsgraden, einer Basis-Plattform und einer Tool-Centre-Point-Plattform zur Ausgabe der haptischen Information. Für den vorliegenden Fall ist eine RUU- bzw. DELTA-Struktur geeignet. Diese Struktur übersetzt drei Antriebsmomente in eine rein kartesische Ausgabe. Basierend auf der Analyse der kinematischen Entwurfsziele für haptische Mechanismen erfolgte eine Auslegung des Mechanismus im Hinblick auf isotropes, d.h. richtungsunabhängiges Übertragungsverhalten. Charakteristisches Maß ist die globale Konditionszahl. Entscheidend für die Qualität der haptischen Rückmeldung ist das dynamische Übertragungsverhalten haptischer Bedienelemente. Für eindimensionale Systeme ist in der Literatur zur Modellierung der Zwei-Tor Ansatz basierend auf der elektromechanischen Netzwerktheorie eingeführt. Im Rahmen dieser Arbeit erfolgt erstmalig die Erweiterung auch für den mehrdimensionalen Fall. Damit ist es möglich, auch die dynamischen Eigenschaften mehrdimensionaler Mechanismen mit dem Zwei-Tor Ansatz abzubilden. Dies erlaubt Anwendung des Entwurfsverfahrens der "Transparenz" für mehrdimensionale Systeme. Zur Analyse der mechanischen Eigenschaften des operierten Gewebes entstehen zwei Messplätze für die Frequenzbereiche f = 10...10^4 Hz (taktile Wahrnehmung) und f=DC...50 Hz (kinästhetische Wahrnehmung). Sie ermöglichen die messtechnische Charakterisierung der mechanischen Impedanz und die Ableitung mechanischer Schaltungen. Damit lässt sich die Impedanz des Gewebes rechnerisch im Gütekriterium der Transparenz zur Bewertung eines haptischen Telemanipulationssystems einsetzen. Die Realisierung eines haptischen Bedienelements erfolgt für ein neuartiges, tragbares Teleoperationssystem. Das Bedienkonzept ist an Hand eines ergonomischen Funktionsmusters im Tierversuch evaluiert. Kernkomponente ist ein haptisches Joystick mit drei kartesischen Freiheitsgraden durch einen RUU-Mechanismus. Der Arbeitsraum beträgt 743,5 cm³. Das Bedienelement ist mit einer Impedanz-gesteuerten Systemstruktur entworfen und feinwerktechnisch umgesetzt. Als Antriebe kommen drei EC-Motoren zum Einsatz. Mit einem maximalen Moment von 0,2 Nm erzeugen sie eine haptische Rückmeldung von 5N in 82% des Volumens im Arbeitsraum. Die zum Betrieb erforderlichen kinematischen Berechnungen sind auf einem Steuerrechner implementiert. Zusammen mit der Leistungselektronik ist dieser in einem mobilen Rack integriert. Der Nachweis der Funktionsfähigkeit erfolgt an einem experimentellen Telemanipulationssystem im Laborbetrieb

Selection of network parameters in wireless control of bilateral teleoperated manipulators.

This paper describes how to establish performance charts for selection of network parameters for effective utilization of a bilateral teleoperated manipulator working under a wireless communication channel. The goal is to construct a set of charts that help researchers and engineers to select appropriate parameters of wireless network setup for a known configuration of environment obstruction. To achieve this goal, a teleoperated setup comprising a master haptic device, a slave manipulator dynamic simulator, and a communication channel emulated using the network simulator version 2 (NS2) simulator is first developed. Next, performance indices are defined to evaluate the quality of position tracking of the slave manipulator end-effector and force tracking of the master haptic. Three indices chosen in this paper are the integral of squared position and force errors, the integral of absolute position and force error, and the amplitude of position and force overshoot. Extensive experiments on the developed setup are then conducted to study effects of time-varying packet loss on the performance of the teleoperated system. The largest mean packet loss, at which the system exhibits satisfactory tracking, is then quantified. This packet loss is used as an indicator to define regions representing the quality of tracking. The effectiveness of the proposed technique is validated by testing a fully instrumented hydraulically actuated system under various real wireless channel scenarios

Parallel Manipulators

In recent years, parallel kinematics mechanisms have attracted a lot of attention from the academic and industrial communities due to potential applications not only as robot manipulators but also as machine tools. Generally, the criteria used to compare the performance of traditional serial robots and parallel robots are the workspace, the ratio between the payload and the robot mass, accuracy, and dynamic behaviour. In addition to the reduced coupling effect between joints, parallel robots bring the benefits of much higher payload-robot mass ratios, superior accuracy and greater stiffness; qualities which lead to better dynamic performance. The main drawback with parallel robots is the relatively small workspace. A great deal of research on parallel robots has been carried out worldwide, and a large number of parallel mechanism systems have been built for various applications, such as remote handling, machine tools, medical robots, simulators, micro-robots, and humanoid robots. This book opens a window to exceptional research and development work on parallel mechanisms contributed by authors from around the world. Through this window the reader can get a good view of current parallel robot research and applications

Near Real-Time Closed-Loop Optimal Control Feedback for Spacecraft Attitude Maneuvers

Optimization of spacecraft attitude maneuvers can significantly reduce attitude control system size and mass, and extend satellite end-of-life. Optimal control theory has been applied to solve a variety of open-loop optimal control problems for terrestrial, air, and space applications. However, general application of real-time optimal controllers on spacecraft for large slew maneuvers has been limited because open-loop control systems are inherently vulnerable to error and the computation necessary to solve for an optimized control solution is resource intensive. This research effort is focused on developing a near real-time optimal control (RTOC) system for spacecraft attitude maneuvers on the Air Force Institute of Technology\u27s 2nd generation simulated satellite, SimSat II. To meet the end goal of developing a RTOC controller, necessary preliminary steps were completed to accurately characterize SimSAT II\u27s mass properties and attitude control system. Using DIDO, a pseudospectral-based optimal control solver package, to continuously solve and execute a sequence of optimized open-loop control solutions in near real-time, the RTOC controller can optimally control the state of the satellite over the course of a large angle slew maneuver. In this research, simulation and experimental results clearly demonstrate the benefit of RTOC versus other non-optimal control methods for the same maneuver

Semiautonomous Robotic Manipulator for Minimally Invasive Aortic Valve Replacement

Aortic valve surgery is the preferred procedure for replacing a damaged valve with an artificial one. The ValveTech robotic platform comprises a flexible articulated manipulator and surgical interface supporting the effective delivery of an artificial valve by teleoperation and endoscopic vision. This article presents our recent work on force-perceptive, safe, semiautonomous navigation of the ValveTech platform prior to valve implantation. First, we present a force observer that transfers forces from the manipulator body and tip to a haptic interface. Second, we demonstrate how hybrid forward/inverse mechanics, together with endoscopic visual servoing, lead to autonomous valve positioning. Benchtop experiments and an artificial phantom quantify the performance of the developed robot controller and navigator. Valves can be autonomously delivered with a 2.0±0.5 mm position error and a minimal misalignment of 3.4±0.9°. The hybrid force/shape observer (FSO) algorithm was able to predict distributed external forces on the articulated manipulator body with an average error of 0.09 N. FSO can also estimate loads on the tip with an average accuracy of 3.3%. The presented system can lead to better patient care, delivery outcome, and surgeon comfort during aortic valve surgery, without requiring sensorization of the robot tip, and therefore obviating miniaturization constraints.</p

Proceedings of the NASA Conference on Space Telerobotics, volume 1

The theme of the Conference was man-machine collaboration in space. Topics addressed include: redundant manipulators; man-machine systems; telerobot architecture; remote sensing and planning; navigation; neural networks; fundamental AI research; and reasoning under uncertainty

Cable-driven parallel mechanisms for minimally invasive robotic surgery

Minimally invasive surgery (MIS) has revolutionised surgery by providing faster recovery times, less post-operative complications, improved cosmesis and reduced pain for the patient. Surgical robotics are used to further decrease the invasiveness of procedures, by using yet smaller and fewer incisions or using natural orifices as entry point. However, many robotic systems still suffer from technical challenges such as sufficient instrument dexterity and payloads, leading to limited adoption in clinical practice. Cable-driven parallel mechanisms (CDPMs) have unique properties, which can be used to overcome existing challenges in surgical robotics. These beneficial properties include high end-effector payloads, efficient force transmission and a large configurable instrument workspace. However, the use of CDPMs in MIS is largely unexplored. This research presents the first structured exploration of CDPMs for MIS and demonstrates the potential of this type of mechanism through the development of multiple prototypes: the ESD CYCLOPS, CDAQS, SIMPLE, neuroCYCLOPS and microCYCLOPS. One key challenge for MIS is the access method used to introduce CDPMs into the body. Three different access methods are presented by the prototypes. By focusing on the minimally invasive access method in which CDPMs are introduced into the body, the thesis provides a framework, which can be used by researchers, engineers and clinicians to identify future opportunities of CDPMs in MIS. Additionally, through user studies and pre-clinical studies, these prototypes demonstrate that this type of mechanism has several key advantages for surgical applications in which haptic feedback, safe automation or a high payload are required. These advantages, combined with the different access methods, demonstrate that CDPMs can have a key role in the advancement of MIS technology.Open Acces