Control of redundant robot arms with null-space compliance and singularity-free orientation representation

This paper tackles the problem of controlling the position and orientation, expressed in a singularity-free representation form, of the end-effector of a redundant robot, while addressing an active compliant behaviour within the null-space. The manuscript extends the work in [1] by explicitly addressing the orientation part. In order to successfully accomplish the task, a dynamic controller is designed without need of any exteroceptive sensors information. A rigorous stability analysis is provided to confirm the developed theory. Experiments are finally carried out to bolster the performance of the proposed approach

Tracking Control of Redundant Manipulators with Singularity-Free Orientation Representation and Null-Space Compliant Behaviour

This paper presents a suitable solution to control the pose of the end-effector of a redundant robot along a pre-planned trajectory, while addressing an active compliant behaviour in the null-space. The orientation of the robot is expressed through a singularity-free representation form. To accomplish the task, no exteroceptive sensor is needed. While a rigorous stability proof confirms the developed theory, experimental results bolster the performance of the proposed approach

Multi-robot cooperative platform : a task-oriented teleoperation paradigm

This thesis proposes the study and development of a teleoperation system based on multi-robot cooperation under the task oriented teleoperation paradigm: Multi-Robot Cooperative Paradigm, MRCP. In standard teleoperation, the operator uses the master devices to control the remote slave robot arms. These arms reproduce the desired movements and perform the task. With the developed work, the operator can virtually manipulate an object. MRCP automatically generates the arms orders to perform the task. The operator does not have to solve situations arising from possible restrictions that the slave arms may have. The research carried out is therefore aimed at improving the accuracy teleoperation tasks in complex environments, particularly in the field of robot assisted minimally invasive surgery. This field requires patient safety and the workspace entails many restrictions to teleoperation. MRCP can be defined as a platform composed of several robots that cooperate automatically to perform a teleoperated task, creating a robotic system with increased capacity (workspace volume, accessibility, dexterity ...). The cooperation is based on transferring the task between robots when necessary to enable a smooth task execution. The MRCP control evaluates the suitability of each robot to continue with the ongoing task and the optimal time to execute a task transfer between the current selected robot and the best candidate to continue with the task. From the operator¿s point of view, MRCP provides an interface that enables the teleoperation though the task-oriented paradigm: operator orders are translated into task actions instead of robot orders. This thesis is structured as follows: The first part is dedicated to review the current solutions in the teleoperation of complex tasks and compare them with those proposed in this research. The second part of the thesis presents and reviews in depth the different evaluation criteria to determine the suitability of each robot to continue with the execution of a task, considering the configuration of the robots and emphasizing the criterion of dexterity and manipulability. The study reviews the different required control algorithms to enable the task oriented telemanipulation. This proposed teleoperation paradigm is transparent to the operator. Then, the Thesis presents and analyses several experimental results using MRCP in the field of minimally invasive surgery. These experiments study the effectiveness of MRCP in various tasks requiring the cooperation of two hands. A type task is used: a suture using minimally invasive surgery technique. The analysis is done in terms of execution time, economy of movement, quality and patient safety (potential damage produced by undesired interaction between the tools and the vital tissues of the patient). The final part of the thesis proposes the implementation of different virtual aids and restrictions (guided teleoperation based on haptic visual and audio feedback, protection of restricted workspace regions, etc.) using the task oriented teleoperation paradigm. A framework is defined for implementing and applying a basic set of virtual aids and constraints within the framework of a virtual simulator for laparoscopic abdominal surgery. The set of experiments have allowed to validate the developed work. The study revealed the influence of virtual aids in the learning process of laparoscopic techniques. It has also demonstrated the improvement of learning curves, which paves the way for its implementation as a methodology for training new surgeons.Aquesta tesi doctoral proposa l'estudi i desenvolupament d'un sistema de teleoperació basat en la cooperació multi-robot sota el paradigma de la teleoperació orientada a tasca: Multi-Robot Cooperative Paradigm, MRCP. En la teleoperació clàssica, l'operador utilitza els telecomandaments perquè els braços robots reprodueixin els seus moviments i es realitzi la tasca desitjada. Amb el treball realitzat, l'operador pot manipular virtualment un objecte i és mitjançant el MRCP que s'adjudica a cada braç les ordres necessàries per realitzar la tasca, sense que l'operador hagi de resoldre les situacions derivades de possibles restriccions que puguin tenir els braços executors. La recerca desenvolupada està doncs orientada a millorar la teleoperació en tasques de precisió en entorns complexos i, en particular, en el camp de la cirurgia mínimament invasiva assistida per robots. Aquest camp imposa condicions de seguretat del pacient i l'espai de treball comporta moltes restriccions a la teleoperació. MRCP es pot definir com a una plataforma formada per diversos robots que cooperen de forma automàtica per dur a terme una tasca teleoperada, generant un sistema robòtic amb capacitats augmentades (volums de treball, accessibilitat, destresa,...). La cooperació es basa en transferir la tasca entre robots a partir de determinar quin és aquell que és més adequat per continuar amb la seva execució i el moment òptim per realitzar la transferència de la tasca entre el robot actiu i el millor candidat a continuar-la. Des del punt de vista de l'operari, MRCP ofereix una interfície de teleoperació que permet la realització de la teleoperació mitjançant el paradigma d'ordres orientades a la tasca: les ordres es tradueixen en accions sobre la tasca en comptes d'estar dirigides als robots. Aquesta tesi està estructurada de la següent manera: Primerament es fa una revisió de l'estat actual de les diverses solucions desenvolupades actualment en el camp de la teleoperació de tasques complexes, comparant-les amb les proposades en aquest treball de recerca. En el segon bloc de la tesi es presenten i s'analitzen a fons els diversos criteris per determinar la capacitat de cada robot per continuar l'execució d'una tasca, segons la configuració del conjunt de robots i fent especial èmfasi en el criteri de destresa i manipulabilitat. Seguint aquest estudi, es presenten els diferents processos de control emprats per tal d'assolir la telemanipulació orientada a tasca de forma transparent a l'operari. Seguidament es presenten diversos resultats experimentals aplicant MRCP al camp de la cirurgia mínimament invasiva. En aquests experiments s'estudia l'eficàcia de MRCP en diverses tasques que requereixen de la cooperació de dues mans. S'ha escollit una tasca tipus: sutura amb tècnica de cirurgia mínimament invasiva. L'anàlisi es fa en termes de temps d'execució, economia de moviment, qualitat i seguretat del pacient (potencials danys causats per la interacció no desitjada entre les eines i els teixits vitals del pacient). Finalment s'ha estudiat l'ús de diferents ajudes i restriccions virtuals (guiat de la teleoperació via retorn hàptic, visual o auditiu, protecció de regions de l'espai de treball, etc) dins el paradigma de teleoperació orientada a tasca. S'ha definint un marc d'aplicació base i implementant un conjunt de restriccions virtuals dins el marc d'un simulador de cirurgia laparoscòpia abdominal. El conjunt d'experiments realitzats han permès validar el treball realitzat. Aquest estudi ha permès determinar la influencia de les ajudes virtuals en el procés d'aprenentatge de les tècniques laparoscòpiques. S'ha evidenciat una millora en les corbes d'aprenentatge i obre el camí a la seva implantació com a metodologia d'entrenament de nous cirurgians.Postprint (published version

Kinematics and Robot Design II (KaRD2019) and III (KaRD2020)

This volume collects papers published in two Special Issues “Kinematics and Robot Design II, KaRD2019” (https://www.mdpi.com/journal/robotics/special_issues/KRD2019) and “Kinematics and Robot Design III, KaRD2020” (https://www.mdpi.com/journal/robotics/special_issues/KaRD2020), which are the second and third issues of the KaRD Special Issue series hosted by the open access journal robotics.The KaRD series is an open environment where researchers present their works and discuss all topics focused on the many aspects that involve kinematics in the design of robotic/automatic systems. It aims at being an established reference for researchers in the field as other serial international conferences/publications are. Even though the KaRD series publishes one Special Issue per year, all the received papers are peer-reviewed as soon as they are submitted and, if accepted, they are immediately published in MDPI Robotics. Kinematics is so intimately related to the design of robotic/automatic systems that the admitted topics of the KaRD series practically cover all the subjects normally present in well-established international conferences on “mechanisms and robotics”.KaRD2019 together with KaRD2020 received 22 papers and, after the peer-review process, accepted only 17 papers. The accepted papers cover problems related to theoretical/computational kinematics, to biomedical engineering and to other design/applicative aspects

Representation and control of coordinated-motion tasks for human-robot systems

It is challenging for robots to perform various tasks in a human environment. This is because many human-centered tasks require coordination in both hands and may often involve cooperation with another human. Although human-centered tasks require different types of coordinated movements, most of the existing methodologies have focused only on specific types of coordination. This thesis aims at the description and control of coordinated-motion tasks for human-robot systems; i.e., humanoid robots as well as multi-robot and human-robot systems. First, for bimanually coordinated-motion tasks in dual-manipulator systems, we propose the Extended-Cooperative-Task-Space (ECTS) representation, which extends the existing Cooperative-Task-Space (CTS) representation based on the kinematic models for human bimanual movements in Biomechanics. The proposed ECTS representation can represent the whole spectrum of dual-arm motion/force coordination using two sets of ECTS motion/force variables in a unified manner. The type of coordination can be easily chosen by two meaningful coefficients, and during coordinated-motion tasks, each set of variables directly describes two different aspects of coordinated motion and force behaviors. Thus, the operator can specify coordinated-motion/force tasks more intuitively in high-level descriptions, and the specified tasks can be easily reused in other situations with greater flexibility. Moreover, we present consistent procedures of using the ECTS representation for task specifications in the upper-body and lower-body subsystems of humanoid robots in order to perform manipulation and locomotion tasks, respectively. Besides, we propose and discuss performance indices derived based on the ECTS representation, which can be used to evaluate and optimize the performance of any type of dual-arm manipulation tasks. We show that using the ECTS representation for specifying both dual-arm manipulation and biped locomotion tasks can greatly simplify the motion planning process, allowing the operator to focus on high-level descriptions of those tasks. Both upper-body and lower-body task specifications are demonstrated by specifying whole-body task examples on a Hubo II+ robot carrying out dual-arm manipulation as well as biped locomotion tasks in a simulation environment. We also present the results from experiments on a dual-arm robot (Baxter) for teleoperating various types of coordinated-motion tasks using a single 6D mouse interface. The specified upper- and lower-body tasks can be considered as coordinated motions with constraints. In order to express various constraints imposed across the whole-body, we discuss the modeling of whole-body structure and the computations for robotic systems having multiple kinematic chains. Then we present a whole-body controller formulated as a quadratic programming, which can take different types of constraints into account in a prioritized manner. We validate the whole-body controller based on the simulation results on a Hubo II+ robot performing specified whole-body task examples with a number of motion and force constraints as well as actuation limits. Lastly, we discuss an extension of the ECTS representation, called Hierarchical Extended-Cooperative-Task Space (H-ECTS) framework, which uses tree-structured graphical representations for coordinated-motion tasks of multi-robot and human-robot systems. The H-ECTS framework is validated by experimental results on two Baxter robots cooperating with each other as well as with an additional human partner

Passive Compliance Control of Redundant Serial Manipulators

Current industrial robotic manipulators, and even state of the art robotic manipulators, are slower and less reliable than humans at executing constrained manipulation tasks, tasks where motion is constrained in some direction (e.g., opening a door, turning a crank, polishing a surface, or assembling parts). Many constrained manipulation tasks are still performed by people because robots do not have the manipulation ability to reliably interact with a stiff environment, for which even small commanded position error yields very high contact forces in the constrained directions. Contact forces can be regulated using compliance control, in which the multi-directional elastic behavior (force-displacement relationship) of the end-effector is controlled along with its position. Some state of the art manipulators can directly control the end-effector\u27s elastic behavior using kinematic redundancy (when the robot has more than the necessary number of joints to realize a desired end-effector position) and using variable stiffness actuators (actuators that adjust the physical joint stiffness in real time). Although redundant manipulators with variable stiffness actuators are capable of tracking a time-varying elastic behavior and position of the end-effector, no prior work addresses how to control the robot actuators to do so. This work frames this passive compliance control problem as a redundant inverse kinematics path planning problem extended to include compliance. The problem is to find a joint manipulation path (a continuous sequence of joint positions and joint compliances) to realize a task manipulation path (a continuous sequence of end-effector positions and compliances). This work resolves the joint manipulation path at two levels of quality: 1) instantaneously optimal and 2) globally optimal. An instantaneously optimal path is generated by integrating the optimal joint velocity (according to an instantaneous cost function) that yields the desired task velocity. A globally optimal path is obtained by deforming an instantaneously generated path into one that minimizes a global cost function (integral of the instantaneous cost function). This work shows the existence of multiple local minima of the global cost function and provides an algorithm for finding the global minimum

Cognitive Reasoning for Compliant Robot Manipulation

Physically compliant contact is a major element for many tasks in everyday environments. A universal service robot that is utilized to collect leaves in a park, polish a workpiece, or clean solar panels requires the cognition and manipulation capabilities to facilitate such compliant interaction. Evolution equipped humans with advanced mental abilities to envision physical contact situations and their resulting outcome, dexterous motor skills to perform the actions accordingly, as well as a sense of quality to rate the outcome of the task. In order to achieve human-like performance, a robot must provide the necessary methods to represent, plan, execute, and interpret compliant manipulation tasks. This dissertation covers those four steps of reasoning in the concept of intelligent physical compliance. The contributions advance the capabilities of service robots by combining artificial intelligence reasoning methods and control strategies for compliant manipulation. A classification of manipulation tasks is conducted to identify the central research questions of the addressed topic. Novel representations are derived to describe the properties of physical interaction. Special attention is given to wiping tasks which are predominant in everyday environments. It is investigated how symbolic task descriptions can be translated into meaningful robot commands. A particle distribution model is used to plan goal-oriented wiping actions and predict the quality according to the anticipated result. The planned tool motions are converted into the joint space of the humanoid robot Rollin' Justin to perform the tasks in the real world. In order to execute the motions in a physically compliant fashion, a hierarchical whole-body impedance controller is integrated into the framework. The controller is automatically parameterized with respect to the requirements of the particular task. Haptic feedback is utilized to infer contact and interpret the performance semantically. Finally, the robot is able to compensate for possible disturbances as it plans additional recovery motions while effectively closing the cognitive control loop. Among others, the developed concept is applied in an actual space robotics mission, in which an astronaut aboard the International Space Station (ISS) commands Rollin' Justin to maintain a Martian solar panel farm in a mock-up environment. This application demonstrates the far-reaching impact of the proposed approach and the associated opportunities that emerge with the availability of cognition-enabled service robots

Modeling, Control, and Motion Analysis of a Class of Extensible Continuum Manipulators

In this dissertation, the development of a kinematic model, a configuration-space controller, a master-slave teleoperation controller, along with the analysis of the self-motion properties for redundant, extensible, continuous backbone (continuum) ``trunk and tentacle\u27 manipulators are detailed. Unlike conventional rigid-link robots, continuum manipulators are robots that can bend at any point along their backbone, resulting in new and unique modeling and control issues. Taken together, these chapters represent one of the first efforts towards devising model-based controllers of such robots, as well as characterizing their self-motion in its simplest form. Chapter 2 describes the development of a convenient set of generalized, spatial forward kinematics for extensible continuum manipulators based on the robot\u27s measurable variables. This development, takes advantage of the standard constant curvature assumption made for such manipulators and is simpler and more intuitive than the existing kinematic derivations which utilize a pseudo-rigid link manipulator. In Chapter 3, a new control strategy for continuum robots is presented. Control of this emerging new class of robots has proved difficult due to the inherent complexity of their dynamics. Using a recently established full Lagrangian dynamic model, a new nonlinear model-based control strategy (sliding-mode control) for continuum robots is introduced. Simulation results are illustrated using the dynamic model of a three-section, six Degree-of-Freedom, planar continuum robot and an experiment was conducted on the OctArm 9 Degree-of-Freedom continuum manipulator. In both the simulation and experiment, the results of the sliding-mode controller were found to be significantly better than a standard inverse-dynamics PD controller. In Chapter 4, the nature of continuum manipulator self-motion is studied. While use of the redundant continuum manipulator self-motion property (configuration changes which leave the end-effector location fixed) has been proposed, the nature of their null-spaces has not previously been explored. The manipulator related resolved-motion rate inverse kinematics which are based on the forward kinematics described in Chapter 2, are used. Based on these derivations, the self-motion of a 2-section, extensible redundant continuum manipulator in planar and spatial situations (generalizable to n-sections) is analyzed. The existence of a single self-motion manifold underlying the structures is proven, and simple self-motion cases spanning the null-space are introduced. The results of this analysis allow for a better understanding of general continuum robot self-motions and relate their underlying structure to real world examples and applications. The results are supported by experimental validation of the self-motion properties on the 9 Degree-of-Freedom OctArm continuum manipulator. In Chapter 5, teleoperation control of a kinematically redundant, continuum slave robot by a non-redundant, rigid-link master system is described. This problem is novel because the self-motion of the redundant robot can be utilized to achieve secondary control objectives while allowing the user to only control the tip of the slave system. To that end, feedback linearizing controllers are proposed for both the master and slave systems, whose effectiveness is demonstrated using numerical simulations and experimental results (using the 9 Degree-of-Freedom OctArm continuum manipulator as the slave system) for trajectory tracking as well as singularity avoidance subtask