The Shape of Damping: Optimizing Damping Coefficients to Improve Transparency on Bilateral Telemanipulation

This thesis presents a novel optimization-based passivity control algorithm for hapticenabled bilateral teleoperation systems involving multiple degrees of freedom. In particular, in the context of energy-bounding control, the contribution focuses on the implementation of a passivity layer for an existing time-domain scheme, ensuring optimal transparency of the interaction along subsets of the environment space which are preponderant for the given task, while preserving the energy bounds required for passivity. The involved optimization problem is convex and amenable to real-time implementation. The effectiveness of the proposed design is validated via an experiment performed on a virtual teleoperated environment. The interplay between transparency and stability is a critical aspect in haptic-enabled bilateral teleoperation control. While it is important to present the user with the true impedance of the environment, destabilizing factors such as time delays, stiff environments, and a relaxed grasp on the master device may compromise the stability and safety of the system. Passivity has been exploited as one of the the main tools for providing sufficient conditions for stable teleoperation in several controller design approaches, such as the scattering algorithm, timedomain passivity control, energy bounding algorithm, and passive set position modulation. In this work it is presented an innovative energy-based approach, which builds upon existing time-domain passivity controllers, improving and extending their effectiveness and functionality. The set of damping coefficients are prioritized in each degree of freedom, the resulting transparency presents a realistic force feedback in comparison to the other directions. Thus, the prioritization takes effect using a quadratic programming algorithm to find the optimal values for the damping. Finally, the energy tanks approach on passivity control is a solution used to ensure stability in a system for robotics bilateral manipulation. The bilateral telemanipulation must maintain the principle of passivity in all moments to preserve the system\u2019s stability. This work presents a brief introduction to haptic devices as a master component on the telemanipulation chain; the end effector in the slave side is a representation of an interactive object within an environment having a force sensor as feedback signal. The whole interface is designed into a cross-platform framework named ROS, where the user interacts with the system. Experimental results are presented

Passivity-Based adaptive bilateral teleoperation control for uncertain manipulators without jerk measurements

In this work, we consider the bilateral teleoperation problem of cooperative robotic systems in a Single-Master Multi-Slave (SM/MS) configuration, which is able to perform load transportation tasks in the presence of parametric uncertainty in the robot kinematic and dynamic models. The teleoperation architecture is based on the two-layer approach placed in a hierarchical structure, whose top and bottom layers are responsible for ensuring the transparency and stability properties respectively. The load transportation problem is tackled by using the formation control approach wherein the desired translational velocity and interaction force are provided to the master robot by the user, while the object is manipulated with a bounded constant force by the slave robots. Firstly, we develop an adaptive kinematic-based control scheme based on a composite adaptation law to solve the cooperative control problem for robots with uncertain kinematics. Secondly, the dynamic adaptive control for cooperative robots is implemented by means of a cascade control strategy, which does not require the measurement of the time derivative of force (which requires jerk measurements). The combination of the Lyapunov stability theory and the passivity formalism are used to establish the stability and convergence property of the closed-loop control system. Simulations and experimental results illustrate the performance and feasibility of the proposed control scheme.No presente trabalho, considera-se o problema de teleoperação bilateral de um sistema robótico cooperativo do tipo single-master e multiple-slaves (SM/MS) capaz de realizar tarefas de transporte de carga na presença de incertezas paramétricas no modelo cinemático e dinâmico dos robôs. A arquitetura de teleoperação está baseada na abordagem de duas camadas em estrutura hierárquica, onde as camadas superior e inferior são responsáveis por assegurar as propriedades de transparência e estabilidade respectivamente. O problema de transporte de carga é formulado usando a abordagem de controle de formação onde a velocidade de translação desejada e a força de interação são fornecidas ao robô mestre pelo operador, enquanto o objeto é manipulado pelos robôs escravos com uma força constante limitada. Primeiramente, desenvolve-se um esquema de controle adaptativo cinemático baseado em uma lei de adaptação composta para solucionar o problema de controle cooperativo de robôs com cinemática incerta. Em seguida, o controle adaptativo dinâmico de robôs cooperativos é implementado por meio de uma estratégia de controle em cascata, que não requer a medição da derivada da força (o qual requer a derivada da aceleração ou jerk). A teoria de estabilidade de Lyapunov e o formalismo de passividade são usados para estabelecer as propriedades de estabilidade e a convergência do sistema de controle em malha-fechada. Resultados de simulações numéricas ilustram o desempenho e viabilidade da estratégia de controle proposta

Modeling and Improving Teleoperation Performance of Semi-Autonomous Wheeled Robots

Robotics and unmanned vehicles have allowed us to interact with environments in ways that were impossible decades ago. As perception, decision making, and control improve, it becomes possible to automate more parts of robot operation. However, humans will remain a critical part of robot control based on preference, ethical, and technical reasons. An ongoing question will be when and how to pair humans and automation to create semi-autonomous systems. The answer to this question depends on numerous factors such as the robot's task, platform, environment conditions, and the user. The work in this dissertation focuses on modeling the impact of these factors on performance and developing improved semi-autonomous control schemes, so that robot systems can be better designed. Experiments and analysis focus on wheeled robots, however the approach taken and many of the trends could be applied to a variety of platforms. Wheeled robots are often teleoperated over wireless communication networks. While this arrangement may be convenient, it introduces many challenges including time-varying delays and poor perception of the robot's environment that can lead to the robot colliding with objects or rolling over. With regards to semi-autonomous control, rollover prevention and obstacle avoidance behaviors are considered. In this area, two contributions are presented. The first is a rollover prevention method that uses an existing manipulator arm on-board a wheeled robot. The second is a method of approximating convex obstacle free regions for use in optimal control path planning problems. Teleoperation conditions, including communication delays, automation, and environment layout, are considered in modeling robot operation performance. From these considerations stem three contributions. The first is a method of relating driving performance among different communication delay distributions. The second parameterizes how driving through different arrangements of obstacles relates to performance. Lastly, based on user studies, teleoperation performance is related to different conditions of communication delay, automation level, and environment arrangement. The contributions of this dissertation will assist roboticists to implement better automation and understand when to use automation.PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/136951/1/jgstorms_1.pd

Output Feedback Bilateral Teleoperation with Force Estimation in the Presence of Time Delays

This thesis presents a novel bilateral teleoperation algorithm for n degree of freedom nonlinear manipulators connected through time delays. Teleoperation has many practical uses, as there are many benefits that come from being able to operate machines from a distance. For instance, the ability to send a remote controlled robotic vehicle into a hazardous environment can be a great asset in many industrial applications. As well, the field of remote medicine can benefit from these technologies. A highly skilled surgeon could perform surgery on a patient who is located in another city, or even country. Earth to space operations and deep sea exploration are other areas where teleoperation is quite useful. Central to the approach presented in this work is the use of second order sliding mode unknown input observers for estimating the external forces acting on the manipulators. The use of these observers removes the need for both velocity and force sensors, leading to a lower cost hardware setup that provides all of the advantages of a position-force teleoperation algorithm. Stability results for this new algorithm are presented for several cases. Stability of each of the master and slave sides of the teleoperation system is demonstrated, showing that the master and slave are both stabilized by their respective controllers when the unknown input observers are used for state and force estimation. Additionally, closed loop stability results for the teleoperation system connected to a variety of slave side environments are presented. Delay-independent stability results for a linear spring-damper environment as well as a general finite-gain stable nonlinear environment are given. Delay-dependent stability results for the case where the slave environment is a liner spring-damper and the delays are commensurate are also presented. As well, stability results for the closed loop under the assumption that the human operator is modeled as a finite-gain stable nonlinear environment are given. Following the theoretical presentation, numerical simulations illustrating the algorithm are presented, and experimental results verifying the practical application of the approach are given

A Stable and Transparent Framework for Adaptive Shared Control of Robots

In mixed-initiative haptic shared control of robots, humans and automatic control system work in parallel. The commands to the robot are a weighted sum of forces from these two agents. This thesis develops control methods to improve the force feedback performance for mixed-initiative shared teleoperation and to adapt the control authority between human and automatic control system in a stable manner even in the presence of communication delays. All methods are validated on real robotic hardware

Nonlinear Control Techniques for Robot Manipulators

This Masters thesis describes the design and implementation of control strategies for the following topics of research: i) Whole Arm Grasping Control for Redundant Robot Manipulators, ii) Neural Network Grasping Controller for Continuum Robots and, iii) Coordination Control for Haptic and Teleoperator Systems. An approach to whole arm grasping of objects using redundant robot manipulators is presented. A kinematic control which facilitates the encoding of both the end-effector position, as well as body self-motion positioning information as a desired trajectory signal for the manipulator joints is developed. An approach is presented to whole arm grasping control for continuum robots. The grasping controller is developed in two stages; high level path planning for the grasping objective, and a low level joint controller using a neural network feedforward component to compensate for dynamic uncertainties. Lastly, two controllers are developed for nonlinear haptic and teleoperator systems for coordination of the master and slave systems

Control of Nonlinear Mechatronic Systems

This dissertation is divided into four self-contained chapters. In Chapter 1, an adaptive nonlinear tracking controller for kinematically redundant robot manipulators is presented. Past research efforts have focused on the end-effector tracking control of redundant robots because of their increased dexterity over their non-redundant counterparts. This work utilizes an adaptive full-state feedback quaternion based controller developed in [1] and focuses on the design of a general sub-task controller. This sub-task controller does not affect the position and orientation tracking control objectives, but instead projects a preference on the configuration of the manipulator based on sub-task objectives such as the following: singularity avoidance, joint limit avoidance, bounding the impact forces, and bounding the potential energy. In Chapter 2, two controllers are developed for nonlinear haptic and teleoperator systems for coordination of the master and slave systems. The first controller is proven to yield a semi-global asymptotic result in the presence of parametric uncertainty in the master and the slave dynamic models provided the user and the environmental input forces are measurable. The second controller yields a global asymptotic result despite unmeasurable user and environmental input forces provided the dynamic models of the master and slave systems are known. These controllers rely on a transformation and a flexible target system to allow the master system\u27s impedance to be easily adjusted so that it matches a desired target system. This work also offers a structure to encode a velocity field assist mechanism to provide the user help in controlling the slave system in completing a pre-defined contour following task. For each controller, Lyapunov-based techniques are used to prove that both controllers provide passive coordination of the haptic/teleoperator system when the velocity field assist mechanism is disabled. When the velocity field assist mechanism is enabled, the analysis proves the coordination of the haptic/teleoperator system. Simulation results are presented for both controllers. In Chapter 3, two controllers are developed for flat multi-input/multi-output nonlinear systems. First, a robust adaptive controller is proposed and proven to yield semi-global asymptotic tracking in the presence of additive disturbances and parametric uncertainty. In addition to guaranteeing an asymptotic output tracking result, it is also proven that the parameter estimate vector is driven to a constant vector. In the second part of the chapter, a learning controller is designed and proven to yield a semi-global asymptotic tracking result in the presence of additive disturbances where the desired trajectory is periodic. A continuous nonlinear integral feedback component is utilized in the design of both controllers and Lyapunov-based techniques are used to guarantee that the tracking error is asymptotically driven to zero. Numerical simulation results are presented for both controllers. In Chapter 4, a new dynamic model for continuum robot manipulators is derived. The dynamic model is developed based on the geometric model of extensible continuum robot manipulators with no torsional effects. The development presented in this chapter is an extension of the dynamic model proposed in [2] (by Mochiyama and Suzuki) to include a class of extensible continuum robot manipulators. First, the kinetic energy of a slice of the continuum robot is evaluated. Next, the total kinetic energy of the manipulator is obtained by utilizing a limit operation (i.e., sum of the kinetic energy of all the slices). Then, the gravitational potential energy of the manipulator is derived. Next, the elastic potential energy of the manipulator is derived for both bending and extension. Finally, the dynamic model of a planar 3-section extensible continuum robot manipulator is derived by utilizing the Lagrange representation. Numerical simulation results are presented for a planar 3-section extensible continuum robot manipulator