Function based control for bilateral systems in tele-micromanipulation

Design of a motion control system should take into account (a) unconstrained motion performed without interaction with environment or any other system, and (b) constrained motion with system in contact with environment or other systems. Control in both cases can be formulated in terms of maintaining desired system configuration what makes essentially the same structure for common tasks: trajectory tracking, interaction force control, compliance control etc. The same design approach can be used to formulate control in bilateral systems aimed to maintain desired functional relations between human and environment through master and slave motion systems. Implementation of the methodology is currently being pursued with a custom built Tele-micromanipulation setup and preliminary results concerning force/position tracking and transparency between master and slave are clearly demonstrated

Model Mediated Teleoperation with a Hand-Arm Exoskeleton in Long Time Delays Using Reinforcement Learning

Telerobotic systems must adapt to new environmental conditions and deal with high uncertainty caused by long-time delays. As one of the best alternatives to human-level intelligence, Reinforcement Learning (RL) may offer a solution to cope with these issues. This paper proposes to integrate RL with the Model Mediated Teleoperation (MMT) concept. The teleoperator interacts with a simulated virtual environment, which provides instant feedback. Whereas feedback from the real environment is delayed, feedback from the model is instantaneous, leading to high transparency. The MMT is realized in combination with an intelligent system with two layers. The first layer utilizes Dynamic Movement Primitives (DMP) which accounts for certain changes in the avatar environment. And, the second layer addresses the problems caused by uncertainty in the model using RL methods. Augmented reality was also provided to fuse the avatar device and virtual environment models for the teleoperator. Implemented on DLR's Exodex Adam hand-arm haptic exoskeleton, the results show RL methods are able to find different solutions when changes are applied to the object position after the demonstration. The results also show DMPs to be effective at adapting to new conditions where there is no uncertainty involved

Control of interconnected mechanical systems

In this paper control systems design approach, based on siding mode methods, that allows maintain some functional relation – like bilateral or multilateral systems, establishment of virtual relation among mobile robots or control of haptic systems - is presented. It is shown that all basic motion control problems - trajectory tracking, force control, hybrid position/force control scheme and the impedance control for the interacting systems- can be treated in the same way while avoiding the structural change of the controller and guarantying stable behavior of the system In order to show applicability of the proposed techniques simulation and experimental results for high precision systems in microsystems assembly tasks are presented.

Sensors Allocation and Observer Design for Discrete Bilateral Teleoperation Systems with Multi-Rate Sampling

This study addresses sensor allocation by analyzing exponential stability for discrete-time teleoperation systems. Previous studies mostly concentrate on the continuous-time teleoperation systems and neglect the management of significant practical phenomena, such as data-swap, the effect of sampling rates of samplers, and refresh rates of actuators on the system’s stability. A multi-rate sampling approach is proposed in this study, given the isolation of the master and slave robots in teleoperation systems which may have different hardware restrictions. This architecture collects data through numerous sensors with various sampling rates, assuming that a continuous-time controller stabilizes a linear teleoperation system. The aim is to assign each position and velocity signals to sensors with different sampling rates and divide the state vector between sensors to guarantee the stability of the resulting multi-rate sampled-data teleoperation system. Sufficient Krasovskii-based conditions will be provided to preserve the exponential stability of the system. This problem will be transformed into a mixed-integer program with LMIs (linear matrix inequalities). These conditions are also used to design the observers for the multi-rate teleoperation systems whose estimation errors converge exponentially to the origin. The results are validated by numerical simulations which are useful in designing sensor networks for teleoperation systems

Passivity-Based adaptive bilateral teleoperation control for uncertain manipulators without jerk measurements

In this work, we consider the bilateral teleoperation problem of cooperative robotic systems in a Single-Master Multi-Slave (SM/MS) configuration, which is able to perform load transportation tasks in the presence of parametric uncertainty in the robot kinematic and dynamic models. The teleoperation architecture is based on the two-layer approach placed in a hierarchical structure, whose top and bottom layers are responsible for ensuring the transparency and stability properties respectively. The load transportation problem is tackled by using the formation control approach wherein the desired translational velocity and interaction force are provided to the master robot by the user, while the object is manipulated with a bounded constant force by the slave robots. Firstly, we develop an adaptive kinematic-based control scheme based on a composite adaptation law to solve the cooperative control problem for robots with uncertain kinematics. Secondly, the dynamic adaptive control for cooperative robots is implemented by means of a cascade control strategy, which does not require the measurement of the time derivative of force (which requires jerk measurements). The combination of the Lyapunov stability theory and the passivity formalism are used to establish the stability and convergence property of the closed-loop control system. Simulations and experimental results illustrate the performance and feasibility of the proposed control scheme.No presente trabalho, considera-se o problema de teleoperação bilateral de um sistema robótico cooperativo do tipo single-master e multiple-slaves (SM/MS) capaz de realizar tarefas de transporte de carga na presença de incertezas paramétricas no modelo cinemático e dinâmico dos robôs. A arquitetura de teleoperação está baseada na abordagem de duas camadas em estrutura hierárquica, onde as camadas superior e inferior são responsáveis por assegurar as propriedades de transparência e estabilidade respectivamente. O problema de transporte de carga é formulado usando a abordagem de controle de formação onde a velocidade de translação desejada e a força de interação são fornecidas ao robô mestre pelo operador, enquanto o objeto é manipulado pelos robôs escravos com uma força constante limitada. Primeiramente, desenvolve-se um esquema de controle adaptativo cinemático baseado em uma lei de adaptação composta para solucionar o problema de controle cooperativo de robôs com cinemática incerta. Em seguida, o controle adaptativo dinâmico de robôs cooperativos é implementado por meio de uma estratégia de controle em cascata, que não requer a medição da derivada da força (o qual requer a derivada da aceleração ou jerk). A teoria de estabilidade de Lyapunov e o formalismo de passividade são usados para estabelecer as propriedades de estabilidade e a convergência do sistema de controle em malha-fechada. Resultados de simulações numéricas ilustram o desempenho e viabilidade da estratégia de controle proposta

SMC framework in motion control systems

Design of a motion control system should take into account both the unconstrained motion performed without interaction with environment or other system, and the constrained motion where system is in contact with environment or has certain functional interaction with another system. In this paper control systems design approach, based on siding mode methods, that allows selection of control for generic tasks as trajectory and/or force tracking as well as for systems that require maintain some functional relation like bilateral or multilateral systems, establisment of virtual relation among mobile robots or control of haptic systems is presented. It is shown that all basic motion control problems - trajectory tracking, force control, hybrid position/force control scheme and the impedance control - can be treated in the same way while avoiding the structural change of the controller and guarantying stable behavior of the system In order to show applicability of the proposed techniques simulation and experimental results for high precision systems in microsystems assembly tasks and bilateral control systems are presente

Bilateralno upravljanje zasnovano na zadacima za primjene u mikrosustavima

Design of a motion control system, convenient for a wide range of applications in industry, space, biology, medicine, particularly including more than one physics environment is very important. Well known control architectures like trajectory tracking, compliance control, interaction force control are scientific milestones which has common control task: to maintain d esired system configuration. In this concept, motion control system can be an unconstrained motion-performed interaction with neither environment nor any other system, or constrained motion-system in contact with environment and/or other systems. This paper provides the function based design approach to formulate control of constrained system particularly bilateral systems in micromanipulation applications. The control objective a imed to maintain desired functional relations between human and environment defining convenient tasks and their proper relations on master and slave motion systems. Preliminary results concerning position tracking, force control and transparency between master and slave systems are clearly demonstrated.Sinteza slijednog sustava prikladnog za široki raspon primjena u industriji, svemiru, biologiji, medicini te posebno za primjene koje obuhvaćaju više raličitih fizikalnih okruženja, vrlo je važna. Dobro poznate strukture upravljanja poput slijeđenja trajektorije, usklađenog upravljanja i upravljanja interakcijskom silom predstavljaju znanstvene prekretnice koje imaju zajednički upravljački cilj: održavanje željene konfiguracije sustava. U ovom konceptu, slijedni sustav može biti sustav bez ograničenja i bez interakcije s okolinom ili ostalim sustavima, odnosno može biti sustav s ograničenjima koji je spregnut s okolinom i/ili drugim sustavima. Ovaj članak opisuje funkcijski zasnovanu sintezu sustava upravljanja za sustav s ograničenjima, a posebno za bilateralne sustave u mikromanipulacijskim primjenama. Cilj upravljanja je održavanje željenih funkcionalnih relacija izmežu čovjeka i okoline definirajući prikladne zadaće i njihove odgovarajuće relacije za glavni i podređeni slijedni sustav. Preliminarni rezultati vezani uz upravljanje pozicijom, upravljanje silom te veza izmeđ u glavnog i podređ enog sustava su jasno prezentirani

The Shape of Damping: Optimizing Damping Coefficients to Improve Transparency on Bilateral Telemanipulation

This thesis presents a novel optimization-based passivity control algorithm for hapticenabled bilateral teleoperation systems involving multiple degrees of freedom. In particular, in the context of energy-bounding control, the contribution focuses on the implementation of a passivity layer for an existing time-domain scheme, ensuring optimal transparency of the interaction along subsets of the environment space which are preponderant for the given task, while preserving the energy bounds required for passivity. The involved optimization problem is convex and amenable to real-time implementation. The effectiveness of the proposed design is validated via an experiment performed on a virtual teleoperated environment. The interplay between transparency and stability is a critical aspect in haptic-enabled bilateral teleoperation control. While it is important to present the user with the true impedance of the environment, destabilizing factors such as time delays, stiff environments, and a relaxed grasp on the master device may compromise the stability and safety of the system. Passivity has been exploited as one of the the main tools for providing sufficient conditions for stable teleoperation in several controller design approaches, such as the scattering algorithm, timedomain passivity control, energy bounding algorithm, and passive set position modulation. In this work it is presented an innovative energy-based approach, which builds upon existing time-domain passivity controllers, improving and extending their effectiveness and functionality. The set of damping coefficients are prioritized in each degree of freedom, the resulting transparency presents a realistic force feedback in comparison to the other directions. Thus, the prioritization takes effect using a quadratic programming algorithm to find the optimal values for the damping. Finally, the energy tanks approach on passivity control is a solution used to ensure stability in a system for robotics bilateral manipulation. The bilateral telemanipulation must maintain the principle of passivity in all moments to preserve the system\u2019s stability. This work presents a brief introduction to haptic devices as a master component on the telemanipulation chain; the end effector in the slave side is a representation of an interactive object within an environment having a force sensor as feedback signal. The whole interface is designed into a cross-platform framework named ROS, where the user interacts with the system. Experimental results are presented

Model Mediated Teleoperation with a Hand-Arm Exoskeleton in Long Time Delays Using Reinforcement Learning

elerobotic systems must adapt to new environmental conditions and deal with high uncertainty caused by long-time delays. As one of the best alternatives to human-level intelligence, Reinforcement Learning (RL) may offer a solution to cope with these issues. This paper proposes to integrate RL with the Model Mediated Teleoperation (MMT) concept. The teleoperator interacts with a simulated virtual environment, which provides instant feedback. Whereas feedback from the real environment is delayed, feedback from the model is instantaneous, leading to high transparency. The MMT is realized in combination with an intelligent system with two layers. The first layer utilizes Dynamic Movement Primitives (DMP) which accounts for certain changes in the avatar environment. And, the second layer addresses the problems caused by uncertainty in the model using RL methods. Augmented reality was also provided to fuse the avatar device and virtual environment models for the teleoperator. Implemented on DLR's Exodex Adam hand-arm haptic exoskeleton, the results show RL methods are able to find different solutions when changes are applied to the object position after the demonstration. The results also show DMPs to be effective at adapting to new conditions where there is no uncertainty involved

Model-Augmented Haptic Telemanipulation: Concept, Retrospective Overview, and Current Use Cases

Certain telerobotic applications, including telerobotics in space, pose particularly demanding challenges to both technology and humans. Traditional bilateral telemanipulation approaches often cannot be used in such applications due to technical and physical limitations such as long and varying delays, packet loss, and limited bandwidth, as well as high reliability, precision, and task duration requirements. In order to close this gap, we research model-augmented haptic telemanipulation (MATM) that uses two kinds of models: a remote model that enables shared autonomous functionality of the teleoperated robot, and a local model that aims to generate assistive augmented haptic feedback for the human operator. Several technological methods that form the backbone of the MATM approach have already been successfully demonstrated in accomplished telerobotic space missions. On this basis, we have applied our approach in more recent research to applications in the fields of orbital robotics, telesurgery, caregiving, and telenavigation. In the course of this work, we have advanced specific aspects of the approach that were of particular importance for each respective application, especially shared autonomy, and haptic augmentation. This overview paper discusses the MATM approach in detail, presents the latest research results of the various technologies encompassed within this approach, provides a retrospective of DLR's telerobotic space missions, demonstrates the broad application potential of MATM based on the aforementioned use cases, and outlines lessons learned and open challenges