Passive Control Architectures for Collaborative Virtual Haptic Interaction and Bilateral Teleoperation over Unreliable Packet-Switched Digital Network

This PhD dissertation consists of two major parts: collaborative haptic interaction (CHI) and bilateral teleoperation over the Internet. For the CHI, we propose a novel hybrid peer-to-peer (P2P) architecture including the shared virtual environment (SVE) simulation, coupling between the haptic device and VE, and P2P synchronization control among all VE copies. This framework guarantees the interaction stability for all users with general unreliable packet-switched communication network which is the most challenging problem for CHI control framework design. This is achieved by enforcing our novel \emph{passivity condition} which fully considers time-varying non-uniform communication delays, random packet loss/swapping/duplication for each communication channel. The topology optimization method based on graph algebraic connectivity is also developed to achieve optimal performance under the communication bandwidth limitation. For validation, we implement a four-user collaborative haptic system with simulated unreliable packet-switched network connections. Both the hybrid P2P architecture design and the performance improvement due to the topology optimization are verified. In the second part, two novel hybrid passive bilateral teleoperation control architectures are proposed to address the challenging stability and performance issues caused by the general Internet communication unreliability (e.g. varying time delay, packet loss, data duplication, etc.). The first method--Direct PD Coupling (DPDC)--is an extension of traditional PD control to the hybrid teleoperation system. With the assumption that the Internet communication unreliability is upper bounded, the passive gain setting condition is derived and guarantees the interaction stability for the teleoperation system which interacts with unknown/unmodeled passive human and environment. However, the performance of DPDC degrades drastically when communication unreliability is severe because its feasible gain region is limited by the device viscous damping. The second method--Virtual Proxy Based PD Coupling (VPDC)--is proposed to improve the performance while providing the same interaction stability. Experimental and quantitative comparisons between DPDC and VPDC are conducted, and both interaction stability and performance difference are validated

Sampled data systems passivity and discrete port-Hamiltonian systems

In this paper, we present a novel way to approach the interconnection of a continuous and a discrete time physical system first presented in [1][2] [3]. This is done in a way which preserves passivity of the coupled system independently of the sampling time T. This strategy can be used both in the field of telemanipulation, for the implementation of a passive master/slave system on a digital transmission line with varying time delays and possible loss of packets (e.g., the Internet), and in the field of haptics, where the virtual environment should `feel¿ like a physical equivalent system

An Analysis of Sampling Effect on the Absolute Stability of Discrete-time Bilateral Teleoperation Systems

Absolute stability of discrete-time teleoperation systems can be jeopardized by choosing inappropriate sampling time architecture. A modified structure is presented for the bilateral teleoperation system including continuous-time slave robot, master robot, human operator, and the environment with sampled-data PD-like + dissipation controllers which make the system absolute stable in the presence of the time delay and sampling rates in the communication network. The output position and force signals are quantized with uniform sampling periods. Input-delay approach is used in this paper to convert the sampled-data system to a continuous-time counterpart. The main contribution of this paper is calculating a lower bound on the maximum sampling period as a stability condition. Also, the presented method imposes upper bounds on the damping of robots and notifies the sampling time importance on the transparency and stability of the system. Both simulation and experimental results are performed to show the validity of the proposed conditions and verify the effectiveness of the sampling scheme

The Shape of Damping: Optimizing Damping Coefficients to Improve Transparency on Bilateral Telemanipulation

This thesis presents a novel optimization-based passivity control algorithm for hapticenabled bilateral teleoperation systems involving multiple degrees of freedom. In particular, in the context of energy-bounding control, the contribution focuses on the implementation of a passivity layer for an existing time-domain scheme, ensuring optimal transparency of the interaction along subsets of the environment space which are preponderant for the given task, while preserving the energy bounds required for passivity. The involved optimization problem is convex and amenable to real-time implementation. The effectiveness of the proposed design is validated via an experiment performed on a virtual teleoperated environment. The interplay between transparency and stability is a critical aspect in haptic-enabled bilateral teleoperation control. While it is important to present the user with the true impedance of the environment, destabilizing factors such as time delays, stiff environments, and a relaxed grasp on the master device may compromise the stability and safety of the system. Passivity has been exploited as one of the the main tools for providing sufficient conditions for stable teleoperation in several controller design approaches, such as the scattering algorithm, timedomain passivity control, energy bounding algorithm, and passive set position modulation. In this work it is presented an innovative energy-based approach, which builds upon existing time-domain passivity controllers, improving and extending their effectiveness and functionality. The set of damping coefficients are prioritized in each degree of freedom, the resulting transparency presents a realistic force feedback in comparison to the other directions. Thus, the prioritization takes effect using a quadratic programming algorithm to find the optimal values for the damping. Finally, the energy tanks approach on passivity control is a solution used to ensure stability in a system for robotics bilateral manipulation. The bilateral telemanipulation must maintain the principle of passivity in all moments to preserve the system\u2019s stability. This work presents a brief introduction to haptic devices as a master component on the telemanipulation chain; the end effector in the slave side is a representation of an interactive object within an environment having a force sensor as feedback signal. The whole interface is designed into a cross-platform framework named ROS, where the user interacts with the system. Experimental results are presented

Experimental Evaluation of the Projection-based Force Reflection Algorithms for Haptic Interaction with Virtual Environment

Haptic interaction with virtual environments is currently a major and growing area of research with a number of emerging applications, particularly in the field of robotics. Digital implementation of the virtual environments, however, introduces errors which may result in instability of the haptic displays. This thesis deals with experimental investigation of the Projection-Based Force Reflection Algorithms (PFRAs) for haptic interaction with virtual environments, focusing on their performance in terms of stability and transparency. Experiments were performed to compare the PFRA in terms of performance for both non-delayed and delayed haptic interactions with more conventional haptic rendering methods, such as the Virtual Coupling (VC) and Wave Variables (WV). The results demonstrated that the PFRA is more stable, guarantees higher levels of transparency, and is less sensitive to decrease in update rates

Ground verification of the feasibility of telepresent on-orbit servicing

In an ideal case telepresence achieves a state in which a human operator can no longer differentiate between an interaction with a real environment and a technical mediated one. This state is called transparent telepresence. The applicability of telepresence to on-orbit servicing (OOS), i.e., an unmanned servicing operation in space, teleoperated from ground in real time, is verified in this paper. For this purpose, a communication test environment was set up on the ground, which involved the Institute of Astronautics (LRT) ground station in Garching, Germany, and the European Space Agency (ESA) ground station in Redu, Belgium. Both were connected via the geostationary ESA data relay satellite ARTEMIS. Utilizing the data relay satellite, a teleoperation was accomplished in which the human operator as well as the (space) teleoperator was located on the ground. The feasibility of telepresent OOS was evaluated, using an OOS test bed at the Institute of Mechatronics and Robotics at the German Aerospace Center (DLR). The manipulation task was representative for OOS and supported real-time feedback from the haptic-visual workspace. The tests showed that complex manipulation tasks can be fulfilled by utilizing geostationary data relay satellites. For verifying the feasibility of telepresent OOS, different evaluation methods were used. The properties of the space link were measured and related to subjective perceptions of participants, who had to fulfill manipulation tasks. An evaluation of the transparency of the system, including the data relay satellite, was accomplished as well

Wavelet packet transform based compression for bilateral teleoperation

This paper introduces a codec scheme for compressing the control and feedback signals in bilateral control systems. The method makes use of Wavelet Packet Transform (WPT) and Inverse Wavelet Packet Transform (IWPT) for coding and decoding operations respectively. Data compression is carried out in low pass filter output by reducing the sampling rate; and in high pass filter output by truncating the wavelet coefficients. The proposed codec works on both directions of signal transmission between a master robot and a slave robot over a networked motion control architecture. Following the formulation of the compression/decompression methodology, experimental validation is conducted on a single degree of freedom (DOF) motion control system. In the experiments, responses from different Wavelet structures are analyzed and a comparative study is carried out considering the factors of compression rate, reconstruction power error and real time computational complexity. It is confirmed that the controller using the proposed compression algorithm performs very close to the uncompressed one while enabling transmission of much less data over network