A Comprehensive Survey of the Tactile Internet: State of the art and Research Directions

The Internet has made several giant leaps over the years, from a fixed to a mobile Internet, then to the Internet of Things, and now to a Tactile Internet. The Tactile Internet goes far beyond data, audio and video delivery over fixed and mobile networks, and even beyond allowing communication and collaboration among things. It is expected to enable haptic communication and allow skill set delivery over networks. Some examples of potential applications are tele-surgery, vehicle fleets, augmented reality and industrial process automation. Several papers already cover many of the Tactile Internet-related concepts and technologies, such as haptic codecs, applications, and supporting technologies. However, none of them offers a comprehensive survey of the Tactile Internet, including its architectures and algorithms. Furthermore, none of them provides a systematic and critical review of the existing solutions. To address these lacunae, we provide a comprehensive survey of the architectures and algorithms proposed to date for the Tactile Internet. In addition, we critically review them using a well-defined set of requirements and discuss some of the lessons learned as well as the most promising research directions

Congestion Control for Network-Aware Telehaptic Communication

Telehaptic applications involve delay-sensitive multimedia communication between remote locations with distinct Quality of Service (QoS) requirements for different media components. These QoS constraints pose a variety of challenges, especially when the communication occurs over a shared network, with unknown and time-varying cross-traffic. In this work, we propose a transport layer congestion control protocol for telehaptic applications operating over shared networks, termed as dynamic packetization module (DPM). DPM is a lossless, network-aware protocol which tunes the telehaptic packetization rate based on the level of congestion in the network. To monitor the network congestion, we devise a novel network feedback module, which communicates the end-to-end delays encountered by the telehaptic packets to the respective transmitters with negligible overhead. Via extensive simulations, we show that DPM meets the QoS requirements of telehaptic applications over a wide range of network cross-traffic conditions. We also report qualitative results of a real-time telepottery experiment with several human subjects, which reveal that DPM preserves the quality of telehaptic activity even under heavily congested network scenarios. Finally, we compare the performance of DPM with several previously proposed telehaptic communication protocols and demonstrate that DPM outperforms these protocols.Comment: 25 pages, 19 figure

Teleoperation of passivity-based model reference robust control over the internet

This dissertation offers a survey of a known theoretical approach and novel experimental results in establishing a live communication medium through the internet to host a virtual communication environment for use in Passivity-Based Model Reference Robust Control systems with delays. The controller which is used as a carrier to support a robust communication between input-to-state stability is designed as a control strategy that passively compensates for position errors that arise during contact tasks and strives to achieve delay-independent stability for controlling of aircrafts or other mobile objects. Furthermore the controller is used for nonlinear systems, coordination of multiple agents, bilateral teleoperation, and collision avoidance thus maintaining a communication link with an upper bound of constant delay is crucial for robustness and stability of the overall system. For utilizing such framework an elucidation can be formulated by preparing site survey for analyzing not only the geographical distances separating the nodes in which the teleoperation will occur but also the communication parameters that define the virtual topography that the data will travel through. This survey will first define the feasibility of the overall operation since the teleoperation will be used to sustain a delay based controller over the internet thus obtaining a hypothetical upper bound for the delay via site survey is crucial not only for the communication system but also the delay is required for the design of the passivity-based model reference robust control. Following delay calculation and measurement via site survey, bandwidth tests for unidirectional and bidirectional communication is inspected to ensure that the speed is viable to maintain a real-time connection. Furthermore from obtaining the results it becomes crucial to measure the consistency of the delay throughout a sampled period to guarantee that the upper bound is not breached at any point within the communication to jeopardize the robustness of the controller. Following delay analysis a geographical and topological overview of the communication is also briefly examined via a trace-route to understand the underlying nodes and their contribution to the delay and round-trip consistency. To accommodate the communication channel for the controller the input and output data from both nodes need to be encapsulated within a transmission control protocol via a multithreaded design of a robust program within the C language. The program will construct a multithreaded client-server relationship in which the control data is transmitted. For added stability and higher level of security the channel is then encapsulated via an internet protocol security by utilizing a protocol suite for protecting the communication by authentication and encrypting each packet of the session using negotiation of cryptographic keys during each session

Towards Tactile Internet in Beyond 5G Era: Recent Advances, Current Issues and Future Directions

Tactile Internet (TI) is envisioned to create a paradigm shift from the content-oriented communications to steer/control-based communications by enabling real-time transmission of haptic information (i.e., touch, actuation, motion, vibration, surface texture) over Internet in addition to the conventional audiovisual and data traffics. This emerging TI technology, also considered as the next evolution phase of Internet of Things (IoT), is expected to create numerous opportunities for technology markets in a wide variety of applications ranging from teleoperation systems and Augmented/Virtual Reality (AR/VR) to automotive safety and eHealthcare towards addressing the complex problems of human society. However, the realization of TI over wireless media in the upcoming Fifth Generation (5G) and beyond networks creates various non-conventional communication challenges and stringent requirements in terms of ultra-low latency, ultra-high reliability, high data-rate connectivity, resource allocation, multiple access and quality-latency-rate tradeoff. To this end, this paper aims to provide a holistic view on wireless TI along with a thorough review of the existing state-of-the-art, to identify and analyze the involved technical issues, to highlight potential solutions and to propose future research directions. First, starting with the vision of TI and recent advances and a review of related survey/overview articles, we present a generalized framework for wireless TI in the Beyond 5G Era including a TI architecture, the main technical requirements, the key application areas and potential enabling technologies. Subsequently, we provide a comprehensive review of the existing TI works by broadly categorizing them into three main paradigms; namely, haptic communications, wireless AR/VR, and autonomous, intelligent and cooperative mobility systems. Next, potential enabling technologies across physical/Medium Access Control (MAC) and network layers are identified and discussed in detail. Also, security and privacy issues of TI applications are discussed along with some promising enablers. Finally, we present some open research challenges and recommend promising future research directions

Fuzzy-logic-based control, filtering, and fault detection for networked systems: A Survey

This paper is concerned with the overview of the recent progress in fuzzy-logic-based filtering, control, and fault detection problems. First, the network technologies are introduced, the networked control systems are categorized from the aspects of fieldbuses and industrial Ethernets, the necessity of utilizing the fuzzy logic is justified, and the network-induced phenomena are discussed. Then, the fuzzy logic control strategies are reviewed in great detail. Special attention is given to the thorough examination on the latest results for fuzzy PID control, fuzzy adaptive control, and fuzzy tracking control problems. Furthermore, recent advances on the fuzzy-logic-based filtering and fault detection problems are reviewed. Finally, conclusions are given and some possible future research directions are pointed out, for example, topics on two-dimensional networked systems, wireless networked control systems, Quality-of-Service (QoS) of networked systems, and fuzzy access control in open networked systems.This work was supported in part by the National Natural Science Foundation of China under Grants 61329301, 61374039, 61473163, and 61374127, the Hujiang Foundation of China under Grants C14002 andD15009, the Engineering and Physical Sciences Research Council (EPSRC) of the UK, the Royal Society of the UK, and the Alexander von Humboldt Foundation of Germany

Selection of network parameters in wireless control of bilateral teleoperated manipulators.

This paper describes how to establish performance charts for selection of network parameters for effective utilization of a bilateral teleoperated manipulator working under a wireless communication channel. The goal is to construct a set of charts that help researchers and engineers to select appropriate parameters of wireless network setup for a known configuration of environment obstruction. To achieve this goal, a teleoperated setup comprising a master haptic device, a slave manipulator dynamic simulator, and a communication channel emulated using the network simulator version 2 (NS2) simulator is first developed. Next, performance indices are defined to evaluate the quality of position tracking of the slave manipulator end-effector and force tracking of the master haptic. Three indices chosen in this paper are the integral of squared position and force errors, the integral of absolute position and force error, and the amplitude of position and force overshoot. Extensive experiments on the developed setup are then conducted to study effects of time-varying packet loss on the performance of the teleoperated system. The largest mean packet loss, at which the system exhibits satisfactory tracking, is then quantified. This packet loss is used as an indicator to define regions representing the quality of tracking. The effectiveness of the proposed technique is validated by testing a fully instrumented hydraulically actuated system under various real wireless channel scenarios

Haptic data reduction through dynamic perceptual analysis and event-based communication

This research presents an adjustable and flexible framework for haptic data compression and communication that can be used in a robotic teleoperation session. The framework contains a customized event-driven transmission control protocol, several dynamically adaptive perceptual and prediction methods for haptic sample reduction, and last but not the least, an architecture for the data flow

Redesigning the human-robot interface : intuitive teleoperation of anthropomorphic robots

textA novel interface for robotic teleoperation was developed to enable accurate and highly efficient teleoperation of the Industrial Reconfigurable Anthropomorphic Dual-arm (IRAD) system and other robotic systems. In order to achieve a revolutionary increase in operator productivity, the bilateral/master-slave approach must give way to shared autonomy and unilateral control; autonomy must be employed where possible, and appropriate sensory feedback only where autonomy is impossible; and today’s low-information/high feedback model must be replaced by one that emphasizes feedforward precision and minimal corrective feedback. This is emphasized for task spaces outside of the traditional anthropomorphic scale such as mobile manipulation (i.e. large task spaces) and high precision tasks (i.e. very small task spaces). The system is demonstrated using an anthropomorphically dimensioned industrial manipulator working in task spaces from one meter to less than one millimeter, in both simulation and hardware. This thesis discusses the design requirements and philosophy of this interface, provides a summary of prototype teleoperation hardware, simulation environment, test-bed hardware, and experimental results.Mechanical Engineerin

Bilateral Macro-Micro Teleoperation Using A Magnetic Actuation Mechanism

In recent years, there has been increasing interest in the advancement of microrobotic systems in micro-engineering, micro-fabrication, biological research and biomedical applications. Untethered magnetic-based microrobotic systems are one of the most widely developing groups of microrobotic systems that have been extensively explored for biological and biomedical micro-manipulations. These systems show promise in resolving problems related to on-board power supply limitations as well as mechanical contact sealing and lubrication. In this thesis, a high precision magnetic untethered microrobotic system is demonstrated for micro-handling tasks. A key aspect of the proposed platform concerns the integration of magnetic levitation technology and bilateral macro-micro teleoperation for human intervention to avoid imperceptible failures in poorly observed micro-domain environments. The developed platform has three basic subsystems: a magnetic untethered microrobotic system (MUMS), a haptic device, and a scaled bilateral teleoperation system. The MUMS produces and regulates a magnetic field for non-contact propelling of a microrobot. In order to achieve a controlled motion of the magnetically levitated microrobot, a mathematical force model of the magnetic propulsion mechanism is developed and used to design various control systems. In the workspace of 30 × 32 × 32 mm 3, both PID and LQG\LTR controllers perform similarly the position accuracy of 10 µ m in a vertical direction and 2 µ m in a horizontal motion. The MUMS is equipped with an eddy-current damper to enhance its inherent damping factor in the microrobot's horizontal motions. This paper deals with the modeling and analysis of an eddy-current damper that is formed by a conductive plate placed below the levitated microrobot to overcome inherent dynamical vibrations and improve motion precision. The modeling of eddy-current distribution in the conductive plate is investigated by solving the diffusion equation for vector magnetic potential, and an analytical expression for the horizontal damping force is presented and experimentally validated. It is demonstrated that eddy-current damping is a crucial technique for increasing the damping coefficient in a non-contact way and for improving levitation performance. The damping can be widely used in applications of magnetic actuation systems in micro-manipulation and micro-fabrication. To determine the position of the microrobot in a workspace, the MUMS uses high-accuracy laser sensors. However, laser positioning techniques can only be used in highly transparent environments. A novel technique based on real-time magnetic flux measurement has been proposed for the position estimation of the microrobot in case of laser beam blockage, whereby a combination of Hall-effect sensors is employed to find the microrobot's position in free motion by using the produced magnetic flux. In free motion, the microrobot tends to move toward the horizontally zero magnetic field gradient, Bmax location. As another key feature of the magnetic flux measurement, it was realized that the applied force from the environment to the microrobot can be estimated as linearly proportional to the distance of the microrobot from the Bmax location. The developed micro-domain force estimation method is verified experimentally with an accuracy of 1.27 µ N. A bilateral macro-micro teleoperation technique is employed in the MUMS for the telepresence of a human operator in the task environment. A gain-switching position-position teleoperation scheme is employed and a human operator controls the motion of the microrobot via a master manipulator for dexterous micro-manipulation tasks. The operator can sense a strong force during micro-domain tasks if the microrobot encounters a stiff environment, and the effect of hard contact is fed back to the operator's hand. The position-position method works for both free motion and hard contact. However, to enhance the feeling of a micro-domain environment in the human operator, the scaled force must be transferred to a human, thereby realizing a direct-force-reflection bilateral teleoperation. Additionally, a human-assisted virtual reality interface is developed to improve a human operator's skills in using the haptic-enabled platform, before carrying out an actual dexterous task.1 yea