Novel observers for compensation of communication delay in bilateral control systems

The problem of communication delay in bilateral or teleoperation systems is even more emphasized with the use of the internet for communication, which may give rise to loss of transparency and even instability. To address the problem, numerous methods have been proposed. This study is among the few recent studies taking a disturbance observer approach to the problem of time delay, and introduces a novel sliding-mode observer to overcome specifically the effects of communication delay in the feedback loop. The observer operates in combination with a PD+ controller which controls the system dynamics, while also compensating load torque uncertainties on the slave side. To this aim, an EKF based load estimation algorithm is performed on the slave side. The performance of this approach is tested with computer simulations for the teleoperation of a 1-DOF robotic arm. The simulations reveal an acceptable amount of accuracy and transparency between the estimated slave and actual slave position under both constant and random measurement delay and variable and step-type load variations on the slave side, motivating the use of the approach for internet-based bilateral control systems

Teleoperation of passivity-based model reference robust control over the internet

This dissertation offers a survey of a known theoretical approach and novel experimental results in establishing a live communication medium through the internet to host a virtual communication environment for use in Passivity-Based Model Reference Robust Control systems with delays. The controller which is used as a carrier to support a robust communication between input-to-state stability is designed as a control strategy that passively compensates for position errors that arise during contact tasks and strives to achieve delay-independent stability for controlling of aircrafts or other mobile objects. Furthermore the controller is used for nonlinear systems, coordination of multiple agents, bilateral teleoperation, and collision avoidance thus maintaining a communication link with an upper bound of constant delay is crucial for robustness and stability of the overall system. For utilizing such framework an elucidation can be formulated by preparing site survey for analyzing not only the geographical distances separating the nodes in which the teleoperation will occur but also the communication parameters that define the virtual topography that the data will travel through. This survey will first define the feasibility of the overall operation since the teleoperation will be used to sustain a delay based controller over the internet thus obtaining a hypothetical upper bound for the delay via site survey is crucial not only for the communication system but also the delay is required for the design of the passivity-based model reference robust control. Following delay calculation and measurement via site survey, bandwidth tests for unidirectional and bidirectional communication is inspected to ensure that the speed is viable to maintain a real-time connection. Furthermore from obtaining the results it becomes crucial to measure the consistency of the delay throughout a sampled period to guarantee that the upper bound is not breached at any point within the communication to jeopardize the robustness of the controller. Following delay analysis a geographical and topological overview of the communication is also briefly examined via a trace-route to understand the underlying nodes and their contribution to the delay and round-trip consistency. To accommodate the communication channel for the controller the input and output data from both nodes need to be encapsulated within a transmission control protocol via a multithreaded design of a robust program within the C language. The program will construct a multithreaded client-server relationship in which the control data is transmitted. For added stability and higher level of security the channel is then encapsulated via an internet protocol security by utilizing a protocol suite for protecting the communication by authentication and encrypting each packet of the session using negotiation of cryptographic keys during each session

An adaptive controller for enhancing operator performance during teleoperation

An adaptive controller is developed for adjusting robot arm parameters while manipulating payloads of unknown mass and inertia. The controller is tested experimentally in a master/slave configuration where the adaptive slave arm is commanded via human operator inputs from a master. Kinematically similar six-joint master and slave arms are used with the last three joints locked for simplification. After a brief initial adaptation period for the unloaded arm, the slave arm retrieves different size payloads and maneuvers them about the workspace. Comparisons are then drawn with similar tasks where the adaptation is turned off. Several simplifications of the controller dynamics are also addressed and experimentally verified

NASA space station automation: AI-based technology review

Research and Development projects in automation for the Space Station are discussed. Artificial Intelligence (AI) based automation technologies are planned to enhance crew safety through reduced need for EVA, increase crew productivity through the reduction of routine operations, increase space station autonomy, and augment space station capability through the use of teleoperation and robotics. AI technology will also be developed for the servicing of satellites at the Space Station, system monitoring and diagnosis, space manufacturing, and the assembly of large space structures

Viewfinder: final activity report

The VIEW-FINDER project (2006-2009) is an 'Advanced Robotics' project that seeks to apply a semi-autonomous robotic system to inspect ground safety in the event of a fire. Its primary aim is to gather data (visual and chemical) in order to assist rescue personnel. A base station combines the gathered information with information retrieved from off-site sources. The project addresses key issues related to map building and reconstruction, interfacing local command information with external sources, human-robot interfaces and semi-autonomous robot navigation. The VIEW-FINDER system is a semi-autonomous; the individual robot-sensors operate autonomously within the limits of the task assigned to them, that is, they will autonomously navigate through and inspect an area. Human operators monitor their operations and send high level task requests as well as low level commands through the interface to any nodes in the entire system. The human interface has to ensure the human supervisor and human interveners are provided a reduced but good and relevant overview of the ground and the robots and human rescue workers therein

Sensorless force feedback joystick control for teleoperation of construction equipment

This paper aims to develop an innovative approach named sensorless force feedback joystick control for teleoperation of construction equipment. First, a force sensorless supervisory controller is designed with two advanced modules: a neural network-based environment classifier to estimate environment characteristics without requiring a force sensor and, a fuzzy-based force feedback tuner to generate properly a force reflection to the joystick. Second, two local robust adaptive controllers are simply built using neural network and Lyapunov stability condition to ensure desired task performances at both master and slave sites. A teleoperation system is setup to demonstrate the applicability of the proposed approach

Aerospace medicine and biology: A continuing bibliography with indexes (supplement 320)

This bibliography lists 125 reports, articles and other documents introduced into the NASA Scientific and Technical Information System during January, 1989. Subject coverage includes: aerospace medicine and psychology, life support systems and controlled environments, safety equipment, exobiology and extraterrestrial life, and flight crew behavior and performance

Neural Dynamics of Delayed Feedback in Robot Teleoperation: Insights from fNIRS Analysis

As robot teleoperation increasingly becomes integral in executing tasks in distant, hazardous, or inaccessible environments, the challenge of operational delays remains a significant obstacle. These delays are inherent in signal transmission and processing and can adversely affect the operators performance, particularly in tasks requiring precision and timeliness. While current research has made strides in mitigating these delays through advanced control strategies and training methods, a crucial gap persists in understanding the neurofunctional impacts of these delays and the efficacy of countermeasures from a cognitive perspective. Our study narrows this gap by leveraging functional Near-Infrared Spectroscopy (fNIRS) to examine the neurofunctional implications of simulated haptic feedback on cognitive activity and motor coordination under delayed conditions. In a human-subject experiment (N=41), we manipulated sensory feedback to observe its influences on various brain regions of interest (ROIs) response during teleoperation tasks. The fNIRS data provided a detailed assessment of cerebral activity, particularly in ROIs implicated in time perception and the execution of precise movements. Our results reveal that certain conditions, which provided immediate simulated haptic feedback, significantly optimized neural functions related to time perception and motor coordination, and improved motor performance. These findings provide empirical evidence about the neurofunctional basis of the enhanced motor performance with simulated synthetic force feedback in the presence of teleoperation delays.Comment: Submitted to Frontiers in Human Neuroscienc

Simplifying Tool Usage in Teleoperative Tasks

Modern robotic research has presented the opportunity for enhanced teleoperative systems. Teleprogramming has been developed for teleoperation in time-delayed environments, but can also lead to increased productivity in non-delayed teleoperation. Powered tools are used to increase the abilities of the remote manipulator. However, tools add to the complexity of the system, both in terms of control and sensing. Teleprogramming can be used to simplify the operators interaction with the manipulator/tool system. Further, the adaptive sensing algorithm of the remote site system (using an instrumented compliant wrist for feedback) simplifies the sensory requirements of the system. Current remote-site implementation of a teleprogramming tool-usage strategy that simplifies tool use is described in this document. The use of powered tools in teleoperation tasks is illustrated by two examples, one using an air-powered impact wrench, and the other using an electric winch. Both of these tools are implemented at our remote site workcell, consisting of a Puma 560 robot working on the task of removing the top of a large box