NASA space station automation: AI-based technology review. Executive summary

Research and Development projects in automation technology for the Space Station are described. Artificial Intelligence (AI) based technologies are planned to enhance crew safety through reduced need for EVA, increase crew productivity through the reduction of routine operations, increase space station autonomy, and augment space station capability through the use of teleoperation and robotics

Stabilization and control of teleoperation systems with time delays

A control scheme for teleoperation systems with time delay is developed based on the concept of passivity. This control method requires neither detailed knowledge of the manipulator systems nor the mathematical models of the environments, and it is applicable for any time delays. The main contribution of this method is that it is less conservative than the traditional passivity based method. In this method, the passivity controller only operates when the system loses passivity, while in a traditional passivity formulation, the controller works at all times during operation and thus adversely affect the performance of the system.;Using the proposed control scheme, a sub-system is defined that is composed of the communication channel, slave robot and the manipulated environment. This sub system is treated as a one-port network component, and passivity theory is applied to this component to assure stability. The energy flowing into the one-port network, in the form of the control command and the force feedback, is monitored. A passivity regulator is activated to maintain the passivity of the network by modifying the feedback force to the master, and thus adjust the energy exchange between the master and the communication channel.;When this method is applied, only the information at the interface between the master manipulator and the communication channel is collected and observed, there is no need for accurate or detailed knowledge of the structure or timing of the communication channel. The method can make the system lossless regardless of the feedback force, the coordinating force controlling the slave joint motions or the contact force. The approach can stabilize the system regardless of the time delay, discontinuities with environmental contact, or discretization of the physical plant. It will pose no problem when the environmental contact force is directly fed back. The results of this work show that it is advantageous to use the measured environmental force as the feedback, providing superior performance for free motion and more realistic haptic feedback for the operator from the remote environment.;Simulation and experimental results are presented to verify the proposed control scheme

On the use of haptic tablets for UGV teleoperation in unstructured environments: system design and evaluation

Teleoperation of Unmanned Ground Vehicles (UGVs), particularly for inspection of unstructured and unfamiliar environments still raises important challenges from the point of view of the operator interface. One of these challenges is caused by the fact that all information available to the operator is presented to the operator through a computer interface, providing only a partial view of the robot situation. The majority of existing interfaces provide information using visual, and, less frequently, sound channels. The lack of Situation Awareness (SA), caused by this partial view, may lead to an incorrect and inefficient response to the current UGV state, usually confusing and frustrating the human operator. For instance, the UGV may become stuck in debris while the operator struggles to move the robot, not understanding the cause of the UGV lack of motion. We address this problem by studying the use of haptic feedback to improve operator SA. More precisely, improving SA with respect to the traction state of the UGV, using a haptic tablet for both commanding the robot and conveying traction state to the user by haptic feedback. We report (1) a teleoperating interface, integrating a haptic tablet with an existing UGV teleoperation interface, and (2) the experimental results of a user study designed to evaluate the advantage of this interface in the teleoperation of a UGV, in a search and rescue scenario. Statistically significant results were found supporting the hypothesis that using the haptic tablet elicits a reduction in the time that the UGV spends in states without traction.info:eu-repo/semantics/publishedVersio

NASA space station automation: AI-based technology review

Research and Development projects in automation for the Space Station are discussed. Artificial Intelligence (AI) based automation technologies are planned to enhance crew safety through reduced need for EVA, increase crew productivity through the reduction of routine operations, increase space station autonomy, and augment space station capability through the use of teleoperation and robotics. AI technology will also be developed for the servicing of satellites at the Space Station, system monitoring and diagnosis, space manufacturing, and the assembly of large space structures

Advancing automation and robotics technology for the space station and for the US economy: Submitted to the United States Congress October 1, 1987

In April 1985, as required by Public Law 98-371, the NASA Advanced Technology Advisory Committee (ATAC) reported to Congress the results of its studies on advanced automation and robotics technology for use on the space station. This material was documented in the initial report (NASA Technical Memorandum 87566). A further requirement of the Law was that ATAC follow NASA's progress in this area and report to Congress semiannually. This report is the fifth in a series of progress updates and covers the period between 16 May 1987 and 30 September 1987. NASA has accepted the basic recommendations of ATAC for its space station efforts. ATAC and NASA agree that the mandate of Congress is that an advanced automation and robotics technology be built to support an evolutionary space station program and serve as a highly visible stimulator affecting the long-term U.S. economy

Advancing automation and robotics technology for the Space Station Freedom and for the US economy

The progress made by levels 1, 2, and 3 of the Office of Space Station in developing and applying advanced automation and robotics technology is described. Emphasis is placed upon the Space Station Freedom Program responses to specific recommendations made in the Advanced Technology Advisory Committee (ATAC) progress report 10, the flight telerobotic servicer, and the Advanced Development Program. Assessments are presented for these and other areas as they apply to the advancement of automation and robotics technology for the Space Station Freedom

Virtual Reality-Based Interface for Advanced Assisted Mobile Robot Teleoperation

[EN] This work proposes a new interface for the teleoperation of mobile robots based on virtual reality that allows a natural and intuitive interaction and cooperation between the human and the robot, which is useful for many situations, such as inspection tasks, the mapping of complex environments, etc. Contrary to previous works, the proposed interface does not seek the realism of the virtual environment but provides all the minimum necessary elements that allow the user to carry out the teleoperation task in a more natural and intuitive way. The teleoperation is carried out in such a way that the human user and the mobile robot cooperate in a synergistic way to properly accomplish the task: the user guides the robot through the environment in order to benefit from the intelligence and adaptability of the human, whereas the robot is able to automatically avoid collisions with the objects in the environment in order to benefit from its fast response. The latter is carried out using the well-known potential field-based navigation method. The efficacy of the proposed method is demonstrated through experimentation with the Turtlebot3 Burger mobile robot in both simulation and real-world scenarios. In addition, usability and presence questionnaires were also conducted with users of different ages and backgrounds to demonstrate the benefits of the proposed approach. In particular, the results of these questionnaires show that the proposed virtual reality based interface is intuitive, ergonomic and easy to use.This research was funded by the Spanish Government (Grant PID2020-117421RB-C21 funded byMCIN/AEI/10.13039/501100011033) and by the Generalitat Valenciana (Grant GV/2021/181).Solanes, JE.; Muñoz García, A.; Gracia Calandin, LI.; Tornero Montserrat, J. (2022). Virtual Reality-Based Interface for Advanced Assisted Mobile Robot Teleoperation. Applied Sciences. 12(12):1-22. https://doi.org/10.3390/app12126071122121

Sensory Manipulation as a Countermeasure to Robot Teleoperation Delays: System and Evidence

In the field of robotics, robot teleoperation for remote or hazardous environments has become increasingly vital. A major challenge is the lag between command and action, negatively affecting operator awareness, performance, and mental strain. Even with advanced technology, mitigating these delays, especially in long-distance operations, remains challenging. Current solutions largely focus on machine-based adjustments. Yet, there's a gap in using human perceptions to improve the teleoperation experience. This paper presents a unique method of sensory manipulation to help humans adapt to such delays. Drawing from motor learning principles, it suggests that modifying sensory stimuli can lessen the perception of these delays. Instead of introducing new skills, the approach uses existing motor coordination knowledge. The aim is to minimize the need for extensive training or complex automation. A study with 41 participants explored the effects of altered haptic cues in delayed teleoperations. These cues were sourced from advanced physics engines and robot sensors. Results highlighted benefits like reduced task time and improved perceptions of visual delays. Real-time haptic feedback significantly contributed to reduced mental strain and increased confidence. This research emphasizes human adaptation as a key element in robot teleoperation, advocating for improved teleoperation efficiency via swift human adaptation, rather than solely optimizing robots for delay adjustment.Comment: Submitted to Scientific Report

Evaluating Immersive Teleoperation Interfaces: Coordinating Robot Radiation Monitoring Tasks in Nuclear Facilities

We present a virtual reality (VR) teleoperation interface for a ground-based robot, featuring dense 3D environment reconstruction and a low latency video stream, with which operators can immersively explore remote environments. At the UK Atomic Energy Authority's (UKAEA) Remote Applications in Challenging Environments (RACE) facility, we applied the interface in a user study where trained robotics operators completed simulated nuclear monitoring and decommissioning style tasks to compare VR and traditional teleoperation interface designs. We found that operators in the VR condition took longer to complete the experiment, had reduced collisions, and rated the generated 3D map with higher importance when compared to non-VR operators. Additional physiological data suggested that VR operators had a lower objective cognitive workload during the experiment but also experienced increased physical demand. Overall the presented results show that VR interfaces may benefit work patterns in teleoperation tasks within the nuclear industry, but further work is needed to investigate how such interfaces can be integrated into real world decommissioning workflows

Evaluating immersive teleoperation interfaces: coordinating robot radiation monitoring tasks in nuclear facilities

We present a virtual reality (VR) teleoperation interface for a ground-based robot, featuring dense 3D environment reconstruction and a low latency video stream, with which operators can immersively explore remote environments. At the UK Atomic Energy Authority's (UKAEA) Remote Applications in Challenging Environments (RACE) facility, we applied the interface in a user study where trained robotics operators completed simulated nuclear monitoring and decommissioning style tasks to compare VR and traditional teleoperation interface designs. We found that operators in the VR condition took longer to complete the experiment, had reduced collisions, and rated the generated 3D map with higher importance when compared to non-VR operators. Additional physiological data suggested that VR operators had a lower objective cognitive workload during the experiment but also experienced increased physical demand. Overall the presented results show that VR interfaces may benefit work patterns in teleoperation tasks within the nuclear industry, but further work is needed to investigate how such interfaces can be integrated into real world decommissioning workflows