Diverse applications of advanced man-telerobot interfaces

Advancements in man-machine interfaces and control technologies used in space telerobotics and teleoperators have potential application wherever human operators need to manipulate multi-dimensional spatial relationships. Bilateral six degree-of-freedom position and force cues exchanged between the user and a complex system can broaden and improve the effectiveness of several diverse man-machine interfaces

Virtual Simulation Platform for Training Semi-Autonomous Robotic Vehicles’ Operators

This chapter covers the development of a virtual simulation platform for training a semiautonomous robotic vehicle (SARV) operator via an open-source game engine called Unity3D. The SARV such as remotely operated vehicles (ROVs) is becoming increasingly popular in the maritime industry for risky jobs in inhospitable environments. The primary element in carrying out underwater missions in a hostile environment lies within the skills and experience of an ROV pilot. Training for ROV pilots is essential to prevent damage to expensive field equipment during the real operations. The proposed simulator differs from the existing simulators in the market is the use of modern game engine software to develop a “serious game” for ROV pilot trainee at much lower cost and shorter time-to-market. The results revealed that proposed virtual simulator can develop a high-fidelity virtual reality training for the underwater operation guided by classification society

A New Virtual Reality Interface for Underwater Intervention Missions

Ponencia presentada en IFAC-PapersOnLine, Volume 53, Issue 2, 2020, Pages 14600-14607Nowadays, most underwater intervention missions are developed through the well-known work-class ROVs (Remote Operated Vehicles), equipped with teleoperated arms under human supervision. Thus, despite the appearance on the market of the first prototypes of the so-called I-AUV (Autonomous Underwater Vehicles for Intervention), the most mature technology associated with ROVs continues to be trusted. In order to fill the gap between ROVs and incipient I-AUVs technology, new research is under progress in our laboratory. In particular, new HRI (Human Robot Interaction) capabilities are being tested inside a three-year Spanish coordinated project focused on cooperative underwater intervention missions. In this work new results are presented concerning a new user interface which includes immersion capabilities through Virtual Reality (VR) technology. It is worth noting that a new HRI module has been demonstrated, through a pilot study, in which the users had to solve some specific tasks, with minimum guidance and instructions, following simple Problem Based Learning (PBL) scheme. Finally, it is noticeable that, although this is only a work in progress, the obtained results are promising concerning friendly and intuitive characteristics of the developed HRI module. Thus, some critical aspects, like complexity fall, training time and cognitive fatigue of the ROV pilot, seem more affordable now

TRIDENT: A Framework for Autonomous Underwater Intervention

TRIDENT is a STREP project recently approved by the European Commission whose proposal was submitted to the ICT call 4 of the 7th Framework Program. The project proposes a new methodology for multipurpose underwater intervention tasks. To that end, a cooperative team formed with an Autonomous Surface Craft and an Intervention Autonomous Underwater Vehicle will be used. The proposed methodology splits the mission in two stages mainly devoted to survey and intervention tasks, respectively. The project brings together research skills specific to the marine environments in navigation and mapping for underwater robotics, multi-sensory perception, intelligent control architectures, vehiclemanipulator systems and dexterous manipulation. TRIDENT is a three years project and its start is planned by first months of 2010.This work is partially supported by the European Commission through FP7-ICT2009-248497 projec

Introducing Intelligence and Autonomy into Industrial Robots to Address Operations into Dangerous Area

The paper addresses the issue to use new generation robotic systems inside industrial facilities in order to complete operations in dangerous area. The new robotic systems are currently adopting the autonomous approach already in use in military sector; however, in this context the intensity of operations and the necessity to interact with high productivity systems introduce different challenges. Despite the problems, it is evident that this approach could provide very interesting improvements in terms of safety for humans especially in relations to dangerous area. For instance, in confined spaces, Oil & Gas or Hot Metal Industry these new autonomous systems could reduce the number of injures and casualties. In addition, these systems could increase the operation efficiency in this complex frameworks as well as the possibility to carry out inspections systematically; in this sense, this could result in improving the overall reliability, productivity and safety of the whole Industrial Plant. Therefore, it is important to consider that these systems could be used to address also security aspects such as access control, however they could result vulnerable to new threats such as the cyber ones and need to be properly designed in terms of single entities, algorithms, infrastructure and architecture. From this point of view, it is evident that Modeling and Simulation represent the main approach to design properly these new systems. In this paper, the authors present the use of autonomous systems introducing advanced capabilities supported by Artificial Intelligence to deal with complex operations in dangerous industrial frameworks. The proposed examples in oil and gas and hot metal industry confirm the potential of these systems and demonstrate as simulation supports their introduction in terms of engineering, testing, installation, ramp up and training

AUTONOMOUS SYSTEMS & SAFETY ISSUES: THE ROADMAP TO ENABLE NEW ADVANCES IN INDUSTRIAL APPLICATIONS

The paper addresses the safety issues related to the development of new solutions based on autonomous systems for industrial applications and the necessity to develop experimental environments for investigating these cases; a set of examples is proposed in order to provide cases and challenges as well as to suggest approaches to address these problems

DexROV: Enabling effective dexterous ROV operations in presence of communication latency

Subsea interventions in the oil & gas industry as well as in other domains such as archaeology or geological surveys are demanding and costly activities for which robotic solutions are often deployed in addition or in substitution to human divers - contributing to risks and costs cutting. The operation of ROVs (Remotely Operated Vehicles) nevertheless requires significant off-shore dedicated manpower to handle and operate the robotic platform and the supporting vessel. In order to reduce the footprint of operations, DexROV proposes to implement and evaluate novel operation paradigms with safer, more cost effective and time efficient ROV operations. As a keystone of the proposed approach, manned support will in a large extent be delocalized within an onshore ROV control center, possibly at a large distance from the actual operations, relying on satellite communications. The proposed scheme also makes provision for advanced dexterous manipulation and semi-autonomous capabilities, leveraging human expertise when deemed useful. The outcomes of the project will be integrated and evaluated in a series of tests and evaluation campaigns, culminating with a realistic deep sea (1,300 meters) trial in the Mediterranean sea

Towards automated sample collection and return in extreme underwater environments

© The Author(s), 2022. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Billings, G., Walter, M., Pizarro, O., Johnson-Roberson, M., & Camilli, R. Towards automated sample collection and return in extreme underwater environments. Journal of Field Robotics, 2(1), (2022): 1351–1385, https://doi.org/10.55417/fr.2022045.In this report, we present the system design, operational strategy, and results of coordinated multivehicle field demonstrations of autonomous marine robotic technologies in search-for-life missions within the Pacific shelf margin of Costa Rica and the Santorini-Kolumbo caldera complex, which serve as analogs to environments that may exist in oceans beyond Earth. This report focuses on the automation of remotely operated vehicle (ROV) manipulator operations for targeted biological sample-collection-and-return from the seafloor. In the context of future extraterrestrial exploration missions to ocean worlds, an ROV is an analog to a planetary lander, which must be capable of high-level autonomy. Our field trials involve two underwater vehicles, the SuBastian ROV and the Nereid Under Ice (NUI) hybrid ROV for mixed initiative (i.e., teleoperated or autonomous) missions, both equipped seven-degrees-of-freedom hydraulic manipulators. We describe an adaptable, hardware-independent computer vision architecture that enables high-level automated manipulation. The vision system provides a three-dimensional understanding of the workspace to inform manipulator motion planning in complex unstructured environments. We demonstrate the effectiveness of the vision system and control framework through field trials in increasingly challenging environments, including the automated collection and return of biological samples from within the active undersea volcano Kolumbo. Based on our experiences in the field, we discuss the performance of our system and identify promising directions for future research.This work was funded under a NASA PSTAR grant, number NNX16AL08G, and by the National Science Foundation under grants IIS-1830660 and IIS-1830500. The authors would like to thank the Costa Rican Ministry of Environment and Energy and National System of Conservation Areas for permitting research operations at the Costa Rican shelf margin, and the Schmidt Ocean Institute (including the captain and crew of the R/V Falkor and ROV SuBastian) for their generous support and making the FK181210 expedition safe and highly successful. Additionally, the authors would like to thank the Greek Ministry of Foreign Affairs for permitting the 2019 Kolumbo Expedition to the Kolumbo and Santorini calderas, as well as Prof. Evi Nomikou and Dr. Aggelos Mallios for their expert guidance and tireless contributions to the expedition

Unmanned Systems Sentinel / 24 June 2016

Approved for public release; distribution is unlimited