The Underpinnings of Workload in Unmanned Vehicle Systems

This paper identifies and characterizes factors that contribute to operator workload in unmanned vehicle systems. Our objective is to provide a basis for developing models of workload for use in design and operation of complex human-machine systems. In 1986, Hart developed a foundational conceptual model of workload, which formed the basis for arguably the most widely used workload measurement techniquethe NASA Task Load Index. Since that time, however, there have been many advances in models and factor identification as well as workload control measures. Additionally, there is a need to further inventory and describe factors that contribute to human workload in light of technological advances, including automation and autonomy. Thus, we propose a conceptual framework for the workload construct and present a taxonomy of factors that can contribute to operator workload. These factors, referred to as workload drivers, are associated with a variety of system elements including the environment, task, equipment and operator. In addition, we discuss how workload moderators, such as automation and interface design, can be manipulated in order to influence operator workload. We contend that workload drivers, workload moderators, and the interactions among drivers and moderators all need to be accounted for when building complex, human-machine systems

Autonomous Systems, Robotics, and Computing Systems Capability Roadmap: NRC Dialogue

Contents include the following: Introduction. Process, Mission Drivers, Deliverables, and Interfaces. Autonomy. Crew-Centered and Remote Operations. Integrated Systems Health Management. Autonomous Vehicle Control. Autonomous Process Control. Robotics. Robotics for Solar System Exploration. Robotics for Lunar and Planetary Habitation. Robotics for In-Space Operations. Computing Systems. Conclusion

Technologies and Operations for High Voltage Corona Detection with UAVs

Autonomous UAV transmission line inspection served as a reference mission for NASA demonstration of UAV deployment for economic benefit; this paper reports corona sensing advances in development of that reference mission. Unmanned aerial vehicles can serve as a platform for autonomous sensing and location of high voltage coronal discharge. Simple processing of commercial corona camera imagery can automate discharge localization and documentation. Inexpensive ultraviolet point sensors can sense discharge when carried close to the defect with a UAV. Augmented with a parabolic mirror, point sensor range can be increased to a safe inspection standoff distance, at the cost of a narrowed field of view. Results from a test flight of an augmented UV sensor are described. The imaging approach is superior in sensitivity and acquisition time, while the point sensor approach has superior size, weight, cost and durability advantages

Aerial identification of flashed over faulty insulator using binary image classification

Flashed over insulator faults are the most significant faults in high voltage line insulators. They are complicated to identify using traditional methods due to their labor-intensive nature. This study proposes a deep learning-based algorithm for detecting flashed over insulator faults in the real time. The algorithm is based on the Resnet 50 architecture, which has been shown to be effective for image classification tasks in the previous studies regarding image analysis. The algorithm is fast, robust and efficient, making it suitable for real-time applications. The algorithm is trained on a dataset of images of flashed over and non-flashed over insulators. This dataset was collected from various transmission lines and National Center of Robotics and Automation, which are located in Pakistan. For validating the effectiveness of the Resnet 50 algorithm, it was compared with the results obtained from the two other widely popular deep learning algorithms, Densenet 121 and VGG 16 (trained and validated on the same dataset). The results showed that the Resnet 50 was able to detect flashed over insulator faults with an accuracy of over 99%. Whereas the Densenet 121 and VGG 16 have achieved an accuracy of less than 51%

First Responders' Localization and Health Monitoring During Rescue Operations

Currently, first responders’ coordination and decision-making during res-cue, firefighting or police operations is performed via radio/GSM channels with some support of video streaming. In unknown premises, officers have no global situational awareness on operation status, which reduces coordination efficiency and increases decision making mistakes. This paper pro-poses a solution enabling the situational awareness by introducing an integrated operation workflow for actors localization and health monitoring. The solution will provide global situational awareness to both coordinators and actors, thereby increasing efficiency of coordination, reducing mistakes in decision making and diminishing risks of unexpected situations to appear. This will result in faster operation progress, lower number of human casualties and financial losses and, the most important, saved human lives in calamity situations

Radicalization of Airspace Security: Prospects and Botheration of Drone Defense System Technology

The development of a comprehensive and decisive drone defense integrated control system that can provide maximum security is crucial for maintaining territorial integrity and accelerating smart aerial mobility to sustain the emerging drone transportation system (DTS) for priority-based logistics and mobile communication. This study explores recent developments in the design of robust drone defense control systems that can observe and respond not only to drone attacks inside and outside a facility but also to equipment data such as CCTV security control on the ground and security sensors in the facility at a glance. Also, it considered DDS strategies, schema, and innovative security setups in different regions. Finally, open research issues in DDs designs are discussed, and useful recommendations are provided. Effective means for drone source authentication, delivery package verification, operator authorization, and dynamic scenario-specific engagement are solicited for comprehensive DDS design for maximum security Received: 2023-03-07 Revised: 2023-04-2

Generative AI for Unmanned Vehicle Swarms: Challenges, Applications and Opportunities

With recent advances in artificial intelligence (AI) and robotics, unmanned vehicle swarms have received great attention from both academia and industry due to their potential to provide services that are difficult and dangerous to perform by humans. However, learning and coordinating movements and actions for a large number of unmanned vehicles in complex and dynamic environments introduce significant challenges to conventional AI methods. Generative AI (GAI), with its capabilities in complex data feature extraction, transformation, and enhancement, offers great potential in solving these challenges of unmanned vehicle swarms. For that, this paper aims to provide a comprehensive survey on applications, challenges, and opportunities of GAI in unmanned vehicle swarms. Specifically, we first present an overview of unmanned vehicles and unmanned vehicle swarms as well as their use cases and existing issues. Then, an in-depth background of various GAI techniques together with their capabilities in enhancing unmanned vehicle swarms are provided. After that, we present a comprehensive review on the applications and challenges of GAI in unmanned vehicle swarms with various insights and discussions. Finally, we highlight open issues of GAI in unmanned vehicle swarms and discuss potential research directions.Comment: 23 page

Design knowledge for deep-learning-enabled image-based decision support systems — evidence from power line maintenance decision-making [in press]

With the ever-increasing societal dependence on electricity, one of the critical tasks in power supply is maintaining the power line infrastructure. In the process of making informed, cost-effective, and timely decisions, maintenance engineers must rely on human-created, heterogeneous, structured, and also largely unstructured information. The maturing research on vision-based power line inspection driven by advancements in deep learning offers first possibilities to move towards more holistic, automated, and safe decision-making. However, (current) research focuses solely on the extraction of information rather than its implementation in decision-making processes. This paper addresses this shortcoming by designing, instantiating, and evaluating a holistic deep-learning-enabled image-based decision support system artifact for power line maintenance at a German distribution system operator in southern Germany. Following the design science research paradigm two main components of the artifact are designed: A deep-learning-based model component responsible for automatic fault detection of power line parts as well as a user-oriented interface responsible for presenting the captured information in a way that enables more informed decisions. As a basis for both components, preliminary design requirements from literature and the application field are derived. Drawing on justificatory knowledge from deep learning as well as decision support systems, tentative design principles are derived. Based on these design principles, a prototype of the artifact is implemented that allows for rigorous evaluation of the design knowledge in multiple evaluation episodes, covering different angles. Through a technical experiment the technical novelty of the artifact\u27s capability to capture selected faults (regarding insulators and safety pins) on unmanned aerial vehicle (UAV)-captured image data (model component) is validated. Subsequent interviews, surveys, and workshops in a natural environment confirm the usefulness of the model as well as the user interface component. The evaluation provides evidence that (1) the image processing approach manages to address the gap of power line component inspection and (2) that the proposed holistic design knowledge for image-based decision support systems enables more informed decision-making. This paper therefore contributes to research and practice in three ways. First, the technical feasibility to detect certain maintenance-intensive parts of power lines with the help of unique UAV image data is shown. Second, the distribution system operators specific problem is solved by supporting decisions in maintenance with the proposed image-based decision support system. Third, precise design knowledge for image-based decision support systems is formulated that can inform future system designs of a similar nature

2020 NASA Technology Taxonomy

This document is an update (new photos used) of the PDF version of the 2020 NASA Technology Taxonomy that will be available to download on the OCT Public Website. The updated 2020 NASA Technology Taxonomy, or "technology dictionary", uses a technology discipline based approach that realigns like-technologies independent of their application within the NASA mission portfolio. This tool is meant to serve as a common technology discipline-based communication tool across the agency and with its partners in other government agencies, academia, industry, and across the world