Human Performance Modeling: Analysis of the Effects of Manned-Unmanned Teaming on Pilot Workload and Mission Performance

Due to the advent of autonomous technology coupled with the extreme expense of manned aircraft, the Department of Defense (DoD) has increased interest in developing affordable, expendable Unmanned Aerial Vehicles (UAVs) to become autonomous wingmen for jet fighters in mosaic warfare. Like a mosaic that forms a whole picture out of smaller pieces, battlefield commanders can utilize disaggregated capabilities, such as Manned-Unmanned Teaming (MUM-T), to operate in contested environments. With a single pilot controlling both the UAVs and manned aircraft, it may be challenging for pilots to manage all systems should the system design not be conducive to a steady state level of workload. To understand the potential effects of MUM-T on the pilot’s cognitive workload, an Improved Performance Research Integration Tool (IMPRINT) Pro pilot workload model was developed. The model predicts the cognitive workload of the pilot in a simulated environment when interacting with both the cockpit and multiple UAVs to provide insight into the effect of Human-Agent Interactions (HAI) and increasing autonomous control abstraction on the pilot’s cognitive workload and mission performance. This research concluded that peaks in workload occur for the pilot during periods of high communications load and this communication may be degraded or delayed during air-to-air engagements. Nonetheless, autonomous control of the UAVs through a combination of Vector Steering, Pilot Directed Engagements, and Tactical Battle Management would enable pilots to successfully command up to 3 UAVs as well as their own aircraft against 4 enemy targets, while maintaining acceptable pilot cognitive workload in an air-to-air mission scenario

The Underpinnings of Workload in Unmanned Vehicle Systems

This paper identifies and characterizes factors that contribute to operator workload in unmanned vehicle systems. Our objective is to provide a basis for developing models of workload for use in design and operation of complex human-machine systems. In 1986, Hart developed a foundational conceptual model of workload, which formed the basis for arguably the most widely used workload measurement techniquethe NASA Task Load Index. Since that time, however, there have been many advances in models and factor identification as well as workload control measures. Additionally, there is a need to further inventory and describe factors that contribute to human workload in light of technological advances, including automation and autonomy. Thus, we propose a conceptual framework for the workload construct and present a taxonomy of factors that can contribute to operator workload. These factors, referred to as workload drivers, are associated with a variety of system elements including the environment, task, equipment and operator. In addition, we discuss how workload moderators, such as automation and interface design, can be manipulated in order to influence operator workload. We contend that workload drivers, workload moderators, and the interactions among drivers and moderators all need to be accounted for when building complex, human-machine systems

Autonomous, Context-Sensitive, Task Management Systems and Decision Support Tools I: Human-Autonomy Teaming Fundamentals and State of the Art

Recent advances in artificial intelligence, machine learning, data mining and extraction, and especially in sensor technology have resulted in the availability of a vast amount of digital data and information and the development of advanced automated reasoners. This creates the opportunity for the development of a robust dynamic task manager and decision support tool that is context sensitive and integrates information from a wide array of on-board and off aircraft sourcesa tool that monitors systems and the overall flight situation, anticipates information needs, prioritizes tasks appropriately, keeps pilots well informed, and is nimble and able to adapt to changing circumstances. This is the first of two companion reports exploring issues associated with autonomous, context-sensitive, task management and decision support tools. In the first report, we explore fundamental issues associated with the development of an integrated, dynamic, flight information and automation management system. We discuss human factors issues pertaining to information automation and review the current state of the art of pilot information management and decision support tools. We also explore how effective human-human team behavior and expectations could be extended to teams involving humans and automation or autonomous systems

EXPLORING THE POTENTIAL OF A MACHINE TEAMMATE

Artificial intelligence has been in use for decades. It is already deployed in manned formations and will continue to be fielded to military units over the next several years. Current strategies and operational concepts call for increased use of artificial-intelligence capabilities across the defense enterprise—from senior leaders to the tactical edge. Unfortunately, artificial intelligence and the warriors that they support will not be compatible "out of the box." Simply bolting an artificial intelligence into teams of humans will not ensure success. The Department of Defense must pay careful attention to how it is deploying artificial intelligences alongside humans. This is especially true in teams where the structure of the team and the behaviors of its members can make or break performance. Because humans and machines work differently, teams should be designed to leverage the strengths of each partner. Team designs should account for the inherent strengths of the machine partner and use them to shore up human weaknesses. This study contributes to the body of knowledge by submitting novel conceptual models that capture the desired team behaviors of humans and machines when operating in human-machine teaming constructs. These models may inform the design of human-machine teams in ways that improve team performance and agility.NPS_Cruser, Monterey, CA 93943Outstanding ThesisMajor, United States Marine CorpsMajor, United States Marine CorpsApproved for public release. Distribution is unlimited

Considerations in Assuring Safety of Increasingly Autonomous Systems

Recent technological advances have accelerated the development and application of increasingly autonomous (IA) systems in civil and military aviation. IA systems can provide automation of complex mission tasks-ranging across reduced crew operations, air-traffic management, and unmanned, autonomous aircraft-with most applications calling for collaboration and teaming among humans and IA agents. IA systems are expected to provide benefits in terms of safety, reliability, efficiency, affordability, and previously unattainable mission capability. There is also a potential for improving safety by removal of human errors. There are, however, several challenges in the safety assurance of these systems due to the highly adaptive and non-deterministic behavior of these systems, and vulnerabilities due to potential divergence of airplane state awareness between the IA system and humans. These systems must deal with external sensors and actuators, and they must respond in time commensurate with the activities of the system in its environment. One of the main challenges is that safety assurance, currently relying upon authority transfer from an autonomous function to a human to mitigate safety concerns, will need to address their mitigation by automation in a collaborative dynamic context. These challenges have a fundamental, multidimensional impact on the safety assurance methods, system architecture, and V&V capabilities to be employed. The goal of this report is to identify relevant issues to be addressed in these areas, the potential gaps in the current safety assurance techniques, and critical questions that would need to be answered to assure safety of IA systems. We focus on a scenario of reduced crew operation when an IA system is employed which reduces, changes or eliminates a human's role in transition from two-pilot operations

Consortium for Robotics and Unmanned Systems Education and Research (CRUSER) 2019 Annual Report

Prepared for: Dr. Brian Bingham, CRUSER DirectorThe Naval Postgraduate School (NPS) Consortium for Robotics and Unmanned Systems Education and Research (CRUSER) provides a collaborative environment and community of interest for the advancement of unmanned systems (UxS) education and research endeavors across the Navy (USN), Marine Corps (USMC) and Department of Defense (DoD). CRUSER is a Secretary of the Navy (SECNAV) initiative to build an inclusive community of interest on the application of unmanned systems (UxS) in military and naval operations. This 2019 annual report summarizes CRUSER activities in its eighth year of operations and highlights future plans.Deputy Undersecretary of the Navy PPOIOffice of Naval Research (ONR)Approved for public release; distribution is unlimited

Consortium for Robotics and Unmanned Systems Education and Research (CRUSER) 2019 Annual Report

Prepared for: Dr. Brian Bingham, CRUSER DirectorThe Naval Postgraduate School (NPS) Consortium for Robotics and Unmanned Systems Education and Research (CRUSER) provides a collaborative environment and community of interest for the advancement of unmanned systems (UxS) education and research endeavors across the Navy (USN), Marine Corps (USMC) and Department of Defense (DoD). CRUSER is a Secretary of the Navy (SECNAV) initiative to build an inclusive community of interest on the application of unmanned systems (UxS) in military and naval operations. This 2019 annual report summarizes CRUSER activities in its eighth year of operations and highlights future plans.Deputy Undersecretary of the Navy PPOIOffice of Naval Research (ONR)Approved for public release; distribution is unlimited