The Effects of Commercial Video Game Playing: A Comparison of Skills and Abilities for the Predator UAV

Currently, Predator unmanned aerial vehicles (UAV) are operated by pilots and navigators experienced with manned combat aircraft. With a projected increase in UAVs, more combat pilots will be needed to operate these aircraft. Yet, if the current operational tempo continues, the supply of combat pilots may not be able to meet the demand. Perhaps alternative pools of Air Force personnel could be considered for UAV duty to meet operational requirements. Because the Predator UAV is a software-driven aircraft, video game players (VGPs) already possess and use many skills that may be similar to those of Predator UAV pilots. A variety of games can add situational awareness skills that a player/airman can bring to a new situation. This research examines the applicability of video-games-based skills to the operation of the Predator UAV. Nine people were interviewed to determine the overlap between piloting skills, UAV-specific skills, and skills gained and developed from gaming. The results indicate that frequent VGPs have the confidence and the consistent ability to obtain and retain new skills, many of which are related to operating the Predator UAV in a 2-D environment while not relying on the visual and nonvisual cues of the manned aircraft pilot

Autonomous aircraft initiative study

The results of a consulting effort to aid NASA Ames-Dryden in defining a new initiative in aircraft automation are described. The initiative described is a multi-year, multi-center technology development and flight demonstration program. The initiative features the further development of technologies in aircraft automation already being pursued at multiple NASA centers and Department of Defense (DoD) research and Development (R and D) facilities. The proposed initiative involves the development of technologies in intelligent systems, guidance, control, software development, airborne computing, navigation, communications, sensors, unmanned vehicles, and air traffic control. It involves the integration and implementation of these technologies to the extent necessary to conduct selected and incremental flight demonstrations

The Underpinnings of Workload in Unmanned Vehicle Systems

This paper identifies and characterizes factors that contribute to operator workload in unmanned vehicle systems. Our objective is to provide a basis for developing models of workload for use in design and operation of complex human-machine systems. In 1986, Hart developed a foundational conceptual model of workload, which formed the basis for arguably the most widely used workload measurement techniquethe NASA Task Load Index. Since that time, however, there have been many advances in models and factor identification as well as workload control measures. Additionally, there is a need to further inventory and describe factors that contribute to human workload in light of technological advances, including automation and autonomy. Thus, we propose a conceptual framework for the workload construct and present a taxonomy of factors that can contribute to operator workload. These factors, referred to as workload drivers, are associated with a variety of system elements including the environment, task, equipment and operator. In addition, we discuss how workload moderators, such as automation and interface design, can be manipulated in order to influence operator workload. We contend that workload drivers, workload moderators, and the interactions among drivers and moderators all need to be accounted for when building complex, human-machine systems

Unmanned Systems Sentinel / 3 June 2016

Approved for public release; distribution is unlimited

Intelligent Autonomous Decision-Making and Cooperative Control Technology of High-Speed Vehicle Swarms

This book is a reprint of the Special Issue “Intelligent Autonomous Decision-Making and Cooperative Control Technology of High-Speed Vehicle Swarms”,which was published in Applied Sciences

Coordinating Team Tactics for Swarm-vs.-Swarm Adversarial Games

While swarms of UAVs have received much attention in the last few years, adversarial swarms (i.e., competitive, swarm-vs.-swarm games) have been less well studied. In this dissertation, I investigate the factors influential in team-vs.-team UAV aerial combat scenarios, elucidating the impacts of force concentration and opponent spread in the engagement space. Specifically, this dissertation makes the following contributions: (1) Tactical Analysis: Identifies conditions under which either explicitly-coordinating tactics or decentralized, greedy tactics are superior in engagements as small as 2-vs.-2 and as large as 10-vs.-10, and examines how these patterns change with the quality of the teams' weapons; (2) Coordinating Tactics: Introduces and demonstrates a deep-reinforcement-learning framework that equips agents to learn to use their own and their teammates' situational context to decide which pre-scripted tactics to employ in what situations, and which teammates, if any, to coordinate with throughout the engagement; the efficacy of agents using the neural network trained within this framework outperform baseline tactics in engagements against teams of agents employing baseline tactics in N-vs.-N engagements for N as small as two and as large as 64; and (3) Bio-Inspired Coordination: Discovers through Monte-Carlo agent-based simulations the importance of prioritizing the team's force concentration against the most threatening opponent agents, but also of preserving some resources by deploying a smaller defense force and defending against lower-penalty threats in addition to high-priority threats to maximize the remaining fuel within the defending team's fuel reservoir.Ph.D

Hierarchical Multi-Agent Reinforcement Learning for Air Combat Maneuvering

The application of artificial intelligence to simulate air-to-air combat scenarios is attracting increasing attention. To date the high-dimensional state and action spaces, the high complexity of situation information (such as imperfect and filtered information, stochasticity, incomplete knowledge about mission targets) and the nonlinear flight dynamics pose significant challenges for accurate air combat decision-making. These challenges are exacerbated when multiple heterogeneous agents are involved. We propose a hierarchical multi-agent reinforcement learning framework for air-to-air combat with multiple heterogeneous agents. In our framework, the decision-making process is divided into two stages of abstraction, where heterogeneous low-level policies control the action of individual units, and a high-level commander policy issues macro commands given the overall mission targets. Low-level policies are trained for accurate unit combat control. Their training is organized in a learning curriculum with increasingly complex training scenarios and league-based self-play. The commander policy is trained on mission targets given pre-trained low-level policies. The empirical validation advocates the advantages of our design choices.Comment: 22nd International Conference on Machine Learning and Applications (ICMLA 23

Machine Learning-Aided Operations and Communications of Unmanned Aerial Vehicles: A Contemporary Survey

The ongoing amalgamation of UAV and ML techniques is creating a significant synergy and empowering UAVs with unprecedented intelligence and autonomy. This survey aims to provide a timely and comprehensive overview of ML techniques used in UAV operations and communications and identify the potential growth areas and research gaps. We emphasise the four key components of UAV operations and communications to which ML can significantly contribute, namely, perception and feature extraction, feature interpretation and regeneration, trajectory and mission planning, and aerodynamic control and operation. We classify the latest popular ML tools based on their applications to the four components and conduct gap analyses. This survey also takes a step forward by pointing out significant challenges in the upcoming realm of ML-aided automated UAV operations and communications. It is revealed that different ML techniques dominate the applications to the four key modules of UAV operations and communications. While there is an increasing trend of cross-module designs, little effort has been devoted to an end-to-end ML framework, from perception and feature extraction to aerodynamic control and operation. It is also unveiled that the reliability and trust of ML in UAV operations and applications require significant attention before full automation of UAVs and potential cooperation between UAVs and humans come to fruition.Comment: 36 pages, 304 references, 19 Figure

Unmanned systems interoperability standards

Over the past several years, there has been rapid growth in the development and employment of unmanned systems in military and civilian endeavors. Some military organizations have expressed concern that these systems are being fielded without sufficient capabilities to interoperate with existing systems. Despite recognition of this requirement, interoperability efforts remain diverse and disjointed across the United States and internationally. The Naval Postgraduate School (NPS), Monterey, California, was sponsored by the U.S. Office of the Secretary of Defense (OSD) Joint Ground Robotics Enterprise (JGRE) in Fiscal Year 2016 (FY16) to explore (1) enhancement of robotics education; (2) improved representation of robotic systems in combat simulations; and (3) interoperability standards for military robotics systems. This report discusses work performed in FY16 to identify current and emerging interoperability standards for unmanned systems, including interactions of robotic systems with command and control (C2) and simulation systems. The investigation included assessment of the applicability of standardization activities in the Simulation Interoperability Standards Organization (SISO) in its development of the Phase 1 Coalition Battle Management Language (C-BML) and currently in-progress Command and Control Systems - Simulation Systems Interoperation (C2SIM) standardization efforts. The report provides a recommended approach, standards, activities, and timetable for a cross-system communications roadmap.Secretary of Defense Joint Ground Robotics Enterprise, 3090 Defense Pentagon, Room 5C756, Washington, DC 20301Office of the Secretary of Defense Joint Ground Robotics Enterprise.Approved for public release; distribution is unlimited

Air-Combat Strategy Using Approximate Dynamic Programming

Unmanned Aircraft Systems (UAS) have the potential to perform many of the dangerous missions currently own by manned aircraft. Yet, the complexity of some tasks, such as air combat, have precluded UAS from successfully carrying out these missions autonomously. This paper presents a formulation of a level flight, fixed velocity, one-on-one air combat maneuvering problem and an approximate dynamic programming (ADP) approach for computing an efficient approximation of the optimal policy. In the version of the problem formulation considered, the aircraft learning the optimal policy is given a slight performance advantage. This ADP approach provides a fast response to a rapidly changing tactical situation, long planning horizons, and good performance without explicit coding of air combat tactics. The method's success is due to extensive feature development, reward shaping and trajectory sampling. An accompanying fast and e ffective rollout-based policy extraction method is used to accomplish on-line implementation. Simulation results are provided that demonstrate the robustness of the method against an opponent beginning from both off ensive and defensive situations. Flight results are also presented using micro-UAS own at MIT's Real-time indoor Autonomous Vehicle test ENvironment (RAVEN).Defense University Research Instrumentation Program (U.S.) (grant number FA9550-07-1-0321)United States. Air Force Office of Scientific Research (AFOSR # FA9550-08-1-0086)American Society for Engineering Education (National Defense Science and Engineering Graduate Fellowship