Hierarchical Multi-Agent Reinforcement Learning for Air Combat Maneuvering

The application of artificial intelligence to simulate air-to-air combat scenarios is attracting increasing attention. To date the high-dimensional state and action spaces, the high complexity of situation information (such as imperfect and filtered information, stochasticity, incomplete knowledge about mission targets) and the nonlinear flight dynamics pose significant challenges for accurate air combat decision-making. These challenges are exacerbated when multiple heterogeneous agents are involved. We propose a hierarchical multi-agent reinforcement learning framework for air-to-air combat with multiple heterogeneous agents. In our framework, the decision-making process is divided into two stages of abstraction, where heterogeneous low-level policies control the action of individual units, and a high-level commander policy issues macro commands given the overall mission targets. Low-level policies are trained for accurate unit combat control. Their training is organized in a learning curriculum with increasingly complex training scenarios and league-based self-play. The commander policy is trained on mission targets given pre-trained low-level policies. The empirical validation advocates the advantages of our design choices.Comment: 22nd International Conference on Machine Learning and Applications (ICMLA 23

Aerospace Medicine and Biology: A continuing bibliography with indexes (supplement 291)

This bibliography lists 131 reports, articles and other documents introduced into the NASA scientific and technical information system in November 1986

Aerospace medicine and biology: A continuing bibliography with indexes (supplement 368)

This bibliography lists 305 reports, articles, and other documents introduced into the NASA Scientific and Technical Information System during Sep. 1992. The subject coverage concentrates on the biological, physiological, psychological, and environmental effects to which humans are subjected during and following simulated or actual flight in the Earth's atmosphere or in interplanetary space. References describing similar effects on biological organisms of lower order are also included. Such related topics as sanitary problems, pharmacology, toxicology, safety and survival, life support systems, exobiology, and personnel factors receive appropriate attention. Applied research receives the most emphasis, but references to fundamental studies and theoretical principles related to experimental development also qualify for inclusion

Towards Biological Inspiration in the Development of Complex Systems

Greater understanding of biology in modem times has enabled significant breakthroughs in improving healthcare, quality of life, and eliminating many diseases and congenital illnesses. Simultaneously there is a move towards emulating nature and copying many of the wonders uncovered in biology, resulting in "biologically inspired" systems. Significant results have been reported in a wide range of areas, with systems inspired by nature enabling exploration, communication, and advances that were never dreamed possible just a few years ago. We warn, that as in many other fields of endeavor, we should be inspired by nature and biology, not engage in mimicry. We describe some results of biological inspiration that augur promise in terms of improving the safety and security of systems, and in developing self-managing systems, that we hope will ultimately lead to self-governing systems

Aerospace medicine and biology: A continuing bibliography with indexes

This bibliography lists 180 reports, articles and other documents introduced into the NASA scientific and technical information system in February 1985

Optimal Collision Avoidance Trajectories for Unmanned/Remotely Piloted Aircraft

The post-911 environment has punctuated the force-multiplying capabilities that Remotely Piloted Aircraft (RPA) provides combatant commanders at all echelons on the battlefield. Not only have unmanned aircraft systems made near-revolutionary impacts on the battlefield, their utility and proliferation in law enforcement, homeland security, humanitarian operations, and commercial applications have likewise increased at a rapid rate. As such, under the Federal Aviation Administration (FAA) Modernization and Reform Act of 2012, the United States Congress tasked the FAA to provide for the safe integration of civil unmanned aircraft systems into the national airspace system (NAS) as soon as practicable, but not later than September 30, 2015. However, a necessary entrance criterion to operate RPAs in the NAS is the ability to Sense and Avoid (SAA) both cooperative and noncooperative air traffic to attain a target level of safety as a traditional manned aircraft platform. The goal of this research effort is twofold: First, develop techniques for calculating optimal avoidance trajectories, and second, develop techniques for estimating an intruder aircraft\u27s trajectory in a stochastic environment. This dissertation describes the optimal control problem associated with SAA and uses a direct orthogonal collocation method to solve this problem and then analyzes these results for different collision avoidance scenarios

Aerospace medicine and biology: A continuing bibliography with indexes, supplement 164

This bibliography lists 275 reports, articles, and other documents introduced into the NASA scientific and technical information system in January 1977

99% (Biological) Inspiration …

Greater understanding of biology in modern times has enabled significant breakthroughs in improving healthcare, quality of life, and eliminating many diseases and congenital illnesses. Simultaneously there is a move towards emulating nature and copying many of the wonders uncovered in biology, resulting in “biologically inspired” systems. Significant results have been reported in a wide range of areas, with systems inspired by nature enabling exploration, communication, and advances that were never dreamed possible just a few years ago. We warn, that as in many other fields of endeavor, we should be inspired by nature and biology, not engage in mimicry. We describe some results of biological inspiration that augur promise in terms of improving the safety and security of systems, and in developing self-managing systems, that we hope will ultimately lead to self-governing systems.1st IFIP International Conference on Biologically Inspired Cooperative Computing - Biological Inspiration: Just a dream?Red de Universidades con Carreras en Informática (RedUNCI

Air Force Institute of Technology Research Report 2020

This Research Report presents the FY20 research statistics and contributions of the Graduate School of Engineering and Management (EN) at AFIT. AFIT research interests and faculty expertise cover a broad spectrum of technical areas related to USAF needs, as reflected by the range of topics addressed in the faculty and student publications listed in this report. In most cases, the research work reported herein is directly sponsored by one or more USAF or DOD agencies. AFIT welcomes the opportunity to conduct research on additional topics of interest to the USAF, DOD, and other federal organizations when adequate manpower and financial resources are available and/or provided by a sponsor. In addition, AFIT provides research collaboration and technology transfer benefits to the public through Cooperative Research and Development Agreements (CRADAs). Interested individuals may discuss ideas for new research collaborations, potential CRADAs, or research proposals with individual faculty using the contact information in this document

Aerospace medicine and biology: A continuing bibliography with indexes (supplement 287)

This bibliography lists 346 reports, articles and other documents introduced into the NASA scientific and technical information system in July 1986