A Simulation Framework for Fast Design Space Exploration of Unmanned Air System Traffic Management Policies

The number of daily small Unmanned Aircraft Systems (sUAS) operations in uncontrolled low altitude airspace is expected to reach into the millions. UAS Traffic Management (UTM) is an emerging concept aiming at the safe and efficient management of such very dense traffic, but few studies are addressing the policies to accommodate such demand and the required ground infrastructure in suburban or urban environments. Searching for the optimal air traffic management policy is a combinatorial optimization problem with intractable complexity when the number of sUAS and the constraints increases. As the demands on the airspace increase and traffic patterns get complicated, it is difficult to forecast the potential low altitude airspace hotspots and the corresponding ground resource requirements. This work presents a Multi-agent Air Traffic and Resource Usage Simulation (MATRUS) framework that aims for fast evaluation of different air traffic management policies and the relationship between policy, environment and resulting traffic patterns. It can also be used as a tool to decide the resource distribution and launch site location in the planning of a next-generation smart city. As a case study, detailed comparisons are provided for the sUAS flight time, conflict ratio, cellular communication resource usage, for a managed (centrally coordinated) and unmanaged (free flight) traffic scenario.Comment: The Integrated Communications Navigation and Surveillance (ICNS) Conference in 201

Architecture and Information Requirements to Assess and Predict Flight Safety Risks During Highly Autonomous Urban Flight Operations

As aviation adopts new and increasingly complex operational paradigms, vehicle types, and technologies to broaden airspace capability and efficiency, maintaining a safe system will require recognition and timely mitigation of new safety issues as they emerge and before significant consequences occur. A shift toward a more predictive risk mitigation capability becomes critical to meet this challenge. In-time safety assurance comprises monitoring, assessment, and mitigation functions that proactively reduce risk in complex operational environments where the interplay of hazards may not be known (and therefore not accounted for) during design. These functions can also help to understand and predict emergent effects caused by the increased use of automation or autonomous functions that may exhibit unexpected non-deterministic behaviors. The envisioned monitoring and assessment functions can look for precursors, anomalies, and trends (PATs) by applying model-based and data-driven methods. Outputs would then drive downstream mitigation(s) if needed to reduce risk. These mitigations may be accomplished using traditional design revision processes or via operational (and sometimes automated) mechanisms. The latter refers to the in-time aspect of the system concept. This report comprises architecture and information requirements and considerations toward enabling such a capability within the domain of low altitude highly autonomous urban flight operations. This domain may span, for example, public-use surveillance missions flown by small unmanned aircraft (e.g., infrastructure inspection, facility management, emergency response, law enforcement, and/or security) to transportation missions flown by larger aircraft that may carry passengers or deliver products. Caveat: Any stated requirements in this report should be considered initial requirements that are intended to drive research and development (R&D). These initial requirements are likely to evolve based on R&D findings, refinement of operational concepts, industry advances, and new industry or regulatory policies or standards related to safety assurance

Large-Scale Unmanned Aerial Systems Traffic Density Prediction and Management

In recent years, the applications of Unmanned Aerial Systems (UAS) has become more and more popular. We envision that in the near future, the complicated and high density UAS traffic will impose significant burden to air traffic management. Lot of works focus on the application development of individual Small Unmanned Aerial Systems (sUAS) or sUAS management Policy, however, the study of the UAS cluster behaviors such as forecasting and managing of the UAS traffic has generally not been addressed. In order to address the above issue, there is an urgent need to investigate three research directions. The first direction is to develop a high fidelity simulator for the UAS cluster behavior evaluation. The second direction to study real time trajectory planning algorithms to mitigate the high dense UAS traffic. The last direction is to investigate techniques that rapidly and accurately forecast the UAS traffic pattern in the future. In this thesis, we elaborate these three research topics and present a universal paradigm to predict and manage the traffic for the large-scale unmanned aerial systems. To enable the research in UAS traffic management and prediction, a Java based Multi-Agent Air Traffic and Resource Usage Simulation (MATRUS) framework is first developed. We use two types of UAS trajectories, Point-to-Point (P2P) and Man- hattan, as the case study to describe the capability of presented framework. Various communication and propagation models (i.e. log-distance-path loss) can be integrated with the framework to model the communication between UASs and base stations. The results show that MATRUS has the ability to evaluate different sUAS traffic management policies, and can provide insights on the relationships between air traf- fic and communication resource usage for further studies. Moreover, the framework can be extended to study the effect of sUAS Detect-and-Avoid (DAA) mechanisms, implement additional traffic management policies, and handle more complex traffic demands and geographical distributions. Based on the MATRUS framework, we propose a Sparse Represented Temporal- Spatial (SRTS) UAS trajectory planning algorithm. The SRTS algorithm allows the sUAS to avoid static no-fly areas (i.e. static obstacles) or other areas that have congested air traffic or communication traffic. The core functionality of the routing algorithm supports the instant refresh of the in-flight environment making it appropri- ate for highly dynamic air traffic scenarios. The characterization of the routing time and memory usage demonstrate that the SRTS algorithm outperforms a traditional Temporal-Spatial routing algorithm. The deep learning based approach has shown an outstanding success in many areas, we first investigated the possibility of applying the deep neural network in predicting the trajectory of a single vehicle in a given traffic scene. A new trajectory prediction model is developed, which allows information sharing among vehicles using a graph neural network. The prediction is based on the embedding feature, which is derived from multi-dimensional input sequences including the historical trajectory of target and neighboring vehicles, and their relative positions. Compared to other existing trajectory prediction methods, the proposed approach can reduce the pre- diction error by up to 50.00%. Then, we present a deep neural network model that extracts the features from both spatial and temporal domains to predict the UAS traffic density. In addition, a novel input representation of the future sUAS mission information is proposed. The pre-scheduled missions are categorized into 3 types according to their launching times. The results show that our presented model out- performs all of the baseline models. Meanwhile, the qualitative results demonstrate that our model can accurately predict the hot spot in the future traffic map

INTEROPERABILITY FOR MODELING AND SIMULATION IN MARITIME EXTENDED FRAMEWORK

This thesis reports on the most relevant researches performed during the years of the Ph.D. at the Genova University and within the Simulation Team. The researches have been performed according to M&S well known recognized standards. The studies performed on interoperable simulation cover all the environments of the Extended Maritime Framework, namely Sea Surface, Underwater, Air, Coast & Land, Space and Cyber Space. The applications cover both the civil and defence domain. The aim is to demonstrate the potential of M&S applications for the Extended Maritime Framework, applied to innovative unmanned vehicles as well as to traditional assets, human personnel included. A variety of techniques and methodology have been fruitfully applied in the researches, ranging from interoperable simulation, discrete event simulation, stochastic simulation, artificial intelligence, decision support system and even human behaviour modelling

UAV tracking module proposal based on a regulative comparison between manned and unmanned aviation

Purpose: The aim of this study is twofold. First is to compare manned and unmanned aviation regulations in the context of ICAO Annexes to identify potential deficiencies in the international UAV legislations. Second is to propose a UAV monitoring module work flow as a solution to identified deficiencies in the international UAV regulations. Design/methodology: In the present study, firstly the regulations used in manned aviation were summarized in the context of ICAO Annexes. Then along with an overview of the use of UAVs, international UAV regulations have been reviewed with a general perspective. In addition, a comparison was made on whether contents of ICAO Annexes find a place in common international UAV regulations in order to understand areas to be developed in the international UAV regulations, and to better understand the different principles between manned and unmanned air transport. In the last section, we present a UAV tracking module (UAVTram) in line with the above-mentioned comparison between manned and unmanned aviation and the identified deficiencies in the international UAV regulations. Findings: The international UAV regulations should be developed on the basis of airport airspace use, detection, liabilities, sanctions of violations, and updating of regulation. Proposed UAVTram has potential to offer real-time tracking and detection of UAVs as a solution to malicious use of UAVs. Research limitations/implications: Our study is not exempt from limitations. Firstly, we didn’t review all UAV regulations because it needs a considerable amount of efforts to check out all the UAV regulations pertinent to different areas of the world. It is the same case for manned aviation as we used only ICAO Annexes to contextually compare with UAV regulations. Practical implications: From the practical perspective, studies introducing new technologies such as systems that help detection of remote pilots causing trouble and agile defense systems will give valuable insights to remove individual UAV threats. Originality/value: We didn’t find any study aiming to compare manned and unmanned aviation rules in search of finding potential deficiencies in the UAV regulations. Our study adopts such an approach. Moreover, our solution proposal here uses Bluetooth 5.0 technology mounted on stationary transmitters which provides more effective range with higher data transfer. Another advantage is that this work is projected to be supported by Turkish civil aviation authority, DGCA. This may accelerate efforts to make required real-time tests.Peer Reviewe

Drone deep reinforcement learning: A review

Unmanned Aerial Vehicles (UAVs) are increasingly being used in many challenging and diversified applications. These applications belong to the civilian and the military fields. To name a few; infrastructure inspection, traffic patrolling, remote sensing, mapping, surveillance, rescuing humans and animals, environment monitoring, and Intelligence, Surveillance, Target Acquisition, and Reconnaissance (ISTAR) operations. However, the use of UAVs in these applications needs a substantial level of autonomy. In other words, UAVs should have the ability to accomplish planned missions in unexpected situations without requiring human intervention. To ensure this level of autonomy, many artificial intelligence algorithms were designed. These algorithms targeted the guidance, navigation, and control (GNC) of UAVs. In this paper, we described the state of the art of one subset of these algorithms: the deep reinforcement learning (DRL) techniques. We made a detailed description of them, and we deduced the current limitations in this area. We noted that most of these DRL methods were designed to ensure stable and smooth UAV navigation by training computer-simulated environments. We realized that further research efforts are needed to address the challenges that restrain their deployment in real-life scenarios

Mission-Aware Spatio-Temporal Deep Learning Model for UAS Instantaneous Density Prediction

The number of daily sUAS operations in uncontrolled low altitude airspace is expected to reach into the millions in a few years. Therefore, UAS density prediction has become an emerging and challenging problem. In this paper, a deep learning-based UAS instantaneous density prediction model is presented. The model takes two types of data as input: 1) the historical density generated from the historical data, and 2) the future sUAS mission information. The architecture of our model contains four components: Historical Density Formulation module, UAS Mission Translation module, Mission Feature Extraction module, and Density Map Projection module. The training and testing data are generated by a python based simulator which is inspired by the multi-agent air traffic resource usage simulator (MATRUS) framework. The quality of prediction is measured by the correlation score and the Area Under the Receiver Operating Characteristics (AUROC) between the predicted value and simulated value. The experimental results demonstrate outstanding performance of the deep learning-based UAS density predictor. Compared to the baseline models, for simplified traffic scenario where no-fly zones and safe distance among sUASs are not considered, our model improves the prediction accuracy by more than 15.2% and its correlation score reaches 0.947. In a more realistic scenario, where the no-fly zone avoidance and the safe distance among sUASs are maintained using A* routing algorithm, our model can still achieve 0.823 correlation score. Meanwhile, the AUROC can reach 0.951 for the hot spot prediction