Learning Pose Estimation for UAV Autonomous Navigation and Landing Using Visual-Inertial Sensor Data

In this work, we propose a robust network-in-the-loop control system for autonomous navigation and landing of an Unmanned-Aerial-Vehicle (UAV). To estimate the UAV’s absolute pose, we develop a deep neural network (DNN) architecture for visual-inertial odometry, which provides a robust alternative to traditional methods. We first evaluate the accuracy of the estimation by comparing the prediction of our model to traditional visual-inertial approaches on the publicly available EuRoC MAV dataset. The results indicate a clear improvement in the accuracy of the pose estimation up to 25% over the baseline. Finally, we integrate the data-driven estimator in the closed-loop flight control system of Airsim, a simulator available as a plugin for Unreal Engine, and we provide simulation results for autonomous navigation and landing

Fe(3): An Evaluation Tool for Low-Altitude Air Traffic Operations

The concepts of unmanned aircraft system traffic management (UTM) and urban air mobility (UAM) are introducing high-density operations in low altitude airspace in closer proximity to populated areas than conventional high-altitude air traffic. The Flexible engine for Fast-time Evaluation of Flight Environments (Fe (sup 3)) provides the capability of statistically analyzing the high-density, high-fidelity, and low-altitude traffic system under numerous scenarios, such that stake holders can study impacts of factors in the low-altitude high-density traffic system and define requirements, policies, and protocols needed to support a safe yet efficient traffic system, and even assess operational risks and optimize flight schedules without conducting infeasible and cost-prohibitive flight tests that involve a large volume of aerial vehicles. This work provides an introduction to this simulation tool including its architecture and various models involved. Its performance and sample application in UAM and UTM are also presented

A 64mW DNN-based Visual Navigation Engine for Autonomous Nano-Drones

Fully-autonomous miniaturized robots (e.g., drones), with artificial intelligence (AI) based visual navigation capabilities are extremely challenging drivers of Internet-of-Things edge intelligence capabilities. Visual navigation based on AI approaches, such as deep neural networks (DNNs) are becoming pervasive for standard-size drones, but are considered out of reach for nanodrones with size of a few cm${}^\mathrm{2}$. In this work, we present the first (to the best of our knowledge) demonstration of a navigation engine for autonomous nano-drones capable of closed-loop end-to-end DNN-based visual navigation. To achieve this goal we developed a complete methodology for parallel execution of complex DNNs directly on-bard of resource-constrained milliwatt-scale nodes. Our system is based on GAP8, a novel parallel ultra-low-power computing platform, and a 27 g commercial, open-source CrazyFlie 2.0 nano-quadrotor. As part of our general methodology we discuss the software mapping techniques that enable the state-of-the-art deep convolutional neural network presented in [1] to be fully executed on-board within a strict 6 fps real-time constraint with no compromise in terms of flight results, while all processing is done with only 64 mW on average. Our navigation engine is flexible and can be used to span a wide performance range: at its peak performance corner it achieves 18 fps while still consuming on average just 3.5% of the power envelope of the deployed nano-aircraft.Comment: 15 pages, 13 figures, 5 tables, 2 listings, accepted for publication in the IEEE Internet of Things Journal (IEEE IOTJ

Low-cost navigation and guidance systems for unmanned aerial vehicles - part 2: Attitude determination and control

This paper presents the second part of the research activity performed by Cranfield University to assess the potential of low-cost navigation sensors for Unmanned Aerial Vehicles (UAVs). This part focuses on carrier-phase Global Navigation Satellite Systems (GNSS) for attitude determination and control of small to medium size UAVs. Recursive optimal estimation algorithms were developed for combining multiple attitude measurements obtained from different observation points (i.e., antenna locations), and their efficiencies were tested in various dynamic conditions. The proposed algorithms converged rapidly and produced the required output even during high dynamics manoeuvres. Results of theoretical performance analysis and simulation activities are presented in this paper, with emphasis on the advantages of the GNSS interferometric approach in UAV applications (i.e., low cost, high data-rate, low volume/weight, low signal processing requirements, etc.). The simulation activities focussed on the AEROSONDE UAV platform and considered the possible augmentation provided by interferometric GNSS techniques to a low-cost and low-weight/volume integrated navigation system (presented in the first part of this series) which employed a Vision-Based Navigation (VBN) system, a Micro-Electro-Mechanical Sensor (MEMS) based Inertial Measurement Unit (IMU) and code-range GNSS (i.e., GPS and GALILEO) for position and velocity computations. The integrated VBN-IMU-GNSS (VIG) system was augmented using the inteferometric GNSS Attitude Determination (GAD) sensor data and a comparison of the performance achieved with the VIG and VIG/GAD integrated Navigation and Guidance Systems (NGS) is presented in this paper. Finally, the data provided by these NGS are used to optimise the design of a hybrid controller employing Fuzzy Logic and Proportional-Integral-Derivative (PID) techniques for the AEROSONDE UAV

Suspended Load Path Tracking Control Using a Tilt-rotor UAV Based on Zonotopic State Estimation

This work addresses the problem of path tracking control of a suspended load using a tilt-rotor UAV. The main challenge in controlling this kind of system arises from the dynamic behavior imposed by the load, which is usually coupled to the UAV by means of a rope, adding unactuated degrees of freedom to the whole system. Furthermore, to perform the load transportation it is often needed the knowledge of the load position to accomplish the task. Since available sensors are commonly embedded in the mobile platform, information on the load position may not be directly available. To solve this problem in this work, initially, the kinematics of the multi-body mechanical system are formulated from the load's perspective, from which a detailed dynamic model is derived using the Euler-Lagrange approach, yielding a highly coupled, nonlinear state-space representation of the system, affine in the inputs, with the load's position and orientation directly represented by state variables. A zonotopic state estimator is proposed to solve the problem of estimating the load position and orientation, which is formulated based on sensors located at the aircraft, with different sampling times, and unknown-but-bounded measurement noise. To solve the path tracking problem, a discrete-time mixed $\mathcal{H}_2/\mathcal{H}_\infty$ controller with pole-placement constraints is designed with guaranteed time-response properties and robust to unmodeled dynamics, parametric uncertainties, and external disturbances. Results from numerical experiments, performed in a platform based on the Gazebo simulator and on a Computer Aided Design (CAD) model of the system, are presented to corroborate the performance of the zonotopic state estimator along with the designed controller

A Survey on Aerial Swarm Robotics

The use of aerial swarms to solve real-world problems has been increasing steadily, accompanied by falling prices and improving performance of communication, sensing, and processing hardware. The commoditization of hardware has reduced unit costs, thereby lowering the barriers to entry to the field of aerial swarm robotics. A key enabling technology for swarms is the family of algorithms that allow the individual members of the swarm to communicate and allocate tasks amongst themselves, plan their trajectories, and coordinate their flight in such a way that the overall objectives of the swarm are achieved efficiently. These algorithms, often organized in a hierarchical fashion, endow the swarm with autonomy at every level, and the role of a human operator can be reduced, in principle, to interactions at a higher level without direct intervention. This technology depends on the clever and innovative application of theoretical tools from control and estimation. This paper reviews the state of the art of these theoretical tools, specifically focusing on how they have been developed for, and applied to, aerial swarms. Aerial swarms differ from swarms of ground-based vehicles in two respects: they operate in a three-dimensional space and the dynamics of individual vehicles adds an extra layer of complexity. We review dynamic modeling and conditions for stability and controllability that are essential in order to achieve cooperative flight and distributed sensing. The main sections of this paper focus on major results covering trajectory generation, task allocation, adversarial control, distributed sensing, monitoring, and mapping. Wherever possible, we indicate how the physics and subsystem technologies of aerial robots are brought to bear on these individual areas

Carrier-phase GNSS attitude determination and control for small UAV applications

As part of our recent research to assess the potential of low-cost navigation sensors for Unmanned Aerial Vehicle (UAV) applications, we investigated the potential of carrier-phase Global Navigation Satellite System (GNSS) for attitude determination and control of small size UAVs. Recursive optimal estimation algorithms were developed for combining multiple attitude measurements obtained from different observation points (i.e., antenna locations), and their efficiencies were tested in various dynamic conditions. The proposed algorithms converged rapidly and produced the required output even during high dynamics manoeuvres. Results of theoretical performance analysis and simulation activities are presented in this paper, with emphasis on the advantages of the GNSS interferometric approach in UAV applications (i.e., low cost, high data-rate, low volume/weight, low signal processing requirements, etc.). The simulation activities focussed on the AEROSONDE UAV platform and considered the possible augmentation provided by interferometric GNSS techniques to a low-cost and low-weight/volume integrated navigation system (presented in the first part of this series) which employed a Vision-Based Navigation (VBN) system, a MicroElectro-Mechanical Sensor (MEMS) based Inertial Measurement Unit (IMU) and code-range GNSS (i.e., GPS and GALILEO) for position and velocity computations. The integrated VBN-IMU-GNSS (VIG) system was augmented using the inteferometric GNSS Attitude Determination (GAD)sensor data and a comparison of the performance achieved with the VIG and VIG/GAD integrated Navigation and Guidance Systems (NGS) is presented in this paper. Finally, the data provided by these NGS are used to optimise the design of a hybrid controller employing Fuzzy Logic and Proportional-Integral-Derivative (PID) techniques for the AEROSONDE UAV

Innovative Solutions for Navigation and Mission Management of Unmanned Aircraft Systems

The last decades have witnessed a significant increase in Unmanned Aircraft Systems (UAS) of all shapes and sizes. UAS are finding many new applications in supporting several human activities, offering solutions to many dirty, dull, and dangerous missions, carried out by military and civilian users. However, limited access to the airspace is the principal barrier to the realization of the full potential that can be derived from UAS capabilities. The aim of this thesis is to support the safe integration of UAS operations, taking into account both the user's requirements and flight regulations. The main technical and operational issues, considered among the principal inhibitors to the integration and wide-spread acceptance of UAS, are identified and two solutions for safe UAS operations are proposed: A. Improving navigation performance of UAS by exploiting low-cost sensors. To enhance the performance of the low-cost and light-weight integrated navigation system based on Global Navigation Satellite System (GNSS) and Micro Electro-Mechanical Systems (MEMS) inertial sensors, an efficient calibration method for MEMS inertial sensors is required. Two solutions are proposed: 1) The innovative Thermal Compensated Zero Velocity Update (TCZUPT) filter, which embeds the compensation of thermal effect on bias in the filter itself and uses Back-Propagation Neural Networks to build the calibration function. Experimental results show that the TCZUPT filter is faster than the traditional ZUPT filter in mapping significant bias variations and presents better performance in the overall testing period. Moreover, no calibration pre-processing stage is required to keep measurement drift under control, improving the accuracy, reliability, and maintainability of the processing software; 2) A redundant configuration of consumer grade inertial sensors to obtain a self-calibration of typical inertial sensors biases. The result is a significant reduction of uncertainty in attitude determination. In conclusion, both methods improve dead-reckoning performance for handling intermittent GNSS coverage. B. Proposing novel solutions for mission management to support the Unmanned Traffic Management (UTM) system in monitoring and coordinating the operations of a large number of UAS. Two solutions are proposed: 1) A trajectory prediction tool for small UAS, based on Learning Vector Quantization (LVQ) Neural Networks. By exploiting flight data collected when the UAS executes a pre-assigned flight path, the tool is able to predict the time taken to fly generic trajectory elements. Moreover, being self-adaptive in constructing a mathematical model, LVQ Neural Networks allow creating different models for the different UAS types in several environmental conditions; 2) A software tool aimed at supporting standardized procedures for decision-making process to identify UAS/payload configurations suitable for any type of mission that can be authorized standing flight regulations. The proposed methods improve the management and safe operation of large-scale UAS missions, speeding up the flight authorization process by the UTM system and supporting the increasing level of autonomy in UAS operations

Carrier-phase GNSS attitude determination and control system for unmanned aerial vehicle applications

This paper presents the results of a research activity performed by Cranfield University to assess the potential of carrierphase Global Navigation Satellite Systems (GNSS) for attitude determination and control of small to medium size Unmanned Aerial Vehicles (UAV). Both deterministic and recursive (optimal estimation) algorithms are developed for combining multiple attitude measurements obtained from different observation points (i.e., antenna locations), and their efficiencies are tested in various dynamic conditions. The proposed algorithms converge rapidly and produce the required output even during high dynamics manoeuvres. Results of theoretical performance analysis and simulation activities are presented in this paper, with emphasis on the advantages of the GNSS interferometric approach in UAV applications (i.e., low cost, high data-rate, low volume/weight, low signal processing requirements, etc.). Modelling and simulation activities focussed on the AEROSONDE UAV platform and considered the possible augmentation provided by interferometric GNSS techniques to a low-cost and low-weight/volume integrated navigation system recently developed at Cranfield University, which employs a Vision-based Navigation (VBN) system, a Micro-Electro-mechanical Sensor (MEMS) based Inertial Measurement Unit (IMU) and code-range GNSS (i.e., GPS and GALILEO) for position and velocity computations. The integrated VBN-IMU-GNSS (VIG) system is augmented by using the inteferometric GNSS Attitude Determination (GAD) and a comparison of the performance achievable with the VIG and VIG/GAD integrated Navigation and Guidance Systems (NGS) is presented. Finally, the data provided by these NGS are used to optimise the design of an hybrid controller employing Fuzzy Logic and Proportional-Integral-Derivative (PID) techniques for the AEROSONDE UAV