Innovative Solutions for Navigation and Mission Management of Unmanned Aircraft Systems

The last decades have witnessed a significant increase in Unmanned Aircraft Systems (UAS) of all shapes and sizes. UAS are finding many new applications in supporting several human activities, offering solutions to many dirty, dull, and dangerous missions, carried out by military and civilian users. However, limited access to the airspace is the principal barrier to the realization of the full potential that can be derived from UAS capabilities. The aim of this thesis is to support the safe integration of UAS operations, taking into account both the user's requirements and flight regulations. The main technical and operational issues, considered among the principal inhibitors to the integration and wide-spread acceptance of UAS, are identified and two solutions for safe UAS operations are proposed: A. Improving navigation performance of UAS by exploiting low-cost sensors. To enhance the performance of the low-cost and light-weight integrated navigation system based on Global Navigation Satellite System (GNSS) and Micro Electro-Mechanical Systems (MEMS) inertial sensors, an efficient calibration method for MEMS inertial sensors is required. Two solutions are proposed: 1) The innovative Thermal Compensated Zero Velocity Update (TCZUPT) filter, which embeds the compensation of thermal effect on bias in the filter itself and uses Back-Propagation Neural Networks to build the calibration function. Experimental results show that the TCZUPT filter is faster than the traditional ZUPT filter in mapping significant bias variations and presents better performance in the overall testing period. Moreover, no calibration pre-processing stage is required to keep measurement drift under control, improving the accuracy, reliability, and maintainability of the processing software; 2) A redundant configuration of consumer grade inertial sensors to obtain a self-calibration of typical inertial sensors biases. The result is a significant reduction of uncertainty in attitude determination. In conclusion, both methods improve dead-reckoning performance for handling intermittent GNSS coverage. B. Proposing novel solutions for mission management to support the Unmanned Traffic Management (UTM) system in monitoring and coordinating the operations of a large number of UAS. Two solutions are proposed: 1) A trajectory prediction tool for small UAS, based on Learning Vector Quantization (LVQ) Neural Networks. By exploiting flight data collected when the UAS executes a pre-assigned flight path, the tool is able to predict the time taken to fly generic trajectory elements. Moreover, being self-adaptive in constructing a mathematical model, LVQ Neural Networks allow creating different models for the different UAS types in several environmental conditions; 2) A software tool aimed at supporting standardized procedures for decision-making process to identify UAS/payload configurations suitable for any type of mission that can be authorized standing flight regulations. The proposed methods improve the management and safe operation of large-scale UAS missions, speeding up the flight authorization process by the UTM system and supporting the increasing level of autonomy in UAS operations

Generic Multisensor Integration Strategy and Innovative Error Analysis for Integrated Navigation

A modern multisensor integrated navigation system applied in most of civilian applications typically consists of GNSS (Global Navigation Satellite System) receivers, IMUs (Inertial Measurement Unit), and/or other sensors, e.g., odometers and cameras. With the increasing availabilities of low-cost sensors, more research and development activities aim to build a cost-effective system without sacrificing navigational performance. Three principal contributions of this dissertation are as follows: i) A multisensor kinematic positioning and navigation system built on Linux Operating System (OS) with Real Time Application Interface (RTAI), York University Multisensor Integrated System (YUMIS), was designed and realized to integrate GNSS receivers, IMUs, and cameras. YUMIS sets a good example of a low-cost yet high-performance multisensor inertial navigation system and lays the ground work in a practical and economic way for the personnel training in following academic researches. ii) A generic multisensor integration strategy (GMIS) was proposed, which features a) the core system model is developed upon the kinematics of a rigid body; b) all sensor measurements are taken as raw measurement in Kalman filter without differentiation. The essential competitive advantages of GMIS over the conventional error-state based strategies are: 1) the influences of the IMU measurement noises on the final navigation solutions are effectively mitigated because of the increased measurement redundancy upon the angular rate and acceleration of a rigid body; 2) The state and measurement vectors in the estimator with GMIS can be easily expanded to fuse multiple inertial sensors and all other types of measurements, e.g., delta positions; 3) one can directly perform error analysis upon both raw sensor data (measurement noise analysis) and virtual zero-mean process noise measurements (process noise analysis) through the corresponding measurement residuals of the individual measurements and the process noise measurements. iii) The a posteriori variance component estimation (VCE) was innovatively accomplished as an advanced analytical tool in the extended Kalman Filter employed by the GMIS, which makes possible the error analysis of the raw IMU measurements for the very first time, together with the individual independent components in the process noise vector

Trajectory determination and analysis in sports by satellite and inertial navigation

This research presents methods for performance analysis in sports through the integration of Global Positioning System (GPS) measurements with Inertial Navigation System (INS). The described approach focuses on strapdown inertial navigation using Micro-Electro-Mechanical System (MEMS) Inertial Measurement Units (IMU). A simple inertial error model is proposed and its relevance is proven by comparison to reference data. The concept is then extended to a setup employing several MEMS-IMUs in parallel. The performance of the system is validated with experiments in skiing and motorcycling. The position accuracy achieved with the integrated system varies from decimeter level with dual-frequency differential GPS (DGPS) to 0.7 m for low-cost, single-frequency DGPS. Unlike the position, the velocity accuracy (0.2 m/s) and orientation accuracy (1 – 2 deg) are almost insensitive to the choice of the receiver hardware. The orientation performance, however, is improved by 30 – 50% when integrating four MEMS-IMUs in skew-redundant configuration. Later part of this research introduces a methodology for trajectory comparison. It is shown that trajectories based on dual-frequency GPS positions can be directly modeled and compared using cubic spline smoothing, while those derived from single-frequency DGPS require additional filtering and matching

Development of a model helicopter based flight test platform for multivariable feedback control.

M. Sc. Eng. University of KwaZulu-Natal, Durban 2009.The dissertation describes the development of a model helicopter based flight test platform for implementing autonomous six degree of freedom flight by a multiple input multiple output automatic control system. The focus of the research is two fold: i. Navigation system design centred about fusing multiple data and measurement sources using Kalman filtering techniques. ii. Electrical engineering of a complete avionics package to support guidance, navigation and control functions. Included are the results from several experiments conducted on the test platform, highlighting salient aspects and performance of the electrical and navigation systems.Appendices could not be converted to pdf and uploaded to ResearchSpace. Appendices found on a separate disc accompanying print copy

Overcoming the challenges of low-cost inertial navigation

Inertial navigation is always available as a base for multisensor navigation systems on, because it requires no external signals. However, measurement errors persist and grow with time so accurate calibration is crucial. Large systematic errors are present in the micro-electro-mechanical sensors (MEMS) whose low cost brings inertial navigation to many new applications. Using factory-calibrated MEMS another navigation technology can calibrate these errors with in-run estimation using a Kalman filter (KF). However, the raw systematic errors of low-cost MEMS are often too large for stable performance. This thesis contributes to knowledge in three areas. First, it takes a simple GNSS-inertial KF and examines the levels of the various systematic errors which cause the integration to fail. This allows the user to know how well calibrated the sensors need to be to use in-run calibration. Second, the thesis examines how the end-user could conduct a calibration: it analyses one method in detail showing how imperfections in the procedure affect the results and comparing calculation methods. This is important as frequently calibration methods are only validated by demonstrating consistent results for one particular sensor. These two are primarily accomplished using statistical Monte Carlo simulations. Third, techniques are examined by which an array of inertial sensors could be used to produce an output which is better than the simple array average. This includes methods that reduce the array’s sensitivity to environmental conditions, this is important because the sensors’ calibration typically depends strongly on temperature. Also included in the thesis are descriptions of experimental hardware and experiments which have been carried to support and unify the other parts of the thesis. Overall, this thesis’ contributions will help make low-cost inertial navigation systems more accurate and will allow system designers to concentrate effort where it will make the most difference

Towards secure & robust PNT for automated systems

This dissertation makes four contributions in support of secure and robust position, navigation, and timing (PNT) for automated systems. The first two relate to PNT security while the latter two address robust positioning for automated ground vehicles. The first contribution is a fundamental theory for provably-secure clock synchronization between two agents in a distributed automated system. All one-way synchronization protocols, such as those based on the Global Positioning System (GPS) and other Global Navigation Satellite Systems (GNSS), are shown to be vulnerable to man-in-the-middle delay attacks. This contribution is the first to identify the necessary and sufficient conditions for provably secure clock synchronization. The second contribution, also related to PNT security, is a three-year study of the world-wide GPS interference landscape based on data from a dual-frequency GNSS receiver operating continuously on the International Space Station (ISS). This work is the first publicly-reported space-based survey of GNSS interference, and unveils previously-unreported GNSS interference activity. The third contribution is a novel ground vehicle positioning technique that is robust to GNSS signal blockage, poor lighting conditions, and adverse weather events such as heavy rain and dense fog. The technique relies on sensors that are commonly available on automated vehicles and are insensitive to lighting and inclement weather: automotive radar, low-cost inertial measurement units (IMUs), and GNSS. Remarkably, it is shown that, given a prior radar map, the proposed technique operating on data from off-the-shelf all-weather automotive sensors can maintain sub-50-cm horizontal position accuracy during 60 min of GNSS-denied driving in downtown Austin, TX. This dissertation’s final contribution is an analysis and demonstration of the feasibility of crowd-sourced digital mapping for automated vehicles. Localization techniques, such as the one described in the previous contribution, rely on such digital maps for accuracy and robustness. A key enabler for large-scale up-to-date maps is enlisting the help of the very consumer vehicles that need the map to build and update it. A method for fusing multi-session vision data into a unified digital map is developed. The asymptotic limit of such a map’s globally-referenced position accuracy is explored for the case in which the mapping agents rely on low-cost GNSS receivers performing standard code-phase-based navigation. Experimental validation along a semi-urban route shows that low-cost consumer vehicles incrementally tighten the accuracy of the jointly-optimized digital map over time enough to support sub-lane-level positioning in a global frame of reference.Electrical and Computer Engineerin

Event-based Vision: A Survey

Event cameras are bio-inspired sensors that differ from conventional frame cameras: Instead of capturing images at a fixed rate, they asynchronously measure per-pixel brightness changes, and output a stream of events that encode the time, location and sign of the brightness changes. Event cameras offer attractive properties compared to traditional cameras: high temporal resolution (in the order of microseconds), very high dynamic range (140 dB vs. 60 dB), low power consumption, and high pixel bandwidth (on the order of kHz) resulting in reduced motion blur. Hence, event cameras have a large potential for robotics and computer vision in challenging scenarios for traditional cameras, such as low-latency, high speed, and high dynamic range. However, novel methods are required to process the unconventional output of these sensors in order to unlock their potential. This paper provides a comprehensive overview of the emerging field of event-based vision, with a focus on the applications and the algorithms developed to unlock the outstanding properties of event cameras. We present event cameras from their working principle, the actual sensors that are available and the tasks that they have been used for, from low-level vision (feature detection and tracking, optic flow, etc.) to high-level vision (reconstruction, segmentation, recognition). We also discuss the techniques developed to process events, including learning-based techniques, as well as specialized processors for these novel sensors, such as spiking neural networks. Additionally, we highlight the challenges that remain to be tackled and the opportunities that lie ahead in the search for a more efficient, bio-inspired way for machines to perceive and interact with the world