A FAULT TOLERANT, DATA FUSION SYSTEM FOR NAVIGATION APPLICATIONS TO A DUCTED FAN VTOL UAV

A Fault Tolerant, Data Fusion (FTDF) algorithm for a Ducted Fan Unmanned Aerial Vehicle (DFUAV) Navigation System is presented. The algorithm have two parts: Gradient Descent (GD) for the Attitude and Heading Reference System (AHRS) and an Interacting Multiple Model (IMM) for position estimation. The GD methodology was designed to fuse the gyroscope, accelerometer, and geomagnetic sensors. The IMM algorithm is able to identify and compensate for multiple sensors data failures. There are three parts in the presentation. Firstly, system identification and the Allan Variance method is used to build dynamic models and noise models for multiple Sensors and Actuators. Secondly, a GD filter is developed for application to the Inertial Measurement Unit (IMU) consisting of tri-axis gyroscopes, accelerometers and magnetometers. The GD filter implementation incorporates magnetic distortion and gyroscope bias drift compensation. The filter uses a quaternion representation, allowing accelerometer and magnetometer data to be used in an analytically derived and optimized algorithm to compute the direction of the gyroscope measurement error as a quaternion derivative. . Finally, the IMM algorithm is used to combine data from multiple sensors simultaneously. This filter uses multiple models that incorporate sensor failures. The probabilities of these models being correct is generated by the IMM. These probabilities can be used to identify sensor failures and compensate for these failures

Multi-sensor data fusion techniques for RPAS detect, track and avoid

Accurate and robust tracking of objects is of growing interest amongst the computer vision scientific community. The ability of a multi-sensor system to detect and track objects, and accurately predict their future trajectory is critical in the context of mission- and safety-critical applications. Remotely Piloted Aircraft System (RPAS) are currently not equipped to routinely access all classes of airspace since certified Detect-and-Avoid (DAA) systems are yet to be developed. Such capabilities can be achieved by incorporating both cooperative and non-cooperative DAA functions, as well as providing enhanced communications, navigation and surveillance (CNS) services. DAA is highly dependent on the performance of CNS systems for Detection, Tacking and avoiding (DTA) tasks and maneuvers. In order to perform an effective detection of objects, a number of high performance, reliable and accurate avionics sensors and systems are adopted including non-cooperative sensors (visual and thermal cameras, Laser radar (LIDAR) and acoustic sensors) and cooperative systems (Automatic Dependent Surveillance-Broadcast (ADS-B) and Traffic Collision Avoidance System (TCAS)). In this paper the sensors and system information candidates are fully exploited in a Multi-Sensor Data Fusion (MSDF) architecture. An Unscented Kalman Filter (UKF) and a more advanced Particle Filter (PF) are adopted to estimate the state vector of the objects based for maneuvering and non-maneuvering DTA tasks. Furthermore, an artificial neural network is conceptualised/adopted to exploit the use of statistical learning methods, which acts to combined information obtained from the UKF and PF. After describing the MSDF architecture, the key mathematical models for data fusion are presented. Conceptual studies are carried out on visual and thermal image fusion architectures

Opportunity Trajectory Reconstruction Techniques for Evaluation of ATC Systems

This paper describes some key points of a new tool being currently developed by Eurocontrol for the assessment of air traffic control (ATC) multisensor trackers performance. It summarizes the algorithmic foundations of the high-accuracy trajectory reconstruction process used to obtain reference trajectories from recorded measures. These trajectories will serve as a reference for the evaluation of the accuracy of ATC data processing centers. The performance of the system is illustrated with some reconstruction experiments on synthetic and real data

Multi Sensor Data Fusion Architectures for Air Traffic Control Applications

Nowadays, the radar is no longer the sole technology which is able to ensure the surveillance of air traffic. The extensive deployment of satellite systems and air-to-ground data links leads to the emergence of complementary means and techniques on which a great deal of research and experiments have been carried out over the past ten years. In such an environment, the sensor data processing, which is a key element in any Air Traffic Control (ATC) centre, has been continuously upgraded so as to follow the sensor technology evolution and in the meantime improves the quality in term of continuity, integrity and accuracy criteria. This book chapter proposes a comprehensive description of the state of art and the roadmap for the future of the multi sensor data fusion architectures and techniques in use in ATC centres. The first part of the chapter describes the background of ATC centres, while the second part of the chapter points out various data fusion techniques. Multi radar data processing architecture is analysed and a brief definition of internal core tracking algorithms is given as well as a comparative benchmark based on their respective advantages and drawbacks. The third part of the chapter focuses on the most recent evolution that leads from a Multi Radar Tracking System to a Multi Sensor Tracking System. The last part of the chapter deals with the sensor data processing that will be put in operation in the next ten years. The main challenge will be to provide the same level of services in both surface and air surveillance areas in order to offer: ⢠highly accurate air and surface situation awareness to air traffic controllers, ⢠situational awareness via Traffic Information System â Broadcast (TIS-B) services to pilots and vehicle drivers, and ⢠new air and surface safety, capacity and efficiency applications to airports and airlines

Real-Time, Multiple Pan/Tilt/Zoom Computer Vision Tracking and 3D Positioning System for Unmanned Aerial System Metrology

The study of structural characteristics of Unmanned Aerial Systems (UASs) continues to be an important field of research for developing state of the art nano/micro systems. Development of a metrology system using computer vision (CV) tracking and 3D point extraction would provide an avenue for making these theoretical developments. This work provides a portable, scalable system capable of real-time tracking, zooming, and 3D position estimation of a UAS using multiple cameras. Current state-of-the-art photogrammetry systems use retro-reflective markers or single point lasers to obtain object poses and/or positions over time. Using a CV pan/tilt/zoom (PTZ) system has the potential to circumvent their limitations. The system developed in this paper exploits parallel-processing and the GPU for CV-tracking, using optical flow and known camera motion, in order to capture a moving object using two PTU cameras. The parallel-processing technique developed in this work is versatile, allowing the ability to test other CV methods with a PTZ system using known camera motion. Utilizing known camera poses, the object\u27s 3D position is estimated and focal lengths are estimated for filling the image to a desired amount. This system is tested against truth data obtained using an industrial system

Adaptive Estimation and Detection Techniques with Applications

Hybrid systems have been identified as one of the main directions in control theory and attracted increasing attention in recent years due to their huge diversity of engineering applications. Multiplemodel (MM) estimation is the state-of-the-art approach to many hybrid estimation problems. Existing MM methods with fixed structure usually perform well for problems that can be handled by a small set of models. However, their performance is limited when the required number of models to achieve a satisfactory accuracy is large due to time evolution of the true mode over a large continuous space. In this research, variable-structure multiple model (VSMM) estimation was investigated, further developed and evaluated. A fundamental solution for on-line adaptation of model sets was developed as well as several VSMM algorithms. These algorithms have been successfully applied to the fields of fault detection and identification as well as target tracking in this thesis. In particular, an integrated framework to detect, identify and estimate failures is developed based on the VSMM. It can handle sequential failures and multiple failures by sensors or actuators. Fault detection and target maneuver detection can be formulated as change-point detection problems in statistics. It is of great importance to have the quickest detection of such mode changes in a hybrid system. Traditional maneuver detectors based on simplistic models are not optimal and are computationally demanding due to the requirement of batch processing. In this presentation, a general sequential testing procedure is proposed for maneuver detection based on advanced sequential tests. It uses a likelihood marginalization technique to cope with the difficulty that the target accelerations are unknown. The approach essentially utilizes a priori information about the accelerations in typical tracking engagements and thus allows improved detection performance. The proposed approach is applicable to change-point detection problems under similar formulation, such as fault detection

Adaptive Estimation and Detection Techniques with Applications

Hybrid systems have been identified as one of the main directions in control theory and attracted increasing attention in recent years due to their huge diversity of engineering applications. Multiplemodel (MM) estimation is the state-of-the-art approach to many hybrid estimation problems. Existing MM methods with fixed structure usually perform well for problems that can be handled by a small set of models. However, their performance is limited when the required number of models to achieve a satisfactory accuracy is large due to time evolution of the true mode over a large continuous space. In this research, variable-structure multiple model (VSMM) estimation was investigated, further developed and evaluated. A fundamental solution for on-line adaptation of model sets was developed as well as several VSMM algorithms. These algorithms have been successfully applied to the fields of fault detection and identification as well as target tracking in this thesis. In particular, an integrated framework to detect, identify and estimate failures is developed based on the VSMM. It can handle sequential failures and multiple failures by sensors or actuators. Fault detection and target maneuver detection can be formulated as change-point detection problems in statistics. It is of great importance to have the quickest detection of such mode changes in a hybrid system. Traditional maneuver detectors based on simplistic models are not optimal and are computationally demanding due to the requirement of batch processing. In this presentation, a general sequential testing procedure is proposed for maneuver detection based on advanced sequential tests. It uses a likelihood marginalization technique to cope with the difficulty that the target accelerations are unknown. The approach essentially utilizes a priori information about the accelerations in typical tracking engagements and thus allows improved detection performance. The proposed approach is applicable to change-point detection problems under similar formulation, such as fault detection

Integrated Collision Avoidance System for Air Vehicle

Collision with ground/water/terrain and midair obstacles is one of the common causes of severe aircraft accidents. The various data from the coremicro AHRS/INS/GPS Integration Unit, terrain data base, and object detection sensors are processed to produce collision warning audio/visual messages and collision detection and avoidance of terrain and obstacles through generation of guidance commands in a closed-loop system. The vision sensors provide more information for the Integrated System, such as, terrain recognition and ranging of terrain and obstacles, which plays an important role to the improvement of the Integrated Collision Avoidance System