Multi-Unmanned Aerial Vehicle (UAV) Cooperative Fault Detection Employing Differential Global Positioning (DGPS), Inertial and Vision Sensors

This paper presents a method to increase the reliability of Unmanned Aerial Vehicle (UAV) sensor Fault Detection and Identification (FDI) in a multi-UAV context. Differential Global Positioning System (DGPS) and inertial sensors are used for sensor FDI in each UAV. The method uses additional position estimations that augment individual UAV FDI system. These additional estimations are obtained using images from the same planar scene taken from two different UAVs. Since accuracy and noise level of the estimation depends on several factors, dynamic replanning of the multi-UAV team can be used to obtain a better estimation in case of faults caused by slow growing errors of absolute position estimation that cannot be detected by using local FDI in the UAVs. Experimental results with data from two real UAVs are also presented

Cooperative Sensor Fault Recovery in Multi-UAV Systems

IEEE International Conference on Robotics and Automation (ICRA), 16-21 May 2016 Stockholm, SwedenThis paper presents the design and experimental validation of a Fault Detection, Identification and Recovery (FDIR) system intended for multi-UAV applications. The system exploits the information provided by internal position, attitude and visual sensors onboard the UAVs of the fleet for detecting faults in the measurements of the position and attitude sensors of any of the member vehicles. Considering the observations provided by two or more UAVs in a cooperative way, it is possible to identify the source of the fault, but also implement a Cooperative Virtual Sensor (CVS) which provides a redundant position and velocity estimation of the faulty UAV that can be used for replacing its internal sensor. The vision-based FDIR system has been validated experimentally with quadrotors in an indoor testbed. In particular, fault detection and identification has been evaluated injecting a fault pattern offline on the position measurements, while the CVS has been applied in real time for the recovery phase.Ministerio de Educación Cultura y Deporte ICT-2011-28808

Fault-tolerant formation driving mechanism designed for heterogeneous MAVs-UGVs groups

A fault-tolerant method for stabilization and navigation of 3D heterogeneous formations is proposed in this paper. The presented Model Predictive Control (MPC) based approach enables to deploy compact formations of closely cooperating autonomous aerial and ground robots in surveillance scenarios without the necessity of a precise external localization. Instead, the proposed method relies on a top-view visual relative localization provided by the micro aerial vehicles flying above the ground robots and on a simple yet stable visual based navigation using images from an onboard monocular camera. The MPC based schema together with a fault detection and recovery mechanism provide a robust solution applicable in complex environments with static and dynamic obstacles. The core of the proposed leader-follower based formation driving method consists in a representation of the entire 3D formation as a convex hull projected along a desired path that has to be followed by the group. Such an approach provides non-collision solution and respects requirements of the direct visibility between the team members. The uninterrupted visibility is crucial for the employed top-view localization and therefore for the stabilization of the group. The proposed formation driving method and the fault recovery mechanisms are verified by simulations and hardware experiments presented in the paper

Avionics-based GNSS integrity augmentation for unmanned aerial systems sense-and-avoid

This paper investigates the synergies between a GNSS Avionics Based Integrity Augmentation (ABIA) system and a novel Unmanned Aerial System (UAS) Sense-and-Avoid (SAA) architecture for cooperative and non-cooperative scenarios. The integration of ABIA with SAA has the potential to provide an integrity-augmented SAA solution that will allow the safe and unrestricted access of UAS to commercial airspace. The candidate SAA system uses Forward-Looking Sensors (FLS) for the non-cooperative case and Automatic Dependent Surveillance-Broadcast (ADS-B) for the cooperative case. In the non-cooperative scenario, the system employs navigation-based image stabilization with image morphology operations and a multi-branch Viterbi filter for obstacle detection, which allows heading estimation. The system utilizes a Track-to-Track (T3) algorithm for data fusion that allows combining data from different tracks obtained with FLS and/or ADS-B depending on the scenario. Successively, it utilizes an Interacting Multiple Model (IMM) algorithm to estimate the state vector allowing a prediction of the intruder trajectory over a specified time horizon. Both in the cooperative and non-cooperative cases, the risk of collision is evaluated by setting a threshold on the Probability Density Function (PDF) of a Near Mid-Air Collision (NMAC) event over the separation area. So, if the specified threshold is exceeded, an avoidance manoeuver is performed based on a heading-based Differential Geometry (DG) algorithm and optimized utilizing a cost function with minimum time constraints and fuel penalty criteria weighted as a function of separation distance. Additionally, the optimised avoidance trajectory considers the constraints imposed by the ABIA in terms of GNSS constellation satellite elevation angles, preventing degradation or losses of navigation data during the whole SAA loop. This integration scheme allows real-time trajectory corrections to re-establish the Required Navigation Performance (RNP) when actual GNSS accuracy degradations and/or data losses take place (e.g., due to aircraft-satellite relative geometry, GNSS receiver tracking, interference, jamming or other external factors). Various simulation case studies were accomplished to evaluate the performance of this Integrity-Augmented SAA (IAS) architecture. The selected host platform was the AEROSONDE Unmanned Aerial Vehicle (UAV) and the simulation cases addressed a variety of cooperative and non-cooperative scenarios in a representative cross-section of the AEROSONDE operational flight envelope. The simulation results show that the proposed IAS architecture is an excellent candidate to perform high-integrity Collision Detection and Resolution (CD&R) utilizing GNSS as the primary source of navigation data, providing solid foundation for future research and developments in this domain

Avionics-based GNSS integrity augmentation for unmanned aerial systems sense-and-avoid

This paper investigates the synergies between a GNSS Avionics Based Integrity Augmentation (ABIA) system and a novel Unmanned Aerial System (UAS) Sense-and-Avoid (SAA) architecture for cooperative and non-cooperative scenarios. The integration of ABIA with SAA has the potential to provide an integrity-augmented SAA solution that will allow the safe and unrestricted access of UAS to commercial airspace. The candidate SAA system uses Forward-Looking Sensors (FLS) for the non-cooperative case and Automatic Dependent Surveillance-Broadcast (ADS-B) for the cooperative case. In the non-cooperative scenario, the system employs navigation-based image stabilization with image morphology operations and a multi-branch Viterbi filter for obstacle detection, which allows heading estimation. The system utilizes a Track-to-Track (T3) algorithm for data fusion that allows combining data from different tracks obtained with FLS and/or ADS-B depending on the scenario. Successively, it utilizes an Interacting Multiple Model (IMM) algorithm to estimate the state vector allowing a prediction of the intruder trajectory over a specified time horizon. Both in the cooperative and non-cooperative cases, the risk of collision is evaluated by setting a threshold on the Probability Density Function (PDF) of a Near Mid-Air Collision (NMAC) event over the separation area. So, if the specified threshold is exceeded, an avoidance manoeuver is performed based on a heading-based Differential Geometry (DG) algorithm and optimized utilizing a cost function with minimum time constraints and fuel penalty criteria weighted as a function of separation distance. Additionally, the optimised avoidance trajectory considers the constraints imposed by the ABIA in terms of GNSS constellation satellite elevation angles, preventing degradation or losses of navigation data during the whole SAA loop. This integration scheme allows real-time trajectory corrections to re-establish the Required Navigation Performance (RNP) when actual GNSS accuracy degradations and/or data losses take place (e.g., due to aircraft-satellite relative geometry, GNSS receiver tracking, interference, jamming or other external factors). Various simulation case studies were accomplished to evaluate the performance of this Integrity-Augmented SAA (IAS) architecture. The selected host platform was the AEROSONDE Unmanned Aerial Vehicle (UAV) and the simulation cases addressed a variety of cooperative and non-cooperative scenarios in a representative cross-section of the AEROSONDE operational flight envelope. The simulation results show that the proposed IAS architecture is an excellent candidate to perform high-integrity Collision Detection and Resolution (CD&R) utilizing GNSS as the primary source of navigation data, providing solid foundation for future research and developments in this domain

Reference Model for Interoperability of Autonomous Systems

This thesis proposes a reference model to describe the components of an Un-manned Air, Ground, Surface, or Underwater System (UxS), and the use of a single Interoperability Building Block to command, control, and get feedback from such vehicles. The importance and advantages of such a reference model, with a standard nomenclature and taxonomy, is shown. We overview the concepts of interoperability and some efforts to achieve common refer-ence models in other areas. We then present an overview of existing un-manned systems, their history, characteristics, classification, and missions. The concept of Interoperability Building Blocks (IBB) is introduced to describe standards, protocols, data models, and frameworks, and a large set of these are analyzed. A new and powerful reference model for UxS, named RAMP, is proposed, that describes the various components that a UxS may have. It is a hierarchical model with four levels, that describes the vehicle components, the datalink, and the ground segment. The reference model is validated by showing how it can be applied in various projects the author worked on. An example is given on how a single standard was capable of controlling a set of heterogeneous UAVs, USVs, and UGVs

Aerial Vehicles

This book contains 35 chapters written by experts in developing techniques for making aerial vehicles more intelligent, more reliable, more flexible in use, and safer in operation.It will also serve as an inspiration for further improvement of the design and application of aeral vehicles. The advanced techniques and research described here may also be applicable to other high-tech areas such as robotics, avionics, vetronics, and space

Global navigation satellite systems performance analysis and augmentation strategies in aviation

In an era of significant air traffic expansion characterized by a rising congestion of the radiofrequency spectrum and a widespread introduction of Unmanned Aircraft Systems (UAS), Global Navigation Satellite Systems (GNSS) are being exposed to a variety of threats including signal interferences, adverse propagation effects and challenging platform-satellite relative dynamics. Thus, there is a need to characterize GNSS signal degradations and assess the effects of interfering sources on the performance of avionics GNSS receivers and augmentation systems used for an increasing number of mission-essential and safety-critical aviation tasks (e.g., experimental flight testing, flight inspection/certification of ground-based radio navigation aids, wide area navigation and precision approach). GNSS signal deteriorations typically occur due to antenna obscuration caused by natural and man-made obstructions present in the environment (e.g., elevated terrain and tall buildings when flying at low altitude) or by the aircraft itself during manoeuvring (e.g., aircraft wings and empennage masking the on-board GNSS antenna), ionospheric scintillation, Doppler shift, multipath, jamming and spurious satellite transmissions. Anyone of these phenomena can result in partial to total loss of tracking and possible tracking errors, depending on the severity of the effect and the receiver characteristics. After designing GNSS performance threats, the various augmentation strategies adopted in the Communication, Navigation, Surveillance/Air Traffic Management and Avionics (CNS + A) context are addressed in detail. GNSS augmentation can take many forms but all strategies share the same fundamental principle of providing supplementary information whose objective is improving the performance and/or trustworthiness of the system. Hence it is of paramount importance to consider the synergies offered by different augmentation strategies including Space Based Augmentation System (SBAS), Ground Based Augmentation System (GBAS), Aircraft Based Augmentation System (ABAS) and Receiver Autonomous Integrity Monitoring (RAIM). Furthermore, by employing multi-GNSS constellations and multi-sensor data fusion techniques, improvements in availability and continuity can be obtained. SBAS is designed to improve GNSS system integrity and accuracy for aircraft navigation and landing, while an alternative approach to GNSS augmentation is to transmit integrity and differential correction messages from ground-based augmentation systems (GBAS). In addition to existing space and ground based augmentation systems, GNSS augmentation may take the form of additional information being provided by other on-board avionics systems, such as in ABAS. As these on-board systems normally operate via separate principles than GNSS, they are not subject to the same sources of error or interference. Using suitable data link and data processing technologies on the ground, a certified ABAS capability could be a core element of a future GNSS Space-Ground-Aircraft Augmentation Network (SGAAN). Although current augmentation systems can provide significant improvement of GNSS navigation performance, a properly designed and flight-certified SGAAN could play a key role in trusted autonomous system and cyber-physical system applications such as UAS Sense-and-Avoid (SAA)