Cooperative Virtual Sensor for Fault Detection and Identification in Multi-UAV Applications

This paper considers the problem of fault detection and identification (FDI) in applications carried out by a group of unmanned aerial vehicles (UAVs) with visual cameras. In many cases, the UAVs have cameras mounted onboard for other applications, and these cameras can be used as bearing-only sensors to estimate the relative orientation of another UAV. The idea is to exploit the redundant information provided by these sensors onboard each of the UAVs to increase safety and reliability, detecting faults on UAV internal sensors that cannot be detected by the UAVs themselves. Fault detection is based on the generation of residuals which compare the expected position of a UAV, considered as target, with the measurements taken by one or more UAVs acting as observers that are tracking the target UAV with their cameras. Depending on the available number of observers and the way they are used, a set of strategies and policies for fault detection are defined. When the target UAV is being visually tracked by two or more observers, it is possible to obtain an estimation of its 3D position that could replace damaged sensors. Accuracy and reliability of this vision-based cooperative virtual sensor (CVS) have been evaluated experimentally in a multivehicle indoor testbed with quadrotors, injecting faults on data to validate the proposed fault detection methods.Comisión Europea H2020 644271Comisión Europea FP7 288082Ministerio de Economia, Industria y Competitividad DPI2015-71524-RMinisterio de Economia, Industria y Competitividad DPI2014-5983-C2-1-RMinisterio de Educación, Cultura y Deporte FP

Kernel-based fault diagnosis of inertial sensors using analytical redundancy

Kernel methods are able to exploit high-dimensional spaces for representational advantage, while only operating implicitly in such spaces, thus incurring none of the computational cost of doing so. They appear to have the potential to advance the state of the art in control and signal processing applications and are increasingly seeing adoption across these domains. Applications of kernel methods to fault detection and isolation (FDI) have been reported, but few in aerospace research, though they offer a promising way to perform or enhance fault detection. It is mostly in process monitoring, in the chemical processing industry for example, that these techniques have found broader application. This research work explores the use of kernel-based solutions in model-based fault diagnosis for aerospace systems. Specifically, it investigates the application of these techniques to the detection and isolation of IMU/INS sensor faults – a canonical open problem in the aerospace field. Kernel PCA, a kernelised non-linear extension of the well-known principal component analysis (PCA) algorithm, is implemented to tackle IMU fault monitoring. An isolation scheme is extrapolated based on the strong duality known to exist between probably the most widely practiced method of FDI in the aerospace domain – the parity space technique – and linear principal component analysis. The algorithm, termed partial kernel PCA, benefits from the isolation properties of the parity space method as well as the non-linear approximation ability of kernel PCA. Further, a number of unscented non-linear filters for FDI are implemented, equipped with data-driven transition models based on Gaussian processes - a non-parametric Bayesian kernel method. A distributed estimation architecture is proposed, which besides fault diagnosis can contemporaneously perform sensor fusion. It also allows for decoupling faulty sensors from the navigation solution

Integrated approaches to handle UAV actuator fault

Unmanned AerialVehicles (UAV) has historically shown to be unreliable when compared to their manned counterparts. Part of the reason is they may not be able to a ord the redundancies required to handle faults from system or cost constraints. This research explores instances when actuator fault handling may be improved with integrated approaches for small UAVs which have limited actuator redundancy. The research started with examining the possibility of handling the case where no actuator redundancy remains post fault. Two fault recovery schemes, combing control allocation and hardware means, for a Quad Rotor UAV with no redundancy upon fault event are developed to enable safe emergency landing. Inspired by the integrated approach, a proposed integrated actuator control scheme is developed, and shown to reduce the magnitude of the error dynamics when input saturation faults occur. Geometrical insights to the proposed actuator scheme are obtained. Simulations using an Aerosonde UAV model with the proposed scheme showed significant improvements to the fault tolerant stuck fault range and improved guidance tracking performance. While much research literature has previously been focused on the controller to handle actuator faults, fault tolerant guidance schemes may also be utilized to accommodate the fault. One possible advantage of using fault tolerant guidance is that it may consider the fault degradation e ects on the overall mission. A fault tolerant guidance reconfiguration method is developed for a path following mission. The method provides an additional degree of freedom in design, which allows more flexibility to the designer to meet mission requirements. This research has provided fresh insights into the handling UAV extremal actuator faults through integrated approaches. The impact of this work is to expand on the possibilities a practitioner may have for improving the fault handling capabilities of a UAV

Fault-tolerant formation driving mechanism designed for heterogeneous MAVs-UGVs groups

A fault-tolerant method for stabilization and navigation of 3D heterogeneous formations is proposed in this paper. The presented Model Predictive Control (MPC) based approach enables to deploy compact formations of closely cooperating autonomous aerial and ground robots in surveillance scenarios without the necessity of a precise external localization. Instead, the proposed method relies on a top-view visual relative localization provided by the micro aerial vehicles flying above the ground robots and on a simple yet stable visual based navigation using images from an onboard monocular camera. The MPC based schema together with a fault detection and recovery mechanism provide a robust solution applicable in complex environments with static and dynamic obstacles. The core of the proposed leader-follower based formation driving method consists in a representation of the entire 3D formation as a convex hull projected along a desired path that has to be followed by the group. Such an approach provides non-collision solution and respects requirements of the direct visibility between the team members. The uninterrupted visibility is crucial for the employed top-view localization and therefore for the stabilization of the group. The proposed formation driving method and the fault recovery mechanisms are verified by simulations and hardware experiments presented in the paper

Virtual Sensor for Failure Detection, Identification and Recovery in the Transition Phase of a Morphing Aircraft

The Helicopter Adaptive Aircraft (HADA) is a morphing aircraft which is able to take-off as a helicopter and, when in forward flight, unfold the wings that are hidden under the fuselage, and transfer the power from the main rotor to a propeller, thus morphing from a helicopter to an airplane. In this process, the reliable folding and unfolding of the wings is critical, since a failure may determine the ability to perform a mission, and may even be catastrophic. This paper proposes a virtual sensor based Fault Detection, Identification and Recovery (FDIR) system to increase the reliability of the HADA aircraft. The virtual sensor is able to capture the nonlinear interaction between the folding/unfolding wings aerodynamics and the HADA airframe using the navigation sensor measurements. The proposed FDIR system has been validated using a simulation model of the HADA aircraft, which includes real phenomena as sensor noise and sampling characteristics and turbulence and wind perturbations

Detection and Isolation of Faults and Cyberattacks in Nonlinear Cyber-Physical Systems using Neural Networks

The theory of Cyber-physical systems (CPSs) has applications in critical infrastructures such as smart grids, manufacturing systems, transportation systems, and autonomous systems such as Unmanned Aerial Vehicles(UAVs). In the CPS, there is a coordination between communication, computation, and control. The communication link in CPS can be subjected to malicious cyberattacks. On the other hand, the physical system in CPS can be faced with different faults such as sensor, actuator, and component faults. Therefore, two significant and challenging problems in CPS can be the detection of faults and cyberattacks. These two threats are intrinsically distinctive and need different strategies to deal with when they occur. This research mainly focuses on providing a methodology to detect and isolate faults and cyberattacks. This work considers false data injection and replay attacks as security threats. Two different adaptive neural network-based detection methods are proposed in this thesis. These adaptive neural networks are able to detect, isolate, and estimate false data injection, and replay attacks. Another contribution of this thesis is to provide a scheme for isolating faults and cyberattacks (false data injection and replay attacks) by using virtual sensors on the plant side, which makes the simultaneous detection of faults and false data injection cyberattacks possible. A nonlinear model of a quadrotor is considered the case study, and the performance of the neural network-based schemes is evaluated through various numerical simulation scenarios

Fault tolerant control for nonlinear aircraft based on feedback linearization

The thesis concerns the fault tolerant flight control (FTFC) problem for nonlinear aircraft by making use of analytical redundancy. Considering initially fault-free flight, the feedback linearization theory plays an important role to provide a baseline control approach for de-coupling and stabilizing a non-linear statically unstable aircraft system. Then several reconfigurable control strategies are studied to provide further robust control performance:- A neural network (NN)-based adaption mechanism is used to develop reconfigurable FTFC performance through the combination of a concurrent updated learninglaw. - The combined feedback linearization and NN adaptor FTFC system is further improved through the use of a sliding mode control (SMC) strategy to enhance the convergence of the NN learning adaptor. - An approach to simultaneous estimation of both state and fault signals is incorporated within an active FTFC system.The faults acting independently on the three primary actuators of the nonlinear aircraft are compensated in the control system.The theoretical ideas developed in the thesis have been applied to the nonlinear Machan Unmanned Aerial Vehicle (UAV) system. The simulation results obtained from a tracking control system demonstrate the improved fault tolerant performance for all the presented control schemes, validated under various faults and disturbance scenarios.A Boeing 747 nonlinear benchmark model, developed within the framework of the GARTEUR FM-AG 16 project “fault tolerant flight control systems”,is used for the purpose of further simulation study and testing of the FTFC scheme developed by making the combined use of concurrent learning NN and SMC theory. The simulation results under the given fault scenario show a promising reconfiguration performance