Cooperative Virtual Sensor for Fault Detection and Identification in Multi-UAV Applications

This paper considers the problem of fault detection and identification (FDI) in applications carried out by a group of unmanned aerial vehicles (UAVs) with visual cameras. In many cases, the UAVs have cameras mounted onboard for other applications, and these cameras can be used as bearing-only sensors to estimate the relative orientation of another UAV. The idea is to exploit the redundant information provided by these sensors onboard each of the UAVs to increase safety and reliability, detecting faults on UAV internal sensors that cannot be detected by the UAVs themselves. Fault detection is based on the generation of residuals which compare the expected position of a UAV, considered as target, with the measurements taken by one or more UAVs acting as observers that are tracking the target UAV with their cameras. Depending on the available number of observers and the way they are used, a set of strategies and policies for fault detection are defined. When the target UAV is being visually tracked by two or more observers, it is possible to obtain an estimation of its 3D position that could replace damaged sensors. Accuracy and reliability of this vision-based cooperative virtual sensor (CVS) have been evaluated experimentally in a multivehicle indoor testbed with quadrotors, injecting faults on data to validate the proposed fault detection methods.Comisión Europea H2020 644271Comisión Europea FP7 288082Ministerio de Economia, Industria y Competitividad DPI2015-71524-RMinisterio de Economia, Industria y Competitividad DPI2014-5983-C2-1-RMinisterio de Educación, Cultura y Deporte FP

Design of an embedded microcomputer based mini quadrotor UAV

This paper describes the design and realization of a mini quadrotor UAV (Unmanned Aerial Vehicle) that has been initiated in the Systems and Control Laboratory at the Computer and Automation Research institute of the Hungarian Academy of Science in collaboration with control departments of the Budapest University of Technology and Economics. The mini quadrotor UAV is intended to use in several areas such as camera-based air-surveillance, traffic control, environmental measurements, etc. The paper focuses upon the embedded microcomputer-based implementation of the mini UAV, describes the elements of the implementation, the tools realized for mathematical model building, as well as obtains a brief outline of the control design

Fault-tolerant formation driving mechanism designed for heterogeneous MAVs-UGVs groups

A fault-tolerant method for stabilization and navigation of 3D heterogeneous formations is proposed in this paper. The presented Model Predictive Control (MPC) based approach enables to deploy compact formations of closely cooperating autonomous aerial and ground robots in surveillance scenarios without the necessity of a precise external localization. Instead, the proposed method relies on a top-view visual relative localization provided by the micro aerial vehicles flying above the ground robots and on a simple yet stable visual based navigation using images from an onboard monocular camera. The MPC based schema together with a fault detection and recovery mechanism provide a robust solution applicable in complex environments with static and dynamic obstacles. The core of the proposed leader-follower based formation driving method consists in a representation of the entire 3D formation as a convex hull projected along a desired path that has to be followed by the group. Such an approach provides non-collision solution and respects requirements of the direct visibility between the team members. The uninterrupted visibility is crucial for the employed top-view localization and therefore for the stabilization of the group. The proposed formation driving method and the fault recovery mechanisms are verified by simulations and hardware experiments presented in the paper

Multi-Unmanned Aerial Vehicle (UAV) Cooperative Fault Detection Employing Differential Global Positioning (DGPS), Inertial and Vision Sensors

This paper presents a method to increase the reliability of Unmanned Aerial Vehicle (UAV) sensor Fault Detection and Identification (FDI) in a multi-UAV context. Differential Global Positioning System (DGPS) and inertial sensors are used for sensor FDI in each UAV. The method uses additional position estimations that augment individual UAV FDI system. These additional estimations are obtained using images from the same planar scene taken from two different UAVs. Since accuracy and noise level of the estimation depends on several factors, dynamic replanning of the multi-UAV team can be used to obtain a better estimation in case of faults caused by slow growing errors of absolute position estimation that cannot be detected by using local FDI in the UAVs. Experimental results with data from two real UAVs are also presented

Design of an UAV swarm

This master thesis tries to give an overview on the general aspects involved in the design of an UAV swarm. UAV swarms are continuoulsy gaining popularity amongst researchers and UAV manufacturers, since they allow greater success rates in task accomplishing with reduced times. Appart from this, multiple UAVs cooperating between them opens a new field of missions that can only be carried in this way. All the topics explained within this master thesis will explain all the agents involved in the design of an UAV swarm, from the communication protocols between them, navigation and trajectory analysis and task allocation

Fault Diagnosis and Fault-Tolerant Control of Unmanned Aerial Vehicles

With the increasing demand for unmanned aerial vehicles (UAVs) in both military and civilian applications, critical safety issues need to be specially considered in order to make better and wider use of them. UAVs are usually employed to work in hazardous and complex environments, which may seriously threaten the safety and reliability of UAVs. Therefore, the safety and reliability of UAVs are becoming imperative for development of advanced intelligent control systems. The key challenge now is the lack of fully autonomous and reliable control techniques in face of different operation conditions and sophisticated environments. Further development of unmanned aerial vehicle (UAV) control systems is required to be reliable in the presence of system component faults and to be insensitive to model uncertainties and external environmental disturbances. This thesis research aims to design and develop novel control schemes for UAVs with consideration of all the factors that may threaten their safety and reliability. A novel adaptive sliding mode control (SMC) strategy is proposed to accommodate model uncertainties and actuator faults for an unmanned quadrotor helicopter. Compared with the existing adaptive SMC strategies in the literature, the proposed adaptive scheme can tolerate larger actuator faults without stimulating control chattering due to the use of adaptation parameters in both continuous and discontinuous control parts. Furthermore, a fuzzy logic-based boundary layer and a nonlinear disturbance observer are synthesized to further improve the capability of the designed control scheme for tolerating model uncertainties, actuator faults, and unknown external disturbances while preventing overestimation of the adaptive control parameters and suppressing the control chattering effect. Then, a cost-effective fault estimation scheme with a parallel bank of recurrent neural networks (RNNs) is proposed to accurately estimate actuator fault magnitude and an active fault-tolerant control (FTC) framework is established for a closed-loop quadrotor helicopter system. Finally, a reconfigurable control allocation approach is combined with adaptive SMC to achieve the capability of tolerating complete actuator failures with application to a modified octorotor helicopter. The significance of this proposed control scheme is that the stability of the closed-loop system is theoretically guaranteed in the presence of both single and simultaneous actuator faults

Robotic Wireless Sensor Networks

In this chapter, we present a literature survey of an emerging, cutting-edge, and multi-disciplinary field of research at the intersection of Robotics and Wireless Sensor Networks (WSN) which we refer to as Robotic Wireless Sensor Networks (RWSN). We define a RWSN as an autonomous networked multi-robot system that aims to achieve certain sensing goals while meeting and maintaining certain communication performance requirements, through cooperative control, learning and adaptation. While both of the component areas, i.e., Robotics and WSN, are very well-known and well-explored, there exist a whole set of new opportunities and research directions at the intersection of these two fields which are relatively or even completely unexplored. One such example would be the use of a set of robotic routers to set up a temporary communication path between a sender and a receiver that uses the controlled mobility to the advantage of packet routing. We find that there exist only a limited number of articles to be directly categorized as RWSN related works whereas there exist a range of articles in the robotics and the WSN literature that are also relevant to this new field of research. To connect the dots, we first identify the core problems and research trends related to RWSN such as connectivity, localization, routing, and robust flow of information. Next, we classify the existing research on RWSN as well as the relevant state-of-the-arts from robotics and WSN community according to the problems and trends identified in the first step. Lastly, we analyze what is missing in the existing literature, and identify topics that require more research attention in the future

A Review of Radio Frequency Based Localization for Aerial and Ground Robots with 5G Future Perspectives

Efficient localization plays a vital role in many modern applications of Unmanned Ground Vehicles (UGV) and Unmanned aerial vehicles (UAVs), which would contribute to improved control, safety, power economy, etc. The ubiquitous 5G NR (New Radio) cellular network will provide new opportunities for enhancing localization of UAVs and UGVs. In this paper, we review the radio frequency (RF) based approaches for localization. We review the RF features that can be utilized for localization and investigate the current methods suitable for Unmanned vehicles under two general categories: range-based and fingerprinting. The existing state-of-the-art literature on RF-based localization for both UAVs and UGVs is examined, and the envisioned 5G NR for localization enhancement, and the future research direction are explored