Vision-based control and autonomous landing of a VTOL-UAV

In recent years the popularity of quadrotor unmanned aerial vehicles (UAVs) has increased. Today, UAVs are widely used by military and police forces for surveillance. They are used by industry for such tasks as traffic monitoring, infrastructure inspection or even delivery of goods. They are used by individuals for hobby flying and aerial photography. It is currently of great interest in the research community to improve the level of autonomy of the UAV for these and future uses. One particular problem is the ability to stabilize over and land on a moving platform. This situation can easily arise for a quadrotor returning to a ship at sea or even a landing pad affixed to a vehicle. Many current techniques rely on knowledge of the platform and its motion, or a predictive model. This information is not always available or accurate. A solution that does not require knowledge of the target is desirable. This thesis deals with practical implementation of optical flow based position stabilization and autonomous landing algorithms for a quadrotor UAV. The quadrotor used is a common low cost platform with a large open source community. Firstly, non-linear estimation and control techniques are implemented for the attitude stabilization using low-cost sensors and limited computational power. Some methods for the system parameters estimation are presented and some challenges related to the implementation are discussed. Despite the ability of the attitude controller to stabilize the orientation of the quadrotor, hovering and landing precisely over a specific area is not possible without a position stabilization scheme. In applications where GPS signals are not available and the hovering target is a priori unknown, it is common to rely on visual information. In this context, this thesis aims for the development of an efficient optical-flow-based position stabilization and autonomous landing scheme for the quadrotor UAV

A pan-tilt camera Fuzzy vision controller on an unmanned aerial vehicle

is paper presents an implementation of two Fuzzy Logic controllers working in parallel for a pan-tilt camera platform on an UAV. This implementation uses a basic Lucas-Kanade tracker algorithm, which sends information about the error between the center of the object to track and the center of the image, to the Fuzzy controller. This information is enough for the controller, to follow the object moving a two axis servo-platform, besides the UAV vibrations and movements. The two Fuzzy controllers of each axis, work with a rules-base of 49 rules, two inputs and one output with a more significant sector defined to improve the behavior of those

Learning Pose Estimation for UAV Autonomous Navigation and Landing Using Visual-Inertial Sensor Data

In this work, we propose a robust network-in-the-loop control system for autonomous navigation and landing of an Unmanned-Aerial-Vehicle (UAV). To estimate the UAV’s absolute pose, we develop a deep neural network (DNN) architecture for visual-inertial odometry, which provides a robust alternative to traditional methods. We first evaluate the accuracy of the estimation by comparing the prediction of our model to traditional visual-inertial approaches on the publicly available EuRoC MAV dataset. The results indicate a clear improvement in the accuracy of the pose estimation up to 25% over the baseline. Finally, we integrate the data-driven estimator in the closed-loop flight control system of Airsim, a simulator available as a plugin for Unreal Engine, and we provide simulation results for autonomous navigation and landing

Design of a Specialized UAV Platform for the Discharge of a Fire Extinguishing Capsule

Tato práce se zabývá návrhem systému specializovaného pro autonomní detekci a lokalizaci požárů z palubních senzorů bezpilotních helikoptér. Hašení požárů je zajištěno automatickým vystřelením ampule s hasící kapalinou do zdroje požáru z palubního vystřelovače. Hlavní část této práce se soustředí na detekci požárů v datech termální kamery a jejich následnou lokalizaci ve světě za pomoci palubní hloubkové kamery. Bezpilotní helikoptéra je poté optimálně navigována na pozici pro zajištění průletu ampule s hasící kapalinou do zdroje požáru. Vyvinuté metody jsou detailně analyzovány a jejich chování je testováno jak v simulaci, tak současně i při reálných experimentech. Kvalitativní a kvantitativní analýza ukazuje na použitelnost a robustnost celého systému.This thesis deals with the design of an unmanned multirotor aircraft system specialized for autonomous detection and localization of fires from onboard sensors, and the task of fast and effective fire extinguishment. The main part of this thesis focuses on the detection of fires in thermal images and their localization in the world using an onboard depth camera. The localized fires are used to optimally position the unmanned aircraft in order to effectively discharge an ampoule filled with a fire extinguishant from an onboard launcher. The developed methods are analyzed in detail and their performance is evaluated in simulation scenarios as well as in real-world experiments. The included quantitative and qualitative analysis verifies the feasibility and robustness of the system

Survey of computer vision algorithms and applications for unmanned aerial vehicles

This paper presents a complete review of computer vision algorithms and vision-based intelligent applications, that are developed in the field of the Unmanned Aerial Vehicles (UAVs) in the latest decade. During this time, the evolution of relevant technologies for UAVs; such as component miniaturization, the increase of computational capabilities, and the evolution of computer vision techniques have allowed an important advance in the development of UAVs technologies and applications. Particularly, computer vision technologies integrated in UAVs allow to develop cutting-edge technologies to cope with aerial perception difficulties; such as visual navigation algorithms, obstacle detection and avoidance and aerial decision-making. All these expert technologies have developed a wide spectrum of application for UAVs, beyond the classic military and defense purposes. Unmanned Aerial Vehicles and Computer Vision are common topics in expert systems, so thanks to the recent advances in perception technologies, modern intelligent applications are developed to enhance autonomous UAV positioning, or automatic algorithms to avoid aerial collisions, among others. Then, the presented survey is based on artificial perception applications that represent important advances in the latest years in the expert system field related to the Unmanned Aerial Vehicles. In this paper, the most significant advances in this field are presented, able to solve fundamental technical limitations; such as visual odometry, obstacle detection, mapping and localization, et cetera. Besides, they have been analyzed based on their capabilities and potential utility. Moreover, the applications and UAVs are divided and categorized according to different criteria.This research is supported by the Spanish Government through the CICYT projects (TRA2015-63708-R and TRA2013-48314-C3-1-R)

Towards an autonomous landing system in presence of uncertain obstacles in indoor environments

The landing task is fundamental to Micro air vehicles (MAVs) when attempting to land in an unpredictable environment (e.g., presence of static obstacles or moving obstacles). The MAV should immediately detect the environment through its sensors and decide its actions for landing. This paper addresses the problem of the autonomous landing approach of a commercial AR. Drone 2.0 in presence of uncertain obstacles in an indoor environment. A localization methodology to estimate the drone's pose based on the sensor fusion techniques which fuses IMU and Poxyz signals is proposed. In addition, a vision-based approach to detect and estimate the velocity, position of the moving obstacle in the drone's working environment is presented. To control the drone landing accurately, a cascade control based on an Accelerated Particle Swarm Optimization algorithm (APSO) is designed. The simulation and experimental results demonstrate that the obtained model is appropriate for the measured data

Design, Development and Implementation of Intelligent Algorithms to Increase Autonomy of Quadrotor Unmanned Missions

This thesis presents the development and implementation of intelligent algorithms to increase autonomy of unmanned missions for quadrotor type UAVs. A six-degree-of freedom dynamic model of a quadrotor is developed in Matlab/Simulink in order to support the design of control algorithms previous to real-time implementation. A dynamic inversion based control architecture is developed to minimize nonlinearities and improve robustness when the system is driven outside bounds of nominal design. The design and the implementation of the control laws are described. An immunity-based architecture is introduced for monitoring quadrotor health and its capabilities for detecting abnormal conditions are successfully demonstrated through flight testing. A vision-based navigation scheme is developed to enhance the quadrotor autonomy under GPS denied environments. An optical flow sensor and a laser range finder are used within an Extended Kalman Filter for position estimation and its estimation performance is analyzed by comparing against measurements from a GPS module. Flight testing results are presented where the performances are analyzed, showing a substantial increase of controllability and tracking when the developed algorithms are used under dynamically changing environments. Healthy flights, flights with failures, flight with GPS-denied navigation and post-failure recovery are presented