Continuous Autonomous UAV Inspection for FPSO vessels

This Master's thesis represents the preliminary design study and proposes the unmanned aerial vehicle (UAV) -based inspection framework, comprising several multirotors with automatic charging and deployment for 24/7 integrity inspection tasks. This project has three main topics. First one describes the operational environment and existing regulations that cover use of UAVs. It forms the basis for proposal of the relevant use-case scenarios. Third part comprises two chapters, where design of concept and framework is being based on the previous factors. It shows that before implementation of fully autonomous inspection system, there is a need to cover both regulatory and technical gaps. It can be explained by the fact that there does not exist any autonomous inspection system today. Thus, this project can be seen as a base for future development of the UAV-based inspection system, as it focuses on creation of a general framework

Trajectory Optimization and NMPC Tracking for a Fixed Wing UAV in Deep Stall with Perch Landing

This paper presents a novel recovery technique for a fixed-wing UAV (Unmanned Aerial Vehicle) based on constrained optimization: i) we propose a trajectory generation for landing the UAV where it first reduces its altitude by deep stalling, then perches on a recovery net, ii) we design an NMPC (Nonlinear Model Predictive Control) tracking controller with terminal constraints for the optimal generated trajectory under disturbances. Compared to nominal net recovery procedures, this technique greatly reduces the landing time and the final airspeed of the UAV. Simulation results for various wind conditions demonstrate the feasibility of the idea.Comment: 8 pages, 13 figure

Strain Gauge Utilization for Aerial Vehicle Dynamic Load Measurement

Title from PDF of title page, viewed on July 11, 2016Thesis advisor: Travis FieldsVitaIncludes bibliographical references (pages 83-90)Thesis (M.S.)--School of Computing and Engineering. University of Missouri--Kansas City, 2016The strain gauge is a commonly used tool for dynamic load and strain measurement of a system. The work presented in this thesis describes the development and evaluation of strain gauges applied to both an aerodynamic decelerator system and an unmanned aerial vehicle. This thesis has three main objectives: (1)develop and evaluate test a circular parachute strain gauge-based load distribution measurement system, (2) develop and evaluate a strain gauge thrust estimation system for a quadrotor unmanned aircraft, and (3)compare the developed strain gauge-based thrust estimation technique with an indirect real time parameter estimation technique for motor fault detection. In pursuit of the first thesis objective, a load distribution measurement system for the suspension lines of circular parachutes was developed. The motivation to create a load distribution measurement system stems from parachute system design traditionally requiring an extensive flight testing regimen. Numerical solution-based design is difficult due to the highly nonlinear deformation behavior of the parachute canopy. Traditionally, circular parachutes are assumed to have symmetric canopy loading upon inflation and during terminal descent. Asymmetric canopy loading can have a significant impact on circular parachute suspension line loads, but is typically neglected. The developed strain gauge-based load distribution measurement system for circular parachutes has wireless capabilities and can be readily applied to a wide variety of aerodynamic declarator systems. The developed system can be used to observe asymmetric behaviors in order to help determine the significance of asymmetric canopy loading. Custom strain gauge load cells with mounted custom circuitry to calibrate, amplify, and transmit the load data were fixed to canopy suspension lines. Parachute drop testing was performed to evaluate the effectiveness to identify any significant asymmetric canopy loading behavior. Drop testing was performed with a 1.2m (4.0ft) quarter-spherical cross based canopy with a payload of 2.0kg (4.4lbs). A 12m (39ft) guide-line based drop rig was implemented to prevent canopy rotational movement that could hinder testing repeatability. Load distribution data was first verified via both static calibration and in-flight total canopy load measurements. Drop testing was then conducted to identify loading asymmetry during both inflation and terminal descent. Results demonstrated the use of the strain gauge-based load distribution measurement system for measuring significant asymmetric canopy loading patterns. In pursuit of the second thesis objective, strain gauges were used to aid in the development of a thrust estimation system for individual motors/propellers of a small quadrotor unmanned aerial vehicle (UAV). Small UAVs have become increasingly utilized for a wide range of applications; however, such aircraft typically do not undergo the same rigorous safety protocols as their larger human-piloted counterparts. A thrust estimation technique for a quadrotor unmanned aircraft was developed and evaluated that could potentially improve flight control design by increasing sensory feedback information. Strain gauges were integrated into the quadrotor frame to provide total force measurements on each arm of the aircraft. A dynamic model coupled with state information from motion capture and on-board measurement data was implemented to compensate for inertial forces caused by rotational and translational acceleration. Testing was conducted to evaluate the accuracy of the individual load cells, inertial compensation,and free-flight motor thrust estimates. Results demonstrate inertial force compensation during high frequency aircraft motion, which could potentially be useful for detecting an in-flight failure. The measurement system therefore has the potential to quickly detect an in-flight failure. The focus of the third thesis objective is to expand on the development of the thrust estimation system by performing an evaluation of the fault detection capabilities. A comparative study was conducted of the thrust estimation system along with a real time parameter estimation in the frequency domain during two motor failure scenarios of a small quadrotor UAV. Detecting and mitigating disturbances caused by in-flight mo tor/propeller failures is an important aspect of a robust flight controller for multirotor aircraft. The comparative study was performed in an attempt to determine whether direct thrust estimation (strain gauge-based) or indirect thrust estimation (parameter estimation using on-board measurement) more accurately and quickly capture an in-flight failure. Flight test results were post-processed to mimic real-time parameter estimation and strain gauged-based fault detection. Results show the strain gauge-based parameter estimation exhibits noisy estimates, but does have faster response to the failure. The parameter estimation using onboard data does not respond to failures as quickly as the strain-gauge based technique, but does produce better parameter estimate stability. Although both estimation techniques display strengths and weaknesses, neither technique is optimal for real time failure detection individually. A combination of the real-time parameter estimation in the frequency domain and the strain gauge-based thrust estimation techniques may yield a fast yet stable fault detection system. The evaluation of the fault detection capabilities of the thrust estimation system did not prove unsuccessful, however it has warranted further investigation into the overall effectiveness of the system for fault detection.Introduction -- Literature review -- Validation and flight testing of a wireless load distribution measurement system -- Feasibility of in-flight quadrotor individual motor thrust measurements -- Conclusio

Guidance, navigation and control of multirotors

Aplicat embargament des de la data de defensa fins el dia 31 de desembre de 2021This thesis presents contributions to the Guidance, Navigation and Control (GNC) systems for multirotor vehicles by applying and developing diverse control techniques and machine learning theory with innovative results. The aim of the thesis is to obtain a GNC system able to make the vehicle follow predefined paths while avoiding obstacles in the vehicle's route. The system must be adaptable to different paths, situations and missions, reducing the tuning effort and parametrisation of the proposed approaches. The multirotor platform, formed by the Asctec Hummingbird quadrotor vehicle, is studied and described in detail. A complete mathematical model is obtained and a freely available and open simulation platform is built. Furthermore, an autopilot controller is designed and implemented in the real platform. The control part is focused on the path following problem. That is, following a predefined path in space without any time constraint. Diverse control-oriented and geometrical algorithms are studied, implemented and compared. Then, the geometrical algorithms are improved by obtaining adaptive approaches that do not need any parameter tuning. The adaptive geometrical approaches are developed by means of Neural Networks. To end up, a deep reinforcement learning approach is developed to solve the path following problem. This approach implements the Deep Deterministic Policy Gradient algorithm. The resulting approach is trained in a realistic multirotor simulator and tested in real experiments with success. The proposed approach is able to accurately follow a path while adapting the vehicle's velocity depending on the path's shape. In the navigation part, an obstacle detection system based on the use of a LIDAR sensor is implemented. A model of the sensor is derived and included in the simulator. Moreover, an approach for treating the sensor data to eliminate the possible ground detections is developed. The guidance part is focused on the reactive path planning problem. That is, a path planning algorithm that is able to re-plan the trajectory online if an unexpected event, such as detecting an obstacle in the vehicle's route, occurs. A deep reinforcement learning approach for the reactive obstacle avoidance problem is developed. This approach implements the Deep Deterministic Policy Gradient algorithm. The developed deep reinforcement learning agent is trained and tested in the realistic simulation platform. This agent is combined with the path following agent and the rest of the elements developed in the thesis obtaining a GNC system that is able to follow different types of paths while avoiding obstacle in the vehicle's route.Aquesta tesi doctoral presenta diverses contribucions relaciones amb els sistemes de Guiat, Navegació i Control (GNC) per a vehicles multirrotor, aplicant i desenvolupant diverses tècniques de control i de machine learning amb resultats innovadors. L'objectiu principal de la tesi és obtenir un sistema de GNC capaç de dirigir el vehicle perquè segueixi una trajectòria predefinida mentre evita els obstacles que puguin aparèixer en el recorregut del vehicle. El sistema ha de ser adaptable a diferents trajectòries, situacions i missions, reduint l'esforç realitzat en l'ajust i la parametrització dels mètodes proposats. La plataforma experimental, formada pel cuadricòpter Asctec Hummingbird, s'estudia i es descriu en detall. S'obté un model matemàtic complet de la plataforma i es desenvolupa una eina de simulació, la qual és de codi lliure. A més, es dissenya un controlador autopilot i s'implementa en la plataforma real. La part de control està enfocada al problema de path following. En aquest problema, el vehicle ha de seguir una trajectòria predefinida en l'espai sense cap tipus de restricció temporal. S'estudien, s'implementen i es comparen diversos algoritmes de control i geomètrics de path following. Després, es milloren els algoritmes geomètrics usant xarxes neuronals per convertirlos en algoritmes adaptatius. Per finalitzar, es desenvolupa un mètode de path following basat en tècniques d'aprenentatge per reforç profund (deep Reinforcement learning). Aquest mètode implementa l'algoritme Deep Deterministic Policy Gradient. L'agent intel. ligent resultant és entrenat en un simulador realista de multirotors i validat en la plataforma experimental real amb èxit. Els resultats mostren que l'agent és capaç de seguir de forma precisa la trajectòria de referència adaptant la velocitat del vehicle segons la curvatura del recorregut. A la part de navegació, s'implementa un sistema de detecció d'obstacles basat en l'ús d'un sensor LIDAR. Es deriva un model del sensor i aquest s'inclou en el simulador. A més, es desenvolupa un mètode per tractar les mesures del sensor per eliminar les possibles deteccions del terra. Pel que fa a la part de guiatge, aquesta està focalitzada en el problema de reactive path planning. És a dir, un algoritme de planificació de trajectòria que és capaç de re-planejar el recorregut del vehicle a l'instant si algun esdeveniment inesperat ocorre, com ho és la detecció d'un obstacle en el recorregut del vehicle. Es desenvolupa un mètode basat en aprenentatge per reforç profund per l'evasió d'obstacles. Aquest mètode implementa l'algoritme Deep Deterministic Policy Gradient. L'agent d'aprenentatge per reforç s'entrena i valida en un simulador de multirotors realista. Aquest agent es combina amb l'agent de path following i la resta d'elements desenvolupats en la tesi per obtenir un sistema GNC capaç de seguir diferents tipus de trajectòries, evadint els obstacles que estiguin en el recorregut del vehicle.Esta tesis doctoral presenta varias contribuciones relacionas con los sistemas de Guiado, Navegación y Control (GNC) para vehículos multirotor, aplicando y desarrollando diversas técnicas de control y de machine learning con resultados innovadores. El objetivo principal de la tesis es obtener un sistema de GNC capaz de dirigir el vehículo para que siga una trayectoria predefinida mientras evita los obstáculos que puedan aparecer en el recorrido del vehículo. El sistema debe ser adaptable a diferentes trayectorias, situaciones y misiones, reduciendo el esfuerzo realizado en el ajuste y la parametrización de los métodos propuestos. La plataforma experimental, formada por el cuadricoptero Asctec Hummingbird, se estudia y describe en detalle. Se obtiene un modelo matemático completo de la plataforma y se desarrolla una herramienta de simulación, la cual es de código libre. Además, se diseña un controlador autopilot, el cual es implementado en la plataforma real. La parte de control está enfocada en el problema de path following. En este problema, el vehículo debe seguir una trayectoria predefinida en el espacio tridimensional sin ninguna restricción temporal Se estudian, implementan y comparan varios algoritmos de control y geométricos de path following. Luego, se mejoran los algoritmos geométricos usando redes neuronales para convertirlos en algoritmos adaptativos. Para finalizar, se desarrolla un método de path following basado en técnicas de aprendizaje por refuerzo profundo (deep reinforcement learning). Este método implementa el algoritmo Deep Deterministic Policy Gradient. El agente inteligente resultante es entrenado en un simulador realista de multirotores y validado en la plataforma experimental real con éxito. Los resultados muestran que el agente es capaz de seguir de forma precisa la trayectoria de referencia adaptando la velocidad del vehículo según la curvatura del recorrido. En la parte de navegación se implementa un sistema de detección de obstáculos basado en el uso de un sensor LIDAR. Se deriva un modelo del sensor y este se incluye en el simulador. Además, se desarrolla un método para tratar las medidas del sensor para eliminar las posibles detecciones del suelo. En cuanto a la parte de guiado, está focalizada en el problema de reactive path planning. Es decir, un algoritmo de planificación de trayectoria que es capaz de re-planear el recorrido del vehículo al instante si ocurre algún evento inesperado, como lo es la detección de un obstáculo en el recorrido del vehículo. Se desarrolla un método basado en aprendizaje por refuerzo profundo para la evasión de obstáculos. Este implementa el algoritmo Deep Deterministic Policy Gradient. El agente de aprendizaje por refuerzo se entrena y valida en un simulador de multirotors realista. Este agente se combina con el agente de path following y el resto de elementos desarrollados en la tesis para obtener un sistema GNC capaz de seguir diferentes tipos de trayectorias evadiendo los obstáculos que estén en el recorrido del vehículo.Postprint (published version

UAVs for the Environmental Sciences

This book gives an overview of the usage of UAVs in environmental sciences covering technical basics, data acquisition with different sensors, data processing schemes and illustrating various examples of application

Machine learning techniques to estimate the dynamics of a slung load multirotor UAV system

This thesis addresses the question of designing robust and flexible controllers to enable autonomous operation of a multirotor UAV with an attached slung load for general cargo transport. This is achieved by following an experimental approach; real flight data from a slung load multirotor coupled system is used as experience, allowing for a computer software to estimate the pose of the slung in order to propose a swing-free controller that will dampen the oscillations of the slung load when the multirotor is following a desired flight trajectory. The thesis presents the reader with a methodology describing the development path from vehicle design and modelling over slung load state estimators to controller synthesis. Attaching a load via a cable to the underside of the aircraft alters the mass distribution of the combined "airborne entity" in a highly dynamic fashion. The load will be subject to inertial, gravitational and unsteady aerodynamic forces which are transmitted to the aircraft via the cable, providing another source of external force to the multirotor platform and thus altering the flight dynamic response characteristics of the vehicle. Similarly the load relies on the forces transmitted by the multirotor to alter its state, which is much more difficult to control. The principle research hypothesis of this thesis is that the dynamics of the coupled system can be identified by applying Machine Learning techniques. One of the major contributions of this thesis is the estimator that uses real flight data to train an unstructured black-box algorithm that can output the position vector of the load using the vehicle pose and pilot pseudo-controls as input. Experimental results show very accurate position estimation of the load using the machine learning estimator when comparing it with a motion tracking system (~2% offset). Another contribution lies in the avionics solution created for data collection, algorithm execution and control of multirotor UAVs, experimental results show successful autonomous flight with a range of algorithms and applications. Finally, to enable flight capabilities of a multirotor with slung load, a control system is developed that dampens the oscillations of the load; the controller uses a feedback approach to simultaneously prevent exciting swing and to actively dampen swing in the slung load. The methods and algorithms developed in this thesis are validated by flight testing

Reference Model for Interoperability of Autonomous Systems

This thesis proposes a reference model to describe the components of an Un-manned Air, Ground, Surface, or Underwater System (UxS), and the use of a single Interoperability Building Block to command, control, and get feedback from such vehicles. The importance and advantages of such a reference model, with a standard nomenclature and taxonomy, is shown. We overview the concepts of interoperability and some efforts to achieve common refer-ence models in other areas. We then present an overview of existing un-manned systems, their history, characteristics, classification, and missions. The concept of Interoperability Building Blocks (IBB) is introduced to describe standards, protocols, data models, and frameworks, and a large set of these are analyzed. A new and powerful reference model for UxS, named RAMP, is proposed, that describes the various components that a UxS may have. It is a hierarchical model with four levels, that describes the vehicle components, the datalink, and the ground segment. The reference model is validated by showing how it can be applied in various projects the author worked on. An example is given on how a single standard was capable of controlling a set of heterogeneous UAVs, USVs, and UGVs