Safe and accurate MAV Control, navigation and manipulation

This work focuses on the problem of precise, aggressive and safe Micro Aerial Vehicle (MAV) navigation as well as deployment in applications which require physical interaction with the environment. To address these issues, we propose three different MAV model based control algorithms that rely on the concept of receding horizon control. As a starting point, we present a computationally cheap algorithm which utilizes an approximate linear model of the system around hover and is thus maximally accurate for slow reference maneuvers. Aiming at overcoming the limitations of the linear model parameterisation, we present an extension to the first controller which relies on the true nonlinear dynamics of the system. This approach, even though computationally more intense, ensures that the control model is always valid and allows tracking of full state aggressive trajectories. The last controller addresses the topic of aerial manipulation in which the versatility of aerial vehicles is combined with the manipulation capabilities of robotic arms. The proposed method relies on the formulation of a hybrid nonlinear MAV-arm model which also takes into account the effects of contact with the environment. Finally, in order to enable safe operation despite the potential loss of an actuator, we propose a supervisory algorithm which estimates the health status of each motor. We further showcase how this can be used in conjunction with the nonlinear controllers described above for fault tolerant MAV flight. While all the developed algorithms are formulated and tested using our specific MAV platforms (consisting of underactuated hexacopters for the free flight experiments, hexacopter-delta arm system for the manipulation experiments), we further discuss how these can be applied to other underactuated/overactuated MAVs and robotic arm platforms. The same applies to the fault tolerant control where we discuss different stabilisation techniques depending on the capabilities of the available hardware. Even though the primary focus of this work is on feedback control, we thoroughly describe the custom hardware platforms used for the experimental evaluation, the state estimation algorithms which provide the basis for control as well as the parameter identification required for the formulation of the various control models. We showcase all the developed algorithms in experimental scenarios designed to highlight the corresponding strengths and weaknesses as well as show that the proposed methods can run in realtime on commercially available hardware.Open Acces

PAC: A Novel Self-Adaptive Neuro-Fuzzy Controller for Micro Aerial Vehicles

There exists an increasing demand for a flexible and computationally efficient controller for micro aerial vehicles (MAVs) due to a high degree of environmental perturbations. In this work, an evolving neuro-fuzzy controller, namely Parsimonious Controller (PAC) is proposed. It features fewer network parameters than conventional approaches due to the absence of rule premise parameters. PAC is built upon a recently developed evolving neuro-fuzzy system known as parsimonious learning machine (PALM) and adopts new rule growing and pruning modules derived from the approximation of bias and variance. These rule adaptation methods have no reliance on user-defined thresholds, thereby increasing the PAC's autonomy for real-time deployment. PAC adapts the consequent parameters with the sliding mode control (SMC) theory in the single-pass fashion. The boundedness and convergence of the closed-loop control system's tracking error and the controller's consequent parameters are confirmed by utilizing the LaSalle-Yoshizawa theorem. Lastly, the controller's efficacy is evaluated by observing various trajectory tracking performance from a bio-inspired flapping-wing micro aerial vehicle (BI-FWMAV) and a rotary wing micro aerial vehicle called hexacopter. Furthermore, it is compared to three distinctive controllers. Our PAC outperforms the linear PID controller and feed-forward neural network (FFNN) based nonlinear adaptive controller. Compared to its predecessor, G-controller, the tracking accuracy is comparable, but the PAC incurs significantly fewer parameters to attain similar or better performance than the G-controller.Comment: This paper has been accepted for publication in Information Science Journal 201

Optimization-based design of fault-tolerant avionics

This dissertation considers the problem of improving the self-consciousness for avionic systems using numerical optimization techniques, emphasizing UAV applications. This self-consciousness implies a sense of awareness for oneself to make a reliable decision on some crucial aspects. In the context of the avionics or aerospace industry, those aspects are SWaP-C as well as safety and reliability. The decision-making processes to optimize these aspects, which are the main contributions of this work, are presented. In addition, implementation on various types of applications related to avionics and UAV are also provided. The first half of this thesis lays out the background of avionics development ranging from a mechanical gyroscope to a current state-of-the-art electronics system. The relevant mathematics regarding convex optimization and its algorithms, which will be used for formulating this self-consciousness problem, are also provided. The latter half presents two problem formulations for redundancy design automation and reconfigurable middleware. The first formulation focuses on the minimization of SWaP-C while satisfying safety and reliability requirements. The other one aims to maximize the system safety and reliability by introducing a fault-tolerant capability via the task scheduler of middleware or RTOS. The usage of these two formulations is shown by four aerospace applications---reconfigurable multicore avionics, a SITL simulation of a UAV GNC system, a modular drone, and a HITL simulation of a fault-tolerant distributed engine control architecture.Ph.D

Development of Self-Learning Type-2 Fuzzy Systems for System Identification and Control of Autonomous Systems

Modelling and control of dynamic systems are faced by multiple technical challenges, mainly due to the nature of uncertain complex, nonlinear, and time-varying systems. Traditional modelling techniques require a complete understanding of system dynamics and obtaining comprehensive mathematical models is not always achievable due to limited knowledge of the systems as well as the presence of multiple uncertainties in the environment. As universal approximators, fuzzy logic systems (FLSs), neural networks (NNs) and neuro-fuzzy systems have proved to be successful computational tools for representing the behaviour of complex dynamical systems. Moreover, FLSs, NNs and learning-based techniques have been gaining popularity for controlling complex, ill-defined, nonlinear, and time-varying systems in the face of uncertainties. However, fuzzy rules derived by experts can be too ad-hoc, and the performance is less than optimum. In other words, generating fuzzy rules and membership functions in fuzzy systems is a potential challenge especially for systems with many variables. Moreover, under the umbrella of FLSs, although type-1 fuzzy logic control systems (T1-FLCs) have been applied to control various complex nonlinear systems, they have limited capability to handle uncertainties. Aiming to accommodate uncertainties, type-2 fuzzy logic control systems (T2-FLCs) were established. This thesis aims to address the shortcomings of existing fuzzy techniques by utilisation of type-2 FLCs with novel adaptive capabilities. The first contribution of this thesis is a novel online system identification technique by means of a recursive interval type-2 Takagi-Sugeno fuzzy C-means clustering technique (IT2-TS-FC) to accommodate the footprint-of-uncertainties (FoUs). This development is meant to specifically address the shortcomings of type-1 fuzzy systems in capturing the footprint-of-uncertainties such as mechanical wear, rotor damage, battery drain and sensor and actuator faults. Unlike previous type-2 TS fuzzy models, the proposed method constructs two fuzzifiers (upper and lower) and two regression coefficients in the consequent part to handle uncertainties. The weighted least square method is employed to compute the regression coefficients. The proposed method is validated using two benchmarks, namely, real flight test data of a quadcopter drone and Mackey-Glass time series data. The algorithm has the capability to model uncertainties (e.g., noisy dataset). The second contribution of this thesis is the development of a novel self-adaptive interval type-2 fuzzy controller named the SAF2C for controlling multi-input multi-output (MIMO) nonlinear systems. The adaptation law is derived using sliding mode control (SMC) theory to reduce the computation time so that the learning process can be expedited by 80% compared to separate single-input single-output (SISO) controllers. The system employs the `Enhanced Iterative Algorithm with Stop Condition' (EIASC) type-reduction method, which is more computationally efficient than the `Karnik-Mendel' type-reduction algorithm. The stability of the SAF2C is proven using the Lyapunov technique. To ensure the applicability of the proposed control scheme, SAF2C is implemented to control several dynamical systems, including a simulated MIMO hexacopter unmanned aerial vehicle (UAV) in the face of external disturbance and parameter variations. The ability of SAF2C to filter the measurement noise is demonstrated, where significant improvement is obtained using the proposed controller in the face of measurement noise. Also, the proposed closed-loop control system is applied to control other benchmark dynamic systems (e.g., a simulated autonomous underwater vehicle and inverted pendulum on a cart system) demonstrating high accuracy and robustness to variations in system parameters and external disturbance. Another contribution of this thesis is a novel stand-alone enhanced self-adaptive interval type-2 fuzzy controller named the ESAF2C algorithm, whose type-2 fuzzy parameters are tuned online using the SMC theory. This way, we expect to design a computationally efficient adaptive Type-2 fuzzy system, suitable for real-time applications by introducing the EIASC type-reducer. The proposed technique is applied on a quadcopter UAV (QUAV), where extensive simulations and real-time flight tests for a hovering QUAV under wind disturbances are also conducted to validate the efficacy of the ESAF2C. Specifically, the control performance is investigated in the face of external wind gust disturbances, generated using an industrial fan. Stability analysis of the ESAF2C control system is investigated using the Lyapunov theory. Yet another contribution of this thesis is the development of a type-2 evolving fuzzy control system (T2-EFCS) to facilitate self-learning (either from scratch or from a certain predefined rule). T2-EFCS has two phases, namely, the structure learning and the parameters learning. The structure of T2-EFCS does not require previous information about the fuzzy structure, and it can start the construction of its rules from scratch with only one rule. The rules are then added and pruned in an online fashion to achieve the desired set-point. The proposed technique is applied to control an unmanned ground vehicle (UGV) in the presence of multiple external disturbances demonstrating the robustness of the proposed control systems. The proposed approach turns out to be computationally efficient as the system employs fewer fuzzy parameters while maintaining superior control performance

Learning Autonomous Flight Controllers with Spiking Neural Networks

The ability of a robot to adapt in-mission to achieve an assigned goal is highly desirable. This thesis project places an emphasis on employing learning-based intelligent control methodologies to the development and implementation of an autonomous unmanned aerial vehicle (UAV). Flight control is carried out by evolving spiking neural networks (SNNs) with Hebbian plasticity. The proposed implementation is capable of learning and self-adaptation to model variations and uncertainties when the controller learned in simulation is deployed on a physical platform. Controller development for small multicopters often relies on simulations as an intermediate step, providing cheap, parallelisable, observable and reproducible optimisation with no risk of damage to hardware. Although model-based approaches have been widely utilised in the process of development, loss of performance can be observed on the target platform due to simplification of system dynamics in simulation (e.g., aerodynamics, servo dynamics, sensor uncertainties). Ignorance of these effects in simulation can significantly deteriorate performance when the controller is deployed. Previous approaches often require mathematical or simulation models with a high level of accuracy which can be difficult to obtain. This thesis, on the other hand, attempts to cross the reality gap between a low-fidelity simulation and the real platform. This is done using synaptic plasticity to adapt the SNN controller evolved in simulation to the actual UAV dynamics. The primary contribution of this work is the implementation of a procedural methodology for SNN control that integrates bioinspired learning mechanisms with artificial evolution, with an SNN library package (i.e. eSpinn) developed by the author. Distinct from existing SNN simulators that mainly focus on large-scale neuron interactions and learning mechanisms from a neuroscience perspective, the eSpinn library draws particular attention to embedded implementations on hardware that is applicable for problems in the robotic domain. This C++ software package is not only able to support simulations in the MATLAB and Python environment, allowing rapid prototyping and validation in simulation; but also capable of seamless transition between simulation and deployment on the embedded platforms. This work implements a modified version of the NEAT neuroevolution algorithm and leverages the power of evolutionary computation to discover functional controller compositions and optimise plasticity mechanisms for online adaptation. With the eSpinn software package the development of spiking neurocontrollers for all degrees of freedom of the UAV is demonstrated in simulation. Plastic height control is carried out on a physical hexacopter platform. Through a set of experiments it is shown that the evolved plastic controller can maintain its functionality by self-adapting to model changes and uncertainties that take place after evolutionary training, and consequently exhibit better performance than its non-plastic counterpart

Design of a flight controller to achieve improved fault tolerance

In the last years, multirotor aerial vehicles have gained popularity both as consumer products and in professional applications. Safety is one of the main concerns during operation, and different approaches to fault tolerance have been proposed and continue to be developed. For a control system to be able to handle off-nominal situations, failures must be properly detected and identified; therefore, a fault detection and identification algorithm is required. Also, the control loop has to be accordingly modified to cope with each particular failure in the best way possible. These algorithms usually run on the vehicle’s low-level flight computer, imposing on it a large additional computational load. In this work, a fault detection and identification module is used to evaluate its impact in terms of additional processing time on a flight computer based on the Cortex-M3 microcontroller. While a highly optimized version of the algorithm is able to run, it still suggests potential hardware limitations for expanding the system capabilities. The evaluation of the same module on an improved flight computer design based on a Cortex-M7 micro-processor shows a significantly reduced footprint in the overall performance, allowing for the addition of an augmented method for faster failure detection

A Contribution to the Design of Highly Redundant Compliant Aerial Manipulation Systems

Es ist vorhersehbar, dass die Luftmanipulatoren in den nächsten Jahrzehnten für viele Aufgaben eingesetzt werden, die entweder zu gefährlich oder zu teuer sind, um sie mit herkömmlichen Methoden zu bewältigen. In dieser Arbeit wird eine neuartige Lösung für die Gesamtsteuerung von hochredundanten Luftmanipulationssystemen vorgestellt. Die Ergebnisse werden auf eine Referenzkonfiguration angewendet, die als universelle Plattform für die Durchführung verschiedener Luftmanipulationsaufgaben etabliert wird. Diese Plattform besteht aus einer omnidirektionalen Drohne und einem seriellen Manipulator. Um den modularen Regelungsentwurf zu gewährleisten, werden zwei rechnerisch effiziente Algorithmen untersucht, um den virtuellen Eingang den Aktuatorbefehlen zuzuordnen. Durch die Integration eines auf einem künstlichen neuronalen Netz basierenden Diagnosemoduls und der rekonfigurierbaren Steuerungszuordnung in den Regelkreis, wird die Fehlertoleranz für die Drohne erzielt. Außerdem wird die Motorsättigung durch Rekonfiguration der Geschwindigkeits- und Beschleunigungsprofile behandelt. Für die Beobachtung der externen Kräfte und Drehmomente werden zwei Filter vorgestellt. Dies ist notwendig, um ein nachgiebiges Verhalten des Endeffektors durch die achsenselektive Impedanzregelung zu erreichen. Unter Ausnutzung der Redundanz des vorgestellten Luftmanipulators wird ein Regler entworfen, der nicht nur die Referenz der Endeffektor-Bewegung verfolgt, sondern auch priorisierte sekundäre Aufgaben ausführt. Die Wirksamkeit der vorgestellten Lösungen wird durch umfangreiche Tests überprüft, und das vorgestellte Steuerungssystem wird als sehr vielseitig und effektiv bewertet.:1 Introduction 2 Fundamentals 3 System Design and Modeling 4 Reconfigurable Control Allocation 5 Fault Diagnostics For Free Flight 6 Force and Torque Observer 7 Trajectory Generation 8 Hybrid Task Priority Control 9 System Integration and Performance Evaluation 10 ConclusionIn the following decades, aerial manipulators are expected to be deployed in scenarios that are either too dangerous for human beings or too expensive to be accomplished by traditional methods. This thesis presents a novel solution for the overall control of highly redundant aerial manipulation systems. The results are applied to a reference configuration established as a universal platform for performing various aerial manipulation tasks. The platform consists of an omnidirectional multirotor UAV and a serial manipulator. To ensure modular control design, two computationally efficient algorithms are studied to allocate the virtual input to actuator commands. Fault tolerance of the aerial vehicle is achieved by integrating a diagnostic module based on an artificial neural network and the reconfigurable control allocation into the control loop. Besides, the risk of input saturation of individual rotors is minimized by predicting and reconfiguring the speed and acceleration responses. Two filter-based observers are presented to provide the knowledge of external forces and torques, which is necessary to achieve compliant behavior of the end-effector through an axis-selective impedance control in the outer loop. Exploiting the redundancy of the proposed aerial manipulator, the author has designed a control law to achieve the desired end-effector motion and execute secondary tasks in order of priority. The effectiveness of the proposed designs is verified with extensive tests generated by following Monte Carlo method, and the presented control scheme is proved to be versatile and effective.:1 Introduction 2 Fundamentals 3 System Design and Modeling 4 Reconfigurable Control Allocation 5 Fault Diagnostics For Free Flight 6 Force and Torque Observer 7 Trajectory Generation 8 Hybrid Task Priority Control 9 System Integration and Performance Evaluation 10 Conclusio

Survey on Aerial Multirotor Design: a Taxonomy Based on Input Allocation

This paper reviews the impact of multirotor aerial vehicles designs on their abilities in terms of tasks and system properties. We propose a general taxonomy to characterize and describe multirotor aerial vehicles and their design, which we apply exhaustively on the vast literature available. Thanks to the systematic characterization of the designs we exhibit groups of designs having the same abilities in terms of achievable tasks and system properties. In particular, we organize the literature review based on the number of atomic actuation units and we discuss global properties arising from their choice and spatial distribution in the designs. Finally, we provide a discussion on the common traits of the designs found in the literature and the main future open problems

Development of advanced autonomous learning algorithms for nonlinear system identification and control

Identification of nonlinear dynamical systems, data stream analysis, etc. is usually handled by autonomous learning algorithms like evolving fuzzy and evolving neuro-fuzzy systems (ENFSs). They are characterized by the single-pass learning mode and open structure-property. Such features enable their effective handling of fast and rapidly changing natures of data streams. The underlying bottleneck of ENFSs lies in its design principle, which involves a high number of free parameters (rule premise and rule consequent) to be adapted in the training process. This figure can even double in the case of the type-2 fuzzy system. From this literature gap, a novel ENFS, namely Parsimonious Learning Machine (PALM) is proposed in this thesis. To reduce the number of network parameters significantly, PALM features utilization of a new type of fuzzy rule based on the concept of hyperplane clustering, where it has no rule premise parameters. PALM is proposed in both type-1 and type-2 fuzzy systems where all of them characterize a fully dynamic rule-based system. Thus, it is capable of automatically generating, merging, and tuning the hyperplane-based fuzzy rule in a single-pass manner. Moreover, an extension of PALM, namely recurrent PALM (rPALM), is proposed and adopts the concept of teacher-forcing mechanism in the deep learning literature. The efficacy of both PALM and rPALM have been evaluated through numerical study with data streams and to identify nonlinear unmanned aerial vehicle system. The proposed models showcase significant improvements in terms of computational complexity and the number of required parameters against several renowned ENFSs while attaining comparable and often better predictive accuracy. The ENFSs have also been utilized to develop three autonomous intelligent controllers (AICons) in this thesis. They are namely Generic (G) controller, Parsimonious controller (PAC), and Reduced Parsimonious Controller (RedPAC). All these controllers start operating from scratch with an empty set of fuzzy rules, and no offline training is required. To cope with the dynamic behavior of the plant, these controllers can add, merge or prune the rules on demand. Among three AICons, the G-controller is built by utilizing an advanced incremental learning machine, namely Generic Evolving Neuro-Fuzzy Inference System. The integration of generalized adaptive resonance theory provides a compact structure of the G-controller. Consequently, the faster evolution of structure is witnessed, which lowers its computational cost. Another AICon namely, PAC is rooted with PALM's architecture. Since PALM has a dependency on user-defined thresholds to adapt the structure, these thresholds are replaced with the concept of bias- variance trade-off in PAC. In RedPAC, the network parameters have further reduced in contrast with PALM-based PAC, where the number of consequent parameters has reduced to one parameter per rule. These AICons work with very minor expert domain knowledge and developed by incorporating the sliding mode control technique. In G-controller and RedPAC, the control law and adaptation laws for the consequent parameters are derived from the SMC algorithm to establish a stable closed-loop system, where the stability of these controllers are guaranteed by using the Lyapunov function and the uniform asymptotic convergence of tracking error to zero is witnessed through the implication of an auxiliary robustifying control term. While using PAC, the boundedness and convergence of the closed-loop control system's tracking error and the controller's consequent parameters are confirmed by utilizing the LaSalle-Yoshizawa theorem. Their efficacy is evaluated by observing various trajectory tracking performance of unmanned aerial vehicles. The accuracy of these controllers is comparable or better than the benchmark controllers where the proposed controllers incur significantly fewer parameters to attain similar or better tracking performance