Vision-based Autonomous Tracking of a Non-cooperative Mobile Robot by a Low-cost Quadrotor Vehicle

The goal of this thesis is the detection and tracking of a ground vehicle, in particular a car-like robot, by a quadrotor. The first challenge to address in any pursuit or tracking scenario is the detection and unique identification of the target. From this first challenge, comes the need to precisely localize the target in a coordinate system that is common to the tracking and tracked vehicles. In most real-life scenarios, the tracked vehicle does not directly communicate information such as its position to the tracking one. From this fact, arises a non-cooperative constraint problem. The autonomous tracking aspect of the mission requires, for both the aerial and ground vehicles, robust pose estimation during the mission. The primary and crucial functions to achieve autonomous behaviors are control and navigation. The principal-agent being the quadrotor, this thesis explains in detail the derivation and analysis of the equations of motion that govern its natural behavior along with the control methods that permit to achieve desired performances. The analysis of these equations reveals a naturally unstable system, subject to non-linearities. Therefore, we explored three different control methods capable of guaranteeing stability while mitigating non-linearities. The first two control methods operate in the linear region and consist of the intuitive Proportional Integrate Derivative controller (PID). The second linear control strategy is represented by an optimal controller that is the Linear Quadratic Regulator controller (LQR). The last and final control method is a nonlinear controller designed from the Sliding Mode Control Theory. In addition to the in-depth analysis, we provide assets and limitations of each control method. In order to achieve the tracking mission, we address the detection and localization problems using respectively visual servoing and frame transform techniques. The pose estimation challenge for the aerial robot is cleared up using Kalman Filtering estimation methods that are also explored in depth. The same estimation method is used to mitigate the ground vehicle’s real-time pose estimation and tracking problem. Analysis results are illustrated using Matlab. A simulation and a real implementation using the Robot Operating System are used to support the obtained results

Design, Development and Implementation of Intelligent Algorithms to Increase Autonomy of Quadrotor Unmanned Missions

This thesis presents the development and implementation of intelligent algorithms to increase autonomy of unmanned missions for quadrotor type UAVs. A six-degree-of freedom dynamic model of a quadrotor is developed in Matlab/Simulink in order to support the design of control algorithms previous to real-time implementation. A dynamic inversion based control architecture is developed to minimize nonlinearities and improve robustness when the system is driven outside bounds of nominal design. The design and the implementation of the control laws are described. An immunity-based architecture is introduced for monitoring quadrotor health and its capabilities for detecting abnormal conditions are successfully demonstrated through flight testing. A vision-based navigation scheme is developed to enhance the quadrotor autonomy under GPS denied environments. An optical flow sensor and a laser range finder are used within an Extended Kalman Filter for position estimation and its estimation performance is analyzed by comparing against measurements from a GPS module. Flight testing results are presented where the performances are analyzed, showing a substantial increase of controllability and tracking when the developed algorithms are used under dynamically changing environments. Healthy flights, flights with failures, flight with GPS-denied navigation and post-failure recovery are presented

Autonomous Flight in Unknown Indoor Environments

http://multi-science.metapress.com/content/80586kml376k2711/This paper presents our solution for enabling a quadrotor helicopter, equipped with a laser rangefinder sensor, to autonomously explore and map unstructured and unknown indoor environments. While these capabilities are already commodities on ground vehicles, air vehicles seeking the same performance face unique challenges. In this paper, we describe the difficulties in achieving fully autonomous helicopter flight, highlighting the differences between ground and helicopter robots that make it difficult to use algorithms that have been developed for ground robots. We then provide an overview of our solution to the key problems, including a multilevel sensing and control hierarchy, a high-speed laser scan-matching algorithm, an EKF for data fusion, a high-level SLAM implementation, and an exploration planner. Finally, we show experimental results demonstrating the helicopter's ability to navigate accurately and autonomously in unknown environments.National Science Foundation (U.S.) (NSF Division of Information and Intelligent Systems under grant # 0546467)United States. Army Research Office (ARO MAST CTA)Singapore. Armed Force

Adaptive and Optimal Motion Control of Multi-UAV Systems

This thesis studies trajectory tracking and coordination control problems for single and multi unmanned aerial vehicle (UAV) systems. These control problems are addressed for both quadrotor and fixed-wing UAV cases. Despite the fact that the literature has some approaches for both problems, most of the previous studies have implementation challenges on real-time systems. In this thesis, we use a hierarchical modular approach where the high-level coordination and formation control tasks are separated from low-level individual UAV motion control tasks. This separation helps efficient and systematic optimal control synthesis robust to effects of nonlinearities, uncertainties and external disturbances at both levels, independently. The modular two-level control structure is convenient in extending single-UAV motion control design to coordination control of multi-UAV systems. Therefore, we examine single quadrotor UAV trajectory tracking problems to develop advanced controllers compensating effects of nonlinearities and uncertainties, and improving robustness and optimality for tracking performance. At fi rst, a novel adaptive linear quadratic tracking (ALQT) scheme is developed for stabilization and optimal attitude control of the quadrotor UAV system. In the implementation, the proposed scheme is integrated with Kalman based reliable attitude estimators, which compensate measurement noises. Next, in order to guarantee prescribed transient and steady-state tracking performances, we have designed a novel backstepping based adaptive controller that is robust to effects of underactuated dynamics, nonlinearities and model uncertainties, e.g., inertial and rotational drag uncertainties. The tracking performance is guaranteed to utilize a prescribed performance bound (PPB) based error transformation. In the coordination control of multi-UAV systems, following the two-level control structure, at high-level, we design a distributed hierarchical (leader-follower) 3D formation control scheme. Then, the low-level control design is based on the optimal and adaptive control designs performed for each quadrotor UAV separately. As particular approaches, we design an adaptive mixing controller (AMC) to improve robustness to varying parametric uncertainties and an adaptive linear quadratic controller (ALQC). Lastly, for planar motion, especially for constant altitude flight of fixed-wing UAVs, in 2D, a distributed hierarchical (leader-follower) formation control scheme at the high-level and a linear quadratic tracking (LQT) scheme at the low-level are developed for tracking and formation control problems of the fixed-wing UAV systems to examine the non-holonomic motion case. The proposed control methods are tested via simulations and experiments on a multi-quadrotor UAV system testbed

Fast Nonlinear Model Predictive Control of Quadrotors: Design and Experiments

Quadrotor (or quadcopter) is a type of Unmanned Aerial Vehicles (UAVs). Due to the quadrotors simple and inexpensive design, they have become popular platforms. This thesis proposes a computationally fast scheme for implementing Nonlinear Model Predictive Control (NMPC) as a high-level controller to solve the path following problem for unmanned quadrotors. After discussing the background and reviewing the literature, it is noted that this problem referred widely in the literature as a necessary step toward the autonomous flight of quadrotor UAVs. The previous studies usually used simplified models which are computationally uncomplicated and straightforward in terms of control developments and stability investigations. Moreover, some articles are presented showing the importance of accurate state observation on the performance of feedback-based control approaches. The NMPC-based controller is designed using a more realistic highly nonlinear control-oriented model which requires heavy computations for practical real-time implementations. To deal with this issue, the Newton generalized minimal residual (Newton/GMRES) method is applied to solve the NMPC’s real-time optimizations rapidly during the control process. This technique uses the Hamiltonian method to derive a set of equations with multiple variables. To solve these in a real-time application, the Newton/GMRES method applies forward-difference generalized minimal residual (fdgmres) algorithm. The simulation and experimental result using a commercial drone, called AR.Drone 2.0, in our laboratory instrumented by a Vicon Vantage motion capture system, demonstrate that our feedback-based control method’s performance highly depends on the reliability of the state vector feedback signals. As a result, a Kalman filter and Luenberger observer algorithms are used for estimating unknown states. The NMPC-based controller operation is simulated, and the result reveals the similar efficiency of observers. Moreover, the NMPC control approach is compared with a proportional controller which shows great improvements in the response of the quadrotor. The experiment showed that our control method is sufficiently fast for practical implementations, and it can solve the trajectory tracking problem properly even for complex paths. This thesis is concluded by stating a summary of contributions and some potential future works

Hybrid active force control for fixed based rotorcraft

Disturbances are considered major challenges faced in the deployment of rotorcraft unmanned aerial vehicle (UAV) systems. Among different types of rotorcraft systems, the twin-rotor helicopter and quadrotor models are considered the most versatile flying machines nowadays due to their range of applications in the civilian and military sectors. However, these systems are multivariate and highly non-linear, making them difficult to be accurately controlled. Their performance could be further compromised when they are operated in the presence of disturbances or uncertainties. This dissertation presents an innovative hybrid control scheme for rotorcraft systems to improve disturbance rejection capability while maintaining system stability, based on a technique called active force control (AFC) via simulation and experimental works. A detailed dynamic model of each aerial system was derived based on the Euler–Lagrange and Newton-Euler methods, taking into account various assumptions and conditions. As a result of the derived models, a proportional-integral-derivative (PID) controller was designed to achieve the required altitude and attitude motions. Due to the PID's inability to reject applied disturbances, the AFC strategy was incorporated with the designed PID controller, to be known as the PID-AFC scheme. To estimate control parameters automatically, a number of artificial intelligence algorithms were employed in this study, namely the iterative learning algorithm and fuzzy logic. Intelligent rules of these AI algorithms were designed and embedded into the AFC loop, identified as intelligent active force control (IAFC)-based methods. This involved, PID-iterative learning active force control (PID-ILAFC) and PID-fuzzy logic active force control (PID-FLAFC) schemes. To test the performance and robustness of these proposed hybrid control systems, several disturbance models were introduced, namely the sinusoidal wave, pulsating, and Dryden wind gust model disturbances. Integral square error was selected as the index performance to compare between the proposed control schemes. In this study, the effectiveness of the PID-ILAFC strategy in connection with the body jerk performance was investigated in the presence of applied disturbance. In terms of experimental work, hardware-in-the-loop (HIL) experimental tests were conducted for a fixed-base rotorcraft UAV system to investigate how effective are the proposed hybrid PID-ILAFC schemes in disturbance rejection. Simulated results, in time domains, reveal the efficacy of the proposed hybrid IAFC-based control methods in the cancellation of different applied disturbances, while preserving the stability of the rotorcraft system, as compared to the conventional PID controller. In most of the cases, the simulated results show a reduction of more than 55% in settling time. In terms of body jerk performance, it was improved by around 65%, for twin-rotor helicopter system, and by a 45%, for quadrotor system. To achieve the best possible performance, results recommend using the full output signal produced by the AFC strategy according to the sensitivity analysis. The HIL experimental tests results demonstrate that the PID-ILAFC method can improve the disturbance rejection capability when compared to other control systems and show good agreement with the simulated counterpart. However, the selection of the appropriate learning parameters and initial conditions is viewed as a crucial step toward this improved performance

Dynamic modelling and swing control of a quadrotor with a cable-suspended payload

A quadrotor is a highly nonlinear system due to the presence of aerodynamic factors such as Coriolis and gyroscopic effects when in flight. In meeting todays’ demands, the applications of quadrotors have been extended to include transportation and therefore, the study of Quadrotor Suspended Load (QSL) systems has become equally as important. However, the presence of the suspended load further complicates the quadrotor system as there is strong coupling with the load and excessive load swinging. This is a problem which forms the basis for this work. This project begins by providing a mathematical description of the QSL system using Euler-Lagrange equations as they are much simplified, yet encompass the many factors present during quadrotor operation and subsequently control excessive payload swinging. The main strength of this work is that unlike other previous work, it covers 8 degrees of freedom (8 DOF) in representing the system dynamics. This presents a much more comprehensive and definitive way of describing the quadrotor and payload positions. Input shaping is used as the swing controller as it is more practical and has been used for swing control of other systems. Validation of the swing controller performance is done using MATLAB SIMULINK. Unlike other controllers that require sophisticated algorithms for their implementation, input shaping will be used as a swing controller as it is much simplified in handling excessive load swinging

Tracking Control of Quadrotors

In this thesis, the tracking control problem of a 6 DOF quadrotor is considered, and different control method is proposed considering optimal control, parametric and nonparametric uncertainty, input saturation, and distributed formation control. An optimal control approach is developed for single quadrotor tracking by minimizing the cost function. For uncertainties of the dynamic system, a robust adaptive tracking controller is proposed with the special structure of the dynamics of the system. Considering the uncertainty and input constraints, a robust adaptive saturation controller is proposed with the aid of an auxiliary compensated system. Decentralized formation control method for quadrotors is presented using a leader-follower scheme using proposed optimal control method. Virtual leader is employed to drive the quadrotors to their desired formation and ultimately track the trajectory defined by the virtual leader. Sliding mode estimators have been implemented to estimate the states of the virtual leader. The control method is designed considering switching communication topologies among the quadrotors. Simulation results are provided to show the effectiveness of the proposed approaches