Comprehensive review on controller for leader-follower robotic system

985-1007This paper presents a comprehensive review of the leader-follower robotics system. The aim of this paper is to find and elaborate on the current trends in the swarm robotic system, leader-follower, and multi-agent system. Another part of this review will focus on finding the trend of controller utilized by previous researchers in the leader-follower system. The controller that is commonly applied by the researchers is mostly adaptive and non-linear controllers. The paper also explores the subject of study or system used during the research which normally employs multi-robot, multi-agent, space flying, reconfigurable system, multi-legs system or unmanned system. Another aspect of this paper concentrates on the topology employed by the researchers when they conducted simulation or experimental studies

Onboard Robust Nonlinear Control for Multiple Multirotor UAVs

In this thesis, we focus on developing and validating onboard robust nonlinear control approaches for multiple multirotor unmanned aerial vehicles (UAVs), for the promise of achieving nontrivial tasks, such as path following with aggressive maneuvers, navigation in complex environments with obstacles, and formation in group. To fulfill these challenging missions, the first concern comes with the stability of flight control for the aggressive UAV maneuvers with large tilted angles. In addition, robustness of control is highly desired in order to lead the multirotor UAVs to safe and accurate performance under disturbances. Furthermore, efficiency of control algorithm is a crucial element for the onboard implementation with limited computational capability. Finally, the potential to simultaneously control a group of UAVs in a stable fashion is required. All of these concerns motivate our work in this thesis in the following aspects. We first propose the problem of robust control for the nontrivial maneuvers of a multirotor UAV under disturbances. A complete framework is developed to enable the UAV to achieve the challenging tasks, which consists of a nonlinear attitude controller based on the solution of global output regulation problems for the rigid body rotations SO(3), a backstepping-like position controller, a six-dimensional (6D) wrench observer to estimate the unknown force and torque disturbances, and an online trajectory planner based on a model predictive control (MPC) method. We prove the strong convergence properties of the proposed method both in theory and via intensive real-robot experiments of aggressive waypoint navigation and large-tilted path following tasks in the presence of external disturbances, e.g. wind gusts. Secondly, we propose the problem of autonomous navigation of a multirotor UAV in complex scenarios. We present an effective and robust control approach, namely a fast MPC method with the inclusion of nonlinear obstacle avoiding constraints, and implement it onboard the UAV at 50Hz. The developed approach enables the navigation for a multirotor UAV in 3D environments with multiple obstacles, by autonomously deciding to fly over or around the randomly located obstacles. The third problem that is addressed in our work is formation control for a group of multirotor UAVs. We solve this problem by proposing a distributed formation control algorithm for multiple UAVs based on the solution of retraction balancing problem. The algorithm brings the whole group of UAVs simultaneously to a prescribed submanifold that determines the formation shape in an asymptotically stable fashion in 2D and 3D environments. We validate our proposed algorithm via a series of hardware-in-the-loop simulations and real-robot experiments in various formation cases of arbitrary time-varying (e.g. expanding, shrinking or moving) shapes. In the actual experiments, up to 4 multirotors have been implemented to form arbitrary triangular, rectangular and circular shapes drawn by the operator via a human-robot-interaction device. We have also carried out virtual tests using up to 6 onboard computers to achieve a spherical formation and a formation moving through obstacles.In dieser Arbeit konzentrieren wir uns auf die Entwicklung und Validierung von robusten nichtlinearen On-Bord Steuerungsansatzen für mehrere unbemannte Multirotor-Luftfahrzeuge (UAVs), mit dem Ziel, nicht triviale Aufgaben zu erledigen wie z.B. Wegfolge mit aggressiven Manovern, Navigation in komplexen Umgebungen mit Hindernissen und Formationsflug in einer Gruppe. Um diese anspruchsvollen Missionen zu erfullen liegt unser Hauptaugenmerk bei der Stabilität der Flugsteuerung für aggressive UAV Manöver mit steilen Lagewinkeln. Des weiteren ist Kontroll-robustheit sehr wünschenswert, um die Multirotor-UAVs unter Beeinflussung sicher und genau zu steuern. Daruber hinaus ist die Effizienz des Kontrollalgorithmus ein wichtiges Element für die Onboard-Implementierung mit eingeschrankter Rechenfähigkeit. Abschliessend ist das Potenzial, gleichzeitig eine Gruppe von UAVs in stabiler Weise zu kontrollieren, erforderlich. All dies motiviert uns zur Arbeit an den folgenden Aspekten: Zuerst behandeln wir das Problem der robusten Steuerung nichttrivialer Manöver eines Multirotor UAV unter Störeinfluss. Ein komplettes Framework wird entwickelt, welches dem UAV ermöglicht diese anspruchsvollen Aufgaben zu bewältigen. Es beinhaltet einem nichtlinearen Lageregler, basierend auf der Lösung von globalen Ausgangsrege lungsproblemen für Starrkörperrotationen SO(3), einem backstepping basierten Positionsregler, einen sechsdimensionalen (6D) wrench observer um die unbekannten Kraftund Drehmomenteinflusse zu schätzen, sowie einem Online-Trajektorienplaner basierend auf Model Predictive Control (MPC). Wir weisen die starken Konvergenzcharakteristiken der vorgeschlagenen Methode nach, sowohl in der Theorie als auchmittels intensiver Real-roboter-Experimente, mit aggressiver Wegpunktnavigation und Wegfindungsaufgaben in extremer Fluglage in Gegenwart externer Einflüsse, z.B. Windböen. Als nächstes bearbeiten wir das Problem der autonomen Navigation eines Multirotor UAV in komplexen Szenarien. Wir stellen einen effektiven und robusten Steuerungsansatz dar, nämlich eine schnelle MPC-Methode mit der Einbeziehung von nichtlinearer Einschränkungen zur Hindernisvermeidung, und implmenetieren diese an Bord des UAV mit 50Hz. Der entwickelte Ansatz ermöglicht die Navigation eines Multirotor UAVs in 3D-Umgebungen mit mehreren Hindernissen, wobei autonom entschieden wir, über oder um die zufällig gelegenen Hindernisse zu fliegen. Das dritte Problem, das in unserer Arbeit angesprochen wird, ist die Bildungssteuerung für eine Gruppe von Multirotor UAVs. Wir lösen dieses Problem, indem wir einen verteilten Formationskontrollalgorithmus für mehrere UAVs auf der Grundlage der Lösung des Retraction Balancing Problems vorschlagen. Der Algorithmus bringt die ganze Gruppe von UAVs gleichzeitig auf eine vorgeschriebene Untermanigfaltigkeit, welche die Formation in asymtotisch stabiler Weise in 2D- und 3D-Umgebungen bestimmt. Wir validieren unseren vorgeschlagenen Algorithmus uber eine Reihe von Hardware-in-the- ¨ Loop-Simulationen und Real-Roboter-Experimente mit verschiedenen Formationsvarianten in beliebigen zeitveränderlichen (z. B. expandierenden, schrumpfenden oder bewegten) Formen. In den eigentlichen Experimenten wurden bis zu 4 Multirotoren eingesetzt, um beliebige dreieckige, rechteckige und kreisförmige Formen zu bilden, die vom Bediener über eine Mensch-Roboter-Interaktionsvorrichtung vorgezeichnet wurden. Wir haben auch virtuelle Tests mit bis zu 6 Onboard-Computern durchgeführt, um eine sphärische Formation und eine Formation zu erreichen, die sich durch Hindernisse. bewegt

Fuzzy Gain-Scheduling PID for UAV Position and Altitude Controllers

Unmanned aerial vehicle (UAV) applications have evolved to a wide range of fields in the last decade. One of the main challenges in autonomous tasks is the UAV stability during maneuvers. Thus, attitude and position control play a crucial role in stabilizing the vehicle in the desired orientation and path. Many control techniques have been developed for this. However, proportional integral derivative (PID) controllers are often used due their structure and efficiency. Despite PID’s good performance, different requirements may be present at different mission stages. The main contribution of this research work is the development of a novel strategy based on a fuzzy-gain scheduling mechanism to adjust the PID controller to stabilize both position and altitude. This control strategy must be effective, simple, and robust to uncertainties and external disturbances. The Robot Operating System (ROS) integrates the proposed system and the flight control unit. The obtained results showed that the proposed approach was successfully applied to the trajectory tracking and revealed a good performance compared to conventional PID and in the presence of noises. In the tests, the position controller was only affected when the altitude error was higher, with an error of 2% lower.publishedVersio

A Survey of path following control strategies for UAVs focused on quadrotors

The trajectory control problem, defined as making a vehicle follow a pre-established path in space, can be solved by means of trajectory tracking or path following. In the trajectory tracking problem a timed reference position is tracked. The path following approach removes any time dependence of the problem, resulting in many advantages on the control performance and design. An exhaustive review of path following algorithms applied to quadrotor vehicles has been carried out, the most relevant are studied in this paper. Then, four of these algorithms have been implemented and compared in a quadrotor simulation platform: Backstepping and Feedback Linearisation control-oriented algorithms and NLGL and Carrot-Chasing geometric algorithms.Peer ReviewedPostprint (author's final draft

Guidance, navigation and control of multirotors

Aplicat embargament des de la data de defensa fins el dia 31 de desembre de 2021This thesis presents contributions to the Guidance, Navigation and Control (GNC) systems for multirotor vehicles by applying and developing diverse control techniques and machine learning theory with innovative results. The aim of the thesis is to obtain a GNC system able to make the vehicle follow predefined paths while avoiding obstacles in the vehicle's route. The system must be adaptable to different paths, situations and missions, reducing the tuning effort and parametrisation of the proposed approaches. The multirotor platform, formed by the Asctec Hummingbird quadrotor vehicle, is studied and described in detail. A complete mathematical model is obtained and a freely available and open simulation platform is built. Furthermore, an autopilot controller is designed and implemented in the real platform. The control part is focused on the path following problem. That is, following a predefined path in space without any time constraint. Diverse control-oriented and geometrical algorithms are studied, implemented and compared. Then, the geometrical algorithms are improved by obtaining adaptive approaches that do not need any parameter tuning. The adaptive geometrical approaches are developed by means of Neural Networks. To end up, a deep reinforcement learning approach is developed to solve the path following problem. This approach implements the Deep Deterministic Policy Gradient algorithm. The resulting approach is trained in a realistic multirotor simulator and tested in real experiments with success. The proposed approach is able to accurately follow a path while adapting the vehicle's velocity depending on the path's shape. In the navigation part, an obstacle detection system based on the use of a LIDAR sensor is implemented. A model of the sensor is derived and included in the simulator. Moreover, an approach for treating the sensor data to eliminate the possible ground detections is developed. The guidance part is focused on the reactive path planning problem. That is, a path planning algorithm that is able to re-plan the trajectory online if an unexpected event, such as detecting an obstacle in the vehicle's route, occurs. A deep reinforcement learning approach for the reactive obstacle avoidance problem is developed. This approach implements the Deep Deterministic Policy Gradient algorithm. The developed deep reinforcement learning agent is trained and tested in the realistic simulation platform. This agent is combined with the path following agent and the rest of the elements developed in the thesis obtaining a GNC system that is able to follow different types of paths while avoiding obstacle in the vehicle's route.Aquesta tesi doctoral presenta diverses contribucions relaciones amb els sistemes de Guiat, Navegació i Control (GNC) per a vehicles multirrotor, aplicant i desenvolupant diverses tècniques de control i de machine learning amb resultats innovadors. L'objectiu principal de la tesi és obtenir un sistema de GNC capaç de dirigir el vehicle perquè segueixi una trajectòria predefinida mentre evita els obstacles que puguin aparèixer en el recorregut del vehicle. El sistema ha de ser adaptable a diferents trajectòries, situacions i missions, reduint l'esforç realitzat en l'ajust i la parametrització dels mètodes proposats. La plataforma experimental, formada pel cuadricòpter Asctec Hummingbird, s'estudia i es descriu en detall. S'obté un model matemàtic complet de la plataforma i es desenvolupa una eina de simulació, la qual és de codi lliure. A més, es dissenya un controlador autopilot i s'implementa en la plataforma real. La part de control està enfocada al problema de path following. En aquest problema, el vehicle ha de seguir una trajectòria predefinida en l'espai sense cap tipus de restricció temporal. S'estudien, s'implementen i es comparen diversos algoritmes de control i geomètrics de path following. Després, es milloren els algoritmes geomètrics usant xarxes neuronals per convertirlos en algoritmes adaptatius. Per finalitzar, es desenvolupa un mètode de path following basat en tècniques d'aprenentatge per reforç profund (deep Reinforcement learning). Aquest mètode implementa l'algoritme Deep Deterministic Policy Gradient. L'agent intel. ligent resultant és entrenat en un simulador realista de multirotors i validat en la plataforma experimental real amb èxit. Els resultats mostren que l'agent és capaç de seguir de forma precisa la trajectòria de referència adaptant la velocitat del vehicle segons la curvatura del recorregut. A la part de navegació, s'implementa un sistema de detecció d'obstacles basat en l'ús d'un sensor LIDAR. Es deriva un model del sensor i aquest s'inclou en el simulador. A més, es desenvolupa un mètode per tractar les mesures del sensor per eliminar les possibles deteccions del terra. Pel que fa a la part de guiatge, aquesta està focalitzada en el problema de reactive path planning. És a dir, un algoritme de planificació de trajectòria que és capaç de re-planejar el recorregut del vehicle a l'instant si algun esdeveniment inesperat ocorre, com ho és la detecció d'un obstacle en el recorregut del vehicle. Es desenvolupa un mètode basat en aprenentatge per reforç profund per l'evasió d'obstacles. Aquest mètode implementa l'algoritme Deep Deterministic Policy Gradient. L'agent d'aprenentatge per reforç s'entrena i valida en un simulador de multirotors realista. Aquest agent es combina amb l'agent de path following i la resta d'elements desenvolupats en la tesi per obtenir un sistema GNC capaç de seguir diferents tipus de trajectòries, evadint els obstacles que estiguin en el recorregut del vehicle.Esta tesis doctoral presenta varias contribuciones relacionas con los sistemas de Guiado, Navegación y Control (GNC) para vehículos multirotor, aplicando y desarrollando diversas técnicas de control y de machine learning con resultados innovadores. El objetivo principal de la tesis es obtener un sistema de GNC capaz de dirigir el vehículo para que siga una trayectoria predefinida mientras evita los obstáculos que puedan aparecer en el recorrido del vehículo. El sistema debe ser adaptable a diferentes trayectorias, situaciones y misiones, reduciendo el esfuerzo realizado en el ajuste y la parametrización de los métodos propuestos. La plataforma experimental, formada por el cuadricoptero Asctec Hummingbird, se estudia y describe en detalle. Se obtiene un modelo matemático completo de la plataforma y se desarrolla una herramienta de simulación, la cual es de código libre. Además, se diseña un controlador autopilot, el cual es implementado en la plataforma real. La parte de control está enfocada en el problema de path following. En este problema, el vehículo debe seguir una trayectoria predefinida en el espacio tridimensional sin ninguna restricción temporal Se estudian, implementan y comparan varios algoritmos de control y geométricos de path following. Luego, se mejoran los algoritmos geométricos usando redes neuronales para convertirlos en algoritmos adaptativos. Para finalizar, se desarrolla un método de path following basado en técnicas de aprendizaje por refuerzo profundo (deep reinforcement learning). Este método implementa el algoritmo Deep Deterministic Policy Gradient. El agente inteligente resultante es entrenado en un simulador realista de multirotores y validado en la plataforma experimental real con éxito. Los resultados muestran que el agente es capaz de seguir de forma precisa la trayectoria de referencia adaptando la velocidad del vehículo según la curvatura del recorrido. En la parte de navegación se implementa un sistema de detección de obstáculos basado en el uso de un sensor LIDAR. Se deriva un modelo del sensor y este se incluye en el simulador. Además, se desarrolla un método para tratar las medidas del sensor para eliminar las posibles detecciones del suelo. En cuanto a la parte de guiado, está focalizada en el problema de reactive path planning. Es decir, un algoritmo de planificación de trayectoria que es capaz de re-planear el recorrido del vehículo al instante si ocurre algún evento inesperado, como lo es la detección de un obstáculo en el recorrido del vehículo. Se desarrolla un método basado en aprendizaje por refuerzo profundo para la evasión de obstáculos. Este implementa el algoritmo Deep Deterministic Policy Gradient. El agente de aprendizaje por refuerzo se entrena y valida en un simulador de multirotors realista. Este agente se combina con el agente de path following y el resto de elementos desarrollados en la tesis para obtener un sistema GNC capaz de seguir diferentes tipos de trayectorias evadiendo los obstáculos que estén en el recorrido del vehículo.Postprint (published version

Unmanned Robotic Systems and Applications

This book presents recent studies of unmanned robotic systems and their applications. With its five chapters, the book brings together important contributions from renowned international researchers. Unmanned autonomous robots are ideal candidates for applications such as rescue missions, especially in areas that are difficult to access. Swarm robotics (multiple robots working together) is another exciting application of the unmanned robotics systems, for example, coordinated search by an interconnected group of moving robots for the purpose of finding a source of hazardous emissions. These robots can behave like individuals working in a group without a centralized control

Design and control of quadrotors with application to autonomous flying

This thesis is about modelling, design and control of Miniature Flying Robots (MFR) with a focus on Vertical Take-Off and Landing (VTOL) systems and specifically, micro quadrotors. It introduces a mathematical model for simulation and control of such systems. It then describes a design methodology for a miniature rotorcraft. The methodology is subsequently applied to design an autonomous quadrotor named OS4. Based on the mathematical model, linear and nonlinear control techniques are used to design and simulate various controllers along this work. The dynamic model and the simulator evolved from a simple set of equations, valid only for hovering, to a complex mathematical model with more realistic aerodynamic coefficients and sensor and actuator models. Two platforms were developed during this thesis. The first one is a quadrotor-like test-bench with off-board data processing and power supply. It was used to safely and easily test control strategies. The second one, OS4, is a highly integrated quadrotor with on-board data processing and power supply. It has all the necessary sensors for autonomous operation. Five different controllers were developed. The first one, based on Lyapunov theory, was applied for attitude control. The second and the third controllers are based on PID and LQ techniques. These were compared for attitude control. The fourth and the fifth approaches use backstepping and sliding-mode concepts. They are applied to control attitude. Finally, backstepping is augmented with integral action and proposed as a single tool to design attitude, altitude and position controllers. This approach is validated through various flight experiments conducted on the OS4

Wind gust estimation for precise quasi - hovering control of quadrotor aircraft

This paper focuses on the control of quadrotor vehicles without wind sensors that are required to accurately track low-speed trajectories in the presence of moderate yet unknown wind gusts. By modeling the wind disturbance as exogenous inputs, and assuming that compensation of its effects can be achieved through quasistatic vehicle motions, this paper proposes an innovative estimation and control scheme comprising a linear dynamic filter for the estimation of such unknown inputs and requiring only position and attitude information. The filter is built upon results from Unknown Input Observer theory and allows estimation of wind and vehicle state without measurement of the wind itself. A simple feedback control law can be used to compensate for the offset position error induced by the disturbance. The proposed filter is independent of the recovery control scheme used to nullify the tracking error, as long as the corresponding applied rotor speeds are available. The solution is first checked in simulation environment by using the Robot Operating System middleware and the Gazebo simulator and then experimentally validated with a quadcopter system flying with real wind sources

Modelling and control of aerial manipulators

Hace unos años, dentro de la robótica aérea, surgió la manipulación aérea como campo de investigación. Desde su nacimiento, su impacto ha ido incrementándose poco a poco debido, sobretodo, al gran número de aplicaciones que podrían llevarse a cabo con este tipo de sistemas. Un manipulador aéreo puede definirse como una plataforma aérea la cual ha sido equipada con uno o varios brazos robóticos. Este nuevo concepto ha abierto un mundo de posibilidades para este tipo de robots aéreos. Además, gracias a la posibilidad de este tipo de robots aéreos de interactuar con su entorno, podrían llevar a cabo inspecciones de estructuras civiles o incluso, tareas de ensamblaje de estructuras y todo ello, por supuesto, de forma autónoma. Esta tesis se centra en el estudio e implementación de sistemas de manipulación aérea y, en particular, en el diseño de estrategias de control para la plataforma aérea. Este estudio comienza con el cáculo de las ecuaciones que representan la dinámica del sistema, y que nos permite analizar su comportamiento y la influencia del movimiento de los brazos robóticos en la estabilidad de la plataforma.El análisis de estas ecuaciones nos permite diseñar de esquemas de control tales como los basados en Backstepping. Pero el objetivo de esta tesis no es solo el diseño sino también la implementación de estas técnicas de control en sistemas de manipulación aérea reales y con capacidad de llevar a cabo tareas de manipulación en escenarios al aire libre. La principales contribuciones de esta tesis son el cálculo de los modelos dinámicos para cada uno de los tipos de manipuladores aéreos estudiados he implementados durante el desarrollo de la tesis. Además del uso de estas modelos para la diseño de una estrategia de control adaptable a cada una de las plataformas. También se ha diseñado un mecanismo “compliant” que ha sido integrado en un manipulador parallevar a cabo tareas de inspección estructuras por contacto, además de un control de fuerza-posición. Cada manipulador aéreo implementado durante esta tesis, excepto el en caso del helicóptero, va unido a un estudio de las especificaciones hardware necesarias para la realización de una validación del sistema mediante experimentos de vuelo en escenarios al aire libre, y en el caso de los manipuladores aéreos para inspección de estructuras, en un puente real. Cada experimento realizado ha sido analizado en detalle para corregir errores, además de para adaptar o agregar cualquier modificación estructural o de hardware necesaria

Single chip solution for stabilization control & monocular visual servoing of small-scale quadrotor helicopter

This thesis documents the research undertaken to develop a high-performing design of a small-scale quadrotor (four-rotor) helicopter capable of delivering the speed and robustness required for agile motion while also featuring an autonomous visual servoing capability within the size, weight, and power (SWaP) constraint package. The state of the art research was reviewed, and the areas in the existing design methodologies that can potentially be improved were identified, which included development of a comprehensive dynamics model of quadrotor, design and construction of a performance optimized prototype vehicle, high-performance actuator design, design of a robust attitude stabilization controller, and a single chip solution for autonomous vision based position control. The gaps in the current art of designing each component were addressed individually. The outcomes of the corresponding development activities include a high-fidelity dynamics and control model of the vehicle. The model was developed using multi-body bond graph modeling approach to incorporate the dynamic interactions between the frame body and propulsion system. Using an algorithmic size, payload capacity, and flight endurance optimization approach, a quadrotor prototype was designed and constructed. In order to conform to the optimized geometric and performance parameters, the frame of the prototype was constructed using printed circuit board (PCB) technology and processing power was integrated using a single chip field programmable gate array (FPGA) technology. Furthermore, to actuate the quadrotor at a high update rate while also improving the power efficiency of the actuation system, a ground up FPGA based brushless direct current (BLDC) motor driver was designed using a low-loss commutation scheme and hall effect sensors. A proportional-integral-derivative (PID) technology based closed loop motor speed controller was also implemented in the same FPGA hardware for precise speed control of the motors. In addition, a novel control law was formulated for robust attitude stabilization by adopting a cascaded architecture of active disturbance rejection control (ADRC) technology and PID control technology. Using the same single FPGA chip to drive an on-board downward looking camera, a monocular visual servoing solution was developed to integrate an autonomous position control feature with the quadrotor. Accordingly, a numerically simple relative position estimation technique was implemented in FPGA hardware that relies on a passive landmark/target for 3-D position estimation. The functionality and effectiveness of the synthesized design were evaluated by performance benchmarking experiments conducted on each individual component as well as on the complete system constructed from these components. It was observed that the proposed small-scale quadrotor, even though just 43 cm in diameter, can lift 434 gm of payload while operating for 18 min. Among the ground up designed components, the FPGA based motor driver demonstrated a maximum of 4% improvement in the power consumption and at the same time can handle a command update at a rate of 16 kHz. The cascaded attitude stabilization controller can asymptotically stabilize the vehicle within 426 ms of the command update. Robust control performance under stochastic wind gusts is also observed from the stabilization controller. Finally, the single chip FPGA based monocular visual servoing solution can estimate pose information at the camera rate of 37 fps and accordingly the quadrotor can autonomously climb/descend and/or hover over a passive target