Models, algorithms and architectures for cooperative manipulation with aerial and ground robots

Les dernières années ont vu le développement de recherches portant sur l'interaction physique entre les robots aériens et leur environnement, accompagné de l'apparition de nombreux nouveaux systèmes mécaniques et approches de régulation. La communauté centrée autour de la robotique aérienne observe actuellement un déplacement de paradigmes des approches classiques de guidage, de navigation et de régulation vers des tâches moins triviales, telle le développement de l'interaction physique entre robots aériens et leur environnement. Ceci correspond à une extension des tâches dites de manipulation, du sol vers les airs. Cette thèse contribue au domaine de la manipulation aérienne en proposant un nouveau concept appelé MAGMaS, pour " Multiple Aerial Ground Manipulator System ". Les motivations qui ont conduites à l'association de manipulateurs terrestres et aériens pour effectuer des tâches de manipulation coopérative, résident dans une volonté d'exploiter leurs particularités respectives. Les manipulateurs terrestres apportant leur importante force et les manipulateurs aériens apportant leur vaste espace de travail. La première contribution de cette thèse présente une modélisation rigoureuse des MAGMaS. Les propriétés du système ainsi que ses possibles extensions sont discutées. Les méthodes de planning, d'estimation et de régulation nécessaire à l'exploitation des MAGMaS pour des tâches de manipulation collaborative sont dérivées. Ce travail propose d'exploiter les redondances des MAGMaS grâce à un algorithme optimal d'allocation de forces entre les manipulateurs. De plus, une méthode générale d'estimation de forces pour robots aériens est introduite. Toutes les techniques et les algorithmes présentés dans cette thèse sont intégrés dans une architecture globale, utilisée à la fois pour la simulation et la validation expérimentale. Cette architecture est en outre augmentée par l'addition d'une structure de télé-présence, afin de permettre l'opération à distances des MAGMaS. L'architecture générale est validée par une démonstration de levage de barre, qui est une application représentative des potentiels usages des MAGMaS. Une autre contribution relative au développement des MAGMaS consiste en une étude exploratoire de la flexibilité dans les objets manipulés par un MAGMaS. Un modèle du phénomène vibratoire est dérivé afin de mettre en exergue ses propriétés en termes de contrôle. La dernière contribution de cette thèse consiste en une étude exploratoire sur l'usage des actionneurs à raideur variable dans les robots aériens, dotant ces systèmes d'une compliance mécanique intrinsèque et de capacité de stockage d'énergie. Les fondements théoriques sont associés à la synthèse d'un contrôleur non-linéaire. L'approche proposée est validée par le biais d'expériences reposant sur l'intégration d'un actionneur à raideur variable léger sur un robot aérien.In recent years, the subject of physical interaction for aerial robots has been a popular research area with many new mechanical designs and control approaches being proposed. The aerial robotics community is currently observing a paradigm shift from classic guidance, navigation, and control tasks towards more unusual tasks, for example requesting aerial robots to physically interact with the environment, thus extending the manipulation task from the ground into the air. This thesis contributes to the field of aerial manipulation by proposing a novel concept known has Multiple Aerial-Ground Manipulator System or MAGMaS, including what appears to be the first experimental demonstration of a MAGMaS and opening a new route of research. The motivation behind associating ground and aerial robots for cooperative manipulation is to leverage their respective particularities, ground robots bring strength while aerial robots widen the workspace of the system. The first contribution of this work introduces a meticulous system model for MAGMaS. The system model's properties and potential extensions are discussed in this work. The planning, estimation and control methods which are necessary to exploit MAGMaS in a cooperative manipulation tasks are derived. This works proposes an optimal control allocation scheme to exploit the MAGMaS redundancies and a general model-based force estimation method is presented. All of the proposed techniques reported in this thesis are integrated in a global architecture used for simulations and experimental validation. This architecture is extended by the addition of a tele-presence framework to allow remote operations of MAGMaS. The global architecture is validated by robust demonstrations of bar lifting, an application that gives an outlook of the prospective use of the proposed concept of MAGMaS. Another contribution in the development of MAGMaS consists of an exploratory study on the flexibility of manipulated loads. A vibration model is derived and exploited to showcase vibration properties in terms of control. The last contribution of this thesis consists of an exploratory study on the use of elastic joints in aerial robots, endowing these systems with mechanical compliance and energy storage capabilities. Theoretical groundings are associated with a nonlinear controller synthesis. The proposed approach is validated by experimental work which relies on the integration of a lightweight variable stiffness actuator on an aerial robot

Advanced Feedback Linearization Control for Tiltrotor UAVs: Gait Plan, Controller Design, and Stability Analysis

Three challenges, however, can hinder the application of Feedback Linearization: over-intensive control signals, singular decoupling matrix, and saturation. Activating any of these three issues can challenge the stability proof. To solve these three challenges, first, this research proposed the drone gait plan. The gait plan was initially used to figure out the control problems in quadruped (four-legged) robots; applying this approach, accompanied by Feedback Linearization, the quality of the control signals was enhanced. Then, we proposed the concept of unacceptable attitude curves, which are not allowed for the tiltrotor to travel to. The Two Color Map Theorem was subsequently established to enlarge the supported attitude for the tiltrotor. These theories were employed in the tiltrotor tracking problem with different references. Notable improvements in the control signals were witnessed in the tiltrotor simulator. Finally, we explored the control theory, the stability proof of the novel mobile robot (tilt vehicle) stabilized by Feedback Linearization with saturation. Instead of adopting the tiltrotor model, which is over-complicated, we designed a conceptual mobile robot (tilt-car) to analyze the stability proof. The stability proof (stable in the sense of Lyapunov) was found for a mobile robot (tilt vehicle) controlled by Feedback Linearization with saturation for the first time. The success tracking result with the promising control signals in the tiltrotor simulator demonstrates the advances of our control method. Also, the Lyapunov candidate and the tracking result in the mobile robot (tilt-car) simulator confirm our deductions of the stability proof. These results reveal that these three challenges in Feedback Linearization are solved, to some extents.Comment: Doctoral Thesis at The University of Toky

Autonomous Approach and Landing Algorithms for Unmanned Aerial Vehicles

In recent years, several research activities have been developed in order to increase the autonomy features in Unmanned Aerial Vehicles (UAVs), to substitute human pilots in dangerous missions or simply in order to execute specific tasks more efficiently and cheaply. In particular, a significant research effort has been devoted to achieve high automation in the landing phase, so as to allow the landing of an aircraft without human intervention, also in presence of severe environmental disturbances. The worldwide research community agrees with the opportunity of the dual use of UAVs (for both military and civil purposes), for this reason it is very important to make the UAVs and their autolanding systems compliant with the actual and future rules and with the procedures regarding autonomous flight in ATM (Air Traffic Management) airspace in addition to the typical military aims of minimizing fuel, space or other important parameters during each autonomous task. Developing autolanding systems with a desired level of reliability, accuracy and safety involves an evolution of all the subsystems related to the guide, navigation and control disciplines. The main drawbacks of the autolanding systems available at the state of art concern or the lack of adaptivity of the trajectory generation and tracking to unpredicted external events, such as varied environmental condition and unexpected threats to avoid, or the missed compliance with the guide lines imposed by certification authorities of the proposed technologies used to get the desired above mentioned adaptivity. During his PhD period the author contributed to the development of an autonomous approach and landing system considering all the indispensable functionalities like: mission automation logic, runway data managing, sensor fusion for optimal estimation of vehicle state, trajectory generation and tracking considering optimality criteria, health management algorithms. In particular the system addressed in this thesis is capable to perform a fully adaptive autonomous landing starting from any point of the three dimensional space. The main novel feature of this algorithm is that it generates on line, with a desired updating rate or at a specified event, the nominal trajectory for the aircraft, based on the actual state of the vehicle and on the desired state at touch down point. Main features of the autolanding system based on the implementation of the proposed algorithm are: on line trajectory re-planning in the landing phase, fully autonomy from remote pilot inputs, weakly instrumented landing runway (without ILS availability), ability to land starting from any point in the space and autonomous management of failures and/or adverse atmospheric conditions, decision-making logic evaluation for key-decisions regarding possible execution of altitude recovery manoeuvre based on the Differential GPS integrity signal and compatible with the functionalities made available by the future GNSS system. All the algorithms developed allow reducing computational tractability of trajectory generation and tracking problems so as to be suitable for real time implementation and to still obtain a feasible (for the vehicle) robust and adaptive trajectory for the UAV. All the activities related to the current study have been conducted at CIRA (Italian Aerospace Research Center) in the framework of the aeronautical TECVOL project whose aim is to develop innovative technologies for the autonomous flight. The autolanding system was developed by the TECVOL team and the author’s contribution to it will be outlined in the thesis. Effectiveness of proposed algorithms has been then evaluated in real flight experiments, using the aeronautical flying demonstrator available at CIRA

Planification et commande d'une plate-forme aéroportée stationnaire autonome dédiée à la surveillance des ouvrages d'art

Today, the inspection of structures is carried out through visual assessments effectedby qualified inspectors. This procedure is very expensive and can put the personal indangerous situations. Consequently, the development of an unmanned aerial vehicleequipped with on-board vision systems is privileged nowadays in order to facilitate theaccess to unreachable zones.In this context, the main focus in the thesis is developing original methods to deal withplanning, reference trajectories generation and tracking issues by a hovering airborneplatform. These methods should allow an automation of the flight in the presence of airdisturbances and obstacles. Within this framework, we are interested in two kinds ofaerial vehicles with hovering capacity: airship and quad-rotors.Aujourd'hui, l'inspection des ouvrages d'art est réalisée de façon visuelle par des contrôleurs sur l'ensemble de la structure. Cette procédure est coûteuse et peut être particulièrement dangereuse pour les intervenants. Pour cela, le développement du système de vision embarquée sur des drones est privilégié ces jours-ci afin de faciliter l'accès aux zones dangereuses.Dans ce contexte, le travail de cette thèse porte sur l'obtention des méthodes originales permettant la planification, la génération des trajectoires de référence, et le suivi de ces trajectoires par une plate-forme aéroportée stationnaire autonome. Ces méthodes devront habiliter une automatisation du vol en présence de perturbations aérologiques ainsi que des obstacles. Dans ce cadre, nous nous sommes intéressés à deux types de véhicules aériens capable de vol stationnaire : le dirigeable et le quadri-rotors.Premièrement, la représentation mathématique du véhicule volant en présence du vent a été réalisée en se basant sur la deuxième loi de Newton. Deuxièmement, la problématique de génération de trajectoire en présence de vent a été étudiée : le problème de temps minimal est formulé, analysé analytiquement et résolu numériquement. Ensuite, une stratégie de planification de trajectoire basée sur les approches de recherche opérationnelle a été développée.Troisièmement, le problème de suivi de trajectoire a été abordé. Une loi de commande non-linéaire robuste basée sur l'analyse de Lyapunov a été proposée. En outre, un pilote automatique basée sur les fonctions de saturations pour un quadri-rotors a été développée.Les méthodes et algorithmes proposés dans cette thèse ont été validés par des simulations

Proceedings of the International Micro Air Vehicles Conference and Flight Competition 2017 (IMAV 2017)

The IMAV 2017 conference has been held at ISAE-SUPAERO, Toulouse, France from Sept. 18 to Sept. 21, 2017. More than 250 participants coming from 30 different countries worldwide have presented their latest research activities in the field of drones. 38 papers have been presented during the conference including various topics such as Aerodynamics, Aeroacoustics, Propulsion, Autopilots, Sensors, Communication systems, Mission planning techniques, Artificial Intelligence, Human-machine cooperation as applied to drones

Exploiting Heterogeneity in Networks of Aerial and Ground Robotic Agents

By taking advantage of complementary communication technologies, distinct sensing functionalities and varied motion dynamics present in a heterogeneous multi-robotic network, it is possible to accomplish a main mission objective by assigning specialized sub-tasks to specific members of a robotic team. An adequate selection of the team members and an effective coordination are some of the challenges to fully exploit the unique capabilities that these types of systems can offer. Motivated by real world applications, we focus on a multi-robotic network consisting off aerial and ground agents which has the potential to provide critical support to humans in complex settings. For instance, aerial robotic relays are capable of transporting small ground mobile sensors to expand the communication range and the situational awareness of first responders in hazardous environments. In the first part of this dissertation, we extend work on manipulation of cable-suspended loads using aerial robots by solving the problem of lifting the cable-suspended load from the ground before proceeding to transport it. Since the suspended load-quadrotor system experiences switching conditions during this critical maneuver, we define a hybrid system and show that it is differentially-flat. This property facilitates the design of a nonlinear controller which tracks a waypoint-based trajectory associated with the discrete states of the hybrid system. In addition, we address the case of unknown payload mass by combining a least-squares estimation method with the designed controller. Second, we focus on the coordination of a heterogeneous team formed by a group of ground mobile sensors and a flying communication router which is deployed to sense areas of interest in a cluttered environment. Using potential field methods, we propose a controller for the coordinated mobility of the team to guarantee inter-robot and obstacle collision avoidance as well as connectivity maintenance among the ground agents while the main goal of sensing is carried out. For the case of the aerial communications relays, we combine antenna diversity with reinforcement learning to dynamically re-locate these relays so that the received signal strength is maintained above a desired threshold. Motivated by the recent interest of combining radio frequency and optical wireless communications, we envision the implementation of an optical link between micro-scale aerial and ground robots. This type of link requires maintaining a sufficient relative transmitter-receiver position for reliable communications. In the third part of this thesis, we tackle this problem. Based on the link model, we define a connectivity cone where a minimum transmission rate is guaranteed. For example, the aerial robot has to track the ground vehicle to stay inside this cone. The control must be robust to noisy measurements. Thus, we use particle filters to obtain a better estimation of the receiver position and we design a control algorithm for the flying robot to enhance the transmission rate. Also, we consider the problem of pairing a ground sensor with an aerial vehicle, both equipped with a hybrid radio-frequency/optical wireless communication system. A challenge is positioning the flying robot within optical range when the sensor location is unknown. Thus, we take advantage of the hybrid communication scheme by developing a control strategy that uses the radio signal to guide the aerial platform to the ground sensor. Once the optical-based signal strength has achieved a certain threshold, the robot hovers within optical range. Finally, we investigate the problem of building an alliance of agents with different skills in order to satisfy the requirements imposed by a given task. We find this alliance, known also as a coalition, by using a bipartite graph in which edges represent the relation between agent capabilities and required resources for task execution. Using this graph, we build a coalition whose total capability resources can satisfy the task resource requirements. Also, we study the heterogeneity of the formed coalition to analyze how it is affected for instance by the amount of capability resources present in the agents

Optimization of non-linear control aerodynamic systems using metaheuristic algorithm Optimisation des commandes non linéaires des systèmes aérodynamiques par les méthodes méta-heuristiques

This thesis is part of the project "modelisation and control dynamic systems" carried by the laboratory of LMSE. This project aims to develop and optimize new control approaches for the UAV quadrotor tracking control. This thesis consisted of the modelling of the quadrotor, and then analysing, designing and implementing new optimal control strategies based on the model-free concept. In this context, the aim of the thesis is to propose new control strategies based on the model-free concept. The proposed strategies help to compensate the disturbances and model uncertainties. Regarding our work, we have proposed different control techniques for quadrotor control. First, an optimal model-free backstepping control law applied to a quadrotor UAV has been proposed. In addition to this work, the dynamic system has been estimated through a new proposed fuzzy strategy and merged with the BC under the model-free concept. Finally, an optimal fuzzy model-free control has been designed based on decentralized fuzzy control. The objective of these control strategies is to achieve the best tracking with unknown nonlinear dynamics and external disturbances. These proposed approaches are validated through analytical and experimental procedures and the effectiveness checked and compared with regard to the related controllers in the presence of disturbances and model uncertainties

Aerial Vehicles

This book contains 35 chapters written by experts in developing techniques for making aerial vehicles more intelligent, more reliable, more flexible in use, and safer in operation.It will also serve as an inspiration for further improvement of the design and application of aeral vehicles. The advanced techniques and research described here may also be applicable to other high-tech areas such as robotics, avionics, vetronics, and space