Aerial Robotics for Inspection and Maintenance

Aerial robots with perception, navigation, and manipulation capabilities are extending the range of applications of drones, allowing the integration of different sensor devices and robotic manipulators to perform inspection and maintenance operations on infrastructures such as power lines, bridges, viaducts, or walls, involving typically physical interactions on flight. New research and technological challenges arise from applications demanding the benefits of aerial robots, particularly in outdoor environments. This book collects eleven papers from different research groups from Spain, Croatia, Italy, Japan, the USA, the Netherlands, and Denmark, focused on the design, development, and experimental validation of methods and technologies for inspection and maintenance using aerial robots

Nonlinear Control Strategies for Outdoor Aerial Manipulators

In this thesis, the design, validation and implementation of nonlinear control strategies for aerial manipulators {i.e. aerial robots equipped with manipulators{ is studied, with special emphasis on the internal coupling of the system and its resilience against external disturbances. For the rst, di erent decentralised control strategies {i.e. using di erent control typologies for each one of the subsystems{ that indirectly take into account this coupling have been analysed. As a result, a nonlinear strategy composed of two controllers is proposed. A higher priority is given to the manipulation accuracy, relaxing the platform tracking, and hence obtaining a solution improving the manipulation capabilities with the surrounding environment. To validate these results, thorough stability and robustness analyses are provided, both theoretically and in simulation. On the other hand, a signi cant e ort has been devoted to improving the response and applicability of robot manipulators used in ight via control. In particular, the design of controllers for lightweight exible manipulators {that reduce the consequences of incidents involving unforeseen contacts{ is analysed. Although their inherent nature perfectly ts for aerial manipulation applications, the added exibility produces unwanted behaviours, such as second-order modes and uncertainties. To cope with them, an adaptable position nonlinear control strategy is proposed. To validate this contribution, the stability of the approach is studied in theory and its capabilities are proven in several experimental scenarios. In these, the robustness of the solution against unforeseen impacts and contact with uncharacterised interfaces is demonstrated. Subsequently, this strategy has been enriched with {multiaxis{ force control capabilities thanks to the inclusion of an outer control loop modifying the manipulator reference. Accordingly, this additional applicationfocused capability is added to the controlled system without loosing the modulated response of the inner-loop position strategy. It is also worth noting that, thanks to the cascade-like nature of the modi cation, the transition between position and force control modes is inherently smooth and automatic. The stability of this expanded strategy has been theoretically analysed and the results validated in a set of experimental scenarios. To validate the rst nonlinear approach with realistic outdoor simulations before its implementation, a computational uid dynamics analysis has been performed to obtain an explicit model of the aerodynamic forces and torques applied to the blunt-body of the aerial platform in ight. The results of this study have been compared to the most common alternative nowadays, being highlighted that the proposed model signi cantly surpasses this option in terms of accuracy. Moreover, it is worth underscoring that this characterisation could be also employed in the future to develop control solutions with enhanced rejection capabilities against wind conditions. Finally, as the focus of this thesis is on the use of novel control strategies on real aerial manipulation outdoors to improve their accuracy while performing complex tasks, a modular autopilot solution to be able to implement them has been also developed. This general-purpose autopilot allows the implementation of new algorithms, and facilitates their theory-to-experimentation transition. Taking into account this perspective, the proposed tool employs the simple and widely-known MAS interface and the highly reliable PX4 autopilot as backup, thus providing a redundant approach to handle unexpected incidents in ight.En esta tesis se ha estudiado el diseño, validación e implementación de estrategias de control no lineales para robots manipuladores aéreos –esto es, robots aéreos equipados con un sistema de manipulación robótica–, dándose especial énfasis a las interacciones internas del sistema y a su resiliencia frente a efectos externos. Para lo primero, se han analizado diferentes estrategias de control descentralizado –es decir, que usan tipologías de control diferentes para cada uno de los subsistemas–, pero que tienen indirectamente en consideración la interacción entre manipulación y vuelo. Como resultado de esta línea, se propone una estretegia de control conformada por dos controladores. Estos se coordinan de tal forma que se le da prioridad a la manipulación sobre el seguimiento de posiciones del vehículo, produciéndose un sistema de control que mejora la precisión de las interacciones entre el sistema manipulador y el entorno. Para validar estos resultados, se ha analizado su estabilidad y robustez tanto teóricamente como mediante simulaciones numéricas. Por otro lado, se ha buscado mejorar la respuesta y aplicabilidad de los manipuladores que se usan en vuelo mediante su control. Dentro de esta tendencia, la tesis se ha centrado en el diseño de controladores para manipuladores ligeros flexibles, ya que estos permiten reducir el peso del sistema completo y reducen el riesgo de incidentes debidos a contactos inesperados. Sin embargo, la flexibilidad de estos produce comportamientos indeseados durante la operación, como la aparición de modos de segundo orden y cierta incentidumbre en su comportamiento. Para reducir su impacto en la precisión de las tareas de manipulación, se ha desarrollado un controlador no lineal adaptable. Para validar estos resultados, se ha analizado la estabilidad del sistema teóricamente y se han desarrollado una serie de experimentos. En ellos, se ha comprobado su robustez ante impactos inesperados y contactos con elementos no caracterizados. Posteriormente, esta estrategia para manipuladores flexibles ha sido ampliada al añadir un bucle externo que posibilita el control en fuerzas en varias direcciones. Esto permite, mediante un único controlador, mantener la suave respuesta de la estrategia. Además cabe destacar que, al contar esta estrategia con un diseño en cascade, la transición entre los segmentos de desplazamiento del brazo y de aplicación de fuerzas es fluida y automática. La estabilidad de esta estrategia ampliada ha sido analizada teóricamente y los resultados han sido validados experimentalmente. Para validar la primera estrategia mediante simulaciones que representen fielmente las condiciones en exteriores antes de su implementación, ha sido necesario realizar un estudio mediante mecánica de fluidos computacional para obtener un modelo explícito de las fuerzas y momentos aerodinámicos a los que se efrenta la plataforma en vuelo. Los resultados de este estudio han sido comparados con la alternativa más empleada actualmente, mostrándose que los avances del método propuesto son sustanciales. Asimismo, es importante destacar que esta caracterización podría también usarse en el futuro para desarrollar controladores con una respuesta mejorada ante perturbaciones aerodinámicas, como en el caso de volar con viento. Finalmente, al ser esta una tesis centrada en las estrategias de control novedosas en sistemas reales para la mejora de su rendimiento en misiones complejas, se ha desarrollado un autopiloto modular fácilmente modificable para implementarlas. Este permite validar experimentalmente nuevos algoritmos y facilita la transición entre teoría y práctica. Para ello, esta herramienta se basa en una interfaz sencilla ampliamente conocida por los investigadores de robótica, Simulink®, y cuenta con un autopiloto de respaldo, PX4, para enfrentarse a los incidentes inesperados que pudieran surgir en vuelo

Models, algorithms and architectures for cooperative manipulation with aerial and ground robots

Les dernières années ont vu le développement de recherches portant sur l'interaction physique entre les robots aériens et leur environnement, accompagné de l'apparition de nombreux nouveaux systèmes mécaniques et approches de régulation. La communauté centrée autour de la robotique aérienne observe actuellement un déplacement de paradigmes des approches classiques de guidage, de navigation et de régulation vers des tâches moins triviales, telle le développement de l'interaction physique entre robots aériens et leur environnement. Ceci correspond à une extension des tâches dites de manipulation, du sol vers les airs. Cette thèse contribue au domaine de la manipulation aérienne en proposant un nouveau concept appelé MAGMaS, pour " Multiple Aerial Ground Manipulator System ". Les motivations qui ont conduites à l'association de manipulateurs terrestres et aériens pour effectuer des tâches de manipulation coopérative, résident dans une volonté d'exploiter leurs particularités respectives. Les manipulateurs terrestres apportant leur importante force et les manipulateurs aériens apportant leur vaste espace de travail. La première contribution de cette thèse présente une modélisation rigoureuse des MAGMaS. Les propriétés du système ainsi que ses possibles extensions sont discutées. Les méthodes de planning, d'estimation et de régulation nécessaire à l'exploitation des MAGMaS pour des tâches de manipulation collaborative sont dérivées. Ce travail propose d'exploiter les redondances des MAGMaS grâce à un algorithme optimal d'allocation de forces entre les manipulateurs. De plus, une méthode générale d'estimation de forces pour robots aériens est introduite. Toutes les techniques et les algorithmes présentés dans cette thèse sont intégrés dans une architecture globale, utilisée à la fois pour la simulation et la validation expérimentale. Cette architecture est en outre augmentée par l'addition d'une structure de télé-présence, afin de permettre l'opération à distances des MAGMaS. L'architecture générale est validée par une démonstration de levage de barre, qui est une application représentative des potentiels usages des MAGMaS. Une autre contribution relative au développement des MAGMaS consiste en une étude exploratoire de la flexibilité dans les objets manipulés par un MAGMaS. Un modèle du phénomène vibratoire est dérivé afin de mettre en exergue ses propriétés en termes de contrôle. La dernière contribution de cette thèse consiste en une étude exploratoire sur l'usage des actionneurs à raideur variable dans les robots aériens, dotant ces systèmes d'une compliance mécanique intrinsèque et de capacité de stockage d'énergie. Les fondements théoriques sont associés à la synthèse d'un contrôleur non-linéaire. L'approche proposée est validée par le biais d'expériences reposant sur l'intégration d'un actionneur à raideur variable léger sur un robot aérien.In recent years, the subject of physical interaction for aerial robots has been a popular research area with many new mechanical designs and control approaches being proposed. The aerial robotics community is currently observing a paradigm shift from classic guidance, navigation, and control tasks towards more unusual tasks, for example requesting aerial robots to physically interact with the environment, thus extending the manipulation task from the ground into the air. This thesis contributes to the field of aerial manipulation by proposing a novel concept known has Multiple Aerial-Ground Manipulator System or MAGMaS, including what appears to be the first experimental demonstration of a MAGMaS and opening a new route of research. The motivation behind associating ground and aerial robots for cooperative manipulation is to leverage their respective particularities, ground robots bring strength while aerial robots widen the workspace of the system. The first contribution of this work introduces a meticulous system model for MAGMaS. The system model's properties and potential extensions are discussed in this work. The planning, estimation and control methods which are necessary to exploit MAGMaS in a cooperative manipulation tasks are derived. This works proposes an optimal control allocation scheme to exploit the MAGMaS redundancies and a general model-based force estimation method is presented. All of the proposed techniques reported in this thesis are integrated in a global architecture used for simulations and experimental validation. This architecture is extended by the addition of a tele-presence framework to allow remote operations of MAGMaS. The global architecture is validated by robust demonstrations of bar lifting, an application that gives an outlook of the prospective use of the proposed concept of MAGMaS. Another contribution in the development of MAGMaS consists of an exploratory study on the flexibility of manipulated loads. A vibration model is derived and exploited to showcase vibration properties in terms of control. The last contribution of this thesis consists of an exploratory study on the use of elastic joints in aerial robots, endowing these systems with mechanical compliance and energy storage capabilities. Theoretical groundings are associated with a nonlinear controller synthesis. The proposed approach is validated by experimental work which relies on the integration of a lightweight variable stiffness actuator on an aerial robot

Visual Servoing

The goal of this book is to introduce the visional application by excellent researchers in the world currently and offer the knowledge that can also be applied to another field widely. This book collects the main studies about machine vision currently in the world, and has a powerful persuasion in the applications employed in the machine vision. The contents, which demonstrate that the machine vision theory, are realized in different field. For the beginner, it is easy to understand the development in the vision servoing. For engineer, professor and researcher, they can study and learn the chapters, and then employ another application method

Safe and accurate MAV Control, navigation and manipulation

This work focuses on the problem of precise, aggressive and safe Micro Aerial Vehicle (MAV) navigation as well as deployment in applications which require physical interaction with the environment. To address these issues, we propose three different MAV model based control algorithms that rely on the concept of receding horizon control. As a starting point, we present a computationally cheap algorithm which utilizes an approximate linear model of the system around hover and is thus maximally accurate for slow reference maneuvers. Aiming at overcoming the limitations of the linear model parameterisation, we present an extension to the first controller which relies on the true nonlinear dynamics of the system. This approach, even though computationally more intense, ensures that the control model is always valid and allows tracking of full state aggressive trajectories. The last controller addresses the topic of aerial manipulation in which the versatility of aerial vehicles is combined with the manipulation capabilities of robotic arms. The proposed method relies on the formulation of a hybrid nonlinear MAV-arm model which also takes into account the effects of contact with the environment. Finally, in order to enable safe operation despite the potential loss of an actuator, we propose a supervisory algorithm which estimates the health status of each motor. We further showcase how this can be used in conjunction with the nonlinear controllers described above for fault tolerant MAV flight. While all the developed algorithms are formulated and tested using our specific MAV platforms (consisting of underactuated hexacopters for the free flight experiments, hexacopter-delta arm system for the manipulation experiments), we further discuss how these can be applied to other underactuated/overactuated MAVs and robotic arm platforms. The same applies to the fault tolerant control where we discuss different stabilisation techniques depending on the capabilities of the available hardware. Even though the primary focus of this work is on feedback control, we thoroughly describe the custom hardware platforms used for the experimental evaluation, the state estimation algorithms which provide the basis for control as well as the parameter identification required for the formulation of the various control models. We showcase all the developed algorithms in experimental scenarios designed to highlight the corresponding strengths and weaknesses as well as show that the proposed methods can run in realtime on commercially available hardware.Open Acces

Aeronautical engineering: A continuing bibliography with indexes (supplement 275)

This bibliography lists 379 reports, articles, and other documents introduced into the NASA scientific and technical information system in Jan. 1991

A Contribution to the Design of Highly Redundant Compliant Aerial Manipulation Systems

Es ist vorhersehbar, dass die Luftmanipulatoren in den nächsten Jahrzehnten für viele Aufgaben eingesetzt werden, die entweder zu gefährlich oder zu teuer sind, um sie mit herkömmlichen Methoden zu bewältigen. In dieser Arbeit wird eine neuartige Lösung für die Gesamtsteuerung von hochredundanten Luftmanipulationssystemen vorgestellt. Die Ergebnisse werden auf eine Referenzkonfiguration angewendet, die als universelle Plattform für die Durchführung verschiedener Luftmanipulationsaufgaben etabliert wird. Diese Plattform besteht aus einer omnidirektionalen Drohne und einem seriellen Manipulator. Um den modularen Regelungsentwurf zu gewährleisten, werden zwei rechnerisch effiziente Algorithmen untersucht, um den virtuellen Eingang den Aktuatorbefehlen zuzuordnen. Durch die Integration eines auf einem künstlichen neuronalen Netz basierenden Diagnosemoduls und der rekonfigurierbaren Steuerungszuordnung in den Regelkreis, wird die Fehlertoleranz für die Drohne erzielt. Außerdem wird die Motorsättigung durch Rekonfiguration der Geschwindigkeits- und Beschleunigungsprofile behandelt. Für die Beobachtung der externen Kräfte und Drehmomente werden zwei Filter vorgestellt. Dies ist notwendig, um ein nachgiebiges Verhalten des Endeffektors durch die achsenselektive Impedanzregelung zu erreichen. Unter Ausnutzung der Redundanz des vorgestellten Luftmanipulators wird ein Regler entworfen, der nicht nur die Referenz der Endeffektor-Bewegung verfolgt, sondern auch priorisierte sekundäre Aufgaben ausführt. Die Wirksamkeit der vorgestellten Lösungen wird durch umfangreiche Tests überprüft, und das vorgestellte Steuerungssystem wird als sehr vielseitig und effektiv bewertet.:1 Introduction 2 Fundamentals 3 System Design and Modeling 4 Reconfigurable Control Allocation 5 Fault Diagnostics For Free Flight 6 Force and Torque Observer 7 Trajectory Generation 8 Hybrid Task Priority Control 9 System Integration and Performance Evaluation 10 ConclusionIn the following decades, aerial manipulators are expected to be deployed in scenarios that are either too dangerous for human beings or too expensive to be accomplished by traditional methods. This thesis presents a novel solution for the overall control of highly redundant aerial manipulation systems. The results are applied to a reference configuration established as a universal platform for performing various aerial manipulation tasks. The platform consists of an omnidirectional multirotor UAV and a serial manipulator. To ensure modular control design, two computationally efficient algorithms are studied to allocate the virtual input to actuator commands. Fault tolerance of the aerial vehicle is achieved by integrating a diagnostic module based on an artificial neural network and the reconfigurable control allocation into the control loop. Besides, the risk of input saturation of individual rotors is minimized by predicting and reconfiguring the speed and acceleration responses. Two filter-based observers are presented to provide the knowledge of external forces and torques, which is necessary to achieve compliant behavior of the end-effector through an axis-selective impedance control in the outer loop. Exploiting the redundancy of the proposed aerial manipulator, the author has designed a control law to achieve the desired end-effector motion and execute secondary tasks in order of priority. The effectiveness of the proposed designs is verified with extensive tests generated by following Monte Carlo method, and the presented control scheme is proved to be versatile and effective.:1 Introduction 2 Fundamentals 3 System Design and Modeling 4 Reconfigurable Control Allocation 5 Fault Diagnostics For Free Flight 6 Force and Torque Observer 7 Trajectory Generation 8 Hybrid Task Priority Control 9 System Integration and Performance Evaluation 10 Conclusio

Modelling and Control of Small-Scale Helicopter on a Test Platform

The helicopter is a Multiple-Input Multiple-Output (MIMO) system with highly coupled characteristics, which increases the complexity of the system dynamics. In addition, the system dynamics of the helicopter are unstable, referring to its tendency to deviate from an equilibrium when disturbed. Despite the complexity in its modelling and control, the benefit of using a helicopter for unmanned, autonomous applications can be tremendous. One particular application that motivates this research is the use of an unmanned small-scale helicopter in an autonomous survey mission over an area struck by disaster, such as an earthquake. The work presented in this thesis provides a framework for utilizing a platform system for research and development of small-scale helicopter systems. A platform system enables testing and analysis to be performed indoor in a controlled environment. This can provide a more convenient mean for helicopter research since the system is not affected by environmental elements, such as wind, rain or snow condition. However, the presence of the platform linkages poses challenges for analysis and controller design as it alters the helicopter system flight dynamics. Through a six degree-of-freedom (6 DOF) platform model derived in this research, the criteria for matching the trim conditions between the platform system and a stand alone helicopter have been identified. With the matched trim conditions, linearization is applied to perform analysis on the effects that the platform has on the system dynamics. The results of the analysis provide insights into both the limitations and benefits of utilizing the platform system for helicopter research. Finally, a Virtual Joint Control scheme is proposed as an unified control strategy for both the platform and the stand alone helicopter systems. Having a consistent control scheme between the two systems allows for comparisons between simulation and experimental results for the two systems to be made more readily. Furthermore, the Virtual Joint Control scheme represents a novel flight control strategy for stand alone helicopter systems