Passive Compliance Control of Aerial Manipulators

This paper presents a passive compliance control for aerial manipulators to achieve stable environmental interactions. The main challenge is the absence of actuation along body-planar directions of the aerial vehicle which might be required during the interaction to preserve passivity. The controller proposed in this paper guarantees passivity of the manipulator through a proper choice of end-effector coordinates, and that of vehicle fuselage is guaranteed by exploiting time domain passivity technique. Simulation studies validate the proposed approach.Comment: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 201

Design of an Anthropomorphic, Compliant, and Lightweight Dual Arm for Aerial Manipulation

This paper presents an anthropomorphic, compliant and lightweight dual arm manipulator designed and developed for aerial manipulation applications with multi-rotor platforms. Each arm provides four degrees of freedom in a human-like kinematic configuration for end effector positioning: shoulder pitch, roll and yaw, and elbow pitch. The dual arm, weighting 1.3 kg in total, employs smart servo actuators and a customized and carefully designed aluminum frame structure manufactured by laser cut. The proposed design reduces the manufacturing cost as no computer numerical control machined part is used. Mechanical joint compliance is provided in all the joints, introducing a compact spring-lever transmission mechanism between the servo shaft and the links, integrating a potentiometer for measuring the deflection of the joints. The servo actuators are partially or fully isolated against impacts and overloads thanks to the ange bearings attached to the frame structure that support the rotation of the links and the deflection of the joints. This simple mechanism increases the robustness of the arms and safety in the physical interactions between the aerial robot and the environment. The developed manipulator has been validated through different experiments in fixed base test-bench and in outdoor flight tests.Unión Europea H2020-ICT-2014- 644271Ministerio de Economía y Competitividad DPI2015-71524-RMinisterio de Economía y Competitividad DPI2017-89790-

Compliant aerial manipulation.

The aerial manipulation is a research field which proposes the integration of robotic manipulators in aerial platforms, typically multirotors – widely known as “drones” – or autonomous helicopters. The development of this technology is motivated by the convenience to reduce the time, cost and risk associated to the execution of certain operations or tasks in high altitude areas or difficult access workspaces. Some illustrative application examples are the detection and insulation of leaks in pipe structures in chemical plants, repairing the corrosion in the blades of wind turbines, the maintenance of power lines, or the installation and retrieval of sensor devices in polluted areas. Although nowadays it is possible to find a wide variety of commercial multirotor platforms with payloads from a few gramps up to several kilograms, and flight times around thirty minutes, the development of an aerial manipulator is still a technological challenge due to the strong requirements relative to the design of the manipulator in terms of very low weight, low inertia, dexterity, mechanical robustness and control. The main contribution of this thesis is the design, development and experimental validation of several prototypes of lightweight (<2 kg) and compliant manipulators to be integrated in multirotor platforms, including human-size dual arm systems, compliant joint arms equipped with human-like finger modules for grasping, and long reach aerial manipulators. Since it is expected that the aerial manipulator is capable to execute inspection and maintenance tasks in a similar way a human operator would do, this thesis proposes a bioinspired design approach, trying to replicate the human arm in terms of size, kinematics, mass distribution, and compliance. This last feature is actually one of the key concepts developed and exploited in this work. Introducing a flexible element such as springs or elastomers between the servos and the links extends the capabilities of the manipulator, allowing the estimation and control of the torque/force, the detection of impacts and overloads, or the localization of obstacles by contact. It also improves safety and efficiency of the manipulator, especially during the operation on flight or in grabbing situations, where the impacts and contact forces may damage the manipulator or destabilize the aerial platform. Unlike most industrial manipulators, where force-torque control is possible at control rates above 1 kHz, the servo actuators typically employed in the development of aerial manipulators present important technological limitations: no torque feedback nor control, only position (and in some models, speed) references, low update rates (<100 Hz), and communication delays. However, these devices are still the best solution due to their high torque to weight ratio, low cost, compact design, and easy assembly and integration. In order to cope with these limitations, the compliant joint arms presented here estimate and control the wrenches from the deflection of the spring-lever transmission mechanism introduced in the joints, measured at joint level with encoders or potentiometers, or in the Cartesian space employing vision sensors. Note that in the developed prototypes, the maximum joint deflection is around 25 degrees, which corresponds to a deviation in the position of the end effector around 20 cm for a human-size arm. The capabilities and functionalities of the manipulators have been evaluated in fixed base test-bench firstly, and then in outdoor flight tests, integrating the arms in different commercial hexarotor platforms. Frequency characterization, position/force/impedance control, bimanual grasping, arm teleoperation, payload mass estimation, or contact-based obstacle localization are some of the experiments presented in this thesis that validate the developed prototypes.La manipulación aérea es un campo de investigación que propone la integración de manipuladores robóticos in plataformas aéreas, típicamente multirotores – comúnmente conocidos como “drones” – o helicópteros autónomos. El desarrollo de esta tecnología está motivada por la conveniencia de reducir el tiempo, coste y riesgo asociado a la ejecución de ciertas operaciones o tareas en áreas de gran altura o espacios de trabajo de difícil acceso. Algunos ejemplos ilustrativos de aplicaciones son la detección y aislamiento de fugas en estructura de tuberías en plantas químicas, la reparación de la corrosión en las palas de aerogeneradores, el mantenimiento de líneas eléctricas, o la instalación y recuperación de sensores en zonas contaminadas. Aunque hoy en día es posible encontrar una amplia variedad de plataformas multirotor comerciales con cargas de pago desde unos pocos gramos hasta varios kilogramos, y tiempo de vuelo entorno a treinta minutos, el desarrollo de los manipuladores aéreos es todavía un desafío tecnológico debido a los exigentes requisitos relativos al diseño del manipulador en términos de muy bajo peso, baja inercia, destreza, robustez mecánica y control. La contribución principal de esta tesis es el diseño, desarrollo y validación experimental de varios prototipos de manipuladores de bajo peso (<2 kg) con capacidad de acomodación (“compliant”) para su integración en plataformas aéreas multirotor, incluyendo sistemas bi-brazo de tamaño humano, brazos robóticos de articulaciones flexibles con dedos antropomórficos para agarre, y manipuladores aéreos de largo alcance. Puesto que se prevé que el manipulador aéreo sea capaz de ejecutar tareas de inspección y mantenimiento de forma similar a como lo haría un operador humano, esta tesis propone un enfoque de diseño bio-inspirado, tratando de replicar el brazo humano en cuanto a tamaño, cinemática, distribución de masas y flexibilidad. Esta característica es de hecho uno de los conceptos clave desarrollados y utilizados en este trabajo. Al introducir un elemento elástico como los muelles o elastómeros entre el los actuadores y los enlaces se aumenta las capacidades del manipulador, permitiendo la estimación y control de las fuerzas y pares, la detección de impactos y sobrecargas, o la localización de obstáculos por contacto. Además mejora la seguridad y eficiencia del manipulador, especialmente durante las operaciones en vuelo, donde los impactos y fuerzas de contacto pueden dañar el manipulador o desestabilizar la plataforma aérea. A diferencia de la mayoría de manipuladores industriales, donde el control de fuerzas y pares es posible a tasas por encima de 1 kHz, los servo motores típicamente utilizados en el desarrollo de manipuladores aéreos presentan importantes limitaciones tecnológicas: no hay realimentación ni control de torque, sólo admiten referencias de posición (o bien de velocidad), y presentan retrasos de comunicación. Sin embargo, estos dispositivos son todavía la mejor solución debido al alto ratio de torque a peso, por su bajo peso, diseño compacto y facilidad de ensamblado e integración. Para suplir estas limitaciones, los brazos robóticos flexibles presentados aquí permiten estimar y controlar las fuerzas a partir de la deflexión del mecanismo de muelle-palanca introducido en las articulaciones, medida a nivel articular mediante potenciómetros o codificadores, o en espacio Cartesiano mediante sensores de visión. Tómese como referencia que en los prototipos desarrollados la máxima deflexión articular es de unos 25 grados, lo que corresponde a una desviación de posición en torno a 20 cm en el efector final para un brazo de tamaño humano. Las capacidades y funcionalidades de estos manipuladores se han evaluado en base fija primero, y luego en vuelos en exteriores, integrando los brazos en diferentes plataformas hexartor comerciales. Caracterización frecuencial, control de posición/fuerza/impedancia, agarre bimanual, teleoperación de brazos, estimación de carga, o la localización de obstáculos mediante contacto son algunos de los experimentos presentados en esta tesis para validar los prototipos desarrollados por el auto

Methods for autonomous wristband placement with a search-and-rescue aerial manipulator

A new robotic system for Search And Rescue (SAR) operations based on the automatic wristband placement on the victims’ arm, which may provide identification, beaconing and remote sensor readings for continuous health monitoring. This paper focuses on the development of the automatic target localization and the device placement using an unmanned aerial manipulator. The automatic wrist detection and localization system uses an RGB-D camera and a convolutional neural network based on the region faster method (Faster R-CNN). A lightweight parallel delta manipulator with a large workspace has been built, and a new design of a wristband in the form of a passive detachable gripper, is presented, which under contact, automatically attaches to the human, while disengages from the manipulator. A new trajectory planning method has been used to minimize the torques caused by the external forces during contact, which cause attitude perturbations. Experiments have been done to evaluate the machine learning method for detection and location, and for the assessment of the performance of the trajectory planning method. The results show how the VGG-16 neural network provides a detection accuracy of 67.99%. Moreover, simulation experiments have been done to show that the new trajectories minimize the perturbations to the aerial platform.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech

The AEROARMS Project: Aerial Robots with Advanced Manipulation Capabilities for Inspection and Maintenance

This article summarizes new aerial robotic manipulation technologies and methods—aerial robotic manipulators with dual arms and multidirectional thrusters—developed in the AEROARMS project for outdoor industrial inspection and maintenance (I&M). Our report deals with the control systems, including the control of the interaction forces and the compliance the teleoperation, which uses passivity to tackle the tradeoff between stability and performance the perception methods for localization, mapping, and inspection the planning methods, including a new control-aware approach for aerial manipulation. Finally, we describe a novel industrial platform with multidirectional thrusters and a new arm design to increase the robustness in industrial contact inspections. In addition, the lessons learned in applying the platform to outdoor aerial manipulation for I&M are pointed out

A Lightweight Modular Continuum Manipulator with IMU-based Force Estimation

Most aerial manipulators use serial rigid-link designs, which results in large forces when initiating contacts during manipulation and could cause flight stability difficulty. This limitation could potentially be improved by the compliance of continuum manipulators. To achieve this goal, we present the novel design of a compact, lightweight, and modular cable-driven continuum manipulator for aerial drones. We then derive a complete modeling framework for its kinematics, statics, and stiffness (compliance). The modeling framework can guide the control and design problems to integrate the manipulator to aerial drones. In addition, thanks to the derived stiffness (compliance) matrix, and using a low-cost IMU sensor to capture deformation angles, we present a simple method to estimate manipulation force at the tip of the manipulator. We report preliminary experimental validations of the hardware prototype, providing insights on its manipulation feasibility. We also report preliminary results of the IMU-based force estimation method.Comment: 12 pages, submitted to ASME Journal of Mechanisms and Robotics 2022, under review. arXiv admin note: substantial text overlap with arXiv:2206.0624

Whole-Body Bilateral Teleoperation of a Redundant Aerial Manipulator

Attaching a robotic manipulator to a flying base allows for significant improvements in the reachability and versatility of manipulation tasks. In order to explore such systems while taking advantage of human capabilities in terms of perception and cognition, bilateral teleoperation arises as a reasonable solution. However, since most telemanipulation tasks require visual feedback in addition to the haptic one, real-time (task-dependent) positioning of a video camera, which is usually attached to the flying base, becomes an additional objective to be fulfilled. Since the flying base is part of the kinematic structure of the robot, if proper care is not taken, moving the video camera could undesirably disturb the end-effector motion. For that reason, the necessity of controlling the base position in the null space of the manipulation task arises. In order to provide the operator with meaningful information about the limits of the allowed motions in the null space, this paper presents a novel haptic concept called Null-Space Wall. In addition, a framework to allow stable bilateral teleoperation of both tasks is presented. Numerical simulation data confirm that the proposed framework is able to keep the system passive while allowing the operator to perform time-delayed telemanipulation and command the base to a task-dependent optimal pose.Comment: to be published in 2020 IEEE International Conference on Robotics and Automation (ICRA

Safe local aerial manipulation for the installation of devices on power lines: Aerial-core first year results and designs

Article number 6220The power grid is an essential infrastructure in any country, comprising thousands of kilometers of power lines that require periodic inspection and maintenance, carried out nowadays by human operators in risky conditions. To increase safety and reduce time and cost with respect to conventional solutions involving manned helicopters and heavy vehicles, the AERIAL-CORE project proposes the development of aerial robots capable of performing aerial manipulation operations to assist human operators in power lines inspection and maintenance, allowing the installation of devices, such as bird flight diverters or electrical spacers, and the fast delivery and retrieval of tools. This manuscript describes the goals and functionalities to be developed for safe local aerial manipulation, presenting the preliminary designs and experimental results obtained in the first year of the project.European Union (UE). H2020 871479Ministerio de Ciencia, Innovación y Universidades de España FPI 201

On Aerial Robots with Grasping and Perching Capabilities: A Comprehensive Review

Over the last decade, there has been an increased interest in developing aerial robotic platforms that exhibit grasping and perching capabilities not only within the research community but also in companies across different industry sectors. Aerial robots range from standard multicopter vehicles/drones, to autonomous helicopters, and fixed-wing or hybrid devices. Such devices rely on a range of different solutions for achieving grasping and perching. These solutions can be classified as: 1) simple gripper systems, 2) arm-gripper systems, 3) tethered gripping mechanisms, 4) reconfigurable robot frames, 5) adhesion solutions, and 6) embedment solutions. Grasping and perching are two crucial capabilities that allow aerial robots to interact with the environment and execute a plethora of complex tasks, facilitating new applications that range from autonomous package delivery and search and rescue to autonomous inspection of dangerous or remote environments. In this review paper, we present the state-of-the-art in aerial grasping and perching mechanisms and we provide a comprehensive comparison of their characteristics. Furthermore, we analyze these mechanisms by comparing the advantages and disadvantages of the proposed technologies and we summarize the significant achievements in these two research topics. Finally, we conclude the review by suggesting a series of potential future research directions that we believe that are promising