Compliant aerial manipulation.

The aerial manipulation is a research field which proposes the integration of robotic manipulators in aerial platforms, typically multirotors – widely known as “drones” – or autonomous helicopters. The development of this technology is motivated by the convenience to reduce the time, cost and risk associated to the execution of certain operations or tasks in high altitude areas or difficult access workspaces. Some illustrative application examples are the detection and insulation of leaks in pipe structures in chemical plants, repairing the corrosion in the blades of wind turbines, the maintenance of power lines, or the installation and retrieval of sensor devices in polluted areas. Although nowadays it is possible to find a wide variety of commercial multirotor platforms with payloads from a few gramps up to several kilograms, and flight times around thirty minutes, the development of an aerial manipulator is still a technological challenge due to the strong requirements relative to the design of the manipulator in terms of very low weight, low inertia, dexterity, mechanical robustness and control. The main contribution of this thesis is the design, development and experimental validation of several prototypes of lightweight (<2 kg) and compliant manipulators to be integrated in multirotor platforms, including human-size dual arm systems, compliant joint arms equipped with human-like finger modules for grasping, and long reach aerial manipulators. Since it is expected that the aerial manipulator is capable to execute inspection and maintenance tasks in a similar way a human operator would do, this thesis proposes a bioinspired design approach, trying to replicate the human arm in terms of size, kinematics, mass distribution, and compliance. This last feature is actually one of the key concepts developed and exploited in this work. Introducing a flexible element such as springs or elastomers between the servos and the links extends the capabilities of the manipulator, allowing the estimation and control of the torque/force, the detection of impacts and overloads, or the localization of obstacles by contact. It also improves safety and efficiency of the manipulator, especially during the operation on flight or in grabbing situations, where the impacts and contact forces may damage the manipulator or destabilize the aerial platform. Unlike most industrial manipulators, where force-torque control is possible at control rates above 1 kHz, the servo actuators typically employed in the development of aerial manipulators present important technological limitations: no torque feedback nor control, only position (and in some models, speed) references, low update rates (<100 Hz), and communication delays. However, these devices are still the best solution due to their high torque to weight ratio, low cost, compact design, and easy assembly and integration. In order to cope with these limitations, the compliant joint arms presented here estimate and control the wrenches from the deflection of the spring-lever transmission mechanism introduced in the joints, measured at joint level with encoders or potentiometers, or in the Cartesian space employing vision sensors. Note that in the developed prototypes, the maximum joint deflection is around 25 degrees, which corresponds to a deviation in the position of the end effector around 20 cm for a human-size arm. The capabilities and functionalities of the manipulators have been evaluated in fixed base test-bench firstly, and then in outdoor flight tests, integrating the arms in different commercial hexarotor platforms. Frequency characterization, position/force/impedance control, bimanual grasping, arm teleoperation, payload mass estimation, or contact-based obstacle localization are some of the experiments presented in this thesis that validate the developed prototypes.La manipulación aérea es un campo de investigación que propone la integración de manipuladores robóticos in plataformas aéreas, típicamente multirotores – comúnmente conocidos como “drones” – o helicópteros autónomos. El desarrollo de esta tecnología está motivada por la conveniencia de reducir el tiempo, coste y riesgo asociado a la ejecución de ciertas operaciones o tareas en áreas de gran altura o espacios de trabajo de difícil acceso. Algunos ejemplos ilustrativos de aplicaciones son la detección y aislamiento de fugas en estructura de tuberías en plantas químicas, la reparación de la corrosión en las palas de aerogeneradores, el mantenimiento de líneas eléctricas, o la instalación y recuperación de sensores en zonas contaminadas. Aunque hoy en día es posible encontrar una amplia variedad de plataformas multirotor comerciales con cargas de pago desde unos pocos gramos hasta varios kilogramos, y tiempo de vuelo entorno a treinta minutos, el desarrollo de los manipuladores aéreos es todavía un desafío tecnológico debido a los exigentes requisitos relativos al diseño del manipulador en términos de muy bajo peso, baja inercia, destreza, robustez mecánica y control. La contribución principal de esta tesis es el diseño, desarrollo y validación experimental de varios prototipos de manipuladores de bajo peso (<2 kg) con capacidad de acomodación (“compliant”) para su integración en plataformas aéreas multirotor, incluyendo sistemas bi-brazo de tamaño humano, brazos robóticos de articulaciones flexibles con dedos antropomórficos para agarre, y manipuladores aéreos de largo alcance. Puesto que se prevé que el manipulador aéreo sea capaz de ejecutar tareas de inspección y mantenimiento de forma similar a como lo haría un operador humano, esta tesis propone un enfoque de diseño bio-inspirado, tratando de replicar el brazo humano en cuanto a tamaño, cinemática, distribución de masas y flexibilidad. Esta característica es de hecho uno de los conceptos clave desarrollados y utilizados en este trabajo. Al introducir un elemento elástico como los muelles o elastómeros entre el los actuadores y los enlaces se aumenta las capacidades del manipulador, permitiendo la estimación y control de las fuerzas y pares, la detección de impactos y sobrecargas, o la localización de obstáculos por contacto. Además mejora la seguridad y eficiencia del manipulador, especialmente durante las operaciones en vuelo, donde los impactos y fuerzas de contacto pueden dañar el manipulador o desestabilizar la plataforma aérea. A diferencia de la mayoría de manipuladores industriales, donde el control de fuerzas y pares es posible a tasas por encima de 1 kHz, los servo motores típicamente utilizados en el desarrollo de manipuladores aéreos presentan importantes limitaciones tecnológicas: no hay realimentación ni control de torque, sólo admiten referencias de posición (o bien de velocidad), y presentan retrasos de comunicación. Sin embargo, estos dispositivos son todavía la mejor solución debido al alto ratio de torque a peso, por su bajo peso, diseño compacto y facilidad de ensamblado e integración. Para suplir estas limitaciones, los brazos robóticos flexibles presentados aquí permiten estimar y controlar las fuerzas a partir de la deflexión del mecanismo de muelle-palanca introducido en las articulaciones, medida a nivel articular mediante potenciómetros o codificadores, o en espacio Cartesiano mediante sensores de visión. Tómese como referencia que en los prototipos desarrollados la máxima deflexión articular es de unos 25 grados, lo que corresponde a una desviación de posición en torno a 20 cm en el efector final para un brazo de tamaño humano. Las capacidades y funcionalidades de estos manipuladores se han evaluado en base fija primero, y luego en vuelos en exteriores, integrando los brazos en diferentes plataformas hexartor comerciales. Caracterización frecuencial, control de posición/fuerza/impedancia, agarre bimanual, teleoperación de brazos, estimación de carga, o la localización de obstáculos mediante contacto son algunos de los experimentos presentados en esta tesis para validar los prototipos desarrollados por el auto

Design and validation of a high DOF origami inspired soft actuated assistive exoskeleton arm and spine

This research presents the design, development, and validation of a high degree of freedom (DOF) exoskeleton actuated by origami-inspired soft inflatable modules. The objective was to create reliable soft actuators to provide safe and compliant movement assistance. Utilising lightweight 3D printing materials and origami-inspired soft flexible modules, the developed exoskeleton offers seven DOF to assist reaching motion of the upper limb. A passive rubber joint was incorporated for gravity compensation of the upper limb with elastic stability. The integrated exoskeleton consists of collapsible soft actuators made from polyethylene tubing, an ultra-lightweight structure with seven DOF, and real-time feedback through electronic goniometers. The validation included comprehensive testing of the soft actuators, and evaluating speed and accuracy. Torque measurements of the single module reached up to 4.46 Nm. A participant experiment in reaching motion demonstrated relatively slow but accurate movement, showcasing the effectiveness in assisting passive motion. This research successfully integrates soft actuators with a high DOF exoskeleton, highlighting its potential for providing movement assistance in various applications in future

Otimização muscle-in-the-loop em tempo real para reabilitação física com um exosqueleto ativo: uma mudança de paradigma

Assisting human locomotion with a wearable robotic orthosis is still quite challenging, largely due to the complexity of the neuromusculoskeletal system, the time-varying dynamics that accompany motor adaptation, and the uniqueness of every individual’s response to the assistance given by the robot. To this day, these devices have not met their well-known promise yet, mostly due to the fact that they are not perfectly suitable for the rehabilitation of neuropathologic patients. One of the main challenges hampering this goal still relies on the interface and co-dependency between the human and the machine. Nowadays, most commercial exoskeletons replay pre-defined gait patterns, whereas research exoskeletons are switching to controllers based on optimized torque profiles. In most cases, the dynamics of the human musculoskeletal system are still ignored and do not take into account the optimal conditions for inducing a positive modulation of neuromuscular activity. This is because both rehabilitation strategies are still emphasized on the macro level of the whole joint instead of focusing on the muscles’ dynamics and activity, which are the actual anatomical elements that may need to be rehabilitated. Strategies to keep the human in the loop of the exoskeleton’s control laws in real-time may help to overcome these challenges. The main purpose of the present dissertation is to make a paradigm shift in the approach on how the assistance that is given to a subject by an exoskeleton is modelled and controlled during physical rehabilitation. Therefore, in the scope of the present work, it was intended to design, concede, implement, and validate a real-time muscle-in-the-loop optimization model to find the best assistive support ratio that would induce optimal rehabilitation conditions to a specific group of impaired muscles while having a minimum impact on the other healthy muscles. The developed optimization model was implemented in the form of a plugin and was integrated on a neuromechanical model-based interface for driving a bilateral ankle exoskeleton. Experimental pilot tests evaluated the feasibility and effectiveness of the model. Results of the most significant pilots achieved EMG reductions up to 61 ± 3 % in Soleus and 41 ± 10 % in Gastrocnemius Lateralis. Moreover, results also demonstrated the efficiency of the optimization’s specific reduction on rehabilitation by looking into the muscular fatigue after each experiment. Finally, two parallel preliminary studies emerged from the pilots, which looked at muscle adaptation, after a new assistive condition had been applied, over time and at the effect of the lateral positioning of the exoskeleton’s actuators on the leg muscles.Auxiliar a locomoção humana com uma ortose robótica ainda é bastante desafiante, em grande parte devido à complexidade do sistema neuromusculoesquelético, à dinâmica variável no tempo que acompanha a adaptação motora e à singularidade da resposta de cada indivíduo à assistência dada pelo robô. Até hoje, está por cumprir a promessa inicial destes dispositivos, principalmente devido ao facto de não serem perfeitamente adequados para a reabilitação de pacientes neuropatológicos. Um dos principais desafios que dificultam esse objetivo foca-se ainda na interface e na co-dependência entre o ser humano e a máquina. Hoje em dia, a maioria dos exoesqueletos comerciais reproduz padrões de marcha predefinidos, enquanto que os exoesqueletos em investigação estão só agora a mudar para controladores com base em perfis de binário otimizados. Na maioria dos casos, a dinâmica do sistema musculoesquelético humano ainda é ignorada e não tem em consideração as condições ideais para induzir uma modulação positiva da atividade neuromuscular. Isso ocorre porque ambas as estratégias de reabilitação ainda são enfatizadas no nível macro de toda a articulação, em vez de se concentrar na dinâmica e atividade dos músculos, que são os elementos anatómicos que realmente precisam de ser reabilitados. Estratégias para manter o ser humano em loop nos comandos que controlam o exoesqueleto em tempo real podem ajudar a superar estes desafios. O principal objetivo desta dissertação é fazer uma mudança de paradigma na abordagem em como a assistência que é dada a um sujeito por um exosqueleto é modelada e controlada durante a reabilitação física. Portanto, no contexto do presente trabalho, pretendeu-se projetar, conceder, implementar e validar um modelo de otimização muscle-in-the-loop em tempo real para encontrar a melhor relação de suporte capaz de induzir as condições ideais de reabilitação para um grupo específico de músculos fragilizados, tendo um impacto mínimo nos outros músculos saudáveis. O modelo de otimização desenvolvido foi implementado na forma de um plugin e foi integrado numa interface baseada num modelo neuromecânico para o controlo de um exoesqueleto bilateral de tornozelo. Testes experimentais piloto avaliaram a viabilidade e a eficácia do modelo. Os resultados dos testes mais significativos demonstraram reduções de EMG de até 61 ± 3 % no Soleus e 41 ± 10 % no Gastrocnemius Lateral. Adicionalmente, os resultados demonstraram também a eficiência em reabilitação da redução específica no EMG devido à otimização tendo em conta a fadiga muscular após cada teste. Finalmente, dois estudos preliminares paralelos emergiram dos testes piloto, que analisaram a adaptação muscular após uma nova condição assistiva ter sido definida ao longo do tempo e o efeito do posicionamento lateral dos atuadores do exoesqueleto nos músculos da perna.Mestrado em Engenharia Biomédic

Design and tele-impedance control of a variable stiffness transradial hand prosthesis

According to theWorld Health Organization, only about the half of upper extremity amputees receive prosthetic limbs and only the half of this group consistently use their prosthetic limbs. The prominent reasons that hinder widespread adaptation of prosthetic devices are their high cost, non-intuitive control interface and insufficient dexterity for performing activities of daily living. This dissertation aims to address these challenges and presents the design, implementation, experimental characterization and human subject studies of a low cost, customizable, variable stiffness transradial hand prosthesis controlled through a natural human-machine interface. The transradial hand prosthesis features a low cost, robust, adaptive and lightweight design, thanks to its tendon-driven, under-actuated, compliant fingers and variable stiffness actuation. In particular, the underactuated compliant ngers feature high dexterity by naturally adapting to different object geometries and provide impact resistance. Antagonistically arranged Bowden-cable based variable stiffness actuation enables independent modulation of the impedance and position of the main tendon of prosthesis. Moreover, Bowden-cable based transmission allows for the actuator/ reduction/power module to be opportunistically placed remotely, away from the transradial hand prosthesis, helping significantly decrease the weight of the device. Furthermore, the transradial hand prosthesis, including the compliant fingers, can be implemented through simple and low-cost manufacturing processes, such as 3D printing, and each prosthesis can be customized to ensure an ideal fit to match the needs of the transradial amputee

Sensing, Design Optimization, and Motion Planning for Agile Pneumatic Artificial Muscle-Driven Robots

Mechanical compliance in robotic systems facilitates safe human-robot interaction and improves robot adaptation to environmental uncertainty. Several promising compliant actuator technologies have emerged from the field of soft robotics, in particular the pneumatic artificial muscle—a soft, lightweight actuator that contracts under pressure. The pneumatic muscle's passive compliance eliminates the need for precise high-bandwidth actuator control to simulate mechanical impedance. However, the pneumatic muscle is limited in practical robot applications—particularly, without sacrificing robot agility—due to several key challenges: development of compatible soft sensors, translation of conventional high-level control and planning techniques to pneumatic muscle-driven systems, and limitations in pneumatic muscle pressurization rate and force generation capabilities. This work seeks to address these challenges, via a threefold approach, to access the benefits of compliant robot actuation while maximizing the robot's dynamic capabilities. The first objective targets the development of a pneumatic muscle design with integrated sensing to enable kinematic and dynamic state estimation of muscle-actuated robots without hindering muscle compliance. The second objective focuses on the construction of a trajectory optimization framework for planning dynamic robot maneuvers using 'burst-inflation' muscle pressure control. Finally, the third objective explores a design optimization strategy utilizing biological joint mechanisms to compensate for pneumatic muscle limitations and maximize robot agility.Ph.D

Design, fabrication and control of soft robots

Conventionally, engineers have employed rigid materials to fabricate precise, predictable robotic systems, which are easily modelled as rigid members connected at discrete joints. Natural systems, however, often match or exceed the performance of robotic systems with deformable bodies. Cephalopods, for example, achieve amazing feats of manipulation and locomotion without a skeleton; even vertebrates such as humans achieve dynamic gaits by storing elastic energy in their compliant bones and soft tissues. Inspired by nature, engineers have begun to explore the design and control of soft-bodied robots composed of compliant materials. This Review discusses recent developments in the emerging field of soft robotics.National Science Foundation (U.S.) (Grant IIS-1226883

3D printed pneumatic soft actuators and sensors: their modeling, performance quantification, control and applications in soft robotic systems

Continued technological progress in robotic systems has led to more applications where robots and humans operate in close proximity and even physical contact in some cases. Soft robots, which are primarily made of highly compliant and deformable materials, provide inherently safe features, unlike conventional robots that are made of stiff and rigid components. These robots are ideal for interacting safely with humans and operating in highly dynamic environments. Soft robotics is a rapidly developing field exploiting biomimetic design principles, novel sensor and actuation concepts, and advanced manufacturing techniques. This work presents novel soft pneumatic actuators and sensors that are directly 3D printed in one manufacturing step without requiring postprocessing and support materials using low-cost and open-source fused deposition modeling (FDM) 3D printers that employ an off-the-shelf commercially available soft thermoplastic poly(urethane) (TPU). The performance of the soft actuators and sensors developed is optimized and predicted using finite element modeling (FEM) analytical models in some cases. A hyperelastic material model is developed for the TPU based on its experimental stress-strain data for use in FEM analysis. The novel soft vacuum bending (SOVA) and linear (LSOVA) actuators reported can be used in diverse robotic applications including locomotion robots, adaptive grippers, parallel manipulators, artificial muscles, modular robots, prosthetic hands, and prosthetic fingers. Also, the novel soft pneumatic sensing chambers (SPSC) developed can be used in diverse interactive human-machine interfaces including wearable gloves for virtual reality applications and controllers for soft adaptive grippers, soft push buttons for science, technology, engineering, and mathematics (STEM) education platforms, haptic feedback devices for rehabilitation, game controllers and throttle controllers for gaming and bending sensors for soft prosthetic hands. These SPSCs are directly 3D printed and embedded in a monolithic soft robotic finger as position and touch sensors for real-time position and force control. One of the aims of soft robotics is to design and fabricate robotic systems with a monolithic topology embedded with its actuators and sensors such that they can safely interact with their immediate physical environment. The results and conclusions of this thesis have significantly contributed to the realization of this aim

MODELLING AND CONTROL OF MULTI-FINGERED ROBOT HAND USING INTELLIGENT TECHNIQUES

Research and development of robust multi-fingered robot hand (MFRH) have been going on for more than three decades. Yet few can be found in an industrial application. The difficulties stem from many factors, one of which is that the lack of general and effective control techniques for the manipulation of robot hand. In this research, a MFRH with five fingers has been proposed with intelligent control algorithms. Initially, mathematical modeling for the proposed MFRH has been derived to find the Forward Kinematic, Inverse Kinematic, Jacobian, Dynamics and the plant model. Thereafter, simulation of the MFRH using PID controller, Fuzzy Logic Controller, Fuzzy-PID controller and PID-PSO controller has been carried out to gauge the system performance based parameters such rise time, settling time and percent overshoot

Modeling and nonlinear adaptive control of an aerial manipulation system

Autonomous aerial robots have become an essential part of many civilian and military applications. The workspace and agility of these vehicles motivated great research interest resulting in various studies addressing their control architectures and mechanical configurations. Increasing autonomy enabled them to perform tasks such as surveillance, inspection and remote sensing in hazardous and challenging environments. The ongoing research promises further contributions to the society, in both theory and practice. To furthermore extend their vast applications, aerial robots are equipped with the tools to enable physical interaction with the environment. These tasks represent a great challenge due to the technological limitations as well as the lack of sophisticated methods necessary for the control of the system to perform desired operations in an efficient and stable manner. Modeling and control problem of an aerial manipulation is still an open research topic with many studies addressing these issues from different perspectives. This thesis deals with the nonlinear adaptive control of an aerial manipulation system (AMS). The system consists of a quadrotor equipped with a 2 degrees of freedom (DOF) manipulator. The complete modeling of the system is done using the Euler-Lagrange method. A hierarchical nonlinear control structure which consists of outer and inner control loops has been utilized. Model Reference Adaptive Controller (MRAC) is designed for the outer loop where the required command signals are generated to force the quadrotor to move on a reference trajectory in the presence of mass uncertainties and reaction forces coming from the manipulator. For the inner loop, the attitude dynamics of the quadrotor and the joint dynamics of the 2-DOF robotic arm are considered as a fully actuated 5-DOF unified part of the AMS. Nonlinear adaptive control has been utilized for the low-level controller where the changes in inertias have been considered. The proposed controller is tested on a high fidelity AMS model in the presence of uncertainties, wind disturbances and measurement noise, and satisfactory trajectory tracking performance with improved robustness is achieved