Nonlinear Control Strategies for Outdoor Aerial Manipulators

In this thesis, the design, validation and implementation of nonlinear control strategies for aerial manipulators {i.e. aerial robots equipped with manipulators{ is studied, with special emphasis on the internal coupling of the system and its resilience against external disturbances. For the rst, di erent decentralised control strategies {i.e. using di erent control typologies for each one of the subsystems{ that indirectly take into account this coupling have been analysed. As a result, a nonlinear strategy composed of two controllers is proposed. A higher priority is given to the manipulation accuracy, relaxing the platform tracking, and hence obtaining a solution improving the manipulation capabilities with the surrounding environment. To validate these results, thorough stability and robustness analyses are provided, both theoretically and in simulation. On the other hand, a signi cant e ort has been devoted to improving the response and applicability of robot manipulators used in ight via control. In particular, the design of controllers for lightweight exible manipulators {that reduce the consequences of incidents involving unforeseen contacts{ is analysed. Although their inherent nature perfectly ts for aerial manipulation applications, the added exibility produces unwanted behaviours, such as second-order modes and uncertainties. To cope with them, an adaptable position nonlinear control strategy is proposed. To validate this contribution, the stability of the approach is studied in theory and its capabilities are proven in several experimental scenarios. In these, the robustness of the solution against unforeseen impacts and contact with uncharacterised interfaces is demonstrated. Subsequently, this strategy has been enriched with {multiaxis{ force control capabilities thanks to the inclusion of an outer control loop modifying the manipulator reference. Accordingly, this additional applicationfocused capability is added to the controlled system without loosing the modulated response of the inner-loop position strategy. It is also worth noting that, thanks to the cascade-like nature of the modi cation, the transition between position and force control modes is inherently smooth and automatic. The stability of this expanded strategy has been theoretically analysed and the results validated in a set of experimental scenarios. To validate the rst nonlinear approach with realistic outdoor simulations before its implementation, a computational uid dynamics analysis has been performed to obtain an explicit model of the aerodynamic forces and torques applied to the blunt-body of the aerial platform in ight. The results of this study have been compared to the most common alternative nowadays, being highlighted that the proposed model signi cantly surpasses this option in terms of accuracy. Moreover, it is worth underscoring that this characterisation could be also employed in the future to develop control solutions with enhanced rejection capabilities against wind conditions. Finally, as the focus of this thesis is on the use of novel control strategies on real aerial manipulation outdoors to improve their accuracy while performing complex tasks, a modular autopilot solution to be able to implement them has been also developed. This general-purpose autopilot allows the implementation of new algorithms, and facilitates their theory-to-experimentation transition. Taking into account this perspective, the proposed tool employs the simple and widely-known MAS interface and the highly reliable PX4 autopilot as backup, thus providing a redundant approach to handle unexpected incidents in ight.En esta tesis se ha estudiado el diseño, validación e implementación de estrategias de control no lineales para robots manipuladores aéreos –esto es, robots aéreos equipados con un sistema de manipulación robótica–, dándose especial énfasis a las interacciones internas del sistema y a su resiliencia frente a efectos externos. Para lo primero, se han analizado diferentes estrategias de control descentralizado –es decir, que usan tipologías de control diferentes para cada uno de los subsistemas–, pero que tienen indirectamente en consideración la interacción entre manipulación y vuelo. Como resultado de esta línea, se propone una estretegia de control conformada por dos controladores. Estos se coordinan de tal forma que se le da prioridad a la manipulación sobre el seguimiento de posiciones del vehículo, produciéndose un sistema de control que mejora la precisión de las interacciones entre el sistema manipulador y el entorno. Para validar estos resultados, se ha analizado su estabilidad y robustez tanto teóricamente como mediante simulaciones numéricas. Por otro lado, se ha buscado mejorar la respuesta y aplicabilidad de los manipuladores que se usan en vuelo mediante su control. Dentro de esta tendencia, la tesis se ha centrado en el diseño de controladores para manipuladores ligeros flexibles, ya que estos permiten reducir el peso del sistema completo y reducen el riesgo de incidentes debidos a contactos inesperados. Sin embargo, la flexibilidad de estos produce comportamientos indeseados durante la operación, como la aparición de modos de segundo orden y cierta incentidumbre en su comportamiento. Para reducir su impacto en la precisión de las tareas de manipulación, se ha desarrollado un controlador no lineal adaptable. Para validar estos resultados, se ha analizado la estabilidad del sistema teóricamente y se han desarrollado una serie de experimentos. En ellos, se ha comprobado su robustez ante impactos inesperados y contactos con elementos no caracterizados. Posteriormente, esta estrategia para manipuladores flexibles ha sido ampliada al añadir un bucle externo que posibilita el control en fuerzas en varias direcciones. Esto permite, mediante un único controlador, mantener la suave respuesta de la estrategia. Además cabe destacar que, al contar esta estrategia con un diseño en cascade, la transición entre los segmentos de desplazamiento del brazo y de aplicación de fuerzas es fluida y automática. La estabilidad de esta estrategia ampliada ha sido analizada teóricamente y los resultados han sido validados experimentalmente. Para validar la primera estrategia mediante simulaciones que representen fielmente las condiciones en exteriores antes de su implementación, ha sido necesario realizar un estudio mediante mecánica de fluidos computacional para obtener un modelo explícito de las fuerzas y momentos aerodinámicos a los que se efrenta la plataforma en vuelo. Los resultados de este estudio han sido comparados con la alternativa más empleada actualmente, mostrándose que los avances del método propuesto son sustanciales. Asimismo, es importante destacar que esta caracterización podría también usarse en el futuro para desarrollar controladores con una respuesta mejorada ante perturbaciones aerodinámicas, como en el caso de volar con viento. Finalmente, al ser esta una tesis centrada en las estrategias de control novedosas en sistemas reales para la mejora de su rendimiento en misiones complejas, se ha desarrollado un autopiloto modular fácilmente modificable para implementarlas. Este permite validar experimentalmente nuevos algoritmos y facilita la transición entre teoría y práctica. Para ello, esta herramienta se basa en una interfaz sencilla ampliamente conocida por los investigadores de robótica, Simulink®, y cuenta con un autopiloto de respaldo, PX4, para enfrentarse a los incidentes inesperados que pudieran surgir en vuelo

Design and Implementation of a Robot Force and Motion Server

A robot manipulator is a force and motion server for a robot. The robot, interpreting sensor information in terms of a world model and a task plan, issues instructions to the manipulator to carry out tasks. The control of a manipulator first involves motion trajectory generation needed when the manipulator is instructed to move to desired positions. The procedure of generating the trajectory must be flexible and efficient. When the manipulator comes into contact with the environment such as during assembly, it must be able to comply with the geometric constraints presented by the contact in order to perform tasks successfully. The control strategies for motion and compliance are executed in real time by the control computer, which must be powerful enough to carry out the necessary computations. This thesis first presents an efficient method for manipulator motion planning. Two fundamental modes of motion, Cartesian and joint, are considered and transition between motion segments is uniformly treated to obtain an efficient and simple system. A modified hybrid control method for manipulator compliance is then proposed and implemented. The method overcomes the problems existing in previous approaches such as stiffness control and hybrid control. Finally, a controller architecture is studied to distribute computations into a number of processors to satisfy the computational requirement in a cost-effective manner. The implementation using Intel\u27s single board computers is also discussed. Finally, to demonstrate the system, the motion trajectory. and the modified forced/motion control scheme are implemented on the controller and a PUMA 260 manipulator controlled from a multi-user VAX/Unix system through an Ethernet interface

Automatic programming of arc welding robots

Automatic programming of arc welding robots requires the geometric description of a part from a solid modeling system, expert weld process knowledge and the kinematic arrangement of the robot and positioner automatically. Current commercial solid modelers are incapable of storing explicitly product and process definitions of weld features. This work presents a paradigm to develop a computer-aided engineering environment that supports complete weld feature information in a solid model and create an automatic programming system for robotic arc welding;In the first part, welding features are treated as properties or attributes of an object, features which are portions of the object surface--the topological boundary. The structure for representing the features and attributes is a graph called the Welding Attribute Graph (WAGRAPH). The method associates appropriate weld features to geometric primitives, adds welding attributes, and checks the validity of welding specifications. A systematic structure is provided to incorporate welding attributes and coordinate system information in a CSG tree. The specific implementation of this structure using an hybrid solid modeler (IDEAS) and an object-oriented programming paradigm is described;The second part provides a comprehensive methodology to acquire and represent weld process knowledge required for the proper selection of welding schedules. A methodology of knowledge acquisition using statistical methods is proposed. It is shown that these procedures did little to capture the private knowledge of experts (heuristics), but helped in determining general dependencies, and trends. A need was established for building the knowledge-based system using handbook knowledge and to allow the experts further to build the system. A methodology to check the consistency and validity for such knowledge addition is proposed. A mapping shell designed to transform the design features to application specific weld process schedules is described;A new approach using fixed path modified continuation methods is proposed in the final section to plan continuously the trajectory of weld seams in an integrated welding robot and positioner environment. The joint displacement, velocity, and acceleration histories all along the path as a function of the path parameter for the best possible welding condition are provided for the robot and the positioner to track various paths normally encountered in arc welding

Path and Motion Planning for Autonomous Mobile 3D Printing

Autonomous robotic construction was envisioned as early as the ‘90s, and yet, con- struction sites today look much alike ones half a century ago. Meanwhile, highly automated and efficient fabrication methods like Additive Manufacturing, or 3D Printing, have seen great success in conventional production. However, existing efforts to transfer printing technology to construction applications mainly rely on manufacturing-like machines and fail to utilise the capabilities of modern robotics. This thesis considers using Mobile Manipulator robots to perform large-scale Additive Manufacturing tasks. Comprised of an articulated arm and a mobile base, Mobile Manipulators, are unique in their simultaneous mobility and agility, which enables printing-in-motion, or Mobile 3D Printing. This is a 3D printing modality, where a robot deposits material along larger-than-self trajectories while in motion. Despite profound potential advantages over existing static manufacturing-like large- scale printers, Mobile 3D printing is underexplored. Therefore, this thesis tack- les Mobile 3D printing-specific challenges and proposes path and motion planning methodologies that allow this printing modality to be realised. The work details the development of Task-Consistent Path Planning that solves the problem of find- ing a valid robot-base path needed to print larger-than-self trajectories. A motion planning and control strategy is then proposed, utilising the robot-base paths found to inform an optimisation-based whole-body motion controller. Several Mobile 3D Printing robot prototypes are built throughout this work, and the overall path and motion planning strategy proposed is holistically evaluated in a series of large-scale 3D printing experiments

Model-Based Robot Control and Multiprocessor Implementation

Model-based control of robot manipulators has been gaining momentum in recent years. Unfortunately there are very few experimental validations to accompany simulation results and as such majority of conclusions drawn lack the credibility associated with the real control implementation

Locomotion training of legged robots using hybrid machine learning techniques

In this study artificial neural networks and fuzzy logic are used to control the jumping behavior of a three-link uniped robot. The biped locomotion control problem is an increment of the uniped locomotion control. Study of legged locomotion dynamics indicates that a hierarchical controller is required to control the behavior of a legged robot. A structured control strategy is suggested which includes navigator, motion planner, biped coordinator and uniped controllers. A three-link uniped robot simulation is developed to be used as the plant. Neurocontrollers were trained both online and offline. In the case of on-line training, a reinforcement learning technique was used to train the neurocontroller to make the robot jump to a specified height. After several hundred iterations of training, the plant output achieved an accuracy of 7.4%. However, when jump distance and body angular momentum were also included in the control objectives, training time became impractically long. In the case of off-line training, a three-layered backpropagation (BP) network was first used with three inputs, three outputs and 15 to 40 hidden nodes. Pre-generated data were presented to the network with a learning rate as low as 0.003 in order to reach convergence. The low learning rate required for convergence resulted in a very slow training process which took weeks to learn 460 examples. After training, performance of the neurocontroller was rather poor. Consequently, the BP network was replaced by a Cerebeller Model Articulation Controller (CMAC) network. Subsequent experiments described in this document show that the CMAC network is more suitable to the solution of uniped locomotion control problems in terms of both learning efficiency and performance. A new approach is introduced in this report, viz., a self-organizing multiagent cerebeller model for fuzzy-neural control of uniped locomotion is suggested to improve training efficiency. This is currently being evaluated for a possible patent by NASA, Johnson Space Center. An alternative modular approach is also developed which uses separate controllers for each stage of the running stride. A self-organizing fuzzy-neural controller controls the height, distance and angular momentum of the stride. A CMAC-based controller controls the movement of the leg from the time the foot leaves the ground to the time of landing. Because the leg joints are controlled at each time step during flight, movement is smooth and obstacles can be avoided. Initial results indicate that this approach can yield fast, accurate results

Development and Characterization of Velocity Workspaces for the Human Knee.

The knee joint is the most complex joint in the human body. A complete understanding of the physical behavior of the joint is essential for the prevention of injury and efficient treatment of infirmities of the knee. A kinematic model of the human knee including bone surfaces and four major ligaments was studied using techniques pioneered in robotic workspace analysis. The objective of this work was to develop and test methods for determining displacement and velocity workspaces for the model and investigate these workspaces. Data were collected from several sources using magnetic resonance imaging (MRI) and computed tomography (CT). Geometric data, including surface representations and ligament lengths and insertions, were extracted from the images to construct the kinematic model. Fixed orientation displacement workspaces for the tibia relative to the femur were computed using ANSI C programs and visualized using commercial personal computer graphics packages. Interpreting the constraints at a point on the fixed orientation displacement workspace, a corresponding velocity workspace was computed based on extended screw theory, implemented using MATLAB(TM), and visually interpreted by depicting basis elements. With the available data and immediate application of the displacement workspace analysis to clinical settings, fixed orientation displacement workspaces were found to hold the most promise. Significant findings of the velocity workspace analysis include the characterization of the velocity workspaces depending on the interaction of the underlying two-systems of the constraint set, an indication of the contributions from passive constraints to force closure of the joint, computational means to find potentially harmful motions within the model, and realistic motions predicted from solely geometric constraints. Geometric algebra was also investigated as an alternative method of representing the underlying mathematics of the computations with promising results. Recommendations for improving and continuing the research may be divided into three areas: the evolution of the knee model to allow a representation for cartilage and the menisci to be used in the workspace analysis, the integration of kinematic data with the workspace analysis, and the development of in vivo data collection methods to foster validation of the techniques outlined in this dissertation

Motion Planning for Manipulation With Heuristic Search

Heuristic searches such as A* search are a popular means of finding least-cost plans due to their generality, strong theoretical guarantees on completeness and optimality, simplicity in implementation, and consistent behavior. In planning for robotic manipulation, however, these techniques are commonly thought of as impractical due to the high-dimensionality of the planning problem. As part of this thesis work, we have developed a heuristic search-based approach to motion planning for manipulation that does deal effectively with the high-dimensionality of the problem. In this thesis, I will present the approach together with its theoretical properties and show how to apply it to single-arm and dual-arm motion planning with upright constraints on a PR2 robot operating in non-trivial cluttered spaces. Then I will explain how we extended our approach to manipulation planning for n-arms with regrasping. In this work, the planner itself makes all of the discrete decisions, including which arm to use for the pickup and putdown, whether handoffs are necessary and how the object should be grasped at each step along the way. An extensive experimental analysis in both simulation and on a physical PR2 shows that, in terms of runtime, our approach is on par with some of the most common sampling-based approaches. This includes benchmarking our planning framework on two domains that we constructed that are common to manufacturing: pick-and-place of fast moving objects and the autonomous assembly of small objects. Between these applications, the planner exhibited fast planning times and the ability to robustly plan paths into and out of tight working environments that are common to assembly. The closing work of this thesis includes an exhaustive study of the natural tradeoff that occurs between planning efficiency versus solution quality for different values of the heuristic inflation factor. A comparison of the solution quality of our planner to paths computed by an asymptotically optimal approach given a great deal of time for path optimization is included as well. Finally, a set of experimental results are included that show that due to our approach\u27s deterministic cost-minimization, similar input tends to lead to similarity in the output. This kind of local consistency is important to the predictability of the robot\u27s motions and contributes to human-robot safety