A Contribution to the Design of Highly Redundant Compliant Aerial Manipulation Systems

Es ist vorhersehbar, dass die Luftmanipulatoren in den nächsten Jahrzehnten für viele Aufgaben eingesetzt werden, die entweder zu gefährlich oder zu teuer sind, um sie mit herkömmlichen Methoden zu bewältigen. In dieser Arbeit wird eine neuartige Lösung für die Gesamtsteuerung von hochredundanten Luftmanipulationssystemen vorgestellt. Die Ergebnisse werden auf eine Referenzkonfiguration angewendet, die als universelle Plattform für die Durchführung verschiedener Luftmanipulationsaufgaben etabliert wird. Diese Plattform besteht aus einer omnidirektionalen Drohne und einem seriellen Manipulator. Um den modularen Regelungsentwurf zu gewährleisten, werden zwei rechnerisch effiziente Algorithmen untersucht, um den virtuellen Eingang den Aktuatorbefehlen zuzuordnen. Durch die Integration eines auf einem künstlichen neuronalen Netz basierenden Diagnosemoduls und der rekonfigurierbaren Steuerungszuordnung in den Regelkreis, wird die Fehlertoleranz für die Drohne erzielt. Außerdem wird die Motorsättigung durch Rekonfiguration der Geschwindigkeits- und Beschleunigungsprofile behandelt. Für die Beobachtung der externen Kräfte und Drehmomente werden zwei Filter vorgestellt. Dies ist notwendig, um ein nachgiebiges Verhalten des Endeffektors durch die achsenselektive Impedanzregelung zu erreichen. Unter Ausnutzung der Redundanz des vorgestellten Luftmanipulators wird ein Regler entworfen, der nicht nur die Referenz der Endeffektor-Bewegung verfolgt, sondern auch priorisierte sekundäre Aufgaben ausführt. Die Wirksamkeit der vorgestellten Lösungen wird durch umfangreiche Tests überprüft, und das vorgestellte Steuerungssystem wird als sehr vielseitig und effektiv bewertet.:1 Introduction 2 Fundamentals 3 System Design and Modeling 4 Reconfigurable Control Allocation 5 Fault Diagnostics For Free Flight 6 Force and Torque Observer 7 Trajectory Generation 8 Hybrid Task Priority Control 9 System Integration and Performance Evaluation 10 ConclusionIn the following decades, aerial manipulators are expected to be deployed in scenarios that are either too dangerous for human beings or too expensive to be accomplished by traditional methods. This thesis presents a novel solution for the overall control of highly redundant aerial manipulation systems. The results are applied to a reference configuration established as a universal platform for performing various aerial manipulation tasks. The platform consists of an omnidirectional multirotor UAV and a serial manipulator. To ensure modular control design, two computationally efficient algorithms are studied to allocate the virtual input to actuator commands. Fault tolerance of the aerial vehicle is achieved by integrating a diagnostic module based on an artificial neural network and the reconfigurable control allocation into the control loop. Besides, the risk of input saturation of individual rotors is minimized by predicting and reconfiguring the speed and acceleration responses. Two filter-based observers are presented to provide the knowledge of external forces and torques, which is necessary to achieve compliant behavior of the end-effector through an axis-selective impedance control in the outer loop. Exploiting the redundancy of the proposed aerial manipulator, the author has designed a control law to achieve the desired end-effector motion and execute secondary tasks in order of priority. The effectiveness of the proposed designs is verified with extensive tests generated by following Monte Carlo method, and the presented control scheme is proved to be versatile and effective.:1 Introduction 2 Fundamentals 3 System Design and Modeling 4 Reconfigurable Control Allocation 5 Fault Diagnostics For Free Flight 6 Force and Torque Observer 7 Trajectory Generation 8 Hybrid Task Priority Control 9 System Integration and Performance Evaluation 10 Conclusio

Advanced Feedback Linearization Control for Tiltrotor UAVs: Gait Plan, Controller Design, and Stability Analysis

Three challenges, however, can hinder the application of Feedback Linearization: over-intensive control signals, singular decoupling matrix, and saturation. Activating any of these three issues can challenge the stability proof. To solve these three challenges, first, this research proposed the drone gait plan. The gait plan was initially used to figure out the control problems in quadruped (four-legged) robots; applying this approach, accompanied by Feedback Linearization, the quality of the control signals was enhanced. Then, we proposed the concept of unacceptable attitude curves, which are not allowed for the tiltrotor to travel to. The Two Color Map Theorem was subsequently established to enlarge the supported attitude for the tiltrotor. These theories were employed in the tiltrotor tracking problem with different references. Notable improvements in the control signals were witnessed in the tiltrotor simulator. Finally, we explored the control theory, the stability proof of the novel mobile robot (tilt vehicle) stabilized by Feedback Linearization with saturation. Instead of adopting the tiltrotor model, which is over-complicated, we designed a conceptual mobile robot (tilt-car) to analyze the stability proof. The stability proof (stable in the sense of Lyapunov) was found for a mobile robot (tilt vehicle) controlled by Feedback Linearization with saturation for the first time. The success tracking result with the promising control signals in the tiltrotor simulator demonstrates the advances of our control method. Also, the Lyapunov candidate and the tracking result in the mobile robot (tilt-car) simulator confirm our deductions of the stability proof. These results reveal that these three challenges in Feedback Linearization are solved, to some extents.Comment: Doctoral Thesis at The University of Toky

A Geometric Approach to Trajectory Planning for Underactuated Mechanical Systems

In the last decade, multi-rotors flying robots had a rapid development in industry and hobbyist communities thanks to the affordable cost and their availability of parts and components. The high number of degrees of freedom and the challenging dynamics of multi-rotors gave rise to new research problems. In particular, we are interested in the development of technologies for an autonomous fly that would al- low using multi-rotors systems to be used in contexts where the presence of humans is denied, for example in post-disaster areas or during search-and-rescue operations. Multi-rotors are an example of a larger category of robots, called \u201cunder-actuated mechanical systems\u201d (UMS) where the number of actuated degrees of freedom (DoF) is less than the number of available DoF. This thesis applies methods com- ing from geometric mechanics to study the under-actuation problem and proposes a novel method, based on the Hamiltonian formalism, to plan a feasible trajectory for UMS. We first show the application of a method called \u201cVariational Constrained System approach\u201d to a cart-pole example. We discovered that it is not possible to extend this method to generic UMS because it is valid only for a sub-class of UMS, called \u201csuper-articulated\u201d mechanical system. To overcome this limitation, we wrote the Hamilton equations of the quad- rotor and we apply a numerical \u201cdi- rect method\u201d to compute a feasible trajectory that satisfies system and endpoint constraints. We found that by including the system energy in the multi-rotor states, we are able to compute maneuvers that cannot be planned with other methods and that overcome the under-actuation constraints. To demonstrate the benefit of the method developed, we built a custom quad- rotor and an experimental setup with different obstacles, such as a gap in a wall and we show the correctness of the trajectory computed with the new method

Contributions to Open Problems on Cable Driven Robots and Persistent Manifolds for the Synthesis of Mechanisms

Although many efforts are continuously devoted to the advancement of robotics, there are still many open and unresolved problems to be faced. This thesis, therefore, sets out to tackle some of them with the aim of scratching the surface and look a little further for new ideas or solutions. The topics covered are mainly two. The first part deals with the development and improvement of control techniques for cable-driven robots. The second focuses on the study of persistent manifolds seen as constituting aspects of theoretical kinematics. In detail, -Part I deals with cable-driven platforms. In it, both techniques for selecting cable tensions and the design of a robust controller are developed. The aim is, therefore, to enhance the two building blocks of the overall control scheme in order to improve the performance of these robots during the execution of tracking tasks. -- The first chapter introduces to open problems and recalls the main concepts necessary to understand the following chapters; -- the contribution of the second chapter consists of the introduction of the Analytic Centre. It allows the generation of continuous and differentiable tension profiles while taking into account non-linear phenomena such as friction in the computation of tensions to be applied; -- the third chapter, although still at a preliminary stage, introduces sensitivity for tension calculation methods, offering perspectives of considerable interest for tension control in the current scientific context; -- the fourth chapter proposes the design of an adaptive controller. It allows external disturbances and/or uncertainties in the model to be faced such that the task can be performed with as little error as possible. The controller architecture is the innovative peculiarity conferring autonomy to cable systems. Initially applied to counteract wind in aerial systems it is now also used for cable breakage scenarios; -- the conclusions, at first, draw together the results obtained. In addition, they emphasise the lack of the techniques introduced in order to outline possible future paths and topics that need further investigation. - Part II delves into theoretical kinematics. The discovery and classification of invariant screw systems shed light on numerous aspects of robot mobility and synthesis. Nevertheless, this generated the emergence of new ideas and questions that are still unresolved. Among them, one of the more notable concerns the identification and classification of 5-dimensional persistent manifolds. -- Similarly to the first part, the first chapter provides an overview of the problems addressed and the theoretical notions necessary to understand the subsequent contributions; -- the second chapter contributes by directly tackling the above-mentioned question by exploiting the properties of dual quaternions, the Study quadric and differential geometry. A library of 5-persistent varieties, so far missing in the literature, is presented along with theorems that complete and generalise previous ones in the literature; -- an original work, concerning line motions and synthesis of mechanisms that generate them, is reported in the third chapter as a spin-off of the studies on persistent manifolds; -- the conclusions wrap up the obtained results trying to highlight gaps and deficiencies to be dealt with in the future. Here, two small sections are dedicated to ongoing works regarding the persistence definition and the screw systems' invariants and subvariants

Modeling the Human Visuo-Motor System for Remote-Control Operation

University of Minnesota Ph.D. dissertation. 2018. Major: Computer Science. Advisors: Nikolaos Papanikolopoulos, Berenice Mettler. 1 computer file (PDF); 172 pages.Successful operation of a teleoperated miniature rotorcraft relies on capabilities including guidance, trajectory following, feedback control, and environmental perception. For many operating scenarios fragile automation systems are unable to provide adequate performance. In contrast, human-in-the-loop systems demonstrate an ability to adapt to changing and complex environments, stability in control response, high level goal selection and planning, and the ability to perceive and process large amounts of information. Modeling the perceptual processes of the human operator provides the foundation necessary for a systems based approach to the design of control and display systems used by remotely operated vehicles. In this work we consider flight tasks for remotely controlled miniature rotorcraft operating in indoor environments. Operation of agile robotic systems in three dimensional spaces requires a detailed understanding of the perceptual aspects of the problem as well as knowledge of the task and models of the operator response. When modeling the human-in-the-loop the dynamics of the vehicle, environment, and human perception-action are tightly coupled in space and time. The dynamic response of the overall system emerges from the interplay of perception and action. The main questions to be answered in this work are: i) what approach does the human operator implement when generating a control and guidance response? ii) how is information about the vehicle and environment extracted by the human? iii) can the gaze patterns of the pilot be decoded to provide information for estimation and control? In relation to existing research this work differs by focusing on fast acting dynamic systems in multiple dimensions and investigating how the gaze can be exploited to provide action-relevant information. To study human-in-the-loop systems the development and integration of the experimental infrastructure is described. Utilizing the infrastructure, a theoretical framework for computational modeling of the human pilot’s perception-action is proposed and verified experimentally. The benefits of the human visuo-motor model are demonstrated through application examples where the perceptual and control functions of a teleoperation system are augmented to reduce workload and provide a more natural human-machine interface

Mobile Robots Control and Path Planning Strategies

Mobile robots gained lots of attention in the last decades. Because of its flexibility and increased capabilities of automation, mobile robots are used in many applications: from domotic, to search and rescue missions, to agriculture, environment protection and many more. The main capability of mobile robots to accomplish a mission is the mobility in the work environment. To move in a certain environment the robots should achieve: guidance, navigation and control. This thesis focuses on guidance and control of mobile robots, with application to certain classes of robots: Vertical Take Off and Landing Unmanned Aerial Vehicles (VTOL UAV) and Differential Wheel robots (DWR). The contribution of this thesis is on modeling and control of the two classes of robots, and on novel strategies of combined control and motion planning for kinodynamic systems. A new approach to model a class of multi-propeller VTOL is proposed, with the aim of generating a general model for a system as a composition of elementary modules such as actuators and payloads. Two control law for VTOL vehicles and DWR are proposed. The goal of the first is to generate a simple yet powerful control to globally asymptotically stabilize a VTOL for acrobatic maneuvers. The second is a simple saturated input control law for trajectory tracking of a DWR model in 2D. About planning, a novel approach to generate non-feasible trajectories for robots that still guarantees a correct path for kinodynamic planning is proposed. The goal is to reduce the runtime of planners to be used in real-time and realistic scenario. Moreover an innovative framework for mobile robots motion planning with the use of Discrete Event Systems theory is introduced. The two proposed approaches allow to build a global, robust, real-time, quasi-optimal, kinodynamic planner suitable for replanning

Adaptive Control For Autonomous Navigation Of Mobile Robots Considering Time Delay And Uncertainty

Autonomous control of mobile robots has attracted considerable attention of researchers in the areas of robotics and autonomous systems during the past decades. One of the goals in the field of mobile robotics is development of platforms that robustly operate in given, partially unknown, or unpredictable environments and offer desired services to humans. Autonomous mobile robots need to be equipped with effective, robust and/or adaptive, navigation control systems. In spite of enormous reported work on autonomous navigation control systems for mobile robots, achieving the goal above is still an open problem. Robustness and reliability of the controlled system can always be improved. The fundamental issues affecting the stability of the control systems include the undesired nonlinear effects introduced by actuator saturation, time delay in the controlled system, and uncertainty in the model. This research work develops robustly stabilizing control systems by investigating and addressing such nonlinear effects through analytical, simulations, and experiments. The control systems are designed to meet specified transient and steady-state specifications. The systems used for this research are ground (Dr Robot X80SV) and aerial (Parrot AR.Drone 2.0) mobile robots. Firstly, an effective autonomous navigation control system is developed for X80SV using logic control by combining ‘go-to-goal’, ‘avoid-obstacle’, and ‘follow-wall’ controllers. A MATLAB robot simulator is developed to implement this control algorithm and experiments are conducted in a typical office environment. The next stage of the research develops an autonomous position (x, y, and z) and attitude (roll, pitch, and yaw) controllers for a quadrotor, and PD-feedback control is used to achieve stabilization. The quadrotor’s nonlinear dynamics and kinematics are implemented using MATLAB S-function to generate the state output. Secondly, the white-box and black-box approaches are used to obtain a linearized second-order altitude models for the quadrotor, AR.Drone 2.0. Proportional (P), pole placement or proportional plus velocity (PV), linear quadratic regulator (LQR), and model reference adaptive control (MRAC) controllers are designed and validated through simulations using MATLAB/Simulink. Control input saturation and time delay in the controlled systems are also studied. MATLAB graphical user interface (GUI) and Simulink programs are developed to implement the controllers on the drone. Thirdly, the time delay in the drone’s control system is estimated using analytical and experimental methods. In the experimental approach, the transient properties of the experimental altitude responses are compared to those of simulated responses. The analytical approach makes use of the Lambert W function to obtain analytical solutions of scalar first-order delay differential equations (DDEs). A time-delayed P-feedback control system (retarded type) is used in estimating the time delay. Then an improved system performance is obtained by incorporating the estimated time delay in the design of the PV control system (neutral type) and PV-MRAC control system. Furthermore, the stability of a parametric perturbed linear time-invariant (LTI) retarded type system is studied. This is done by analytically calculating the stability radius of the system. Simulation of the control system is conducted to confirm the stability. This robust control design and uncertainty analysis are conducted for first-order and second-order quadrotor models. Lastly, the robustly designed PV and PV-MRAC control systems are used to autonomously track multiple waypoints. Also, the robustness of the PV-MRAC controller is tested against a baseline PV controller using the payload capability of the drone. It is shown that the PV-MRAC offers several benefits over the fixed-gain approach of the PV controller. The adaptive control is found to offer enhanced robustness to the payload fluctuations

비선형 최적화를 이용한 멀티로터 현수 운송의 경로 계획 및 제어 기법

학위논문(박사) -- 서울대학교대학원 : 공과대학 기계항공공학부, 2021.8. 김현진.경로 계획과 제어는 안전하고 안정적으로 멀티로터를 운용하기 위해서 필수적인 요소이다. 충돌을 회피하며 효율적인 경로를 생성하고 이를 실제로 추종하기 위해서는 동역학 모델이 고려되어야 한다. 일반 멀티로터의 동역학 모델은 높은 차원을 가진 비선형식으로 표현되는데, 현수 운송 물체를 추가할 경우 계산이 더욱 복잡해진다. 본 논문은 멀티로터를 이용한 현수 운송에 있어 경로 계획과 제어에 대한 효율적인 기법을 제안한다. 첫 번째로 단일 멀티로터를 이용한 현수 운송을 다룬다. 물체가 별도의 엑츄에이터 없이 운송될 경우 물체는 기체의 움직임에 의해서만 제어가 가능하다. 하지만, 동역학식의 높은 비선형성으로 운용에 어려움이 존재한다. 이를 경감시키기 위해서 회전 동역학식의 비선형성을 줄이고 자세 제어에 존재하는 시간 지연을 고려하여 동역학식을 간소화한다. 경로 계획에 있어서는 충돌 회피를 위해 기체, 케이블, 그리고 운송 물체를 다른 크기와 모양을 가진 타원체들로 감싸며, 효과적이면서도 덜 보수적인 방식으로 충돌 회피 구속조건을 부과한다. Augmented Lagrangian 방법을 이용하여 비선형 구속조건이 부과된 비선형 문제를 실시간 최적화하여 경로를 생성한다. 생성된 경로를 추종하기 위해서 Sequential linear quadratic 솔버를 이용한 모델 예측 제어기로 최적 제어 입력을 계산한다. 제안된 기법은 여러 시뮬레이션과 실험을 통해 검증한다. 다음으로, 다중 멀티로터를 이용한 협업 현수 운송 시스템을 다룬다. 해당 시스템의 상태 변수나 동역학식에서 연결된(coupled) 항의 개수는 기체의 수에 비례하여 증가하기 때문에, 효과적인 기법 없이는 최적화에 많은 시간이 소요된다. 높은 비선형성을 가진 동역학식의 복잡성을 낮추기 위하여 미분 평탄성을 사용한다. 경로 또한 piece-wise Bernstein 다항식을 이용하여 매개변수화하여 최적화 변수의 개수를 줄인다. 최적화 문제를 분해하고 충돌 회피 구속조건들에 대해 볼록화(convexification)를 수행하여 운송 물체의 경로와 장력의 경로에 대한 볼록한(convex) 하위문제들이 만들어진다. 첫 번째 하위문제인 물체 경로 생성에서는, 장애물 회피와 멀티로터의 공간을 확보하기 위하여 안전 비행 통로(safe flight corridor, SFC)와 여유 간격 구속조건을 고려하여 최적화한다. 다음으로, 장력 벡터들의 경로는 장애물 회피와 상호 충돌을 방지하기 위하여 안전 비행 섹터(safe flight sector, SFS)와 상대 안전 비행 섹터(relative safe flight sector, RSFS) 구속조건을 부과하여 최적화한다. 시뮬레이션과 실험으로 복잡한 환경에서 효율적인 경로 계획 기법을 시연하며 검증한다.Trajectory generation and control are fundamental requirements for safe and stable operation of multi-rotors. The dynamic model should be considered to generate efficient and collision-free trajectories with feasibility. While the dynamic model of a bare multi-rotor is expressed non-linearly with high dimensions which results in computational loads, the suspended load increases the complexity further. This dissertation presents efficient algorithms for trajectory generation and control of multi-rotors with a suspended load. A single multi-rotor with a suspended load is addressed first. Since the load is suspended through a cable without any actuator, movement of the load must be controlled via maneuvers of the multi-rotor. However, the highly non-linear dynamics of the system results in difficulties. To relive them, the rotational dynamics is simplified to reduce the non-linearity and consider the delay in attitude control. For trajectory generation, the vehicle, cable, and load are considered as ellipsoids with different sizes and shapes, and collision-free constraints are expressed in an efficient and less-conservative way. The augmented Lagrangian method is applied to solve a nonlinear optimization problem with nonlinear constraints in real-time. Model predictive control with the sequential linear quadratic solver is used to track the generated trajectories. The proposed algorithm is validated with several simulations and experiment. A system with multiple multi-rotors for cooperative transportation of a suspended load is addressed next. As the system has more state variables and coupling terms in the dynamic equation than the system with a single multi-rotor, optimization takes a long time without an efficient method. The differential flatness of the system is used to reduce the complexity of the highly non-linear dynamic equation. The trajectories are also parameterized using piece-wise Bernstein polynomials to decrease the number of optimization variables. By decomposing an optimization problem and performing convexification, convex sub-problems are formulated for the load and the tension trajectories optimization, respectively. In each sub-problem, a light-weight sampling method is used to find a feasible and low-cost trajectory as initialization. In the first sub-problem, the load trajectory is optimized with safe flight corridor (SFC) and clearance constraints for collision avoidance and security of space for the multi-rotors. Then, the tension histories are optimized with safe flight sector (SFS) and relative safe flight sector (RSFS) constraints for obstacle and inter-agent collision avoidance. Simulations and experiments are conducted to demonstrate efficient trajectory generation in a cluttered environment and validate the proposed algorithms.Chapter 1 Introduction 1 1.1 Literature Survey 5 1.2 Contributions 9 1.3 Outline 10 Chapter 2 Single Multi-rotor with a Suspended Load 11 2.1 Dynamics 11 2.2 Trajectory Generation 23 2.3 Optimal Control 31 Chapter 3 Multiple Multi-rotors with a Suspended Load 36 3.1 Problem Setting 36 3.2 Load Trajectory Generation 45 3.3 Tension History Generation 54 Chapter 4 Experimental Validation 68 4.1 Single Multi-rotor with a Suspended Load 68 4.2 Multiple Multi-rotors with a Suspended Load 79 Chapter 5 Conclusion 100 Appendix A Detailed Derivation of Dierential Flatness 102 B Preliminaries of Bernstein Polynomials 108 B.1 Denition of a Bernstein Polynomial 108 B.2 Convex hull property of a Bernstein Polynomial 110 B.3 Representation of a General Polynomial with Bernstein Basis Polynomials 111 B.4 Representation of the Derivative of a Bernstein Polynomial with Bernstein Basis Polynomials 112 References 113 Abstract (in Korean) 119박

Reinforcement Learning and Planning for Preference Balancing Tasks

Robots are often highly non-linear dynamical systems with many degrees of freedom, making solving motion problems computationally challenging. One solution has been reinforcement learning (RL), which learns through experimentation to automatically perform the near-optimal motions that complete a task. However, high-dimensional problems and task formulation often prove challenging for RL. We address these problems with PrEference Appraisal Reinforcement Learning (PEARL), which solves Preference Balancing Tasks (PBTs). PBTs define a problem as a set of preferences that the system must balance to achieve a goal. The method is appropriate for acceleration-controlled systems with continuous state-space and either discrete or continuous action spaces with unknown system dynamics. We show that PEARL learns a sub-optimal policy on a subset of states and actions, and transfers the policy to the expanded domain to produce a more refined plan on a class of robotic problems. We establish convergence to task goal conditions, and even when preconditions are not verifiable, show that this is a valuable method to use before other more expensive approaches. Evaluation is done on several robotic problems, such as Aerial Cargo Delivery, Multi-Agent Pursuit, Rendezvous, and Inverted Flying Pendulum both in simulation and experimentally. Additionally, PEARL is leveraged outside of robotics as an array sorting agent. The results demonstrate high accuracy and fast learning times on a large set of practical applications