AutoTrans: A Complete Planning and Control Framework for Autonomous UAV Payload Transportation

The robotics community is increasingly interested in autonomous aerial transportation. Unmanned aerial vehicles with suspended payloads have advantages over other systems, including mechanical simplicity and agility, but pose great challenges in planning and control. To realize fully autonomous aerial transportation, this paper presents a systematic solution to address these difficulties. First, we present a real-time planning method that generates smooth trajectories considering the time-varying shape and non-linear dynamics of the system, ensuring whole-body safety and dynamic feasibility. Additionally, an adaptive NMPC with a hierarchical disturbance compensation strategy is designed to overcome unknown external perturbations and inaccurate model parameters. Extensive experiments show that our method is capable of generating high-quality trajectories online, even in highly constrained environments, and tracking aggressive flight trajectories accurately, even under significant uncertainty. We plan to release our code to benefit the community.Comment: Accepted by IEEE Robotics and Automation Letter

Aggressive Quadrotor Flight through Narrow Gaps with Onboard Sensing and Computing using Active Vision

We address one of the main challenges towards autonomous quadrotor flight in complex environments, which is flight through narrow gaps. While previous works relied on off-board localization systems or on accurate prior knowledge of the gap position and orientation, we rely solely on onboard sensing and computing and estimate the full state by fusing gap detection from a single onboard camera with an IMU. This problem is challenging for two reasons: (i) the quadrotor pose uncertainty with respect to the gap increases quadratically with the distance from the gap; (ii) the quadrotor has to actively control its orientation towards the gap to enable state estimation (i.e., active vision). We solve this problem by generating a trajectory that considers geometric, dynamic, and perception constraints: during the approach maneuver, the quadrotor always faces the gap to allow state estimation, while respecting the vehicle dynamics; during the traverse through the gap, the distance of the quadrotor to the edges of the gap is maximized. Furthermore, we replan the trajectory during its execution to cope with the varying uncertainty of the state estimate. We successfully evaluate and demonstrate the proposed approach in many real experiments. To the best of our knowledge, this is the first work that addresses and achieves autonomous, aggressive flight through narrow gaps using only onboard sensing and computing and without prior knowledge of the pose of the gap

A Hybrid Control Approach for the Swing Free Transportation of a Double Pendulum with a Quadrotor

In this article, a control strategy approach is proposed for a system consisting of a quadrotor transporting a double pendulum. In our case, we attempt to achieve a swing free transportation of the pendulum, while the quadrotor closely follows a specific trajectory. This dynamic system is highly nonlinear, therefore, the fulfillment of this complex task represents a demanding challenge. Moreover, achieving dampening of the double pendulum oscillations while following a precise trajectory are conflicting goals. We apply a proportional derivative (PD) and a model predictive control (MPC) controllers for this task. Transportation of a multiple pendulum with an aerial robot is a step forward in the state of art towards the study of the transportation of loads with complex dynamics. We provide the modeling of the quadrotor and the double pendulum. For MPC we define the cost function that has to be minimized to achieve optimal control. We report encouraging positive results on a simulated environmentcomparing the performance of our MPC-PD control circuit against a PD-PD configuration, achieving a three fold reduction of the double pendulum maximum swinging angle.This work has been partially supported by FEDER funds through MINECO project TIN2017-85827-P, and project KK-202000044 of the Elkartek 2020 funding program of the Basque Government. This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 777720

Payload Grasping and Transportation by a Quadrotor with a Hook-Based Manipulator

The paper proposes an efficient trajectory planning and control approach for payload grasping and transportation using an aerial manipulator. The proposed manipulator structure consists of a hook attached to a quadrotor using a 1 DoF revolute joint. To perform payload grasping, transportation, and release, first, time-optimal reference trajectories are designed through specific waypoints to ensure the fast and reliable execution of the tasks. Then, a two-stage motion control approach is developed based on a robust geometric controller for precise and reliable reference tracking and a linear--quadratic payload regulator for rapid setpoint stabilization of the payload swing. The proposed control architecture and design are evaluated in a high-fidelity physical simulator with external disturbances and also in real flight experiments.Comment: Submitted to IEEE Robotics and Automation Letters (2023

Controlling a Quadrotor Carrying a Cable-Suspended Load to Pass Through a Window

In this paper, we design an optimal control system for a quadrotor to carry a cable-suspended load flying through a window. As the window is narrower than the length of the cable, it is very challenging to design a practical control system to pass through it. Our solution includes a system identification component, a trajectory generation component, and a trajectory tracking control component. The exact dynamic model that usually derived from the first principles is assumed to be unavailable. Instead, a model identification approach is adopted, which relies on a simple but effective low order equivalent system (LOES) to describe the core dynamical characteristics of the system. After being excited by some specifically designed manoeuvres, the unknown parameters in the LOES are obtained by using a frequency based least square estimation algorithm. Based on the estimated LOES, a numerical optimization algorithm is then utilized for aggressive trajectory generation when relevant constraints are given. The generated trajectory can lead to the quadrotor and load system passing through a narrow window with a cascade PD trajectory tracking controller. Finally, a practical flight test based on an Astec Hummingbird quadrotor is demonstrated and the result validates the proposed approach

Agile load transportation systems using aerial robots

In this dissertation, we address problems that can occur during load transport using aerial robots, i.e., small scale quadrotors. First, detailed models of such transportation system are derived. These models include nonlinear models of a quadrotor, a model of a quadrotor carrying a fixed load and a model of a quadrotor carrying a suspended load. Second, the problem of quadrotor stabilization and trajectory tracking with changes of the center of gravity of the transportation system is addressed. This problem is solved using model reference adaptive control based on output feedback linearization that compensates for dynamical changes in the center of gravity of the quadrotor. The third problem we address is a problem of a swing-free transport of suspended load using quadrotors. Flying with a suspended load can be a very challenging and sometimes hazardous task as the suspended load significantly alters the flight characteristics of the quadrotor. In order to deal with suspended load flight, we present a method based on dynamic programming which is a model based offline method. The second investigated method we use is based on the Nelder-Mead algorithm which is an optimization technique used for nonlinear unconstrained optimization problems. This method is model free and it can be used for offline or online generation of the swing-free trajectories for the suspended load. Besides the swing-free maneuvers with suspended load, load trajectory tracking is another problem we solve in this dissertation. In order to solve this problem we use a Nelder-Mead based algorithm. In addition, we use an online least square policy iteration algorithm. At the end, we propose a high level algorithm for navigation in cluttered environments considering a quadrotor with suspended load. Furthermore, distributed control of multiple quadrotors with suspended load is addressed too. The proposed hierarchical architecture presented in this doctoral dissertation is an important step towards developing the next generation of agile autonomous aerial vehicles. These control algorithms enable quadrotors to display agile maneuvers while reconfiguring in real time whenever a change in the center of gravity occurs. This enables a swing-free load transport or trajectory tracking of the load in urban environments in a decentralized fashion

비선형 최적화를 이용한 멀티로터 현수 운송의 경로 계획 및 제어 기법

학위논문(박사) -- 서울대학교대학원 : 공과대학 기계항공공학부, 2021.8. 김현진.경로 계획과 제어는 안전하고 안정적으로 멀티로터를 운용하기 위해서 필수적인 요소이다. 충돌을 회피하며 효율적인 경로를 생성하고 이를 실제로 추종하기 위해서는 동역학 모델이 고려되어야 한다. 일반 멀티로터의 동역학 모델은 높은 차원을 가진 비선형식으로 표현되는데, 현수 운송 물체를 추가할 경우 계산이 더욱 복잡해진다. 본 논문은 멀티로터를 이용한 현수 운송에 있어 경로 계획과 제어에 대한 효율적인 기법을 제안한다. 첫 번째로 단일 멀티로터를 이용한 현수 운송을 다룬다. 물체가 별도의 엑츄에이터 없이 운송될 경우 물체는 기체의 움직임에 의해서만 제어가 가능하다. 하지만, 동역학식의 높은 비선형성으로 운용에 어려움이 존재한다. 이를 경감시키기 위해서 회전 동역학식의 비선형성을 줄이고 자세 제어에 존재하는 시간 지연을 고려하여 동역학식을 간소화한다. 경로 계획에 있어서는 충돌 회피를 위해 기체, 케이블, 그리고 운송 물체를 다른 크기와 모양을 가진 타원체들로 감싸며, 효과적이면서도 덜 보수적인 방식으로 충돌 회피 구속조건을 부과한다. Augmented Lagrangian 방법을 이용하여 비선형 구속조건이 부과된 비선형 문제를 실시간 최적화하여 경로를 생성한다. 생성된 경로를 추종하기 위해서 Sequential linear quadratic 솔버를 이용한 모델 예측 제어기로 최적 제어 입력을 계산한다. 제안된 기법은 여러 시뮬레이션과 실험을 통해 검증한다. 다음으로, 다중 멀티로터를 이용한 협업 현수 운송 시스템을 다룬다. 해당 시스템의 상태 변수나 동역학식에서 연결된(coupled) 항의 개수는 기체의 수에 비례하여 증가하기 때문에, 효과적인 기법 없이는 최적화에 많은 시간이 소요된다. 높은 비선형성을 가진 동역학식의 복잡성을 낮추기 위하여 미분 평탄성을 사용한다. 경로 또한 piece-wise Bernstein 다항식을 이용하여 매개변수화하여 최적화 변수의 개수를 줄인다. 최적화 문제를 분해하고 충돌 회피 구속조건들에 대해 볼록화(convexification)를 수행하여 운송 물체의 경로와 장력의 경로에 대한 볼록한(convex) 하위문제들이 만들어진다. 첫 번째 하위문제인 물체 경로 생성에서는, 장애물 회피와 멀티로터의 공간을 확보하기 위하여 안전 비행 통로(safe flight corridor, SFC)와 여유 간격 구속조건을 고려하여 최적화한다. 다음으로, 장력 벡터들의 경로는 장애물 회피와 상호 충돌을 방지하기 위하여 안전 비행 섹터(safe flight sector, SFS)와 상대 안전 비행 섹터(relative safe flight sector, RSFS) 구속조건을 부과하여 최적화한다. 시뮬레이션과 실험으로 복잡한 환경에서 효율적인 경로 계획 기법을 시연하며 검증한다.Trajectory generation and control are fundamental requirements for safe and stable operation of multi-rotors. The dynamic model should be considered to generate efficient and collision-free trajectories with feasibility. While the dynamic model of a bare multi-rotor is expressed non-linearly with high dimensions which results in computational loads, the suspended load increases the complexity further. This dissertation presents efficient algorithms for trajectory generation and control of multi-rotors with a suspended load. A single multi-rotor with a suspended load is addressed first. Since the load is suspended through a cable without any actuator, movement of the load must be controlled via maneuvers of the multi-rotor. However, the highly non-linear dynamics of the system results in difficulties. To relive them, the rotational dynamics is simplified to reduce the non-linearity and consider the delay in attitude control. For trajectory generation, the vehicle, cable, and load are considered as ellipsoids with different sizes and shapes, and collision-free constraints are expressed in an efficient and less-conservative way. The augmented Lagrangian method is applied to solve a nonlinear optimization problem with nonlinear constraints in real-time. Model predictive control with the sequential linear quadratic solver is used to track the generated trajectories. The proposed algorithm is validated with several simulations and experiment. A system with multiple multi-rotors for cooperative transportation of a suspended load is addressed next. As the system has more state variables and coupling terms in the dynamic equation than the system with a single multi-rotor, optimization takes a long time without an efficient method. The differential flatness of the system is used to reduce the complexity of the highly non-linear dynamic equation. The trajectories are also parameterized using piece-wise Bernstein polynomials to decrease the number of optimization variables. By decomposing an optimization problem and performing convexification, convex sub-problems are formulated for the load and the tension trajectories optimization, respectively. In each sub-problem, a light-weight sampling method is used to find a feasible and low-cost trajectory as initialization. In the first sub-problem, the load trajectory is optimized with safe flight corridor (SFC) and clearance constraints for collision avoidance and security of space for the multi-rotors. Then, the tension histories are optimized with safe flight sector (SFS) and relative safe flight sector (RSFS) constraints for obstacle and inter-agent collision avoidance. Simulations and experiments are conducted to demonstrate efficient trajectory generation in a cluttered environment and validate the proposed algorithms.Chapter 1 Introduction 1 1.1 Literature Survey 5 1.2 Contributions 9 1.3 Outline 10 Chapter 2 Single Multi-rotor with a Suspended Load 11 2.1 Dynamics 11 2.2 Trajectory Generation 23 2.3 Optimal Control 31 Chapter 3 Multiple Multi-rotors with a Suspended Load 36 3.1 Problem Setting 36 3.2 Load Trajectory Generation 45 3.3 Tension History Generation 54 Chapter 4 Experimental Validation 68 4.1 Single Multi-rotor with a Suspended Load 68 4.2 Multiple Multi-rotors with a Suspended Load 79 Chapter 5 Conclusion 100 Appendix A Detailed Derivation of Dierential Flatness 102 B Preliminaries of Bernstein Polynomials 108 B.1 Denition of a Bernstein Polynomial 108 B.2 Convex hull property of a Bernstein Polynomial 110 B.3 Representation of a General Polynomial with Bernstein Basis Polynomials 111 B.4 Representation of the Derivative of a Bernstein Polynomial with Bernstein Basis Polynomials 112 References 113 Abstract (in Korean) 119박