Safe and accurate MAV Control, navigation and manipulation

This work focuses on the problem of precise, aggressive and safe Micro Aerial Vehicle (MAV) navigation as well as deployment in applications which require physical interaction with the environment. To address these issues, we propose three different MAV model based control algorithms that rely on the concept of receding horizon control. As a starting point, we present a computationally cheap algorithm which utilizes an approximate linear model of the system around hover and is thus maximally accurate for slow reference maneuvers. Aiming at overcoming the limitations of the linear model parameterisation, we present an extension to the first controller which relies on the true nonlinear dynamics of the system. This approach, even though computationally more intense, ensures that the control model is always valid and allows tracking of full state aggressive trajectories. The last controller addresses the topic of aerial manipulation in which the versatility of aerial vehicles is combined with the manipulation capabilities of robotic arms. The proposed method relies on the formulation of a hybrid nonlinear MAV-arm model which also takes into account the effects of contact with the environment. Finally, in order to enable safe operation despite the potential loss of an actuator, we propose a supervisory algorithm which estimates the health status of each motor. We further showcase how this can be used in conjunction with the nonlinear controllers described above for fault tolerant MAV flight. While all the developed algorithms are formulated and tested using our specific MAV platforms (consisting of underactuated hexacopters for the free flight experiments, hexacopter-delta arm system for the manipulation experiments), we further discuss how these can be applied to other underactuated/overactuated MAVs and robotic arm platforms. The same applies to the fault tolerant control where we discuss different stabilisation techniques depending on the capabilities of the available hardware. Even though the primary focus of this work is on feedback control, we thoroughly describe the custom hardware platforms used for the experimental evaluation, the state estimation algorithms which provide the basis for control as well as the parameter identification required for the formulation of the various control models. We showcase all the developed algorithms in experimental scenarios designed to highlight the corresponding strengths and weaknesses as well as show that the proposed methods can run in realtime on commercially available hardware.Open Acces

Nonlinear control of a nano-hexacopter carrying a manipulator arm

International audienceThis paper proposes a simple solution for stabilization of a nano-hexacopter carrying a manipulator arm in order to increase the type of missions achievable by these types of systems. The manipulator arm is attached to the lower part of the hexacopter. The motion of the arm induces a change of the center of mass of the whole body, which induces torques which can produce the loss of stability. The present work deals with the stabilization of the whole system-that is hexacopter and arm-by means of a set of nonlinear control laws. First, an attitude control, stabilizes the hexacopter to a desired attitude taking into account the movement of the arm. Then, a suitable virtual control and the translational dynamics allow the formulation of a nonlinear controller, which drives the aerial vehicle to a desired position. Both controls consist in saturation functions. Experimental results validate the proposed control strategy and compares the results when the motion of the arm is taken into account or not

On Aerial Robots with Grasping and Perching Capabilities: A Comprehensive Review

Over the last decade, there has been an increased interest in developing aerial robotic platforms that exhibit grasping and perching capabilities not only within the research community but also in companies across different industry sectors. Aerial robots range from standard multicopter vehicles/drones, to autonomous helicopters, and fixed-wing or hybrid devices. Such devices rely on a range of different solutions for achieving grasping and perching. These solutions can be classified as: 1) simple gripper systems, 2) arm-gripper systems, 3) tethered gripping mechanisms, 4) reconfigurable robot frames, 5) adhesion solutions, and 6) embedment solutions. Grasping and perching are two crucial capabilities that allow aerial robots to interact with the environment and execute a plethora of complex tasks, facilitating new applications that range from autonomous package delivery and search and rescue to autonomous inspection of dangerous or remote environments. In this review paper, we present the state-of-the-art in aerial grasping and perching mechanisms and we provide a comprehensive comparison of their characteristics. Furthermore, we analyze these mechanisms by comparing the advantages and disadvantages of the proposed technologies and we summarize the significant achievements in these two research topics. Finally, we conclude the review by suggesting a series of potential future research directions that we believe that are promising

An Omnidirectional Aerial Manipulation Platform for Contact-Based Inspection

This paper presents an omnidirectional aerial manipulation platform for robust and responsive interaction with unstructured environments, toward the goal of contact-based inspection. The fully actuated tilt-rotor aerial system is equipped with a rigidly mounted end-effector, and is able to exert a 6 degree of freedom force and torque, decoupling the system's translational and rotational dynamics, and enabling precise interaction with the environment while maintaining stability. An impedance controller with selective apparent inertia is formulated to permit compliance in certain degrees of freedom while achieving precise trajectory tracking and disturbance rejection in others. Experiments demonstrate disturbance rejection, push-and-slide interaction, and on-board state estimation with depth servoing to interact with local surfaces. The system is also validated as a tool for contact-based non-destructive testing of concrete infrastructure.Comment: Accepted submission to Robotics: Science and Systems conference 2019. 9 pages, 12 figure

Detection, location and grasping objects using a stereo sensor on UAV in outdoor environments

The article presents a vision system for the autonomous grasping of objects with Unmanned Aerial Vehicles (UAVs) in real time. Giving UAVs the capability to manipulate objects vastly extends their applications, as they are capable of accessing places that are difficult to reach or even unreachable for human beings. This work is focused on the grasping of known objects based on feature models. The system runs in an on-board computer on a UAV equipped with a stereo camera and a robotic arm. The algorithm learns a feature-based model in an offline stage, then it is used online for detection of the targeted object and estimation of its position. This feature-based model was proved to be robust to both occlusions and the presence of outliers. The use of stereo cameras improves the learning stage, providing 3D information and helping to filter features in the online stage. An experimental system was derived using a rotary-wing UAV and a small manipulator for final proof of concept. The robotic arm is designed with three degrees of freedom and is lightweight due to payload limitations of the UAV. The system has been validated with different objects, both indoors and outdoor

미지 환경에서의 안전 비행 운송을 위한 협업제어 및 경로생성 기법

학위논문 (박사)-- 서울대학교 대학원 공과대학 기계항공공학부, 2017. 8. 김현진.Recently, aerial manipulators using unmanned aerial vehicles (UAVs) are receiving attention due to their superior mobility in three-dimensional space. It can be applied to a wide range of applications such as inspection of hard-to-reach structure or aerial transportation. This dissertation presents a viable approach to safe aerial transportation in unknown environments by using multiple aerial manipulators. Unlike existing approaches for cooperative manipulation based on force decomposition or impedance-based control that often requ- ire heavy or expensive force/torque sensors, this dissertation suggests a method without such sensors, by exploiting the decoupled dynamics to develop estimation and control alg- orithms. With the decoupled dynamics and the assumption of rigid grasp, an online estimator is designed initially to estimate the mass and inertial properties of an unknown payload using the states of the aerial manipulator only. Stable adaptive controller based on the online estimated parameter is then designed using Lyapunov methods. Through simulations, the performance of the proposed controller is compared with conventional passivity-based adaptive algorithms. This dissertation also proposes a motion generation algorithm for cooperative manipulators to transport a payload safely. If the payload is excessively heavy in comparison with the transportation ability of an aerial robot, an aerial robot may crash because of actuation limits on the motors. As a first step, the allowable flight envelope is analyzed with respect to the position of the end-effector. In order to keep the end-effector in the allowable fight region, kinematic coordination between a payload and cooperative aerial manipulators is first studied. A two-layer framework, in which the first layer computes the motion reference of the end-effectors and the second layer calculates the joint motion of the corresponding manipulator, is then developed in a task-prioritized fashion. When generating aerial manipulator trajectories, the desired trajectory is calculated to satisfy the unilateral constraints obtained by the allowable flight envelope. This work also considers the obstacle avoidance of cooperative aerial manipulators in unknown environments. Using the relative distance between an aerial robot and an obstacle as measured by an RGB-D camera and point cloud library (PCL), dynamic movement primitives (DMPs) modify the desired trajectory. By having the leader robot detect an obstacle and the follower robots maintain a given relative distance with the leader, improved efficiency of obstacle avoidance for cooperative robots can be achieved. Finally, the proposed synthesis of estimation, control, and planning algorithms are validated with experiments using custom-made aerial manipulators combined with a two-DOF (Degree Of Freedom) robotic arm. The proposed method is validated with trajectory tracking using two types of payloads. Cooperative aerial transportation in unknown environments is also performed with an unknown obstacle. Both experimental results suggest that the proposed approach can be utilized for safe cooperative aerial transportation.1 Introduction 1 1.1 Background and Motivations 1 1.2 Literature Survey 4 1.2.1 Cooperative Manipulation 4 1.2.2 Handling an Unknown Object 7 1.2.3 Obstacle Avoidance for Cooperative Robots 8 1.3 Research Objectives and Contributions 9 1.3.1 Estimation and Control Algorithm 10 1.3.2 Motion Planning within the Allowable Flight Envelope 11 1.3.3 Real-time Obstacle Avoidance using an RGB-D Camera 11 1.4 Thesis Organization 12 2 Background 14 2.1 Dynamics for Cooperative Aerial Manipulator 14 2.1.1 Rigid Body Statics 15 2.1.2 Dynamics for Single Aerial Manipulator 16 2.1.3 Decoupled Dynamics 19 2.2 Task Priority 22 2.3 DMPs 24 3 Estimator and Controller Design 26 3.1 Payload Mass and Inertia Parameter Estimation 28 3.1.1 System Parametrization 28 3.1.2 On-line Parameter Estimator 29 3.1.3 Robust Analysis for Measurement Noise 32 3.2 Controller Design 34 3.3 Simulation Results 40 4 Path Planning 45 4.1 Allowable Payload for Each Aerial Manipulator 45 4.2 Trajectory Generation with Unilateral Constraints 49 4.2.1 End-eector Trajectory Generation 49 4.2.2 Inverse Kinematics with Null Space Approach 49 4.2.3 Task Prioritization with Unilateral Constraints 56 5 Obstacle Avoidance in Unknown Environments 60 5.1 Obstacle Detection 60 5.2 Movement Primitives for Cooperative Aerial Manipulators 64 6 Experimental Validation and Results 71 6.1 Simulation Validation for Moving Obstacle 71 6.2 Experimental Setup 74 6.3 Experiment for Cooperative Aerial Transportation 77 6.3.1 Path Following with Two Types of Payloads 77 6.3.2 Aerial Transportations in Unknown Environments 78 7 Conclusions 93 Abstract (in Korean) 105Docto