Model-Based Control of Flying Robots for Robust Interaction under Wind Influence

Model-Based Control of Flying Robots for Robust Interaction under Wind Influence The main goal of this thesis is to bridge the gap between trajectory tracking and interaction control for flying robots in order to allow physical interaction under wind influence by making aerial robots aware of the disturbance, interaction, and faults acting on them. This is accomplished by reasoning about the external wrench (force and torque) acting on the robot, and discriminating (distinguishing) between wind, interactions, and collisions. This poses the following research questions. First, is discrimination between the external wrench components even possible in a continuous real-time fashion for control purposes? Second, given the individual wrench components, what are effective control schemes for interaction and trajectory tracking control under wind influence? Third, how can unexpected faults, such as collisions with the environment, be detected and handled efficiently and effectively? In the interest of the first question, a fourth can be posed: is it possible to obtain a measurement of the wind speed that is independent of the external wrench? In this thesis, model-based methods are applied in the pursuit of answers to these questions. This requires a good dynamics model of the robot, as well as accurately identified parameters. Therefore, a systematic parameter identification procedure for aerial robots is developed and applied. Furthermore, external wrench estimation techniques from the field of robot manipulators are extended to be suitable for aerial robots without the need of velocity measurements, which are difficult to obtain in this context. Based on the external wrench estimate, interaction control techniques (impedance and admittance control) are extended and applied to flying robots, and a thorough stability proof is provided. Similarly, the wrench estimate is applied in a geometric trajectory tracking controller to compensate external disturbances, to provide zero steady-state error under wind influence without the need of integral control action. The controllers are finally combined into a novel compensated impedance controller, to facilitate the main goal of the thesis. Collision detection is applied to flying robots, providing a low level reflex reaction that increases safety of these autonomous robots. In order to identify aerodynamic models for wind speed estimation, flight experiments in a three-dimensional wind tunnel were performed using a custom-built hexacopter. This data is used to investigate wind speed estimation using different data-driven aerodynamic models. It is shown that good performance can be obtained using relatively simple linear regression models. In this context, the propeller aerodynamic power model is used to obtain information about wind speed from available motor power measurements. Leveraging the wind tunnel data, it is shown that power can be used to obtain the wind speed. Furthermore, a novel optimization-based method that leverages the propeller aerodynamics model is developed to estimate the wind speed. Essentially, these two methods use the propellers as wind speed sensors, thereby providing an additional measurement independent of the external force. Finally, the novel topic of simultaneously discriminating between aerodynamic, interaction, and fault wrenches is opened up. This enables the implementation of novel types of controllers that are e.g. compliant to physical interaction, while compensating wind disturbances at the same time. The previously unexplored force discrimination topic has the potential to even open a new research avenue for flying robots

Robust Control of Nonlinear Systems with applications to Aerial Manipulation and Self Driving Cars

This work considers the problem of planning and control of robots in an environment with obstacles and external disturbances. The safety of robots is harder to achieve when planning in such uncertain environments. We describe a robust control scheme that combines three key components: system identification, uncertainty propagation, and trajectory optimization. Using this control scheme we tackle three problems. First, we develop a Nonlinear Model Predictive Controller (NMPC) for articulated rigid bodies and apply it to an aerial manipulation system to grasp object mid-air. Next, we tackle the problem of obstacle avoidance under unknown external disturbances. We propose two approaches, the first approach using adaptive NMPC with open- loop uncertainty propagation and the second approach using Tube NMPC. After that, we introduce dynamic models which use Artificial Neural Networks (ANN) and combine them with NMPC to control a ground vehicle and an aerial manipulation system. Finally, we introduce a software framework for integrating the above algorithms to perform complex tasks. The software framework provides users with the ability to design systems that are robust to control and hardware failures where preventive action is taken before-hand. The framework also allows for safe testing of control and task logic in simulation before evaluating on the real robot. The software framework is applied to an aerial manipulation system to perform a package sorting task, and extensive experiments demonstrate the ability of the system to recover from failures. In addition to robust control, we present two related control problems. The first problem pertains to designing an obstacle avoidance controller for an underactuated system that is Lyapunov stable. We extend a standard gyroscopic obstacle avoidance controller to be applicable to an underactuated system. The second problem addresses the navigation of an Unmanned Ground Vehicle (UGV) on an unstructured terrain. We propose using NMPC combined with a high fidelity physics engine to generate a reference trajectory that is dynamically feasible and accounts for unsafe areas in the terrain

ヘクサコプターのための耐故障制御と視覚に基づくナビゲーション

学位の種別:課程博士University of Tokyo(東京大学

UAV or Drones for Remote Sensing Applications in GPS/GNSS Enabled and GPS/GNSS Denied Environments

The design of novel UAV systems and the use of UAV platforms integrated with robotic sensing and imaging techniques, as well as the development of processing workflows and the capacity of ultra-high temporal and spatial resolution data, have enabled a rapid uptake of UAVs and drones across several industries and application domains.This book provides a forum for high-quality peer-reviewed papers that broaden awareness and understanding of single- and multiple-UAV developments for remote sensing applications, and associated developments in sensor technology, data processing and communications, and UAV system design and sensing capabilities in GPS-enabled and, more broadly, Global Navigation Satellite System (GNSS)-enabled and GPS/GNSS-denied environments.Contributions include:UAV-based photogrammetry, laser scanning, multispectral imaging, hyperspectral imaging, and thermal imaging;UAV sensor applications; spatial ecology; pest detection; reef; forestry; volcanology; precision agriculture wildlife species tracking; search and rescue; target tracking; atmosphere monitoring; chemical, biological, and natural disaster phenomena; fire prevention, flood prevention; volcanic monitoring; pollution monitoring; microclimates; and land use;Wildlife and target detection and recognition from UAV imagery using deep learning and machine learning techniques;UAV-based change detection

Game-Theoretic Safety Assurance for Human-Centered Robotic Systems

In order for autonomous systems like robots, drones, and self-driving cars to be reliably introduced into our society, they must have the ability to actively account for safety during their operation. While safety analysis has traditionally been conducted offline for controlled environments like cages on factory floors, the much higher complexity of open, human-populated spaces like our homes, cities, and roads makes it unviable to rely on common design-time assumptions, since these may be violated once the system is deployed. Instead, the next generation of robotic technologies will need to reason about safety online, constructing high-confidence assurances informed by ongoing observations of the environment and other agents, in spite of models of them being necessarily fallible.This dissertation aims to lay down the necessary foundations to enable autonomous systems to ensure their own safety in complex, changing, and uncertain environments, by explicitly reasoning about the gap between their models and the real world. It first introduces a suite of novel robust optimal control formulations and algorithmic tools that permit tractable safety analysis in time-varying, multi-agent systems, as well as safe real-time robotic navigation in partially unknown environments; these approaches are demonstrated on large-scale unmanned air traffic simulation and physical quadrotor platforms. After this, it draws on Bayesian machine learning methods to translate model-based guarantees into high-confidence assurances, monitoring the reliability of predictive models in light of changing evidence about the physical system and surrounding agents. This principle is first applied to a general safety framework allowing the use of learning-based control (e.g. reinforcement learning) for safety-critical robotic systems such as drones, and then combined with insights from cognitive science and dynamic game theory to enable safe human-centered navigation and interaction; these techniques are showcased on physical quadrotors—flying in unmodeled wind and among human pedestrians—and simulated highway driving. The dissertation ends with a discussion of challenges and opportunities ahead, including the bridging of safety analysis and reinforcement learning and the need to ``close the loop'' around learning and adaptation in order to deploy increasingly advanced autonomous systems with confidence

Safe Robot Planning and Control Using Uncertainty-Aware Deep Learning

In order for robots to autonomously operate in novel environments over extended periods of time, they must learn and adapt to changes in the dynamics of their motion and the environment. Neural networks have been shown to be a versatile and powerful tool for learning dynamics and semantic information. However, there is reluctance to deploy these methods on safety-critical or high-risk applications, since neural networks tend to be black-box function approximators. Therefore, there is a need for investigation into how these machine learning methods can be safely leveraged for learning-based controls, planning, and traversability. The aim of this thesis is to explore methods for both establishing safety guarantees as well as accurately quantifying risks when using deep neural networks for robot planning, especially in high-risk environments. First, we consider uncertainty-aware Bayesian Neural Networks for adaptive control, and introduce a method for guaranteeing safety under certain assumptions. Second, we investigate deep quantile regression learning methods for learning time-and-state varying uncertainties, which we use to perform trajectory optimization with Model Predictive Control. Third, we introduce a complete framework for risk-aware traversability and planning, which we use to enable safe exploration of extreme environments. Fourth, we again leverage deep quantile regression and establish a method for accurately learning the distribution of traversability risks in these environments, which can be used to create safety constraints for planning and control.Ph.D