Marine Vehicle Sensor Network Architecture and Protocol Designs for Ocean Observation

The micro-scale and meso-scale ocean dynamic processes which are nonlinear and have large variability, have a significant impact on the fisheries, natural resources, and marine climatology. A rapid, refined and sophisticated observation system is therefore needed in marine scientific research. The maneuverability and controllability of mobile sensor platforms make them a preferred choice to establish ocean observing networks, compared to the static sensor observing platform. In this study, marine vehicles are utilized as the nodes of mobile sensor networks for coverage sampling of a regional ocean area and ocean feature tracking. A synoptic analysis about marine vehicle dynamic control, multi vehicles mission assignment and path planning methods, and ocean feature tracking and observing techniques is given. Combined with the observation plan in the South China Sea, we provide an overview of the mobile sensor networks established with marine vehicles, and the corresponding simulation results

Distributed allocation of mobile sensing swarms in gyre flows

We address the synthesis of distributed control policies to enable a swarm of homogeneous mobile sensors to maintain a desired spatial distribution in a geophysical flow environment, or workspace. In this article, we assume the mobile sensors (or robots) have a "map" of the environment denoting the locations of the Lagrangian coherent structures or LCS boundaries. Based on this information, we design agent-level hybrid control policies that leverage the surrounding fluid dynamics and inherent environmental noise to enable the team to maintain a desired distribution in the workspace. We establish the stability properties of the ensemble dynamics of the distributed control policies. Since realistic quasi-geostrophic ocean models predict double-gyre flow solutions, we use a wind-driven multi-gyre flow model to verify the feasibility of the proposed distributed control strategy and compare the proposed control strategy with a baseline deterministic allocation strategy. Lastly, we validate the control strategy using actual flow data obtained by our coherent structure experimental testbed.Comment: 10 pages, 14 Figures, added reference

Simultaneous AUV navigation and tracking with satellite ASVs

The navigation of Autonomous Underwater Vehicles (AUV) presents a series of challenges, being the location due to the inaccessibility of GPS signal one of them. A solution is the use of several surface vehicles equipped with hydrophones to locate and track an AUV that emits an acoustic signal. This Master’s Thesis addresses this solution with the objective to optimize the energy consumption of 2 Autonomous Surface Vehicles (ASV) while maintaining a preferred geometry of the formation to reduce the uncertainty of the position estimation of the AUV. To control these surface vehicles, 2 approaches of Reinforcement Learning (RL) have been implemented, Deep Deterministic Policy Gradient (DDPG) and Multi-Agent Deep Deter- ministic Policy Gradient (MADDPG). The aim of using these 2 algorithms is to test if the inclusion of the multi-agent element is necessary in this case. The RL algorithms control the linear and angular velocities of each robot. The environment used for the training of the robots is created specifically for this project using Python. A weighted sum of Gaussian functions is designed for the reward function, which contains all the elements related to the optimization of energy consumption and the formation of the AUV. To analyse several aspects of the final models of each robot a total of 4 different tests were done. These tests focus on the analysis of the distribution of the weights in the reward func- tion and the ability to adapt to difficult scenarios. The tests are done as simulations. The re- sults show that the ASVs trained with these implementations of RL modify their behaviour depending on the weight configuration and can adapt to more difficult scenarios depending on aspects of the training such as the noise applied to the actions. Moreover, the performance between the DDPG and MADDPG is compared. A discussion with similar works that have treated this problem is done using the final results

A Data-Driven Intermittent Online Coverage Path Planning Method for AUV-Based Bathymetric Mapping

Bathymetric mapping with Autonomous Underwater Vehicles (AUVs) receives increased attentions in recent years. AUVs offer a lower operational cost and smaller carbon footprint with reduced ship usage, and they can provide higher resolution data when surveying the seabed at a closer distance if compared to ships. However, advancements are still needed to improve the data quality of AUV-based surveys. Unlike mobile robots with deterministic mapping performance, multibeam sonars used in AUV-based bathymetric mapping often yields inconsistent swath width due to the varied seabed elevation and surficial properties. As a result, mapping voids may exist between planned lawnmower transects. Although this could be solved by planning closer lawnmower paths, mission time increases proportionally. Therefore, an onboard path planner is demanded to assure the defined survey objective, i.e., coverage rate. Here in this paper, we present a new data-driven coverage path planning (CPP) method, in which the vehicle automatically updates the waypoints intermittently based on an objective function constructed using the information about the exploration preference, sonar performance, and coverage efficiency. The goal of the proposed method is to plan a cost-effective path on-the-fly to obtain high quality mapping result meeting the requirements in coverage rate and uncertainty. The proposed CPP method has been evaluated in a simulated environment with a 6DOF REMUS AUV model and a realistic seafloor topography. A series of trials has been conducted to investigate the performance affected by the parameters in the objective function. We also compared the proposed method with traditional lawnmower and spiral paths. The results show that the weight assignment in the objective function is critical as they affect the overall survey performance. With proper weight settings, the AUV yields better survey performance, coverage rate and coverage efficiency, compared to traditional approaches. Moreover, the proposed method can be easily adjusted or modified to achieve different coverage goals, such as rapid data gathering of the entire region, survey of irregular workspace, or maintaining real time path planning

통합형 무인 수상선-케이블-수중선 시스템의 다물체동역학 거동 및 제어

Underwater exploration is becoming more and more important, since a vast range of unknown resources in the deep ocean remain undeveloped. This dissertation thus presents a modeling of the coupled dynamics of an Unmanned Surface Vehicle (USV) system with an Underwater Vehicles (UV) connected by an underwater cable (UC). The complexity of this multi-body dynamics system and ocean environments is very difficult to model. First, for modeling this, dynamics analysis was performed on each subsystem and further total coupled system dynamics were studied. The UV which is towed by a UC is modeled with 6-DOF equations of motion that reflects its hydrodynamic characteristic was studied. The 4th-order Runge–Kutta numerical method was used to analyze the motion of the USV with its hydrodynamic coefficients which were obtained through experiments and from the literature. To analyze the effect of the UC, the complicated nonlinear and coupled UC dynamics under currents forces, the governing equations of the UC dynamics are established based on the catenary equation method, then it is solved by applying the shooting method. The new formulation and solution of the UC dynamics yields the three dimensional position and forces of the UC end point under the current forces. Also, the advantage of the proposed method is that the catenary equations using shooting method can be solved in real time such that the calculated position and forces of UC according to time can be directly utilized to calculate the UV motion. The proposed method offers advantages of simple formulation, convenient use, and fast calculation time with exact result. Some simple numerical simulations were conducted to observe the dynamic behaviors of AUV with cable effects. The simulations results clearly reveal that the UC can greatly influence the motions of the vehicles, especially on the UV motions. Based on both the numerical model and simulation results developed in the dissertation, we may offer some valuable information for the operation of the UV and USV. Secondly, for the design controller, a PD controller and its application to automatic berthing control of USV are also studied. For this, a nonlinear mathematical model for the maneuvering of USV in the presence of environmental forces was firstly established. Then, in order to control rudder and propeller during automatic berthing process, a PD control algorithm is applied. The algorithm consists of two parts, the forward velocity control and heading angle control. The control algorithm was designed based on the longitudinal and yaw dynamic models of USV. The desired heading angle was obtained by the so-called “Line of Sight” method. To support the validity of the proposed method, the computer simulations of automatic USV berthing are carried out. The results of simulation showed good performance of the developed berthing control system. Also, a hovering-type AUV equipped with multiple thrusters should maintain the specified position and orientation in order to perform given tasks by applying a dynamic positioning (DP) system. Besides, the control allocation algorithm based on a scaling factor is presented for distributing the forces required by the control law onto the available set of actuators in the most effective and energy efficient way. Thus, it is necessary for the robust control algorithm to conduct successfully given missions in spite of a model uncertainty and a disturbance. In this dissertation, the robust DP control algorithm based on a sliding mode theory is also addressed to guarantee the stability and better performance despite the model uncertainty and disturbance of current and cable effects. Finally, a series of simulations are conducted to verify the availability of the generated trajectories and performance of the designed robust controller. Thirdly, for the navigation of UV, a method for designing the path tracking controller using a Rapidly-exploring Random Trees (RRT) algorithm is proposed. The RRT algorithm is firstly used for the generation of collision free waypoints. Next, the unnecessary waypoints are removed by a simple path pruning algorithm generating a piecewise linear path. After that, a path smoothing algorithm utilizing cubic Bezier spiral curves to generate a continuous curvature path that satisfies the minimum radius of curvature constraint of underwater is implemented. The angle between two waypoints is the only information required for the generation of the continuous curvature path. In order to underwater vehicle follow the reference path, the path tracking controller using the global Sliding Mode Control (SMC) approach is designed. To verify the performance of the proposed algorithm, some simulation results are performed. Simulation results showed that the RRT algorithm could be applied to generate an optimal path in a complex ocean environment with multiple obstacles.Acknowledgement .................................................................................................. vi Abstract……. ....................................................................................... ………….viii Nomenclature ....................................................................................................... xvi List of Abbreviations ........................................................................................... xxi List of Tables ...................................................................................................... xxiii List of Figures ..................................................................................................... xxiv Chapter 1: Introduction ......................................................................................... 1 1.1 Background .................................................................................................. 1 1.1.1 Unmanned Surface Vehicles (USVs) ...................................................... 1 1.1.2 Umbilical Cable ....................................................................................... 4 1.1.3 Unmanned Underwater Vehicles (UUVs) ............................................... 5 1.1.4 Literature on Modeling of Marine Vehicles ............................................ 9 1.1.5 Literature on Control and Guidance of Marine Vehicles ...................... 11 1.2 Our System Architecture ........................................................................... 12 1.3 Motivation ................................................................................................. 13 1.4 Contribution ............................................................................................... 16 1.5 Publications Associated to the Dissertation .............................................. 17 1.6 Structure of the Dissertation ...................................................................... 18 Chapter 2: Mathematical Model of Unmanned Surface Vehicle (USV) ......... 20 2.1 Basic Assumptions .................................................................................... 20 2.2 Three Coordinate Systems ......................................................................... 20 2.3 Variable Notation ...................................................................................... 22 2.4 Kinematics ................................................................................................. 23 2.5 Kinetics ...................................................................................................... 26 2.5.1 Rigid Body Equations of Motion ........................................................... 26 2.5.2 Hydrodynamic Forces and Moments ..................................................... 28 2.5.3 Restoring Forces and Moments ............................................................. 31 2.5.4 Environmental Disturbances .................................................................. 32 2.5.5 Propulsion Forces and Moments ........................................................... 35 2.6 Nonlinear 6DOF Dynamics ....................................................................... 35 2.7 Mathematical Model of USV in 3 DOF .................................................... 36 2.7.1 Planar Kinematics .................................................................................. 36 2.7.2 Planar Nonlinear 3 DOF Dynamics ....................................................... 38 2.8 Configuration of Thrusters ........................................................................ 40 2.9 General Structure and Model Parameters .................................................. 41 2.9.1 Structure of USV ................................................................................... 41 2.9.2 Control System of USV ......................................................................... 42 2.9.3 Winch Control System ........................................................................... 43 Chapter 3: Mathematical Model of the Umbilical Cable (UC) ........................ 45 3.1 Basic Assumptions for UC ........................................................................ 45 3.2 Analysis on Forces of UV ......................................................................... 47 3.3 Relation for UC Equilibrium ..................................................................... 50 3.4 Catenary Equation in the Space Case ........................................................ 51 3.5 Shooting Method ....................................................................................... 55 3.6 Boundary Conditions ................................................................................. 57 3.7 Cable Effects ............................................................................................. 58 3.8 Model Parameters and Simulation ............................................................. 59 Chapter 4: Mathematical Model of Underwater Vehicle (UV) ........................ 63 4.1 Background ................................................................................................ 63 4.1.1 Basic Assumptions................................................................................. 63 4.1.2 Reference Frames .................................................................................. 64 4.1.3 Notations ................................................................................................ 65 4.2 Kinematics Equations ................................................................................ 66 4.3 Kinetic Equations ...................................................................................... 67 4.3.1 Rigid-Body Kinetics .............................................................................. 67 4.3.2 Hydrostatic Terms ................................................................................. 69 4.3.3 Hydrodynamic Terms ............................................................................ 70 4.3.4 Actuator Modeling ................................................................................. 75 4.3.5 Umbilical Cable Forces ......................................................................... 75 4.4 Nonlinear Equations of Motion (6DOF) ................................................... 76 4.5 Simplification of UV Dynamic Model ...................................................... 77 4.5.1 Simplifying the Mass and Inertia Matrix ............................................... 78 4.5.2 Simplifying the Hydrodynamic Damping Matrix.................................. 79 4.5.3 Simplifying the Gravitational and Buoyancy Vector ............................ 80 4.6 Thruster Modeling ..................................................................................... 80 4.7 Current Modeling ...................................................................................... 83 4.8 Dynamic Model Including Ocean Currents ............................................... 84 4.9 Complete Motion Equations of AUV (6DOF) .......................................... 89 4.10 Dynamics Model Parameter Identification ................................................ 91 4.11 Numerical Solution for Equations of Motion ............................................ 93 4.12 General Structure and Model Parameters .................................................. 94 4.12.1 Structure of AUV ............................................................................... 94 4.12.2 Control System of AUV ..................................................................... 96 Chapter 5: Guidance Theory ............................................................................... 97 5.1 Configuration of GNC System .................................................................. 97 5.1.1 Guidance ................................................................................................ 98 5.1.2 Navigation .............................................................................................. 98 5.1.3 Control ................................................................................................... 98 5.2 Maneuvering Problem Statement .............................................................. 99 5.3 Guidance Objectives ................................................................................ 100 5.3.1 Target Tracking ................................................................................... 100 5.3.2 Trajectory Tracking ............................................................................. 100 5.4 Waypoint Representation ........................................................................ 101 5.5 Path Following ......................................................................................... 102 5.6 Line of Sight (LOS) Waypoint Guidance ................................................ 102 5.6.1 Enclosure-Based Steering .................................................................... 104 5.6.2 Look-ahead Based Steering ................................................................. 105 5.6.3 LOS Control......................................................................................... 106 5.7 Cubic Polynomial for Path-Following ..................................................... 107 Chapter 6: Control Algorithm Design and Analysis ....................................... 110 6.1 Proportional Integral Differential (PID) Controller ................................ 110 6.1.1 General Theory .................................................................................... 110 6.1.2 Stability of General PID Controller ..................................................... 112 6.1.3 PID Tuning .......................................................................................... 114 6.1.4 Nonlinear PID for Marine Vehicles ..................................................... 116 6.1.5 Nonlinear PD for Marine Vehicles ...................................................... 117 6.1.6 Stability of Designed PD Controller .................................................... 117 6.2 Sliding Mode Controller .......................................................................... 118 6.2.1 Tracking Error and Sliding Surface ..................................................... 119 6.2.2 Chattering Situation ............................................................................. 120 6.2.3 Control Law and Stability .................................................................... 121 6.3 Allocation Control ................................................................................... 124 6.3.1 Linear Quadratic Unconstrained Control Allocation Using Lagrange Multipliers ................................................................................................ 125 6.3.2 Thruster Allocation with a Constrained Linear Model ........................ 127 6.4 Simulation Results and Discussion ......................................................... 131 6.4.1 Berthing (parking) Control of USV ..................................................... 133 6.4.2 Motion Control of UV ......................................................................... 136 Chapter 7: Obstacle Avoidance and Path Planning for Vehicle Using Rapidly-Exploring Random Trees Algorithm.................................................................. 168 7.1 Path Planning and Guidance: Two Interrelated Problems ....................... 168 7.2 RRT Algorithm for Exploration .............................................................. 171 7.2.1 Random Node Selection ...................................................................... 172 7.2.2 Nearest Neighbor Node Selection ....................................................... 173 7.2.3 RRT Exploration with Obstacles ......................................................... 174 7.3 RRT Algorithm for Navigation of AUV ................................................. 176 7.3.1 Basic RRT Algorithm .......................................................................... 176 7.3.2 Biased-Greedy RRT Algorithm ........................................................... 178 7.3.3 Synchronized Biased-Greedy RRT Algorithm .................................... 179 7.4 Path Pruning ............................................................................................ 182 7.4.1 Path Pruning Using LOS ..................................................................... 182 7.4.2 Global Path Pruning ............................................................................. 183 7.5 Summarize the Proposed RRT Algorithm ............................................... 185 7.6 Simulation for Path Following of AUV .................................................. 187 Chapter 8: Simulation of Complete USV-UC-UV Systems ............................ 196 8.1 Simulation Procedure .............................................................................. 196 8.2 Simulation Results and Discussion ......................................................... 201 8.2.1 Dynamic Behaviors of Complete USV (Stable)-Cable- AUV (Turning Motion) ..................................................................................................... 201 8.2.2 Dynamic Behaviors of Complete USV (Forward motion)-Cable- AUV (Turning Motion) ...................................................................................... 207 8.2.3 Applied Controller to Complete USV -Cable- AUV ........................... 215 Chapter 9: Conclusions and Future Works ..................................................... 238 9.1 Modeling of Complete USV-Cable-AUV System .................................. 238 9.2 Motion Control ........................................................................................ 239 9.3 Cable Force and Moment at the Tow Points ........................................... 239 9.4 Path Planning ........................................................................................... 239 9.5 Future Works ........................................................................................... 240Docto

A Unified Task Priority Control Framework Design for Autonomous Underwater Vehicles

In this thesis, we investigate the problem of bringing various behaviours of Autonomous Underwater Vehicles under a common control framework. Thereby, we propose a unified guidance and control framework for AUVs based on the task priority control approach. This incorporate various behaviors such as path following, terrain following, obstacle avoidance, as well as homing and docking to stationary and moving docking stations. The integration of homing and docking maneuvers into the task priority framework is thus a novel contribution of this thesis. This integration allows, for example, to execute homing maneuvers close to uneven seafloor or obstacles, ensuring the safety of the AUV by giving the highest priority to the safety tasks. Furthermore, the proposed approach tackles a wide range of scenarios without ad hoc solutions. Indeed, the proposed approach is well suited for both the emerging trend of resident AUVs, which stay underwater for a long period inside garage stations, exiting to perform inspection and maintenance missions and homing back to them, and for AUVs that are required to dock to moving stations such as surface vehicles, or towed docking stations. The proposed techniques are further studied in a simulation setting, taking into account the rich number of aforementioned scenarios

Augmented Terrain-Based Navigation to Enable Persistent Autonomy for Underwater Vehicles in GPS-Denied Environments

Aquatic robots, such as Autonomous Underwater Vehicles (AUVs), play a major role in the study of ocean processes that require long-term sampling efforts and commonly perform navigation via dead-reckoning using an accelerometer, a magnetometer, a compass, an IMU and a depth sensor for feedback. However, these instruments are subjected to large drift, leading to unbounded uncertainty in location. Moreover, the spatio-temporal dynamics of the ocean environment, coupled with limited communication capabilities, make navigation and localization difficult, especially in coastal regions where the majority of interesting phenomena occur. To add to this, the interesting features are themselves spatio-temporally dynamic, and effective sampling requires a good understanding of vehicle localization relative to the sampled feature. Therefore, our work is motivated by the desire to enable intelligent data collection of complex dynamics and processes that occur in coastal ocean environments to further our understanding and prediction capabilities. The study originated from the need to localize and navigate aquatic robots in a GPS-denied environment and examine the role of the spatio-temporal dynamics of the ocean into the localization and navigation processes. The methods and techniques needed range from the data collection to the localization and navigation algorithms used on-board of the aquatic vehicles. The focus of this work is to develop algorithms for localization and navigation of AUVs in GPS-denied environments. We developed an Augmented terrain-based framework that incorporates physical science data, i.e., temperature, salinity, pH, etc., to enhance the topographic map that the vehicle uses to navigate. In this navigation scheme, the bathymetric data are combined with the physical science data to enrich the uniqueness of the underlying terrain map and increase the accuracy of underwater localization. Another technique developed in this work addresses the problem of tracking an underwater vehicle when the GPS signal suddenly becomes unavailable. The methods include the whitening of the data to reveal the true statistical distance between datapoints and also incorporates physical science data to enhance the topographic map. Simulations were performed at Lake Nighthorse, Colorado, USA, between April 25th and May 2nd 2018 and at Big Fisherman\u27s Cove, Santa Catalina Island, California, USA, on July 13th and July 14th 2016. Different missions were executed on different environments (snow, rain and the presence of plumes). Results showed that these two methodologies for localization and tracking work for reference maps that had been recorded within a week and the accuracy on the average error in localization can be compared to the errors found when using GPS if the time in which the observations were taken are the same period of the day (morning, afternoon or night). The whitening of the data had positive results when compared to localizing without whitening