Collision probability reduction method for tracking control in automatic docking/berthing using reinforcement learning

Automation of berthing maneuvers in shipping is a pressing issue as the berthing maneuver is one of the most stressful tasks seafarers undertake. Berthing control problems are often tackled by tracking a predefined trajectory or path. Maintaining a tracking error of zero under an uncertain environment is impossible; the tracking controller is nonetheless required to bring vessels close to desired berths. The tracking controller must prioritize the avoidance of tracking errors that may cause collisions with obstacles. This paper proposes a training method based on reinforcement learning for a trajectory tracking controller that reduces the probability of collisions with static obstacles. Via numerical simulations, we show that the proposed method reduces the probability of collisions during berthing maneuvers. Furthermore, this paper shows the tracking performance in a model experiment.The version of record of this article, first published in Journal of Marine Science and Technology (Japan), is available online at Publisher’s website: https://doi.org/10.1007/s00773-023-00962-

A Survey of Recent Machine Learning Solutions for Ship Collision Avoidance and Mission Planning

Machine Learning (ML) techniques have gained significant traction as a means of improving the autonomy of marine vehicles over the last few years. This article surveys the recent ML approaches utilised for ship collision avoidance (COLAV) and mission planning. Following an overview of the ever-expanding ML exploitation for maritime vehicles, key topics in the mission planning of ships are outlined. Notable papers with direct and indirect applications to the COLAV subject are technically reviewed and compared. Critiques, challenges, and future directions are also identified. The outcome clearly demonstrates the thriving research in this field, even though commercial marine ships incorporating machine intelligence able to perform autonomously under all operating conditions are still a long way off.Peer reviewe

A Survey of Recent Machine Learning Solutions for Ship Collision Avoidance and Mission Planning

Machine Learning (ML) techniques have gained significant traction as a means of improving the autonomy of marine vehicles over the last few years. This article surveys the recent ML approaches utilised for ship collision avoidance (COLAV) and mission planning. Following an overview of the ever-expanding ML exploitation for maritime vehicles, key topics in the mission planning of ships are outlined. Notable papers with direct and indirect applications to the COLAV subject are technically reviewed and compared. Critiques, challenges, and future directions are also identified. The outcome clearly demonstrates the thriving research in this field, even though commercial marine ships incorporating machine intelligence able to perform autonomously under all operating conditions are still a long way off

Automated Tugboat Assisted Docking of Large Vessels

The main research aspect behind this project was the problem in docking the ship to the port with limited space and resources available, causing number of onsite accidents and loss of resources. The main objective is to increase safety on ports, reduce pollution and increase fuel efficiency, also reduce the docking time for the vessels, which can be achieved by developing an autonomous docking system involving automated operations of tugboats, the port, and the vessel itself using control systems with limited involvement from human. This requires the development of a predictive control path for each component involved in the process. This is a long-term goal and requires a lot of research work and prototyping. In this thesis work, some studies will be carried out from past research work related to the problems focused on this project and the solutions provided to tackle these problems. Further data will be extracted along with all the essential equations and based on it; mathematical model will be developed as well as the development of path trajectory algorithm will be carried out. Also, its feasibility will be tested using simulation-based prototyping

Automatic Control and Routing of Marine Vessels

Due to the intensive development of the global economy, many problems are constantly emerging connected to the safety of ships’ motion in the context of increasing marine traffic. These problems seem to be especially significant for the further development of marine transportation services, with the need to considerably increase their efficiency and reliability. One of the most commonly used approaches to ensuring safety and efficiency is the wide implementation of various automated systems for guidance and control, including such popular systems as marine autopilots, dynamic positioning systems, speed control systems, automatic routing installations, etc. This Special Issue focuses on various problems related to the analysis, design, modelling, and operation of the aforementioned systems. It covers such actual problems as tracking control, path following control, ship weather routing, course keeping control, control of autonomous underwater vehicles, ship collision avoidance. These problems are investigated using methods such as neural networks, sliding mode control, genetic algorithms, L2-gain approach, optimal damping concept, fuzzy logic and others. This Special Issue is intended to present and discuss significant contemporary problems in the areas of automatic control and the routing of marine vessels

Underwater Vehicles

For the latest twenty to thirty years, a significant number of AUVs has been created for the solving of wide spectrum of scientific and applied tasks of ocean development and research. For the short time period the AUVs have shown the efficiency at performance of complex search and inspection works and opened a number of new important applications. Initially the information about AUVs had mainly review-advertising character but now more attention is paid to practical achievements, problems and systems technologies. AUVs are losing their prototype status and have become a fully operational, reliable and effective tool and modern multi-purpose AUVs represent the new class of underwater robotic objects with inherent tasks and practical applications, particular features of technology, systems structure and functional properties

State relativity and speed-allocated line-of-sight course control for path-following of underwater vehicles

Path-following is a primary task for most marine, air or space crafts, especially during autonomous operations. Research on autonomous underwater vehicles (AUV) has received large interests in the last few decades with research incentives emerging from the safe, cost-effective and practical solutions provided by their applications such as search and rescue, inspection and monitoring of pipe-lines ans sub-sea structures. This thesis presents a novel guidance system based on the popular line-of-sight (LOS) guidance law for path-following (PF) of underwater vehicles (UVs) subject to environmental disturbances. Mathematical modeling and dynamics of (UVs) is presented first. This is followed by a comprehensive literature review on guidance-based path-following control of marine vehicles, which includes revised definitions of the track-errors and more detailed illustrations of the general PF problem. A number of advances on relative equations of motion are made, which include an improved understanding of the fluid FLOW frame and expression of its motion states, an analytic method of modeling the signs of forces and moments and the proofs of passivity and boundedness of relative UV systems in 3-D. The revision in the relative equations of motion include the concept of state relativity, which is an improved understanding of relativity of motion states expressed in reference frames and is also useful in incorporating environmental disturbances. In addition, the concept of drift rate is introduced along with a revision on the angles of motion in 3-D. A switching mechanism was developed to overcome a drawback of a LOS guidance law, and the linear and nonlinear stability results of the LOS guidance laws have been provided, where distinctions are made between straight and curved PF cases. The guidance system employs the unique formulation and solution of the speed allocation problem of allocating a desired speed vector into x and y components, and the course control that employs the slip angle for desired heading for disturbance rejection. The guidance system and particularly the general course control problem has been extended to 3-D with the new definition of vertical-slip angle. The overall guidance system employing the revised relative system model, course control and speed allocation has performed well during path-following under strong ocean current and/or wave disturbances and measurement noises in both 2-D and 3-D scenarios. In 2-D and 3-D 4 degrees-of-freedom models (DOF), the common sway-underactuated and fully actuated cases are considered, and in 3-D 5-DOF model, sway and heave underactuated and fully actuated cases are considered. Stability results of the LOS guidance laws include the semi-global exponential stability (SGES) of the switching LOS guidance and enclosure-based LOS guidance for straight and curved paths, and SGES of the loolahead-based LOS guidance laws for curved paths. Feedback sliding mode and PID controllers are applied during PF providing a comparison between them, and simulations are carried out in MatLab

A COLLISION AVOIDANCE SYSTEM FOR AUTONOMOUS UNDERWATER VEHICLES

The work in this thesis is concerned with the development of a novel and practical collision avoidance system for autonomous underwater vehicles (AUVs). Synergistically, advanced stochastic motion planning methods, dynamics quantisation approaches, multivariable tracking controller designs, sonar data processing and workspace representation, are combined to enhance significantly the survivability of modern AUVs. The recent proliferation of autonomous AUV deployments for various missions such as seafloor surveying, scientific data gathering and mine hunting has demanded a substantial increase in vehicle autonomy. One matching requirement of such missions is to allow all the AUV to navigate safely in a dynamic and unstructured environment. Therefore, it is vital that a robust and effective collision avoidance system should be forthcoming in order to preserve the structural integrity of the vehicle whilst simultaneously increasing its autonomy. This thesis not only provides a holistic framework but also an arsenal of computational techniques in the design of a collision avoidance system for AUVs. The design of an obstacle avoidance system is first addressed. The core paradigm is the application of the Rapidly-exploring Random Tree (RRT) algorithm and the newly developed version for use as a motion planning tool. Later, this technique is merged with the Manoeuvre Automaton (MA) representation to address the inherent disadvantages of the RRT. A novel multi-node version which can also address time varying final state is suggested. Clearly, the reference trajectory generated by the aforementioned embedded planner must be tracked. Hence, the feasibility of employing the linear quadratic regulator (LQG) and the nonlinear kinematic based state-dependent Ricatti equation (SDRE) controller as trajectory trackers are explored. The obstacle detection module, which comprises of sonar processing and workspace representation submodules, is developed and tested on actual sonar data acquired in a sea-trial via a prototype forward looking sonar (AT500). The sonar processing techniques applied are fundamentally derived from the image processing perspective. Likewise, a novel occupancy grid using nonlinear function is proposed for the workspace representation of the AUV. Results are presented that demonstrate the ability of an AUV to navigate a complex environment. To the author's knowledge, it is the first time the above newly developed methodologies have been applied to an A UV collision avoidance system, and, therefore, it is considered that the work constitutes a contribution of knowledge in this area of work.J&S MARINE LT