A Study on the Automatic Ship Control Based on Adaptive Neural Networks

Recently, dynamic models of marine ships are often required to design advanced control systems. In practice, the dynamics of marine ships are highly nonlinear and are affected by highly nonlinear, uncertain external disturbances. This results in parametric and structural uncertainties in the dynamic model, and requires the need for advanced robust control techniques. There are two fundamental control approaches to consider the uncertainty in the dynamic model: robust control and adaptive control. The robust control approach consists of designing a controller with a fixed structure that yields an acceptable performance over the full range of process variations. On the other hand, the adaptive control approach is to design a controller that can adapt itself to the process uncertainties in such a way that adequate control performance is guaranteed. In adaptive control, one of the common assumptions is that the dynamic model is linearly parameterizable with a fixed dynamic structure. Based on this assumption, unknown or slowly varying parameters are found adaptively. However, structural uncertainty is not considered in the existing control techniques. To cope with the nonlinear and uncertain natures of the controlled ships, an adaptive neural network (NN) control technique is developed in this thesis. The developed neural network controller (NNC) is based on the adaptive neural network by adaptive interaction (ANNAI). To enhance the adaptability of the NNC, an algorithm for automatic selection of its parameters at every control cycle is introduced. The proposed ANNAI controller is then modified and applied to some ship control problems. Firstly, an ANNAI-based heading control system for ship is proposed. The performance of the ANNAI-based heading control system in course-keeping and turning control is simulated on a mathematical ship model using computer. For comparison, a NN heading control system using conventional backpropagation (BP) training methods is also designed and simulated in similar situations. The improvements of ANNAI-based heading control system compared to the conventional BP one are discussed. Secondly, an adaptive ANNAI-based track control system for ship is developed by upgrading the proposed ANNAI controller and combining with Line-of-Sight (LOS) guidance algorithm. The off-track distance from ship position to the intended track is included in learning process of the ANNAI controller. This modification results in an adaptive NN track control system which can adapt with the unpredictable change of external disturbances. The performance of the ANNAI-based track control system is then demonstrated by computer simulations under the influence of external disturbances. Thirdly, another application of the ANNAI controller is presented. The ANNAI controller is modified to control ship heading and speed in low-speed maneuvering of ship. Being combined with a proposed berthing guidance algorithm, the ANNAI controller becomes an automatic berthing control system. The computer simulations using model of a container ship are carried out and shows good performance. Lastly, a hybrid neural adaptive controller which is independent of the exact mathematical model of ship is designed for dynamic positioning (DP) control. The ANNAI controllers are used in parallel with a conventional proportional-derivative (PD) controller to adaptively compensate for the environmental effects and minimize positioning as well as tracking error. The control law is simulated on a multi-purpose supply ship. The results are found to be encouraging and show the potential advantages of the neural-control scheme.1. Introduction = 1 1.1 Background and Motivations = 1 1.1.1 The History of Automatic Ship Control = 1 1.1.2 The Intelligent Control Systems = 2 1.2 Objectives and Summaries = 6 1.3 Original Distributions and Major Achievements = 7 1.4 Thesis Organization = 8 2. Adaptive Neural Network by Adaptive Interaction = 9 2.1 Introduction = 9 2.2 Adaptive Neural Network by Adaptive Interaction = 11 2.2.1 Direct Neural Network Control Applications = 11 2.2.2 Description of the ANNAI Controller = 13 2.3 Training Method of the ANNAI Controller = 17 2.3.1 Intensive BP Training = 17 2.3.2 Moderate BP Training = 17 2.3.3 Training Method of the ANNAI Controller = 18 3. ANNAI-based Heading Control System = 21 3.1 Introduction = 21 3.2 Heading Control System = 22 3.3 Simulation Results = 26 3.3.1 Fixed Values of n and = 28 3.3.2 With adaptation of n and r = 33 3.4 Conclusion = 39 4. ANNAI-based Track Control System = 41 4.1 Introduction = 41 4.2 Track Control System = 42 4.3 Simulation Results = 48 4.3.1 Modules for Guidance using MATLAB = 48 4.3.2 M-Maps Toolbox for MATLAB = 49 4.3.3 Ship Model = 50 4.3.4 External Disturbances and Noise = 50 4.3.5 Simulation Results = 51 4.4 Conclusion = 55 5. ANNAI-based Berthing Control System = 57 5.1 Introduction = 57 5.2 Berthing Control System = 58 5.2.1 Control of Ship Heading = 59 5.2.2 Control of Ship Speed = 61 5.2.3 Berthing Guidance Algorithm = 63 5.3 Simulation Results = 66 5.3.1 Simulation Setup = 66 5.3.2 Simulation Results and Discussions = 67 5.4 Conclusion = 79 6. ANNAI-based Dynamic Positioning System = 80 6.1 Introduction = 80 6.2 Dynamic Positioning System = 81 6.2.1 Station-keeping Control = 82 6.2.2 Low-speed Maneuvering Control = 86 6.3 Simulation Results = 88 6.3.1 Station-keeping = 89 6.3.2 Low-speed Maneuvering = 92 6.4 Conclusion = 98 7. Conclusions and Recommendations = 100 7.1 Conclusion = 100 7.1.1 ANNAI Controller = 100 7.1.2 Heading Control System = 101 7.1.3 Track Control System = 101 7.1.4 Berthing Control System = 102 7.1.5 Dynamic Positioning System = 102 7.2 Recommendations for Future Research = 103 References = 104 Appendixes A = 112 Appendixes B = 11

Simulation Studies Relating to Rudder Roll Stabilization of a Container Ship Using Neural Networks

International audienceRRS (Rudder Roll Stabilization) of Ships is a difficult problem because of its associated non-linear dynamics, coupling effects and complex control requirements. This paper proposes a solution of this stabilization problem that is based on an ANN (Artificial Neural Network) controller. The controller has been trained using supervised learning. The simulation studies have been carried out using MATLAB and a non-linear model of a container ship. It has been demonstrated that the proposed controller regulates heading and also controls roll angle very successfully

Automatic Control and Routing of Marine Vessels

Due to the intensive development of the global economy, many problems are constantly emerging connected to the safety of ships’ motion in the context of increasing marine traffic. These problems seem to be especially significant for the further development of marine transportation services, with the need to considerably increase their efficiency and reliability. One of the most commonly used approaches to ensuring safety and efficiency is the wide implementation of various automated systems for guidance and control, including such popular systems as marine autopilots, dynamic positioning systems, speed control systems, automatic routing installations, etc. This Special Issue focuses on various problems related to the analysis, design, modelling, and operation of the aforementioned systems. It covers such actual problems as tracking control, path following control, ship weather routing, course keeping control, control of autonomous underwater vehicles, ship collision avoidance. These problems are investigated using methods such as neural networks, sliding mode control, genetic algorithms, L2-gain approach, optimal damping concept, fuzzy logic and others. This Special Issue is intended to present and discuss significant contemporary problems in the areas of automatic control and the routing of marine vessels

Mechatronics of systems with undetermined configurations

This work is submitted for the award of a PhD by published works. It deals with some of the efforts of the author over the last ten years in the field of Mechatronics. Mechatronics is a new area invented by the Japanese in the late 1970's, it consists of a synthesis of computers and electronics to improve mechanical systems. To control any mechanical event three fundamental features must be brought together: the sensors used to observe the process, the control software, including the control algorithm used and thirdly the actuator that provides the stimulus to achieve the end result. Simulation, which plays such an important part in the Mechatronics process, is used in both in continuous and discrete forms. The author has spent some considerable time developing skills in all these areas. The author was certainly the first at Middlesex to appreciate the new developments in Mechatronics and their significance for manufacturing. The author was one of the first mechanical engineers to recognise the significance of the new transputer chip. This was applied to the LQG optimal control of a cinefilm copying process. A 300% improvement in operating speed was achieved, together with tension control. To make more efficient use of robots they have to be made both faster and cheaper. The author found extremely low natural frequencies of vibration, ranging from 3 to 25 Hz. This limits the speed of response of existing robots. The vibration data was some of the earliest available in this field, certainly in the UK. Several schemes have been devised to control the flexible robot and maintain the required precision. Actuator technology is one area where mechatronic systems have been the subject of intense development. At Middlesex we have improved on the Aexator pneumatic muscle actuator, enabling it to be used with a precision of about 2 mm. New control challenges have been undertaken now in the field of machine tool chatter and the prevention of slip. A variety of novel and traditional control algorithms have been investigated in order to find out the best approach to solve this problem

Controlling a cargo ship without human experience based on deep Q-network

Human experience is regarded as an indispensable part of artificial intelligence in the process of controlling or decision making for autonomous cargo ships. In this paper, a novel Deep Q-Network-based (DQN) approach is proposed, which performs satisfactorily in controlling a cargo ship automatically without any human experience. At the very beginning, we use the model of KRISO Very Large Crude Carrier (KVLCC2) to describe a cargo ship. To manipulate this ship has to conquer great inertia and relatively insufficient driving force. Subsequently, customary waterways, regulations, conventions are described with Artificial Potential Field and value-functions in DQN. Based on this, the artificial intelligence of planning and controlling a cargo ship can be obtained by undertaking sufficient training, which can control the ship directly, while avoiding collisions, keeping its position in the middle of the route as much as possible. In simulation experiments, it is demonstrated that such an approach performs better than manual works and other traditional methods in most conditions, which makes the proposed method a promising solution in improving the autonomy level of cargo ships

Ship steering control using feedforward neural networks

One significant problem in the design of ship steering control systems is that the dynamics of the vessel change with operating conditions such as the forward speed of the vessel, the depth of the water and loading conditions etc. Approaches considered in the past to overcome these difficulties include the use of self adaptive control systems which adjust the control characteristics on a continuous basis to suit the current operating conditions. Artificial neural networks have been receiving considerable attention in recent years and have been considered for a variety of applications where the characteristics of the controlled system change significantly with operating conditions or with time. Such networks have a configuration which remains fixed once the training phase is complete. The resulting controlled systems thus have more predictable characteristics than those which are found in many forms of traditional self-adaptive control systems. In particular, stability bounds can be investigated through simulation studies as with any other form of controller having fixed characteristics. Feedforward neural networks have enjoyed many successful applications in the field of systems and control. These networks include two major categories: multilayer perceptrons and radial basis function networks. In this thesis, we explore the applicability of both of these artificial neural network architectures for automatic steering of ships in a course changing mode of operation. The approach that has been adopted involves the training of a single artificial neural network to represent a series of conventional controllers for different operating conditions. The resulting network thus captures, in a nonlinear fashion, the essential characteristics of all of the conventional controllers. Most of the artificial neural network controllers developed in this thesis are trained with the data generated through simulation studies. However, experience is also gained of developing a neuro controller on the basis of real data gathered from an actual scale model of a supply ship. Another important aspect of this work is the applicability of local model networks for modelling the dynamics of a ship. Local model networks can be regarded as a generalized form of radial basis function networks and have already proved their worth in a number of applications involving the modelling of systems in which the dynamic characteristics can vary significantly with the system operating conditions. The work presented in this thesis indicates that these networks are highly suitable for modelling the dynamics of a ship

Using learning from demonstration to enable automated flight control comparable with experienced human pilots

Modern autopilots fall under the domain of Control Theory which utilizes Proportional Integral Derivative (PID) controllers that can provide relatively simple autonomous control of an aircraft such as maintaining a certain trajectory. However, PID controllers cannot cope with uncertainties due to their non-adaptive nature. In addition, modern autopilots of airliners contributed to several air catastrophes due to their robustness issues. Therefore, the aviation industry is seeking solutions that would enhance safety. A potential solution to achieve this is to develop intelligent autopilots that can learn how to pilot aircraft in a manner comparable with experienced human pilots. This work proposes the Intelligent Autopilot System (IAS) which provides a comprehensive level of autonomy and intelligent control to the aviation industry. The IAS learns piloting skills by observing experienced teachers while they provide demonstrations in simulation. A robust Learning from Demonstration approach is proposed which uses human pilots to demonstrate the task to be learned in a flight simulator while training datasets are captured. The datasets are then used by Artificial Neural Networks (ANNs) to generate control models automatically. The control models imitate the skills of the experienced pilots when performing the different piloting tasks while handling flight uncertainties such as severe weather conditions and emergency situations. Experiments show that the IAS performs learned skills and tasks with high accuracy even after being presented with limited examples which are suitable for the proposed approach that relies on many single-hidden-layer ANNs instead of one or few large deep ANNs which produce a black-box that cannot be explained to the aviation regulators. The results demonstrate that the IAS is capable of imitating low-level sub-cognitive skills such as rapid and continuous stabilization attempts in stormy weather conditions, and high-level strategic skills such as the sequence of sub-tasks necessary to takeoff, land, and handle emergencies

Proceedings of the Second Joint Technology Workshop on Neural Networks and Fuzzy Logic, volume 2

Documented here are papers presented at the Neural Networks and Fuzzy Logic Workshop sponsored by NASA and the University of Texas, Houston. Topics addressed included adaptive systems, learning algorithms, network architectures, vision, robotics, neurobiological connections, speech recognition and synthesis, fuzzy set theory and application, control and dynamics processing, space applications, fuzzy logic and neural network computers, approximate reasoning, and multiobject decision making

Neuromorphic Systems for Pattern Recognition and Uav Trajectory Planning

Detection and control are two essential components in an intelligent system. This thesis investigates novel techniques in both areas with a focus on the applications of handwritten text recognition and UAV flight control. Recognizing handwritten texts is a challenging task due to many different writing styles and lack of clear boundary between adjacent characters. The difficulty is greatly increased if the detection algorithms is solely based on pattern matching without information of dynamics of handwriting trajectories. Motivated by the aforementioned challenges, this thesis first investigates the pattern recognition problem. We use offline handwritten texts recognition as a case study to explore the performance of a recurrent belief propagation model. We first develop a probabilistic inference network to post process the recognition results of deep Convolutional Neural Network (CNN) (e.g. LeNet) and collect individual characters to form words. The output of the inference network is a set of words and their probability. A series of post processing and improvement techniques are then introduced to further increase the recognition accuracy. We study the performance of proposed model through various comparisons. The results show that it significantly improves the accuracy by correcting deletion, insertion and replacement errors, which are the main sources of invalid candidate words. Deep Reinforcement Learning (DRL) has widely been applied to control the autonomous systems because it provides solutions for various complex decision-making tasks that previously could not be solved solely with deep learning. To enable autonomous Unmanned Aerial Vehicles (UAV), this thesis presents a two-level trajectory planning framework for UAVs in an indoor environment. A sequence of waypoints is selected at the higher-level, which leads the UAV from its current position to the destination. At the lower-level, an optimal trajectory is generated analytically between each pair of adjacent waypoints. The goal of trajectory generation is to maintain the stability of the UAV, and the goal of the waypoints planning is to select waypoints with the lowest control thrust throughout the entire trip while avoiding collisions with obstacles. The entire framework is implemented using DRL, which learns the highly complicated and nonlinear interaction between those two levels, and the impact from the environment. Given the pre-planned trajectory, this thesis further presents an actor-critic reinforcement learning framework that realizes continuous trajectory control of the UAV through a set of desired waypoints. We construct a deep neural network and develop reinforcement learning for better trajectory tracking. In addition, Field Programmable Gate Arrays (FPGA) based hardware acceleration is designed for energy efficient real-time control. If we are to integrate the trajectory planning model onto a UAV system for real-time on-board planning, a key challenge is how to deliver required performance under strict memory and computational constraints. Techniques that compress Deep Neural Network (DNN) models attract our attention because they allow optimized neural network models to be efficiently deployed on platforms with limited energy and storage capacity. However, conventional model compression techniques prune the DNN after it is fully trained, which is very time-consuming especially when the model is trained using DRL. To overcome the limitation, we present an early phase integrated neural network weight compression system for DRL based waypoints planning. By applying pruning at an early phase, the compression of the DRL model can be realized without significant overhead in training. By tightly integrating pruning and retraining at the early phase, we achieve a higher model compression rate, reduce more memory and computing complexity, and improve the success rate compared to the original work