A Study on the Automatic Ship Control Based on Adaptive Neural Networks

Recently, dynamic models of marine ships are often required to design advanced control systems. In practice, the dynamics of marine ships are highly nonlinear and are affected by highly nonlinear, uncertain external disturbances. This results in parametric and structural uncertainties in the dynamic model, and requires the need for advanced robust control techniques. There are two fundamental control approaches to consider the uncertainty in the dynamic model: robust control and adaptive control. The robust control approach consists of designing a controller with a fixed structure that yields an acceptable performance over the full range of process variations. On the other hand, the adaptive control approach is to design a controller that can adapt itself to the process uncertainties in such a way that adequate control performance is guaranteed. In adaptive control, one of the common assumptions is that the dynamic model is linearly parameterizable with a fixed dynamic structure. Based on this assumption, unknown or slowly varying parameters are found adaptively. However, structural uncertainty is not considered in the existing control techniques. To cope with the nonlinear and uncertain natures of the controlled ships, an adaptive neural network (NN) control technique is developed in this thesis. The developed neural network controller (NNC) is based on the adaptive neural network by adaptive interaction (ANNAI). To enhance the adaptability of the NNC, an algorithm for automatic selection of its parameters at every control cycle is introduced. The proposed ANNAI controller is then modified and applied to some ship control problems. Firstly, an ANNAI-based heading control system for ship is proposed. The performance of the ANNAI-based heading control system in course-keeping and turning control is simulated on a mathematical ship model using computer. For comparison, a NN heading control system using conventional backpropagation (BP) training methods is also designed and simulated in similar situations. The improvements of ANNAI-based heading control system compared to the conventional BP one are discussed. Secondly, an adaptive ANNAI-based track control system for ship is developed by upgrading the proposed ANNAI controller and combining with Line-of-Sight (LOS) guidance algorithm. The off-track distance from ship position to the intended track is included in learning process of the ANNAI controller. This modification results in an adaptive NN track control system which can adapt with the unpredictable change of external disturbances. The performance of the ANNAI-based track control system is then demonstrated by computer simulations under the influence of external disturbances. Thirdly, another application of the ANNAI controller is presented. The ANNAI controller is modified to control ship heading and speed in low-speed maneuvering of ship. Being combined with a proposed berthing guidance algorithm, the ANNAI controller becomes an automatic berthing control system. The computer simulations using model of a container ship are carried out and shows good performance. Lastly, a hybrid neural adaptive controller which is independent of the exact mathematical model of ship is designed for dynamic positioning (DP) control. The ANNAI controllers are used in parallel with a conventional proportional-derivative (PD) controller to adaptively compensate for the environmental effects and minimize positioning as well as tracking error. The control law is simulated on a multi-purpose supply ship. The results are found to be encouraging and show the potential advantages of the neural-control scheme.1. Introduction = 1 1.1 Background and Motivations = 1 1.1.1 The History of Automatic Ship Control = 1 1.1.2 The Intelligent Control Systems = 2 1.2 Objectives and Summaries = 6 1.3 Original Distributions and Major Achievements = 7 1.4 Thesis Organization = 8 2. Adaptive Neural Network by Adaptive Interaction = 9 2.1 Introduction = 9 2.2 Adaptive Neural Network by Adaptive Interaction = 11 2.2.1 Direct Neural Network Control Applications = 11 2.2.2 Description of the ANNAI Controller = 13 2.3 Training Method of the ANNAI Controller = 17 2.3.1 Intensive BP Training = 17 2.3.2 Moderate BP Training = 17 2.3.3 Training Method of the ANNAI Controller = 18 3. ANNAI-based Heading Control System = 21 3.1 Introduction = 21 3.2 Heading Control System = 22 3.3 Simulation Results = 26 3.3.1 Fixed Values of n and = 28 3.3.2 With adaptation of n and r = 33 3.4 Conclusion = 39 4. ANNAI-based Track Control System = 41 4.1 Introduction = 41 4.2 Track Control System = 42 4.3 Simulation Results = 48 4.3.1 Modules for Guidance using MATLAB = 48 4.3.2 M-Maps Toolbox for MATLAB = 49 4.3.3 Ship Model = 50 4.3.4 External Disturbances and Noise = 50 4.3.5 Simulation Results = 51 4.4 Conclusion = 55 5. ANNAI-based Berthing Control System = 57 5.1 Introduction = 57 5.2 Berthing Control System = 58 5.2.1 Control of Ship Heading = 59 5.2.2 Control of Ship Speed = 61 5.2.3 Berthing Guidance Algorithm = 63 5.3 Simulation Results = 66 5.3.1 Simulation Setup = 66 5.3.2 Simulation Results and Discussions = 67 5.4 Conclusion = 79 6. ANNAI-based Dynamic Positioning System = 80 6.1 Introduction = 80 6.2 Dynamic Positioning System = 81 6.2.1 Station-keeping Control = 82 6.2.2 Low-speed Maneuvering Control = 86 6.3 Simulation Results = 88 6.3.1 Station-keeping = 89 6.3.2 Low-speed Maneuvering = 92 6.4 Conclusion = 98 7. Conclusions and Recommendations = 100 7.1 Conclusion = 100 7.1.1 ANNAI Controller = 100 7.1.2 Heading Control System = 101 7.1.3 Track Control System = 101 7.1.4 Berthing Control System = 102 7.1.5 Dynamic Positioning System = 102 7.2 Recommendations for Future Research = 103 References = 104 Appendixes A = 112 Appendixes B = 11

Adaptive low-level control of autonomous underwater vehicles using deep reinforcement learning

Low-level control of autonomous underwater vehicles (AUVs) has been extensively addressed by classical control techniques. However, the variable operating conditions and hostile environments faced by AUVs have driven researchers towards the formulation of adaptive control approaches. The reinforcement learning (RL) paradigm is a powerful framework which has been applied in different formulations of adaptive control strategies for AUVs. However, the limitations of RL approaches have lead towards the emergence of deep reinforcement learning which has become an attractive and promising framework for developing real adaptive control strategies to solve complex control problems for autonomous systems. However, most of the existing applications of deep RL use video images to train the decision making artificial agent but obtaining camera images only for an AUV control purpose could be costly in terms of energy consumption. Moreover, the rewards are not easily obtained directly from the video frames. In this work we develop a deep RL framework for adaptive control applications of AUVs based on an actor-critic goal-oriented deep RL architecture, which takes the available raw sensory information as input and as output the continuous control actions which are the low-level commands for the AUV's thrusters. Experiments on a real AUV demonstrate the applicability of the stated deep RL approach for an autonomous robot control problem.Fil: Carlucho, Ignacio. Universidad Nacional del Centro de la Provincia de Buenos Aires. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires. - Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Tandil. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires. - Provincia de Buenos Aires. Gobernación. Comisión de Investigaciones Científicas. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires; ArgentinaFil: de Paula, Mariano. Universidad Nacional del Centro de la Provincia de Buenos Aires. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires. - Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Tandil. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires. - Provincia de Buenos Aires. Gobernación. Comisión de Investigaciones Científicas. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires; ArgentinaFil: Wang, Sen. Heriot-Watt University; Reino UnidoFil: Petillot, Yvan. Heriot-Watt University; Reino UnidoFil: Acosta, Gerardo Gabriel. Universidad Nacional del Centro de la Provincia de Buenos Aires. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires. - Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Tandil. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires. - Provincia de Buenos Aires. Gobernación. Comisión de Investigaciones Científicas. Centro de Investigaciones en Física e Ingeniería del Centro de la Provincia de Buenos Aires; Argentin

Intelligent Control Strategies for an Autonomous Underwater Vehicle

The dynamic characteristics of autonomous underwater vehicles (AUVs) present a control problem that classical methods cannot often accommodate easily. Fundamentally, AUV dynamics are highly non-linear, and the relative similarity between the linear and angular velocities about each degree of freedom means that control schemes employed within other flight vehicles are not always applicable. In such instances, intelligent control strategies offer a more sophisticated approach to the design of the control algorithm. Neurofuzzy control is one such technique, which fuses the beneficial properties of neural networks and fuzzy logic in a hybrid control architecture. Such an approach is highly suited to development of an autopilot for an AUV. Specifically, the adaptive network-based fuzzy inference system (ANFIS) is discussed in Chapter 4 as an effective new approach for neurally tuning course-changing fuzzy autopilots. However, the limitation of this technique is that it cannot be used for developing multivariable fuzzy structures. Consequently, the co-active ANFIS (CANFIS) architecture is developed and employed as a novel multi variable AUV autopilot within Chapter 5, whereby simultaneous control of the AUV yaw and roll channels is achieved. Moreover, this structure is flexible in that it is extended in Chapter 6 to perform on-line control of the AUV leading to a novel autopilot design that can accommodate changing vehicle pay loads and environmental disturbances. Whilst the typical ANFIS and CANFIS structures prove effective for AUV control system design, the well known properties of radial basis function networks (RBFN) offer a more flexible controller architecture. Chapter 7 presents a new approach to fuzzy modelling and employs both ANFIS and CANFIS structures with non-linear consequent functions of composite Gaussian form. This merger of CANFIS and a RBFN lends itself naturally to tuning with an extended form of the hybrid learning rule, and provides a very effective approach to intelligent controller development.The Sea Systems and Platform Integration Sector, Defence Evaluation and Research Agency, Winfrit

Automatic Control and Routing of Marine Vessels

Due to the intensive development of the global economy, many problems are constantly emerging connected to the safety of ships’ motion in the context of increasing marine traffic. These problems seem to be especially significant for the further development of marine transportation services, with the need to considerably increase their efficiency and reliability. One of the most commonly used approaches to ensuring safety and efficiency is the wide implementation of various automated systems for guidance and control, including such popular systems as marine autopilots, dynamic positioning systems, speed control systems, automatic routing installations, etc. This Special Issue focuses on various problems related to the analysis, design, modelling, and operation of the aforementioned systems. It covers such actual problems as tracking control, path following control, ship weather routing, course keeping control, control of autonomous underwater vehicles, ship collision avoidance. These problems are investigated using methods such as neural networks, sliding mode control, genetic algorithms, L2-gain approach, optimal damping concept, fuzzy logic and others. This Special Issue is intended to present and discuss significant contemporary problems in the areas of automatic control and the routing of marine vessels

Robust Adaptive Depth Control of Hybrid Underwater Glider in Vertical Plane

Hybrid underwater glider (HUG) is an advanced autonomous underwater vehicle with propellers capable of sustainable operations for many months. Under the underwater disturbances and parameter uncertainties, it is difficult that the HUG coordinates with the desired depth in a robust manner. In this study, a robust adaptive control algorithm for the HUG is proposed. In the descend and ascend periods, the pitch control is designed using backstepping technique and direct adaptive control. When the vehicle approaches the target depth, the surge speed control using adaptive control combined with the pitch control is used to keep the vehicle at the desired depth with a constant cruising speed in the presence of the disturbances. The stability of the proposed controller is verified by using the Lyapunov theorem. Finally, the computer simulation using the numerical method is conducted to show the effectiveness of the proposed controller for a hybrid underwater glider system

Development of Robust Control Strategies for Autonomous Underwater Vehicles

The resources of the energy and chemical balance in the ocean sustain mankind in many ways. Therefore, ocean exploration is an essential task that is accomplished by deploying Underwater Vehicles. An Underwater Vehicle with autonomy feature for its navigation and control is called Autonomous Underwater Vehicle (AUV). Among the task handled by an AUV, accurately positioning itself at a desired position with respect to the reference objects is called set-point control. Similarly, tracking of the reference trajectory is also another important task. Battery recharging of AUV, positioning with respect to underwater structure, cable, seabed, tracking of reference trajectory with desired accuracy and speed to avoid collision with the guiding vehicle in the last phase of docking are some significant applications where an AUV needs to perform the above tasks. Parametric uncertainties in AUV dynamics and actuator torque limitation necessitate to design robust control algorithms to achieve motion control objectives in the face of uncertainties. Sliding Mode Controller (SMC), H / μ synthesis, model based PID group controllers are some of the robust controllers which have been applied to AUV. But SMC suffers from less efficient tuning of its switching gains due to model parameters and noisy estimated acceleration states appearing in its control law. In addition, demand of high control effort due to high frequency chattering is another drawback of SMC. Furthermore, real-time implementation of H / μ synthesis controller based on its stability study is restricted due to use of linearly approximated dynamic model of an AUV, which hinders achieving robustness. Moreover, model based PID group controllers suffer from implementation complexities and exhibit poor transient and steady-state performances under parametric uncertainties. On the other hand model free Linear PID (LPID) has inherent problem of narrow convergence region, i.e.it can not ensure convergence of large initial error to zero. Additionally, it suffers from integrator-wind-up and subsequent saturation of actuator during the occurrence of large initial error. But LPID controller has inherent capability to cope up with the uncertainties. In view of addressing the above said problem, this work proposes wind-up free Nonlinear PID with Bounded Integral (BI) and Bounded Derivative (BD) for set-point control and combination of continuous SMC with Nonlinear PID with BI and BD namely SM-N-PID with BI and BD for trajectory tracking. Nonlinear functions are used for all P,I and D controllers (for both of set-point and tracking control) in addition to use of nonlinear tan hyperbolic function in SMC(for tracking only) such that torque demand from the controller can be kept within a limit. A direct Lyapunov analysis is pursued to prove stable motion of AUV. The efficacies of the proposed controllers are compared with other two controllers namely PD and N-PID without BI and BD for set-point control and PD plus Feedforward Compensation (FC) and SM-NPID without BI and BD for tracking control. Multiple AUVs cooperatively performing a mission offers several advantages over a single AUV in a non-cooperative manner; such as reliability and increased work efficiency, etc. Bandwidth limitation in acoustic medium possess challenges in designing cooperative motion control algorithm for multiple AUVs owing to the necessity of communication of sensors and actuator signals among AUVs. In literature, undirected graph based approach is used for control design under communication constraints and thus it is not suitable for large number of AUVs participating in a cooperative motion plan. Formation control is a popular cooperative motion control paradigm. This thesis models the formation as a minimally persistent directed graph and proposes control schemes for maintaining the distance constraints during the course of motion of entire formation. For formation control each AUV uses Sliding Mode Nonlinear PID controller with Bounded Integrator and Bounded Derivative. Direct Lyapunov stability analysis in the framework of input-to-state stability ensures the stable motion of formation while maintaining the desired distance constraints among the AUVs

Fuel Pump Motor-Drive Systems for More Electric Aircraft

The fuel systems fitted to the current generation of civil transport aircraft are rather complicated, due to the presence of multiple tanks, pumps, valves and complex pipeline systems. During fuel transfer between the tanks, when controlling the aircraft centre of gravity or engine feed and refuel operations, a number of pumps and valves are involved resulting in complex pressure and flow interactions. In order to minimise the pressure surges during sudden system changes and flow overshoot during fuel transfer and refuelling, different motor drive system control strategies have been investigated. It is proposed that the current control method of electrically driven centrifugal-type pumps could be replaced by improved open and closed loop strategies where the flow overshoot can be minimised and pressure surges reduced. Steady-state and dynamic models of an AC induction motor drive and typical aircraft fuel system pipework components have been developed. The validation of these models has been performed using experimental data obtained from a fuel test rig constructed at the University of Bath using water as the working fluid. The simulation results have been shown to agree well with those from experimentation. In addition, the induction motor has been modelled based on its physical properties using the Finite Element Method software MEGA. The investigated fuel system has been described in linear terms and its behaviour has been identified. It is shown that the system dynamic behaviour can be controlled/improved using well established closed loop proportional-integral control. An open loop technique of simultaneous pump and valve control has been proposed and validated using experimental results, resulting in a reduction of both the transient pressure surges and flow overshoot during sudden valve closures, showing significant performance improvements. Improved closed loop control strategies for the pump drive system have also been developed in simulation. These are based on adaptive proportional-integral-derivative and fuzzy logic control strategies.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Advances in PID Control

Since the foundation and up to the current state-of-the-art in control engineering, the problems of PID control steadily attract great attention of numerous researchers and remain inexhaustible source of new ideas for process of control system design and industrial applications. PID control effectiveness is usually caused by the nature of dynamical processes, conditioned that the majority of the industrial dynamical processes are well described by simple dynamic model of the first or second order. The efficacy of PID controllers vastly falls in case of complicated dynamics, nonlinearities, and varying parameters of the plant. This gives a pulse to further researches in the field of PID control. Consequently, the problems of advanced PID control system design methodologies, rules of adaptive PID control, self-tuning procedures, and particularly robustness and transient performance for nonlinear systems, still remain as the areas of the lively interests for many scientists and researchers at the present time. The recent research results presented in this book provide new ideas for improved performance of PID control applications

A Two-Wheeled Self-Balancing Robot with the Fuzzy PD Control Method

A two-wheeled self-balancing robot with a fuzzy PD control method is described and analyzed as an example of a high-order, multiple-variable, nonlinear, strong-coupling, and unstable system. Based on a system structure model, a kinetic equation is constructed using Newtonian dynamics and mechanics. After a number of simulation experiments, we get the best , , and state-feedback matrices. Then a fuzzy PD controller is designed for which the position and speed of the robot are inputs and for which the angle and angle rate of the robot are controlled by a PD controller. Finally, this paper describes a real-time control platform for the two-wheeled self-balancing robot that controls the robot effectively, after some parameter debugging. The result indicates that the fuzzy PD control algorithm can successfully achieve self-balanced control of the two-wheeled robot and prevent the robot from falling