Unsupervised learning based coordinated multi-task allocation for unmanned surface vehicles

In recent decades, unmanned surface vehicles (USVs) are attracting increasing attention due to their underlying capability in autonomously undertaking complex maritime tasks in constrained environments. However, the autonomy level of USVs is still limited, especially when being deployed to conduct multiple tasks simultaneously. This paper, therefore, aims to improve USVs autonomy level by investigating and developing an effective and efficient task management algorithm for multi-USV systems. To better deal with challenging requirements such as allocating vast tasks in cluttered environments, the task management has been de-composed into two submissions, i.e., task allocation and task execution. More specifically, unsupervised learning strategies have been used with an improved K-means algorithm proposed to first assign different tasks for a multi-USV system then a self-organising map (SOM) been implemented to deal with the task execution problem based upon the assigned tasks for each USV. Differing to other work, the communication problem that is crucial for USVs in a constrained environment has been specifically resolved by designing a new competition strategy for K-means algorithm. Key factors that will influence the communication capability in practical applications have been taken into account. A holistic task management architecture has been designed by integrating both the task allocation and task execution algorithms, and a number of simulations in both simulated and practical maritime environments have been carried out to validate the effectiveness of the proposed algorithms

Planning Algorithms for Multi-Robot Active Perception

A fundamental task of robotic systems is to use on-board sensors and perception algorithms to understand high-level semantic properties of an environment. These semantic properties may include a map of the environment, the presence of objects, or the parameters of a dynamic field. Observations are highly viewpoint dependent and, thus, the performance of perception algorithms can be improved by planning the motion of the robots to obtain high-value observations. This motivates the problem of active perception, where the goal is to plan the motion of robots to improve perception performance. This fundamental problem is central to many robotics applications, including environmental monitoring, planetary exploration, and precision agriculture. The core contribution of this thesis is a suite of planning algorithms for multi-robot active perception. These algorithms are designed to improve system-level performance on many fronts: online and anytime planning, addressing uncertainty, optimising over a long time horizon, decentralised coordination, robustness to unreliable communication, predicting plans of other agents, and exploiting characteristics of perception models. We first propose the decentralised Monte Carlo tree search algorithm as a generally-applicable, decentralised algorithm for multi-robot planning. We then present a self-organising map algorithm designed to find paths that maximally observe points of interest. Finally, we consider the problem of mission monitoring, where a team of robots monitor the progress of a robotic mission. A spatiotemporal optimal stopping algorithm is proposed and a generalisation for decentralised monitoring. Experimental results are presented for a range of scenarios, such as marine operations and object recognition. Our analytical and empirical results demonstrate theoretically-interesting and practically-relevant properties that support the use of the approaches in practice

A Novel Double Layered Hybrid Multi-Robot Framework for Guidance and Navigation of Unmanned Surface Vehicles in a Practical Maritime Environment

Formation control and cooperative motion planning are two major research areas currently being used in multi robot motion planning and coordination. The current study proposes a hybrid framework for guidance and navigation of swarm of unmanned surface vehicles (USVs) by combining the key characteristics of formation control and cooperative motion planning. In this framework, two layers of offline planning and online planning are integrated and applied on a practical marine environment. In offline planning, an optimal path is generated from a constrained A* path planning approach, which is later smoothed using a spline. This optimal trajectory is fed as an input for the online planning where virtual target (VT) based multi-agent guidance framework is used to navigate the swarm of USVs. This VT approach combined with a potential theory based swarm aggregation technique provides a robust methodology of global and local collision avoidance based on known positions of the USVs. The combined approach is evaluated with the different number of USVs to understand the effectiveness of the approach from the perspective of practicality, safety and robustness.</jats:p

Cooperative Swarm Optimisation of Unmanned Surface Vehicles

Edited version embargoed 10 07.01.2020 Full version: Access restricted permanently due to 3rd party copyright restrictions. Restriction set on 11/04/2019 by AS, Doctoral CollegeWith growing advances in technology and everyday dependence on oceans for resources, the role of unmanned surface vehicles (USVs) has increased many fold. Extensive operations of USVs having naval, civil and scientific applications are currently being undertaken in various complex marine environments and demands are being placed on them to increase their autonomy and adaptability. A key requirement for the autonomous operation of USVs is to possess a multi-vehicle framework where they can operate as a fleet of vehicles in a practical marine environment with multiple advantages such as surveying of wider areas in less time. From the literature, it is evident that a huge number of studies has been conducted in the area of single USV path planning, guidance and control whilst very few studies have been conducted to understand the implications of the multi vehicle approaches to USVs. This present PhD thesis integrates the modules of efficient optimal path planning, robust path following guidance and cooperative swarm aggregation approach towards development of a new hybrid framework for cooperative navigation of swarm of USVs to enable optimal and autonomous operation in a maritime environment. Initially, an effective and novel optimal path planning approach based on the A* algorithm has been designed taking into account the constraint of a safety distance from the obstacles to avoid the collisions in scenarios of moving obstacles and sea surface currents. This approach is then integrated with a novel virtual target path following guidance module developed for USVs where the reference trajectory from the path planner is fed into the guidance system. The novelty of the current work relies on combining the above mentioned integrated path following guidance system with decentralised swarm aggregation behaviour by means of simple potential based attraction and repulsion functions to maintain the centroid of the swarm of USVs and thereby guiding the swarm of USVs onto a reference path. Finally, an optimal and hybrid framework for cooperative navigation and guidance of fleet of USVs, implementable in practical maritime environments and effective for practical applications at sea is presented.Commonwealth Scholarship Commissio

Control of Autonomous Underwater Vehicles

Autonomous Underwater Vehicles find extensive applications in defense organizations for underwater mine detection and region surveillance. These are also useful for oil and gas industries in detection of leakage in the pipelines and also in many other marine industries. Underwater Robots can be categorized into two types namely (i) Remotely Operated Vehicle (ROV) and (ii) Autonomous Underwater Vehicle (AUV). A ROV is a remotely operated vehicle usually connected with the mother ship or base station through a tethered wire whereas AUV is an Autonomous Underwater Vehicle which traverses autonomously without any external interference. As opposed to ROV, control of an AUV is difficult because it is an underactuated system (whose actuator inputs are less than the number of degrees of freedom to be controlled), also the dynamics of AUV is influenced by external disturbances such as ocean current and hydrodynamic effects. The motion control problems of an AUV can be of different types such as path following, trajectory tracking, waypoint tracking and also localization. The thesis first develops path following control of a single AUV using the Serret- Frenet(S-F) frame approach and error backstepping technique. Later on the same back- stepping approach has been extended for implementation of formation control for multiple AUVs. Out of various motion control strategies, this thesis mainly focusses on path following control problem of a single AUV. To address this problem of path following, a virtual frame is considered. This virtual moving frame is called the S-F frame. The purpose of using S-F frame is to represent the AUV kinematics in terms of virtual frame parameters. Then a suitable control strategy has been developed which generates appropriate thruster force and rudder orientation enabling the AUV to follow the desired path. In the thesis, the path following controller has been developed using the concept of error backstepping method. In the developed controller it is also shown that the path following error i.e. distance between virtual frame and AUV actual frame approaches to zero and it is also ensured that other states of the AUV remain stable and bounded. Although error backstepping approach has been employed for path following problem but the earlier work [1] has not considered the surge motion dynamics and coupling of rudder angle. Therefore, this thesis has addressed the limitation of [1] and developed the backstepping controller considering the rudder coupling term. Although using a single AUV has many advantages but in case of its failure, the com- plete mission may be affected. Further, the area coverage by an individual AUV is limited. Thus, multiple AUVs are deployed for achieving a co-operative operation. Co-operative working of multiple AUVs obviate the aforesaid disadvantages as the group of AUVs in co-operative motion provides robustness in case of an individual AUV failure. Recently, a lot of research has been directed on developing cooperative motion control of multiple AUVs. Co-operative motion control can be achieved through different control strategies such as Leader-Follower, Virtual Based structure and Behavior Based Formation Con- trol. These cooperative control strategies have their own advantages and disadvantages. Hence, these strategies have been reviewed and in this work, the concept of S-F together with error backstepping approach have been exploited to develop formation control of multiple AUVs. A fuzzy logic controller has also been implemented for deriving the con- trol algorithm for leader-follower formation control scheme applied to control a group of AUVs. Subsequently, the thesis presents a graphical simulation environment using VRML and SIMULINK3D to visualize the effect of controllers developed in providing the desired path following and formation control activities of AUV(s). This graphical simulation accepts the AUV states as inputs and represents the motion in an oceanic environment. Also a proposal on hardware set up design of a single AUV is presented in the thesis. The selection of necessary sensors, actuators and various electronics components for the AUV hardware have been presented

Development of Path Following and Cooperative Motion Control Algorithms for Autonomous Underwater Vehicles

Research on autonomous underwater vehicle (AUV) is motivating and challenging owing to their specific applications such as defence, mine counter measure, pipeline inspections, risky missions e.g. oceanographic observations, bathymetric surveys, ocean floor analysis, military uses, and recovery of lost man-made objects. Motion control of AUVs is concerned with navigation, path following and co-operative motion control problems. A number of control complexities are encountered in AUV motion control such as nonlinearities in mass matrix, hydrodynamic terms and ocean currents. These pose challenges to develop efficient control algorithms such that the accurate path following task and effective group co-ordination can be achieved in face of parametric uncertainties and disturbances and communication constraints in acoustic medium. This thesis first proposes development of a number of path following control laws and new co-operative motion control algorithms for achieving successful motion control objectives. These algorithms are potential function based proportional derivative path following control laws, adaptive trajectory based formation control, formation control of multiple AUVs steering towards a safety region, mathematical potential function based flocking control and fuzzy potential function based flocking control. Development of a path following control algorithm aims at generating appropriate control law, such that an AUV tracks a predefined desired path. In this thesis first path following control laws are developed for an underactuated (the number of inputs are lesser than the degrees of freedom) AUV. A potential function based proportional derivative (PFPD) control law is derived to govern the motion of the AUV in an obstacle-rich environment (environment populated by obstacles). For obstacle avoidance, a mathematical potential function is exploited, which provides a repulsive force between the AUV and the solid obstacles intersecting the desired path. Simulations were carried out considering a special type of AUV i.e. Omni Directional Intelligent Navigator (ODIN) to study the efficacy of the developed PFPD controller. For achieving more accuracy in the path following performance, a new controller (potential function based augmented proportional derivative, PFAPD) has been designed by the mass matrix augmentation with PFPD control law. Simulations were made and the results obtained with PFAPD controller are compared with that of PFPD controlle

Internet of Underwater Things and Big Marine Data Analytics -- A Comprehensive Survey

The Internet of Underwater Things (IoUT) is an emerging communication ecosystem developed for connecting underwater objects in maritime and underwater environments. The IoUT technology is intricately linked with intelligent boats and ships, smart shores and oceans, automatic marine transportations, positioning and navigation, underwater exploration, disaster prediction and prevention, as well as with intelligent monitoring and security. The IoUT has an influence at various scales ranging from a small scientific observatory, to a midsized harbor, and to covering global oceanic trade. The network architecture of IoUT is intrinsically heterogeneous and should be sufficiently resilient to operate in harsh environments. This creates major challenges in terms of underwater communications, whilst relying on limited energy resources. Additionally, the volume, velocity, and variety of data produced by sensors, hydrophones, and cameras in IoUT is enormous, giving rise to the concept of Big Marine Data (BMD), which has its own processing challenges. Hence, conventional data processing techniques will falter, and bespoke Machine Learning (ML) solutions have to be employed for automatically learning the specific BMD behavior and features facilitating knowledge extraction and decision support. The motivation of this paper is to comprehensively survey the IoUT, BMD, and their synthesis. It also aims for exploring the nexus of BMD with ML. We set out from underwater data collection and then discuss the family of IoUT data communication techniques with an emphasis on the state-of-the-art research challenges. We then review the suite of ML solutions suitable for BMD handling and analytics. We treat the subject deductively from an educational perspective, critically appraising the material surveyed.Comment: 54 pages, 11 figures, 19 tables, IEEE Communications Surveys & Tutorials, peer-reviewed academic journa

Adaptive and learning-based formation control of swarm robots

Autonomous aerial and wheeled mobile robots play a major role in tasks such as search and rescue, transportation, monitoring, and inspection. However, these operations are faced with a few open challenges including robust autonomy, and adaptive coordination based on the environment and operating conditions, particularly in swarm robots with limited communication and perception capabilities. Furthermore, the computational complexity increases exponentially with the number of robots in the swarm. This thesis examines two different aspects of the formation control problem. On the one hand, we investigate how formation could be performed by swarm robots with limited communication and perception (e.g., Crazyflie nano quadrotor). On the other hand, we explore human-swarm interaction (HSI) and different shared-control mechanisms between human and swarm robots (e.g., BristleBot) for artistic creation. In particular, we combine bio-inspired (i.e., flocking, foraging) techniques with learning-based control strategies (using artificial neural networks) for adaptive control of multi- robots. We first review how learning-based control and networked dynamical systems can be used to assign distributed and decentralized policies to individual robots such that the desired formation emerges from their collective behavior. We proceed by presenting a novel flocking control for UAV swarm using deep reinforcement learning. We formulate the flocking formation problem as a partially observable Markov decision process (POMDP), and consider a leader-follower configuration, where consensus among all UAVs is used to train a shared control policy, and each UAV performs actions based on the local information it collects. In addition, to avoid collision among UAVs and guarantee flocking and navigation, a reward function is added with the global flocking maintenance, mutual reward, and a collision penalty. We adapt deep deterministic policy gradient (DDPG) with centralized training and decentralized execution to obtain the flocking control policy using actor-critic networks and a global state space matrix. In the context of swarm robotics in arts, we investigate how the formation paradigm can serve as an interaction modality for artists to aesthetically utilize swarms. In particular, we explore particle swarm optimization (PSO) and random walk to control the communication between a team of robots with swarming behavior for musical creation