Self-Selective Correlation Ship Tracking Method for Smart Ocean System

In recent years, with the development of the marine industry, navigation environment becomes more complicated. Some artificial intelligence technologies, such as computer vision, can recognize, track and count the sailing ships to ensure the maritime security and facilitates the management for Smart Ocean System. Aiming at the scaling problem and boundary effect problem of traditional correlation filtering methods, we propose a self-selective correlation filtering method based on box regression (BRCF). The proposed method mainly include: 1) A self-selective model with negative samples mining method which effectively reduces the boundary effect in strengthening the classification ability of classifier at the same time; 2) A bounding box regression method combined with a key points matching method for the scale prediction, leading to a fast and efficient calculation. The experimental results show that the proposed method can effectively deal with the problem of ship size changes and background interference. The success rates and precisions were higher than Discriminative Scale Space Tracking (DSST) by over 8 percentage points on the marine traffic dataset of our laboratory. In terms of processing speed, the proposed method is higher than DSST by nearly 22 Frames Per Second (FPS)

Robust Multi-sensor Data Fusion for Practical Unmanned Surface Vehicles (USVs) Navigation

The development of practical Unmanned Surface Vehicles (USVs) are attracting increasing attention driven by their assorted military and commercial application potential. However, addressing the uncertainties presented in practical navigational sensor measurements of an USV in maritime environment remain the main challenge of the development. This research aims to develop a multi-sensor data fusion system to autonomously provide an USV reliable navigational information on its own positions and headings as well as to detect dynamic target ships in the surrounding environment in a holistic fashion. A multi-sensor data fusion algorithm based on Unscented Kalman Filter (UKF) has been developed to generate more accurate estimations of USV’s navigational data considering practical environmental disturbances. A novel covariance matching adaptive estimation algorithm has been proposed to deal with the issues caused by unknown and varying sensor noise in practice to improve system robustness. Certain measures have been designed to determine the system reliability numerically, to recover USV trajectory during short term sensor signal loss, and to autonomously detect and discard permanently malfunctioned sensors, and thereby enabling potential sensor faults tolerance. The performance of the algorithms have been assessed by carrying out theoretical simulations as well as using experimental data collected from a real-world USV projected collaborated with Plymouth University. To increase the degree of autonomy of USVs in perceiving surrounding environments, target detection and prediction algorithms using an Automatic Identification System (AIS) in conjunction with a marine radar have been proposed to provide full detections of multiple dynamic targets in a wider coverage range, remedying the narrow detection range and sensor uncertainties of the AIS. The detection algorithms have been validated in simulations using practical environments with water current effects. The performance of developed multi-senor data fusion system in providing reliable navigational data and perceiving surrounding environment for USV navigation have been comprehensively demonstrated

Reliable Navigational Scene Perception for Autonomous Ships in Maritime Environment

Due to significant advances in robotics and transportation, research on autonomous ships has attracted considerable attention. The most critical task is to make the ships capable of accurately, reliably, and intelligently detecting their surroundings to achieve high levels of autonomy. Three deep learning-based models are constructed in this thesis to perform complex perceptual tasks such as identifying ships, analysing encounter situations, and recognising water surface objects. In this thesis, sensors, including the Automatic Identification System (AIS) and cameras, provide critical information for scene perception. Specifically, the AIS enables mid-range and long-range detection, assisting the decision-making system to take suitable and decisive action. A Convolutional Neural Network-Ship Movement Modes Classification (CNN-SMMC) is used to detect ships or objects. Following that, a Semi- Supervised Convolutional Encoder-Decoder Network (SCEDN) is developed to classify ship encounter situations and make a collision avoidance plan for the moving ships or objects. Additionally, cameras are used to detect short-range objects, a supplementary solution to ships or objects not equipped with an AIS. A Water Obstacle Detection Network based on Image Segmentation (WODIS) is developed to find potential threat targets. A series of quantifiable experiments have demonstrated that these models can provide reliable scene perception for autonomous ships

Air Object Height Estimation with 2-D Radars using Fuzzy Logic

Multi sensor tracking is a widely used technique in aerospace applications to estimate the target kinematics precisely. Particularly naval-based tracking systems utilize, different types of Radars (2-D, 3-D) in multi sensor tracking scenario for robust estimation. As the supplied information from 2-D Radar contains only range and azimuth values, it is difficult to estimate the height of an air object using 2-D Radar. In order to over come the limitation, a geometric method is considered to combine the information obtained from two 2-D Radars located in two different locations. As the solution of the geometric method depends upon certain geometric features, it is not possible to get good results with one pair of sensors. However to obtain better results, it is proposed and experimented more than two 2-D Radars that combined with a fuzzy logic based validation. This paper discusses the issues related to 2-D Radar tracking and the method comprising Triangulation geometry and fuzzy logic based validation method to improve the height estimation accuracy in real time.Defence Science Journal, 2011, 61(5), pp.485-490, DOI:http://dx.doi.org/10.14429/dsj.61.40

Particle Filter Based Ship State and Parameter Estimation for Vessel Maneuvers

Vessel states and parameters estimation is essential for maneuvering and collision avoidance. This study presents an application of particle filter (PF) algorithm to estimate vessel states and parameters. Particularly, to reduce the impact of the vessel’s underactuated property and complex environmental disturbance, the estimation process contains a kinematic curvilinear motion model that describes vessel’s motion. The estimated result can help navigators or ship onboard computers well comprehend the current vessel maneuvering condition. Besides, it can also serve as the necessary data source for vessel’s future trajectory prediction. Therefore, it can be integrated into vessel’s situation awareness (SA) module that supports safety navigation for both conventional and autonomous vessels

Adaptive smartphone-based sensor fusion for estimating competitive rowing kinematic metrics.

Competitive rowing highly values boat position and velocity data for real-time feedback during training, racing and post-training analysis. The ubiquity of smartphones with embedded position (GPS) and motion (accelerometer) sensors motivates their possible use in these tasks. In this paper, we investigate the use of two real-time digital filters to achieve highly accurate yet reasonably priced measurements of boat speed and distance traveled. Both filters combine acceleration and location data to estimate boat distance and speed; the first using a complementary frequency response-based filter technique, the second with a Kalman filter formalism that includes adaptive, real-time estimates of effective accelerometer bias. The estimates of distance and speed from both filters were validated and compared with accurate reference data from a differential GPS system with better than 1 cm precision and a 5 Hz update rate, in experiments using two subjects (an experienced club-level rower and an elite rower) in two different boats on a 300 m course. Compared with single channel (smartphone GPS only) measures of distance and speed, the complementary filter improved the accuracy and precision of boat speed, boat distance traveled, and distance per stroke by 44%, 42%, and 73%, respectively, while the Kalman filter improved the accuracy and precision of boat speed, boat distance traveled, and distance per stroke by 48%, 22%, and 82%, respectively. Both filters demonstrate promise as general purpose methods to substantially improve estimates of important rowing performance metrics

Multi-algorithm Swath Consistency Detection for Multibeam Echosounder Data

It is unrealistic to expect that any single algorithm for pre-filtering Multibeam Echosounder data will be able to detect all of the “noise in such data all of the time. This paper therefore presents a scheme for fusing the results of many pre-filtering sub-algorithms in order to form one, significantly more robust, meta-algorithm. This principle is illustrated on the problem of consistency detection in regions of sloping bathymetry. We show that the meta-algorithm is more robust, adapts dynamically to sub-algorithm performance, and is consistent with operator assessment of the data. The meta-algorithm is called the Multi-Algorithm Swath Consistency Detector