Space Remote Sensing and Detecting Systems of Oceangoing Ships

This paper introduces the implementation of space remote sensing and detecting systems of oceangoing ships as an alternative to the Radio – Automatic Identification System (R-AIS), Satellite – Automatic Identification System (S-AIS), Long Range Identification and Tracking (LRIT), and other current vessel tracking systems. In this paper will be not included  a new project known as a Global Ship Tracking (GST) as an autonomous and discrete satellite network designed by the Space Science Centre (SSC) for research and postgraduate studies in Satellite Communication, Navigation and Surveillance (CNS) at Durban University of Technology (DUT). The ship detection from satellite remote sensing imagery system is a crucial application for maritime safety and security, which includes among others ship tracking, detecting and traffic surveillance, oil spill detection service, and discharge control, sea pollution monitoring, sea ice monitoring service, and protection against illegal fisheries activities. The establishment of a modern sea surface and ships monitoring system needs enhancement of the Satellite Synthetic Aperture Radar (SSAR) that is here discussed as a modern observation infrastructure integrated with Ships Surveillance and Detecting via SSAR TerraSAR-X Spacecraft, Ships Surveillance and Detecting via SSAR Radarsat Spacecraft and Vessels Detecting System (VDS) via SSAR

3D Sonar Measurements in Wakes of Ships of Opportunity

The aim of this work is to test the potential capabilities of 3D sonar technology for studying small-scale processes in the near-surface layer of the ocean, using the centerline wake of ships of opportunity as the object of study. The first tests conducted in Tampa Bay, Florida, with the 3D sonar have demonstrated the ability of this technology to observe the shape of the centerlinewake in great detail starting from centimeter scale, using air bubbles as a proxy. An advantage of the 3Dsonar technology is that it allows quantitative estimates of the ship wake geometry, which presents new opportunities for validation of hydrodynamic models of the ship wake. Three-dimensional sonar is also a potentially useful tool for studies of air-bubble dynamics and turbulence in breaking surface waves

AIS-based Evaluation of Target Detectors and SAR Sensors Characteristics for Maritime Surveillance

International audienceThis paper studies the performances of different ship detectors based on adaptive threshold algorithms. The detec- tion algorithms are based on various clutter distributions and assessed automatically with a systematic methodology. Evaluation using large datasets of medium resolution SAR images and AIS (Automatic Identification System) data as ground truths allows to evaluate the efficiency of each detector. Depending on the datasets used for testing, the detection algorithms offer different advantages and disadvantages. The systematic method used in discriminating real detected targets and false alarms in order to determine the detection rate, allows us to perform an appropriate and consistent comparison of the detectors. The impact of SAR sensors characteristics (incidence angle, polarization, frequency and spatial resolution) is fully assessed, the vessels' length being also considered. Experiments are conducted on Radarsat-2 and CosmoSkymed ScanSAR datasets and AIS data acquired by coastal stations

Ship Wake Detection in SAR Images via Sparse Regularization

In order to analyse synthetic aperture radar (SAR) images of the sea surface, ship wake detection is essential for extracting information on the wake generating vessels. One possibility is to assume a linear model for wakes, in which case detection approaches are based on transforms such as Radon and Hough. These express the bright (dark) lines as peak (trough) points in the transform domain. In this paper, ship wake detection is posed as an inverse problem, which the associated cost function including a sparsity enforcing penalty, i.e. the generalized minimax concave (GMC) function. Despite being a non-convex regularizer, the GMC penalty enforces the overall cost function to be convex. The proposed solution is based on a Bayesian formulation, whereby the point estimates are recovered using maximum a posteriori (MAP) estimation. To quantify the performance of the proposed method, various types of SAR images are used, corresponding to TerraSAR-X, COSMO-SkyMed, Sentinel-1, and ALOS2. The performance of various priors in solving the proposed inverse problem is first studied by investigating the GMC along with the L1, Lp, nuclear and total variation (TV) norms. We show that the GMC achieves the best results and we subsequently study the merits of the corresponding method in comparison to two state-of-the-art approaches for ship wake detection. The results show that our proposed technique offers the best performance by achieving 80% success rate.Comment: 18 page

Sea target detection using spaceborne GNSS-R delay-doppler maps: theory and experimental proof of concept using TDS-1 data

© 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.This study addresses a novel application of global navigation satellite system-reflectometry (GNSS-R) delay-Doppler maps (DDMs), namely sea target detection. In contrast with other competing remote sensing technologies, such as synthetic aperture radar and optical systems, typically exploited in the field of sea target detection, GNSS-R systems could be employed as satellite constellations, so as to fulfill the temporal requirements for near real-time ships and sea ice sheets monitoring. In this study, the revisit time offered by GNSS-R systems is quantitatively evaluated by means of a simulation analysis, in which three different realistic GNSS-R missions are simulated and analyzed. Then, a sea target detection algorithm from spaceborne GNSS-R DDMs is described and assessed. The algorithm is based on a sea clutter compensation step and uses an adaptive threshold to take into account spatial variations in the sea background and/or noise statistics. Finally, the sea target detector algorithm is tested and validated for the first time ever using experimental GNSS-R data from the U.K. TechDemoSat-1 dataset. Performance is assessed by providing the receiver operating characteristic curves, and some preliminary experimental results are presented.Peer ReviewedPostprint (published version

훈련 자료 자동 추출 알고리즘과 기계 학습을 통한 SAR 영상 기반의 선박 탐지

학위논문 (석사) -- 서울대학교 대학원 : 자연과학대학 지구환경과학부, 2021. 2. 김덕진.Detection and surveillance of vessels are regarded as a crucial application of SAR for their contribution to the preservation of marine resources and the assurance on maritime safety. Introduction of machine learning to vessel detection significantly enhanced the performance and efficiency of the detection, but a substantial majority of studies focused on modifying the object detector algorithm. As the fundamental enhancement of the detection performance would be nearly impossible without accurate training data of vessels, this study implemented AIS information containing real-time information of vessel’s movement in order to propose a robust algorithm which acquires the training data of vessels in an automated manner. As AIS information was irregularly and discretely obtained, the exact target interpolation time for each vessel was precisely determined, followed by the implementation of Kalman filter, which mitigates the measurement error of AIS sensor. In addition, as the velocity of each vessel renders an imprint inside the SAR image named as Doppler frequency shift, it was calibrated by restoring the elliptic satellite orbit from the satellite state vector and estimating the distance between the satellite and the target vessel. From the calibrated position of the AIS sensor inside the corresponding SAR image, training data was directly obtained via internal allocation of the AIS sensor in each vessel. For fishing boats, separate information system named as VPASS was applied for the identical procedure of training data retrieval. Training data of vessels obtained via the automated training data procurement algorithm was evaluated by a conventional object detector, for three detection evaluating parameters: precision, recall and F1 score. All three evaluation parameters from the proposed training data acquisition significantly exceeded that from the manual acquisition. The major difference between two training datasets was demonstrated in the inshore regions and in the vicinity of strong scattering vessels in which land artifacts, ships and the ghost signals derived from them were indiscernible by visual inspection. This study additionally introduced a possibility of resolving the unclassified usage of each vessel by comparing AIS information with the accurate vessel detection results.전천후 지구 관측 위성인 SAR를 통한 선박 탐지는 해양 자원의 확보와 해상 안전 보장에 매우 중요한 역할을 한다. 기계 학습 기법의 도입으로 인해 선박을 비롯한 사물 탐지의 정확도 및 효율성이 향상되었으나, 이와 관련된 다수의 연구는 탐지 알고리즘의 개량에 집중되었다. 그러나, 탐지 정확도의 근본적인 향상은 정밀하게 취득된 대량의 훈련자료 없이는 불가능하기에, 본 연구에서는 선박의 실시간 위치, 속도 정보인 AIS 자료를 이용하여 인공 지능 기반의 선박 탐지 알고리즘에 사용될 훈련자료를 자동적으로 취득하는 알고리즘을 제안하였다. 이를 위해 이산적인 AIS 자료를 SAR 영상의 취득시각에 맞추어 정확하게 보간하고, AIS 센서 자체가 가지는 오차를 최소화하였다. 또한, 이동하는 산란체의 시선 속도로 인해 발생하는 도플러 편이 효과를 보정하기 위해 SAR 위성의 상태 벡터를 이용하여 위성과 산란체 사이의 거리를 정밀하게 계산하였다. 이렇게 계산된 AIS 센서의 영상 내의 위치로부터 선박 내 AIS 센서의 배치를 고려하여 선박 탐지 알고리즘의 훈련자료 형식에 맞추어 훈련자료를 취득하고, 어선에 대한 위치, 속도 정보인 VPASS 자료 역시 유사한 방법으로 가공하여 훈련자료를 취득하였다. AIS 자료로부터 취득한 훈련자료는 기존 방법대로 수동 취득한 훈련자료와 함께 인공 지능 기반 사물 탐지 알고리즘을 통해 정확도를 평가하였다. 그 결과, 제시된 알고리즘으로 취득한 훈련 자료는 수동 취득한 훈련 자료 대비 더 높은 탐지 정확도를 보였으며, 이는 기존의 사물 탐지 알고리즘의 평가 지표인 정밀도, 재현율과 F1 score를 통해 진행되었다. 본 연구에서 제안한 훈련자료 자동 취득 기법으로 얻은 선박에 대한 훈련자료는 특히 기존의 선박 탐지 기법으로는 분별이 어려웠던 항만에 인접한 선박과 산란체 주변의 신호에 대한 정확한 분별 결과를 보였다. 본 연구에서는 이와 함께, 선박 탐지 결과와 해당 지역에 대한 AIS 및 VPASS 자료를 이용하여 선박의 미식별성을 판정할 수 있는 가능성 또한 제시하였다.Chapter 1. Introduction - 1 - 1.1 Research Background - 1 - 1.2 Research Objective - 8 - Chapter 2. Data Acquisition - 10 - 2.1 Acquisition of SAR Image Data - 10 - 2.2 Acquisition of AIS and VPASS Information - 20 - Chapter 3. Methodology on Training Data Procurement - 26 - 3.1 Interpolation of Discrete AIS Data - 29 - 3.1.1 Estimation of Target Interpolation Time for Vessels - 29 - 3.1.2 Application of Kalman Filter to AIS Data - 34 - 3.2 Doppler Frequency Shift Correction - 40 - 3.2.1 Theoretical Basis of Doppler Frequency Shift - 40 - 3.2.2 Mitigation of Doppler Frequency Shift - 48 - 3.3 Retrieval of Training Data of Vessels - 53 - 3.4 Algorithm on Vessel Training Data Acquisition from VPASS Information - 61 - Chapter 4. Methodology on Object Detection Architecture - 66 - Chapter 5. Results - 74 - 5.1 Assessment on Training Data - 74 - 5.2 Assessment on AIS-based Ship Detection - 79 - 5.3 Assessment on VPASS-based Fishing Boat Detection - 91 - Chapter 6. Discussions - 110 - 6.1 Discussion on AIS-Based Ship Detection - 110 - 6.2 Application on Determining Unclassified Vessels - 116 - Chapter 7. Conclusion - 125 - 국문 요약문 - 128 - Bibliography - 130 -Maste

A near real-time automated oil spill detection and early warning system using Sentinel-1 SAR imagery for the Southeastern Mediterranean Sea

The ecological and environmental impact of marine oil pollution underlines the importance and necessity of an oil spill surveillance system. This study proposes an operational automated oil spill detection and early warning system to help take quick action for oil combating operations. Oil slicks in the spaceborne Sentinel-1 synthetic aperture radar (SAR) data are detected by a trained deep learning-based oil object detector. These detected oil objects are segmented into binary masks based on the similarity and discontinuity of the backscattering coefficients, and their trajectory is simulated. The detection process was tested on one-year SAR acquisitions in 2019, covering the Southeastern Mediterranean Sea; the false discovery rate (FDR) and false negative rate (FNR) are 23.3% and 24.0%, respectively. The system takes around 1.5 h from downloading SAR images to providing slick trajectory simulation. This study highlights the capabilities of using deep learning-based techniques in an operational oil spill surveillance service

Can We "Sense" the Call of The Ocean? Current Advances in Remote Sensing Computational Imaging for Marine Debris Monitoring

Especially due to the unconscious use of petroleum products, the ocean faces a potential danger: $\textit{plastic pollution}$. Plastic pollutes not only the ocean but also directly the air and foods whilst endangering the ocean wild-life due to the ingestion and entanglements. Especially, during the last decade, public initiatives and academic institutions have spent an enormous time on finding possible solutions to marine plastic pollution. Remote sensing imagery sits in a crucial place for these efforts since it provides highly informative earth observation products. Despite this, detection, and monitoring of the marine environment in the context of plastic pollution is still in its early stages and the current technology offers possible important development for the computational efforts. This paper contributes to the literature with a thorough and rich review and aims to highlight notable literature milestones in marine debris monitoring applications by promoting the computational imaging methodology behind these approaches.Comment: 25 pages, 11 figure

Oil spill and ship detection using high resolution polarimetric X-band SAR data

Among illegal human activities, marine pollution and target detection are the key concern of Maritime Security and Safety. This thesis deals with oil spill and ship detection using high resolution X-band polarimetric SAR (PolSAR). Polarimetry aims at analysing the polarization state of a wave field, in order to obtain physical information from the observed object. In this dissertation PolSAR techniques are suggested as improvement of the current State-of-the-Art of SAR marine pollution and target detection, by examining in depth Near Real Time suitability