Ship detection on open sea and coastal environment

Synthetic Aperture Radar (SAR) is a high-resolution ground-mapping technique with the ability to effectively synthesize a large radar antenna by processing the phase of a smaller radar antenna on a moving platform like an airplane or a satellite. SAR images, due to its properties, have been the focus of many applications such as land and sea monitoring, remote sensing, mapping of surfaces, weather forecasting, among many others. Their relevance is increasing on a daily basis, thus it’s crucial to apply the best suitable method or technique to each type of data collected. Several techniques have been published in the literature so far to enhance automatic ship detection using Synthetic Aperture Radar (SAR) images, like multilook imaging techniques, polarization techniques, Constant False Alarm Rate (CFAR) techniques, Amplitude Change Detection (ACD) techniques among many others. Depending on how the information is gathered and processed, each technique presents different performance and results. Nowadays there are several ongoing SAR missions, and the need to improve ship detection, oil-spills or any kind of sea activity is fundamental to preserve and promote navigation safety as well as constant and accurate monitoring of the surroundings, for example, detection of illegal fishing activities, pollution or drug trafficking. The main objective of this MSc dissertation is to study and implement a set of algorithms for automatic ship detection using SAR images from Sentinel-1 due to its characteristics as well as its ease access. The dissertation organization is as follows: Chapter 1 presents a brief introduction to the theme of this dissertation and its aim, as well as its structure; Chapter 2 summarizes a variety of fundamental key points from historical events and developments to the SAR theory, finishing with a summary of some well-known ship detection methods; Chapter 3 presents a basic guideline to choose the best ship detection technique depending on the data type and operational scenario; Chapter 4 focus on the CFAR technique detailing the implemented algorithms. This technique was selected, given the data set available for testing in this work; Chapter 5 presents the results obtained using the implemented algorithms; Chapter 6 presents the conclusions, final remarks and future work

Study of the speckle noise effects over the eigen decomposition of polarimetric SAR data: a review

This paper is focused on considering the effects of speckle noise on the eigen decomposition of the co- herency matrix. Based on a perturbation analysis of the matrix, it is possible to obtain an analytical expression for the mean value of the eigenvalues and the eigenvectors, as well as for the Entropy, the Anisotroopy and the dif- ferent a angles. The analytical expressions are compared against simulated polarimetric SAR data, demonstrating the correctness of the different expressions.Peer ReviewedPostprint (published version

훈련 자료 자동 추출 알고리즘과 기계 학습을 통한 SAR 영상 기반의 선박 탐지

학위논문 (석사) -- 서울대학교 대학원 : 자연과학대학 지구환경과학부, 2021. 2. 김덕진.Detection and surveillance of vessels are regarded as a crucial application of SAR for their contribution to the preservation of marine resources and the assurance on maritime safety. Introduction of machine learning to vessel detection significantly enhanced the performance and efficiency of the detection, but a substantial majority of studies focused on modifying the object detector algorithm. As the fundamental enhancement of the detection performance would be nearly impossible without accurate training data of vessels, this study implemented AIS information containing real-time information of vessel’s movement in order to propose a robust algorithm which acquires the training data of vessels in an automated manner. As AIS information was irregularly and discretely obtained, the exact target interpolation time for each vessel was precisely determined, followed by the implementation of Kalman filter, which mitigates the measurement error of AIS sensor. In addition, as the velocity of each vessel renders an imprint inside the SAR image named as Doppler frequency shift, it was calibrated by restoring the elliptic satellite orbit from the satellite state vector and estimating the distance between the satellite and the target vessel. From the calibrated position of the AIS sensor inside the corresponding SAR image, training data was directly obtained via internal allocation of the AIS sensor in each vessel. For fishing boats, separate information system named as VPASS was applied for the identical procedure of training data retrieval. Training data of vessels obtained via the automated training data procurement algorithm was evaluated by a conventional object detector, for three detection evaluating parameters: precision, recall and F1 score. All three evaluation parameters from the proposed training data acquisition significantly exceeded that from the manual acquisition. The major difference between two training datasets was demonstrated in the inshore regions and in the vicinity of strong scattering vessels in which land artifacts, ships and the ghost signals derived from them were indiscernible by visual inspection. This study additionally introduced a possibility of resolving the unclassified usage of each vessel by comparing AIS information with the accurate vessel detection results.전천후 지구 관측 위성인 SAR를 통한 선박 탐지는 해양 자원의 확보와 해상 안전 보장에 매우 중요한 역할을 한다. 기계 학습 기법의 도입으로 인해 선박을 비롯한 사물 탐지의 정확도 및 효율성이 향상되었으나, 이와 관련된 다수의 연구는 탐지 알고리즘의 개량에 집중되었다. 그러나, 탐지 정확도의 근본적인 향상은 정밀하게 취득된 대량의 훈련자료 없이는 불가능하기에, 본 연구에서는 선박의 실시간 위치, 속도 정보인 AIS 자료를 이용하여 인공 지능 기반의 선박 탐지 알고리즘에 사용될 훈련자료를 자동적으로 취득하는 알고리즘을 제안하였다. 이를 위해 이산적인 AIS 자료를 SAR 영상의 취득시각에 맞추어 정확하게 보간하고, AIS 센서 자체가 가지는 오차를 최소화하였다. 또한, 이동하는 산란체의 시선 속도로 인해 발생하는 도플러 편이 효과를 보정하기 위해 SAR 위성의 상태 벡터를 이용하여 위성과 산란체 사이의 거리를 정밀하게 계산하였다. 이렇게 계산된 AIS 센서의 영상 내의 위치로부터 선박 내 AIS 센서의 배치를 고려하여 선박 탐지 알고리즘의 훈련자료 형식에 맞추어 훈련자료를 취득하고, 어선에 대한 위치, 속도 정보인 VPASS 자료 역시 유사한 방법으로 가공하여 훈련자료를 취득하였다. AIS 자료로부터 취득한 훈련자료는 기존 방법대로 수동 취득한 훈련자료와 함께 인공 지능 기반 사물 탐지 알고리즘을 통해 정확도를 평가하였다. 그 결과, 제시된 알고리즘으로 취득한 훈련 자료는 수동 취득한 훈련 자료 대비 더 높은 탐지 정확도를 보였으며, 이는 기존의 사물 탐지 알고리즘의 평가 지표인 정밀도, 재현율과 F1 score를 통해 진행되었다. 본 연구에서 제안한 훈련자료 자동 취득 기법으로 얻은 선박에 대한 훈련자료는 특히 기존의 선박 탐지 기법으로는 분별이 어려웠던 항만에 인접한 선박과 산란체 주변의 신호에 대한 정확한 분별 결과를 보였다. 본 연구에서는 이와 함께, 선박 탐지 결과와 해당 지역에 대한 AIS 및 VPASS 자료를 이용하여 선박의 미식별성을 판정할 수 있는 가능성 또한 제시하였다.Chapter 1. Introduction - 1 - 1.1 Research Background - 1 - 1.2 Research Objective - 8 - Chapter 2. Data Acquisition - 10 - 2.1 Acquisition of SAR Image Data - 10 - 2.2 Acquisition of AIS and VPASS Information - 20 - Chapter 3. Methodology on Training Data Procurement - 26 - 3.1 Interpolation of Discrete AIS Data - 29 - 3.1.1 Estimation of Target Interpolation Time for Vessels - 29 - 3.1.2 Application of Kalman Filter to AIS Data - 34 - 3.2 Doppler Frequency Shift Correction - 40 - 3.2.1 Theoretical Basis of Doppler Frequency Shift - 40 - 3.2.2 Mitigation of Doppler Frequency Shift - 48 - 3.3 Retrieval of Training Data of Vessels - 53 - 3.4 Algorithm on Vessel Training Data Acquisition from VPASS Information - 61 - Chapter 4. Methodology on Object Detection Architecture - 66 - Chapter 5. Results - 74 - 5.1 Assessment on Training Data - 74 - 5.2 Assessment on AIS-based Ship Detection - 79 - 5.3 Assessment on VPASS-based Fishing Boat Detection - 91 - Chapter 6. Discussions - 110 - 6.1 Discussion on AIS-Based Ship Detection - 110 - 6.2 Application on Determining Unclassified Vessels - 116 - Chapter 7. Conclusion - 125 - 국문 요약문 - 128 - Bibliography - 130 -Maste

Quad polarimetric synthetic aperture radar analysis of icebergs in Greenland and Svalbard

Polarimetric synthetic aperture radar (PolSAR) has been widely used in ocean and cryospheric applications. This is because, PolSAR can be used in all-day operations and in areas of cloud cover, and therefore can provide valuable large-scale monitoring in polar regions, which is very helpful to shipping and offshore maritime operations. In the last decades, attention has turned to the potential of PolSAR to detect icebergs in the Arctic since they are a major hazard to vessels. However, there is a substantial lack of literature exploring the potentialities of PolSAR and the understanding of iceberg scattering mechanisms. Additionally, it is not known if high resolution PolSAR can be used to detect icebergs smaller than 120 metres. This thesis aims to improve the knowledge of the use of PolSAR scattering mechanisms of icebergs, and detection of small icebergs. First, an introduction to PolSAR is outlined in chapter two, and monitoring of icebergs is presented in chapter three. The first data chapter (Chapter 4) is focused on developing a multi-scale analysis of icebergs using parameters from the Cloude-Pottier and the Yamaguchi decompositions, the polarimetric span and the Pauli scattering vector. This method is carried out using ALOS-2 PALSAR quad polarimetric L-band SAR on icebergs in Greenland. This approach outlines the good potential for using PolSAR for future iceberg classification. One of the main important outcomes is that icebergs are composed by a combination of single targets, which therefore may require a more complex way of processing SAR data to properly extract physical information. In chapter five, the problem of detecting icebergs is addressed by introducing six state-of-the-art detectors previously applied to vessel monitoring. These detectors are the Dual Intensity Polarisation Ratio Anomaly Detector (iDPolRAD), Polarimetric Notch Filter (PNF), Polarimetric Matched Filter (PMF), reflection symmetry (sym), Optimal Polarimetric Detector (OPD) and the Polarimetric Whitening Filter (PWF). Cloude-Pottier entropy, and first and third eigenvalues (eig1 and eig3) of the coherency matrix are also utilised as parameters for comparison. This approach uses the same ALOS-2 dataset, but also evaluates detection performance in two scenarios: icebergs in open ocean, and in sea ice. Polarimetric modes (quad-pol, dual-pol, and single intensities) are also considered for comparison. Currently it is very difficult to detect icebergs less than 120 metres in length using this approach, due to the scattering mechanisms of icebergs and sea ice being very similar. However, it was possible to obtain detection performances of the OPD and PWF, which both showed a Probability of Detection (PF) of 0.99 when the Probability of False Alarms (PF) was set to 10-5 in open ocean. Similarly, in dual pol images, the PWF gave the best performance with a PD of 0.90. Results in sea ice found eig3 to be the best detector with a PD of 0.90 while in dual-pol mode, iDPolRAD gave a PD of 0.978. Single intensity detector performance found the HV channel gave the best detection with a PD of 0.99 in open ocean and 0.87 in sea ice. In the previous two approaches, only satellite data is used. However, in chapter six, data from a ground-based Ku-band Gamma Portable Radio Interferometer (GPRI) instrument is introduced, providing images that are synchronised with the satellite acquisitions. In this approach, the same six detectors are applied to three multitemporal RADARSAT-2 quad pol C-band SAR images on icebergs in Kongsfjorden, Svalbard to evaluate the detection performance within a changing fjord environment. As before, we also make use of Cloude-Pottier entropy, eig1 and eig3. Finally, we evaluate the target-to-clutter ratio (TCR) of the icebergs and check for correlation between the backscattering coefficients and the iceberg dimension. The results obtained from this thesis present original additions to the literature that contributes to the understanding of PolSAR in cryospheric applications. Although these methods are applied to PolSAR and ground-based radar on vessels, they have been applied for the first time on icebergs in this thesis. To summarise, the main findings are that icebergs cannot be represented as single or partial targets, but they do exhibit a collection of single targets clustered together. This result leads to the fact that entropy is not sufficient as a parameter to detect icebergs. Detection results show that the OPD and PWF detectors perform best in an open ocean setting and using quad-pol mode. These results are degraded in dual-pol mode, while single intensity detection is best in the HV cross polarisation channel. When these detectors are applied to the RADARSAT-2 in Svalbard, the OPD and PWF detectors also perform best with PD values ranging between 0.5-0.75 for a PF of 0.01-0.05. However, the sea ice present in the fjord degrades performance across all detectors. Correlation plots with iceberg size show that a regression is not straightforward and Computer Vision methodologies may work best for this

Classification of Compact Polarimetric Synthetic Aperture Radar Images

The RADARSAT Constellation Mission (RCM) was launched in June 2019. RCM, in addition to dual-polarization (DP) and fully quad-polarimetric (QP) imaging modes, provides compact polarimetric (CP) mode data. A CP synthetic aperture radar (SAR) is a coherent DP system in which a single circular polarization is transmitted followed by the reception in two orthogonal linear polarizations. A CP SAR fully characterizes the backscattered field using the Stokes parameters, or equivalently, the complex coherence matrix. This is the main advantage of a CP SAR over the traditional (non-coherent) DP SAR. Therefore, designing scene segmentation and classification methods using CP complex coherence matrix data is advocated in this thesis. Scene classification of remotely captured images is an important task in monitoring the Earth's surface. The high-resolution RCM CP SAR data can be used for land cover classification as well as sea-ice mapping. Mapping sea ice formed in ocean bodies is important for ship navigation and climate change modeling. The Canadian Ice Service (CIS) has expert ice analysts who manually generate sea-ice maps of Arctic areas on a daily basis. An automated sea-ice mapping process that can provide detailed yet reliable maps of ice types and water is desirable for CIS. In addition to linear DP SAR data in ScanSAR mode (500km), RCM wide-swath CP data (350km) can also be used in operational sea-ice mapping of the vast expanses in the Arctic areas. The smaller swath coverage of QP SAR data (50km) is the reason why the use of QP SAR data is limited for sea-ice mapping. This thesis involves the design and development of CP classification methods that consist of two steps: an unsupervised segmentation of CP data to identify homogeneous regions (superpixels) and a labeling step where a ground truth label is assigned to each super-pixel. An unsupervised segmentation algorithm is developed based on the existing Iterative Region Growing using Semantics (IRGS) for CP data and is called CP-IRGS. The constituents of feature model and spatial context model energy terms in CP-IRGS are developed based on the statistical properties of CP complex coherence matrix data. The superpixels generated by CP-IRGS are then used in a graph-based labeling method that incorporates the global spatial correlation among super-pixels in CP data. The classifications of sea-ice and land cover types using test scenes indicate that (a) CP scenes provide improved sea-ice classification than the linear DP scenes, (b) CP-IRGS performs more accurate segmentation than that using only CP channel intensity images, and (c) using global spatial information (provided by a graph-based labeling approach) provides an improvement in classification accuracy values over methods that do not exploit global spatial correlation

Introduction to radar scattering application in remote sensing and diagnostics: Review

The manuscript reviews the current literature on scattering applications of RADAR (Radio Detecting And Ranging) in remote sensing and diagnostics. This paper gives prime features for a variety of RADAR applications ranging from forest and climate monitoring to weather forecast, sea status, planetary information, and mapping of natural disasters such as the ones caused by earthquakes. Both the fundamental parameters involved in scattering mechanisms of RADAR applications and the factors affecting RADAR performances are also discusse

Polarimetric Synthetic Aperture Radar

This open access book focuses on the practical application of electromagnetic polarimetry principles in Earth remote sensing with an educational purpose. In the last decade, the operations from fully polarimetric synthetic aperture radar such as the Japanese ALOS/PalSAR, the Canadian Radarsat-2 and the German TerraSAR-X and their easy data access for scientific use have developed further the research and data applications at L,C and X band. As a consequence, the wider distribution of polarimetric data sets across the remote sensing community boosted activity and development in polarimetric SAR applications, also in view of future missions. Numerous experiments with real data from spaceborne platforms are shown, with the aim of giving an up-to-date and complete treatment of the unique benefits of fully polarimetric synthetic aperture radar data in five different domains: forest, agriculture, cryosphere, urban and oceans

Synthetic Aperture Radar (SAR) Meets Deep Learning

This reprint focuses on the application of the combination of synthetic aperture radars and depth learning technology. It aims to further promote the development of SAR image intelligent interpretation technology. A synthetic aperture radar (SAR) is an important active microwave imaging sensor, whose all-day and all-weather working capacity give it an important place in the remote sensing community. Since the United States launched the first SAR satellite, SAR has received much attention in the remote sensing community, e.g., in geological exploration, topographic mapping, disaster forecast, and traffic monitoring. It is valuable and meaningful, therefore, to study SAR-based remote sensing applications. In recent years, deep learning represented by convolution neural networks has promoted significant progress in the computer vision community, e.g., in face recognition, the driverless field and Internet of things (IoT). Deep learning can enable computational models with multiple processing layers to learn data representations with multiple-level abstractions. This can greatly improve the performance of various applications. This reprint provides a platform for researchers to handle the above significant challenges and present their innovative and cutting-edge research results when applying deep learning to SAR in various manuscript types, e.g., articles, letters, reviews and technical reports

Polarimetric Synthetic Aperture Radar, Principles and Application

Demonstrates the benefits of the usage of fully polarimetric synthetic aperture radar data in applications of Earth remote sensing, with educational and development purposes. Includes numerous up-to-date examples with real data from spaceborne platforms and possibility to use a software to support lecture practicals. Reviews theoretical principles in an intuitive way for each application topic. Covers in depth five application domains (forests, agriculture, cryosphere, urban, and oceans), with reference also to hazard monitorin