Sea Ice Extraction via Remote Sensed Imagery: Algorithms, Datasets, Applications and Challenges

The deep learning, which is a dominating technique in artificial intelligence, has completely changed the image understanding over the past decade. As a consequence, the sea ice extraction (SIE) problem has reached a new era. We present a comprehensive review of four important aspects of SIE, including algorithms, datasets, applications, and the future trends. Our review focuses on researches published from 2016 to the present, with a specific focus on deep learning-based approaches in the last five years. We divided all relegated algorithms into 3 categories, including classical image segmentation approach, machine learning-based approach and deep learning-based methods. We reviewed the accessible ice datasets including SAR-based datasets, the optical-based datasets and others. The applications are presented in 4 aspects including climate research, navigation, geographic information systems (GIS) production and others. It also provides insightful observations and inspiring future research directions.Comment: 24 pages, 6 figure

A ship detector applying Principal Component Analysis to the polarimetric Notch Filter

Ship detection using polarimetric synthetic aperture radar (PolSAR) data has attracted a lot of attention in recent years. Polarimetry can provide information regarding the scattering mechanisms of targets, which helps discriminate between ships and sea clutter. This enhancement is particularly valuable when we aim at detecting smaller vessels in rough sea states. This work exploits a ship detector called the Geometrical Perturbation-Polarimetric Notch Filter (GP-PNF), and it is aimed at improving its performance especially when less polarimetric images are available (e.g., dual-polarimetric data). The idea is to design a new polarimetric feature vector containing more features that are renowned to allow separation between ships and sea clutter. Then, a Principal Component Analysis (PCA) is further used to reduce the dimensionality of the new feature space. Experiments on four real Sentinel-1 datasets are carried out to demonstrate the validity of the proposed method and compare it against other ship detectors. Analyses of the experimental results show that the proposed algorithm can not only reduce the false alarms significantly, but also enhance the target-to-clutter ratio (TCR) so that it can more effectively detect weaker ships

Estimation of the Degree of Polarization in Polarimetric SAR Imagery : Principles and Applications

Les radars à synthèse d’ouverture (RSO) polarimétriques sont devenus incontournables dans le domaine de la télédétection, grâce à leur zone de couverture étendue, ainsi que leur capacité à acquérir des données dans n’importe quelles conditions atmosphériques de jour comme de nuit. Au cours des trois dernières décennies, plusieurs RSO polarimétriques ont été utilisés portant une variété de modes d’imagerie, tels que la polarisation unique, la polarisation double et également des modes dits pleinement polarimétriques. Grâce aux recherches récentes, d’autres modes alternatifs, tels que la polarisation hybride et compacte, ont été proposés pour les futures missions RSOs. Toutefois, un débat anime la communauté de la télédétection quant à l’utilité des modes alternatifs et quant au compromis entre la polarimétrie double et la polarimétrie totale. Cette thèse contribue à ce débat en analysant et comparant ces différents modes d’imagerie RSO dans une variété d’applications, avec un accent particulier sur la surveillance maritime (la détection des navires et de marées noires). Pour nos comparaisons, nous considérons un paramètre fondamental, appelé le degré de polarisation (DoP). Ce paramètre scalaire a été reconnu comme l’un des paramètres les plus pertinents pour caractériser les ondes électromagnétiques partiellement polarisées. A l’aide d’une analyse statistique détaillée sur les images polarimétriques RSO, nous proposons des estimateurs efficaces du DoP pour les systèmes d’imagerie cohérente et incohérente. Ainsi, nous étendons la notion de DoP aux différents modes d’imagerie polarimétrique hybride et compacte. Cette étude comparative réalisée dans différents contextes d’application dégage des propriétés permettant de guider le choix parmi les différents modes polarimétriques. Les expériences sont effectuées sur les données polarimétriques provenant du satellite Canadian RADARSAT-2 et le RSO aéroporté Américain AirSAR, couvrant divers types de terrains tels que l’urbain, la végétation et l’océan. Par ailleurs nous réalisons une étude détaillée sur les potentiels du DoP pour la détection et la reconnaissance des marées noires basée sur les acquisitions récentes d’UAVSAR, couvrant la catastrophe de Deepwater Horizon dans le golfe du Mexique. ABSTRACT : Polarimetric Synthetic Aperture Radar (SAR) systems have become highly fruitful thanks to their wide area coverage and day and night all-weather capabilities. Several polarimetric SARs have been flown over the last few decades with a variety of polarimetric SAR imaging modes; traditional ones are linear singleand dual-pol modes. More sophisticated ones are full-pol modes. Other alternative modes, such as hybrid and compact dual-pol, have also been recently proposed for future SAR missions. The discussion is vivid across the remote sensing society about both the utility of such alternative modes, and also the trade-off between dual and full polarimetry. This thesis contributes to that discussion by analyzing and comparing different polarimetric SAR modes in a variety of geoscience applications, with a particular focus on maritime monitoring and surveillance. For our comparisons, we make use of a fundamental, physically related discriminator called the Degree of Polarization (DoP). This scalar parameter has been recognized as one of the most important parameters characterizing a partially polarized electromagnetic wave. Based on a detailed statistical analysis of polarimetric SAR images, we propose efficient estimators of the DoP for both coherent and in-coherent SAR systems. We extend the DoP concept to different hybrid and compact SAR modes and compare the achieved performance with different full-pol methods. We perform a detailed study of vessel detection and oil-spill recognition, based on linear and hybrid/compact dual-pol DoP, using recent data from the Deepwater Horizon oil-spill, acquired by the National Aeronautics and Space Administration (NASA)/Jet Propulsion Laboratory (JPL) Uninhabited Aerial Vehicle Synthetic Aperture Radar (UAVSAR). Extensive experiments are also performed over various terrain types, such as urban, vegetation, and ocean, using the data acquired by the Canadian RADARSAT-2 and the NASA/JPL Airborne SAR (AirSAR) system

Study of the speckle noise effects over the eigen decomposition of polarimetric SAR data: a review

This paper is focused on considering the effects of speckle noise on the eigen decomposition of the co- herency matrix. Based on a perturbation analysis of the matrix, it is possible to obtain an analytical expression for the mean value of the eigenvalues and the eigenvectors, as well as for the Entropy, the Anisotroopy and the dif- ferent a angles. The analytical expressions are compared against simulated polarimetric SAR data, demonstrating the correctness of the different expressions.Peer ReviewedPostprint (published version

훈련 자료 자동 추출 알고리즘과 기계 학습을 통한 SAR 영상 기반의 선박 탐지

학위논문 (석사) -- 서울대학교 대학원 : 자연과학대학 지구환경과학부, 2021. 2. 김덕진.Detection and surveillance of vessels are regarded as a crucial application of SAR for their contribution to the preservation of marine resources and the assurance on maritime safety. Introduction of machine learning to vessel detection significantly enhanced the performance and efficiency of the detection, but a substantial majority of studies focused on modifying the object detector algorithm. As the fundamental enhancement of the detection performance would be nearly impossible without accurate training data of vessels, this study implemented AIS information containing real-time information of vessel’s movement in order to propose a robust algorithm which acquires the training data of vessels in an automated manner. As AIS information was irregularly and discretely obtained, the exact target interpolation time for each vessel was precisely determined, followed by the implementation of Kalman filter, which mitigates the measurement error of AIS sensor. In addition, as the velocity of each vessel renders an imprint inside the SAR image named as Doppler frequency shift, it was calibrated by restoring the elliptic satellite orbit from the satellite state vector and estimating the distance between the satellite and the target vessel. From the calibrated position of the AIS sensor inside the corresponding SAR image, training data was directly obtained via internal allocation of the AIS sensor in each vessel. For fishing boats, separate information system named as VPASS was applied for the identical procedure of training data retrieval. Training data of vessels obtained via the automated training data procurement algorithm was evaluated by a conventional object detector, for three detection evaluating parameters: precision, recall and F1 score. All three evaluation parameters from the proposed training data acquisition significantly exceeded that from the manual acquisition. The major difference between two training datasets was demonstrated in the inshore regions and in the vicinity of strong scattering vessels in which land artifacts, ships and the ghost signals derived from them were indiscernible by visual inspection. This study additionally introduced a possibility of resolving the unclassified usage of each vessel by comparing AIS information with the accurate vessel detection results.전천후 지구 관측 위성인 SAR를 통한 선박 탐지는 해양 자원의 확보와 해상 안전 보장에 매우 중요한 역할을 한다. 기계 학습 기법의 도입으로 인해 선박을 비롯한 사물 탐지의 정확도 및 효율성이 향상되었으나, 이와 관련된 다수의 연구는 탐지 알고리즘의 개량에 집중되었다. 그러나, 탐지 정확도의 근본적인 향상은 정밀하게 취득된 대량의 훈련자료 없이는 불가능하기에, 본 연구에서는 선박의 실시간 위치, 속도 정보인 AIS 자료를 이용하여 인공 지능 기반의 선박 탐지 알고리즘에 사용될 훈련자료를 자동적으로 취득하는 알고리즘을 제안하였다. 이를 위해 이산적인 AIS 자료를 SAR 영상의 취득시각에 맞추어 정확하게 보간하고, AIS 센서 자체가 가지는 오차를 최소화하였다. 또한, 이동하는 산란체의 시선 속도로 인해 발생하는 도플러 편이 효과를 보정하기 위해 SAR 위성의 상태 벡터를 이용하여 위성과 산란체 사이의 거리를 정밀하게 계산하였다. 이렇게 계산된 AIS 센서의 영상 내의 위치로부터 선박 내 AIS 센서의 배치를 고려하여 선박 탐지 알고리즘의 훈련자료 형식에 맞추어 훈련자료를 취득하고, 어선에 대한 위치, 속도 정보인 VPASS 자료 역시 유사한 방법으로 가공하여 훈련자료를 취득하였다. AIS 자료로부터 취득한 훈련자료는 기존 방법대로 수동 취득한 훈련자료와 함께 인공 지능 기반 사물 탐지 알고리즘을 통해 정확도를 평가하였다. 그 결과, 제시된 알고리즘으로 취득한 훈련 자료는 수동 취득한 훈련 자료 대비 더 높은 탐지 정확도를 보였으며, 이는 기존의 사물 탐지 알고리즘의 평가 지표인 정밀도, 재현율과 F1 score를 통해 진행되었다. 본 연구에서 제안한 훈련자료 자동 취득 기법으로 얻은 선박에 대한 훈련자료는 특히 기존의 선박 탐지 기법으로는 분별이 어려웠던 항만에 인접한 선박과 산란체 주변의 신호에 대한 정확한 분별 결과를 보였다. 본 연구에서는 이와 함께, 선박 탐지 결과와 해당 지역에 대한 AIS 및 VPASS 자료를 이용하여 선박의 미식별성을 판정할 수 있는 가능성 또한 제시하였다.Chapter 1. Introduction - 1 - 1.1 Research Background - 1 - 1.2 Research Objective - 8 - Chapter 2. Data Acquisition - 10 - 2.1 Acquisition of SAR Image Data - 10 - 2.2 Acquisition of AIS and VPASS Information - 20 - Chapter 3. Methodology on Training Data Procurement - 26 - 3.1 Interpolation of Discrete AIS Data - 29 - 3.1.1 Estimation of Target Interpolation Time for Vessels - 29 - 3.1.2 Application of Kalman Filter to AIS Data - 34 - 3.2 Doppler Frequency Shift Correction - 40 - 3.2.1 Theoretical Basis of Doppler Frequency Shift - 40 - 3.2.2 Mitigation of Doppler Frequency Shift - 48 - 3.3 Retrieval of Training Data of Vessels - 53 - 3.4 Algorithm on Vessel Training Data Acquisition from VPASS Information - 61 - Chapter 4. Methodology on Object Detection Architecture - 66 - Chapter 5. Results - 74 - 5.1 Assessment on Training Data - 74 - 5.2 Assessment on AIS-based Ship Detection - 79 - 5.3 Assessment on VPASS-based Fishing Boat Detection - 91 - Chapter 6. Discussions - 110 - 6.1 Discussion on AIS-Based Ship Detection - 110 - 6.2 Application on Determining Unclassified Vessels - 116 - Chapter 7. Conclusion - 125 - 국문 요약문 - 128 - Bibliography - 130 -Maste

Remote Sensing of the Oceans

This book covers different topics in the framework of remote sensing of the oceans. Latest research advancements and brand-new studies are presented that address the exploitation of remote sensing instruments and simulation tools to improve the understanding of ocean processes and enable cutting-edge applications with the aim of preserving the ocean environment and supporting the blue economy. Hence, this book provides a reference framework for state-of-the-art remote sensing methods that deal with the generation of added-value products and the geophysical information retrieval in related fields, including: Oil spill detection and discrimination; Analysis of tropical cyclones and sea echoes; Shoreline and aquaculture area extraction; Monitoring coastal marine litter and moving vessels; Processing of SAR, HF radar and UAV measurements

A notch filter for ship detection with polarimetric SAR data

Ship detection with Synthetic Aperture Radar (SAR) is a major topic for the security and monitoring of maritime areas. One of the advantages of using SAR lay in its capability to acquire useful images with any-weather conditions and at night time. Specifically, this paper proposes a new methodology exploiting polarimetric acquisitions (dual- and quad-polarimetric). The methodology adopted for the detector algorithm was introduced by the author and performs a perturbation analysis in space of polarimetric targets checking for coherence between the target to detect and its perturbed version on the data. In the present work, this methodology is optimized for detection of marine features. In the end, the algorithm can be considered to be a negative (notch) filter focused on sea. Consequently, all the features which have a polarimetric behavior different from the sea are detected (i.e. ships, icebergs, buoys, etc). Moreover, a dual polarimetric version of the detector is designed, to be exploited in the circumstances where quad polarimetric data cannot be acquired. The detector was tested with TerraSAR-X quad polarimetric data showing significant agreement with the available ground truth. Moreover, the theoretical performances of the detector are tested with Monte Carlo simulations in order to extract the probabilities of detection and false alarm. An important result is that the detector is, up to some extend, independent of the sea conditions

Advanced Geoscience Remote Sensing

Nowadays, advanced remote sensing technology plays tremendous roles to build a quantitative and comprehensive understanding of how the Earth system operates. The advanced remote sensing technology is also used widely to monitor and survey the natural disasters and man-made pollution. Besides, telecommunication is considered as precise advanced remote sensing technology tool. Indeed precise usages of remote sensing and telecommunication without a comprehensive understanding of mathematics and physics. This book has three parts (i) microwave remote sensing applications, (ii) nuclear, geophysics and telecommunication; and (iii) environment remote sensing investigations

A Sensitivity Study of L-Band Synthetic Aperture Radar Measurements to the Internal Variations and Evolving Nature of Oil Slicks

This thesis focuses on the use of multi-polarization synthetic aperture radar (SAR) for characterization of marine oil spills. In particular, the potential of detecting internal zones within oil slicks in SAR scenes are investigated by a direct within-slick segmentation scheme, along with a sensitivity study of SAR measurements to the evolving nature of oil slicks. A simple, k-means clustering algorithm, along with a Gaussian Mixture Model are separately applied, giving rise to a comparative study of the internal class structures obtained by both strategies. As no optical imagery is available for verification, the within-slick segmentations are evaluated with respect to the behavior of a set of selected polarimetric features, the prevailing wind conditions and weathering processes. In addition, a fake zone detection scheme is established to help determine if the class structures obtained potentially reflect actual internal variations within the slicks. Further, the evolving nature of oil slicks is studied based on the temporal development of a set of selected geometric region descriptors. Two data sets are available for the investigation presented in this thesis, both captured by a full-polarization L-band airborne SAR system with high spatial- and temporal resolution. The results obtained with respect to the zone detection scheme developed supports the hypothesis of the existence of detectable zones within oil spills in SAR scenes. Additionally, the method established for studying the evolving nature of oil slicks is found convenient for accessing the general behavior of the slicks, and simplifies interpretation