On the usage of GRECOSAR: an orbital polarimetric SAR simulator of complex targets for vessel classification studies

This paper presents a synthetic aperture radar (SAR) simulator that is able to generate polarimetric SAR (POLSAR) and polarimetric inverse SAR data of complex targets. It solves the electromagnetic problem via high-frequency approximations, such as physical optics and the physical theory of diffraction, with notable computational efficiency. In principle, any orbital monostatic sensor working at any band, resolution, and operating mode can be modeled. To make simulations more realistic, the target’s bearing and speed are considered, and for the particular case of vessels, even the translational and rotational movements induced by the sea state. All these capabilities make the simulator a powerful tool for supplying large amounts of data with precise scenario information and for testing future sensor configurations. In this paper, the usefulness of the simulator on vessel classification studies is assessed. Several simulated polarimetric images are presented to analyze the potentialities of coherent target decompositions for classifying complex geometries, thus basing an operational algorithm. The limitations highlighted by the results suggest that other approaches, like POLSAR interferometry, should be explored.Peer Reviewe

On the usage of GRECOSAR, an orbital polarimetric SAR simulator of complex targets, to vessel classification studies

This paper presents a synthetic aperture radar (SAR) simulator that is able to generate polarimetric SAR (POLSAR) and polarimetric inverse SAR data of complex targets. It solves the electromagnetic problem via high-frequency approximations, such as physical optics and the physical theory of diffraction, with notable computational efficiency. In principle, any orbital monostatic sensor working at any band, resolution, and operating mode can be modeled. To make simulations more realistic, the target’s bearing and speed are considered, and for the particular case of vessels, even the translational and rotational movements induced by the sea state. All these capabilities make the simulator a powerful tool for supplying large amounts of data with precise scenario information and for testing future sensor configurations. In this paper, the usefulness of the simulator on vessel classification studies is assessed. Several simulated polarimetric images are presented to analyze the potentialities of coherent target decompositions for classifying complex geometries, thus basing an operational algorithm. The limitations highlighted by the results suggest that other approaches, like POLSAR interferometry, should be explored.Peer Reviewe

Single-pass polarimetric SAR interferometry for vessel classification

This paper presents a novel method for vessel classification based on single-pass polarimetric synthetic aperture radar (SAR) interferometry. It has been developed according to recent ship scattering studies that show that the polarimetric response of many types of vessels can be described by trihedral- and dihedral-like mechanisms. The adopted methodology is quite simple. The input interferometric data are decomposed in terms of the Pauli basis, and hence, one height image is derived for each simple mechanism. Then, the local maxima of these images are isolated, and a 3-D map of scatters is generated. The correlation of this map with the scattering distribution expected for a set of reference ships provides the final classification decision. The performance of the proposed method has been tested with the orbital SAR simulator developed at Universitat PolitÈcnica de Catalunya. Different vessel models have been processed with a sensor configuration similar to the incoming TanDEM-X system. The analysis of diverse vessel bearings, vessel speeds, and sea states shows that the map of scatters matches reasonably the geometry of ships allowing a correct identification even for adverse environmental conditions.Peer Reviewe

훈련 자료 자동 추출 알고리즘과 기계 학습을 통한 SAR 영상 기반의 선박 탐지

학위논문 (석사) -- 서울대학교 대학원 : 자연과학대학 지구환경과학부, 2021. 2. 김덕진.Detection and surveillance of vessels are regarded as a crucial application of SAR for their contribution to the preservation of marine resources and the assurance on maritime safety. Introduction of machine learning to vessel detection significantly enhanced the performance and efficiency of the detection, but a substantial majority of studies focused on modifying the object detector algorithm. As the fundamental enhancement of the detection performance would be nearly impossible without accurate training data of vessels, this study implemented AIS information containing real-time information of vessel’s movement in order to propose a robust algorithm which acquires the training data of vessels in an automated manner. As AIS information was irregularly and discretely obtained, the exact target interpolation time for each vessel was precisely determined, followed by the implementation of Kalman filter, which mitigates the measurement error of AIS sensor. In addition, as the velocity of each vessel renders an imprint inside the SAR image named as Doppler frequency shift, it was calibrated by restoring the elliptic satellite orbit from the satellite state vector and estimating the distance between the satellite and the target vessel. From the calibrated position of the AIS sensor inside the corresponding SAR image, training data was directly obtained via internal allocation of the AIS sensor in each vessel. For fishing boats, separate information system named as VPASS was applied for the identical procedure of training data retrieval. Training data of vessels obtained via the automated training data procurement algorithm was evaluated by a conventional object detector, for three detection evaluating parameters: precision, recall and F1 score. All three evaluation parameters from the proposed training data acquisition significantly exceeded that from the manual acquisition. The major difference between two training datasets was demonstrated in the inshore regions and in the vicinity of strong scattering vessels in which land artifacts, ships and the ghost signals derived from them were indiscernible by visual inspection. This study additionally introduced a possibility of resolving the unclassified usage of each vessel by comparing AIS information with the accurate vessel detection results.전천후 지구 관측 위성인 SAR를 통한 선박 탐지는 해양 자원의 확보와 해상 안전 보장에 매우 중요한 역할을 한다. 기계 학습 기법의 도입으로 인해 선박을 비롯한 사물 탐지의 정확도 및 효율성이 향상되었으나, 이와 관련된 다수의 연구는 탐지 알고리즘의 개량에 집중되었다. 그러나, 탐지 정확도의 근본적인 향상은 정밀하게 취득된 대량의 훈련자료 없이는 불가능하기에, 본 연구에서는 선박의 실시간 위치, 속도 정보인 AIS 자료를 이용하여 인공 지능 기반의 선박 탐지 알고리즘에 사용될 훈련자료를 자동적으로 취득하는 알고리즘을 제안하였다. 이를 위해 이산적인 AIS 자료를 SAR 영상의 취득시각에 맞추어 정확하게 보간하고, AIS 센서 자체가 가지는 오차를 최소화하였다. 또한, 이동하는 산란체의 시선 속도로 인해 발생하는 도플러 편이 효과를 보정하기 위해 SAR 위성의 상태 벡터를 이용하여 위성과 산란체 사이의 거리를 정밀하게 계산하였다. 이렇게 계산된 AIS 센서의 영상 내의 위치로부터 선박 내 AIS 센서의 배치를 고려하여 선박 탐지 알고리즘의 훈련자료 형식에 맞추어 훈련자료를 취득하고, 어선에 대한 위치, 속도 정보인 VPASS 자료 역시 유사한 방법으로 가공하여 훈련자료를 취득하였다. AIS 자료로부터 취득한 훈련자료는 기존 방법대로 수동 취득한 훈련자료와 함께 인공 지능 기반 사물 탐지 알고리즘을 통해 정확도를 평가하였다. 그 결과, 제시된 알고리즘으로 취득한 훈련 자료는 수동 취득한 훈련 자료 대비 더 높은 탐지 정확도를 보였으며, 이는 기존의 사물 탐지 알고리즘의 평가 지표인 정밀도, 재현율과 F1 score를 통해 진행되었다. 본 연구에서 제안한 훈련자료 자동 취득 기법으로 얻은 선박에 대한 훈련자료는 특히 기존의 선박 탐지 기법으로는 분별이 어려웠던 항만에 인접한 선박과 산란체 주변의 신호에 대한 정확한 분별 결과를 보였다. 본 연구에서는 이와 함께, 선박 탐지 결과와 해당 지역에 대한 AIS 및 VPASS 자료를 이용하여 선박의 미식별성을 판정할 수 있는 가능성 또한 제시하였다.Chapter 1. Introduction - 1 - 1.1 Research Background - 1 - 1.2 Research Objective - 8 - Chapter 2. Data Acquisition - 10 - 2.1 Acquisition of SAR Image Data - 10 - 2.2 Acquisition of AIS and VPASS Information - 20 - Chapter 3. Methodology on Training Data Procurement - 26 - 3.1 Interpolation of Discrete AIS Data - 29 - 3.1.1 Estimation of Target Interpolation Time for Vessels - 29 - 3.1.2 Application of Kalman Filter to AIS Data - 34 - 3.2 Doppler Frequency Shift Correction - 40 - 3.2.1 Theoretical Basis of Doppler Frequency Shift - 40 - 3.2.2 Mitigation of Doppler Frequency Shift - 48 - 3.3 Retrieval of Training Data of Vessels - 53 - 3.4 Algorithm on Vessel Training Data Acquisition from VPASS Information - 61 - Chapter 4. Methodology on Object Detection Architecture - 66 - Chapter 5. Results - 74 - 5.1 Assessment on Training Data - 74 - 5.2 Assessment on AIS-based Ship Detection - 79 - 5.3 Assessment on VPASS-based Fishing Boat Detection - 91 - Chapter 6. Discussions - 110 - 6.1 Discussion on AIS-Based Ship Detection - 110 - 6.2 Application on Determining Unclassified Vessels - 116 - Chapter 7. Conclusion - 125 - 국문 요약문 - 128 - Bibliography - 130 -Maste

Remote Sensing of the Oceans

This book covers different topics in the framework of remote sensing of the oceans. Latest research advancements and brand-new studies are presented that address the exploitation of remote sensing instruments and simulation tools to improve the understanding of ocean processes and enable cutting-edge applications with the aim of preserving the ocean environment and supporting the blue economy. Hence, this book provides a reference framework for state-of-the-art remote sensing methods that deal with the generation of added-value products and the geophysical information retrieval in related fields, including: Oil spill detection and discrimination; Analysis of tropical cyclones and sea echoes; Shoreline and aquaculture area extraction; Monitoring coastal marine litter and moving vessels; Processing of SAR, HF radar and UAV measurements

Spaceborne synthetic aperture radar: Current status and future directions. A report to the Committee on Earth Sciences, Space Studies Board, National Research Council

This report provides a context in which questions put forth by NASA's Office of Mission to Planet Earth (OMPTE) regarding the next steps in spaceborne synthetic aperture radar (SAR) science and technology can be addressed. It summarizes the state-of-the-art in theory, experimental design, technology, data analysis, and utilization of SAR data for studies of the Earth, and describes potential new applications. The report is divided into five science chapters and a technology assessment. The chapters summarize the value of existing SAR data and currently planned SAR systems, and identify gaps in observational capabilities needing to be filled to address the scientific questions. Cases where SAR provides complementary data to other (non-SAR) measurement techniques are also described. The chapter on technology assessment outlines SAR technology development which is critical not only to NASA's providing societally relevant geophysical parameters but to maintaining competitiveness in SAR technology, and promoting economic development

The InflateSAR Campaign: Evaluating SAR Identification Capabilities of Distressed Refugee Boats

Most of the recent research in the field of marine target detection has been concentrating on ships with large metallic parts. The focus of this work is on much more challenging targets represented by small rubber inflatables. They are of importance, since in recent years they have largely been used by migrants to cross the Mediterranean Sea between Libya and Europe. The motivation of this research is to mitigate the ongoing humanitarian crisis at Europe’s southern borders. These boats, packed with up to 200 people, are in no way suitable to cross the Mediterranean Sea or any other big water body and are in distress from the moment of departure. The establishment of a satellite-based surveillance infrastructure could considerably support search and rescue missions in the Mediterranean Sea, reduce the number of such boats being missed and mitigate the ongoing death in the open ocean. In this work we describe and analyze data from the InflateSAR acquisition campaign, wherein we gathered multiple-platform SAR imagery of an original refugee inflatable. The test site for this campaign is a lake which provides background clutter that is more predictable. The analysis considered a sum of experiments, enabling investigations of a broad range of scene settings, such as the vessel’s orientation, superstructures and speed. We assess their impact on the detectability of the chosen target under different sensor parameters, such as polarimetry, resolution and incidence angle. Results show that TerraSAR-X Spotlight and Stripmap modes offer good capabilities to potentially detect those types of boats in distress. Low incidence angles and cross-polarization decrease the chance of a successful identification, whereas a fully occupied inflatable, orthogonally oriented to the line of sight, seems to be better visible than an empty one. The polarimetric analyses prove the vessel’s different polarimetric behavior in comparison with the water surface, especially when it comes to entropy. The analysis considered state-of-the-art methodologies with single polarization and dual polarization channels. Finally, different metrics are used to discuss whether and to which extent the results are applicable to other open ocean datasets. This paper does not introduce any vessel detection or classification algorithm from SAR images. Rather, its results aim at paving the way to the design and the development of a specially tailored detection algorithm for small rubber inflatables

Offshore oil spill detection using synthetic aperture radar

Among the different types of marine pollution, oil spill has been considered as a major threat to the sea ecosystems. The source of the oil pollution can be located on the mainland or directly at sea. The sources of oil pollution at sea are discharges coming from ships, offshore platforms or natural seepage from sea bed. Oil pollution from sea-based sources can be accidental or deliberate. Different sensors to detect and monitor oil spills could be onboard vessels, aircraft, or satellites. Vessels equipped with specialised radars, can detect oil at sea but they can cover a very limited area. One of the established ways to monitor sea-based oil pollution is the use of satellites equipped with Synthetic Aperture Radar (SAR).The aim of the work presented in this thesis is to identify optimum set of feature extracted parameters and implement methods at various stages for oil spill detection from Synthetic Aperture Radar (SAR) imagery. More than 200 images of ERS-2, ENVSAT and RADARSAT 2 SAR sensor have been used to assess proposed feature vector for oil spill detection methodology, which involves three stages: segmentation for dark spot detection, feature extraction and classification of feature vector. Unfortunately oil spill is not only the phenomenon that can create a dark spot in SAR imagery. There are several others meteorological and oceanographic and wind induced phenomena which may lead to a dark spot in SAR imagery. Therefore, these dark objects also appear similar to the dark spot due to oil spill and are called as look-alikes. These look-alikes thus cause difficulty in detecting oil spill spots as their primary characteristic similar to oil spill spots. To get over this difficulty, feature extraction becomes important; a stage which may involve selection of appropriate feature extraction parameters. The main objective of this dissertation is to identify the optimum feature vector in order to segregate oil spill and ‘look-alike’ spots. A total of 44 Feature extracted parameters have been studied. For segmentation, four methods; based on edge detection, adaptive theresholding, artificial neural network (ANN) segmentation and the other on contrast split segmentation have been implemented. Spot features are extracted from both the dark spots themselves and their surroundings. Classification stage was performed using two different classification techniques, first one is based on ANN and the other based on a two-stage processing that combines classification tree analysis and fuzzy logic. A modified feature vector, including both new and improved features, is suggested for better description of different types of dark spots. An ANN classifier using full spectrum of feature parameters has also been developed and evaluated. The implemented methodology appears promising in detecting dark spots and discriminating oil spills from look-alikes and processing time is well below any operational service requirements

Oil spill and ship detection using high resolution polarimetric X-band SAR data

Among illegal human activities, marine pollution and target detection are the key concern of Maritime Security and Safety. This thesis deals with oil spill and ship detection using high resolution X-band polarimetric SAR (PolSAR). Polarimetry aims at analysing the polarization state of a wave field, in order to obtain physical information from the observed object. In this dissertation PolSAR techniques are suggested as improvement of the current State-of-the-Art of SAR marine pollution and target detection, by examining in depth Near Real Time suitability