Robust CFAR Detector Based on Truncated Statistics for Polarimetric Synthetic Aperture Radar

Constant false alarm rate (CFAR) algorithms using a local training window are widely used for ship detection with synthetic aperture radar (SAR) imagery. However, when the density of the targets is high, such as in busy shipping lines and crowded harbors, the background statistics may be contaminated by the presence of nearby targets in the training window. Recently, a robust CFAR detector based on truncated statistics (TS) was proposed. However, the truncation of data in the format of polarimetric covariance matrices is much more complicated with respect to the truncation of intensity (single polarization) data. In this article, a polarimetric whitening filter TS CFAR (PWF-TS-CFAR) is proposed to estimate the background parameters accurately in the contaminated sea clutter for PolSAR imagery. The CFAR detector uses a polarimetric whitening filter (PWF) to turn the multidimensional problem to a 1-D case. It uses truncation to exclude possible statistically interfering outliers and uses TS to model the remaining background samples. The algorithm does not require prior knowledge of the interfering targets, and it is performed iteratively and adaptively to derive better estimates of the polarimetric covariance matrix (although this is computationally expensive). The PWF-TS-CFAR detector provides accurate background clutter modeling, a stable false alarm property, and improves the detection performance in high-target-density situations. RadarSat2 data are used to verify our derivations, and the results are in line with the theory

CFAR Ship Detection in Polarimetric Synthetic Aperture Radar Images Based on Whitening Filter

Polarimetric whitening filter (PWF) can be used to filter polarimetric synthetic aperture radar (PolSAR) images to improve the contrast between ships and sea clutter background. For this reason, the output of the filter can be used to detect ships. This paper deals with the setting of the threshold over PolSAR images filtered by the PWF. Two parameter-constant false alarm rate (2P-CFAR) is a common detection method used on whitened polarimetric images. It assumes that the probability density function (PDF) of the filtered image intensity is characterized by a log-normal distribution. However, this assumption does not always hold. In this paper, we propose a systemic analytical framework for CFAR algorithms based on PWF or multi-look PWF (MPWF). The framework covers the entire log-cumulants space in terms of the textural distributions in the product model, including the constant, gamma, inverse gamma, Fisher, beta, inverse beta, and generalized gamma distributions (GΓDs). We derive the analytical forms of the PDF for each of the textural distributions and the probability of false alarm (PFA). Finally, the threshold is derived by fixing the false alarm rate (FAR). Experimental results using both the simulated and real data demonstrate that the derived expressions and CFAR algorithms are valid and robust

PolSAR Ship Detection Based on Neighborhood Polarimetric Covariance Matrix

The detection of small ships in polarimetric synthetic aperture radar (PolSAR) images is still a topic for further investigation. Recently, patch detection techniques, such as superpixel-level detection, have stimulated wide interest because they can use the information contained in similarities among neighboring pixels. In this article, we propose a novel neighborhood polarimetric covariance matrix (NPCM) to detect the small ships in PolSAR images, leading to a significant improvement in the separability between ship targets and sea clutter. The NPCM utilizes the spatial correlation between neighborhood pixels and maps the representation for a given pixel into a high-dimensional covariance matrix by embedding spatial and polarization information. Using the NPCM formalism, we apply a standard whitening filter, similar to the polarimetric whitening filter (PWF). We show how the inclusion of neighborhood information improves the performance compared with the traditional polarimetric covariance matrix. However, this is at the expense of a higher computation cost. The theory is validated via the simulated and measured data under different sea states and using different radar platforms

Joint Polarimetric Subspace Detector Based on Modified Linear Discriminant Analysis

Polarimetric synthetic aperture radar (PolSAR) is widely used in remote sensing and has important applications in the detection of ships. Although many polarimetric detectors have been proposed, they are not well combined. Recently, a polarimetric detection optimization filter (PDOF) was proposed that performs well in most environments. In this study, a novel subspace form of the PDOF (SPDOF) was further developed based on the Cauchy inequality and matrix decomposition theories, enhancing detection performance. Furthermore, a simple method to determine the optimal dimension of the subspace detector based on the trace ratio form was proposed by calculating the area under the receiver operating characteristic (ROC) curve, reaching the best detection performance among the subspaces of the detector. Moreover, to combine different subspace detectors, a modified linear discriminant analysis was proposed and developed to the diagonal loading detector (DLD) based on polarimetric subspaces. The experimental results demonstrate the superiority of these joint polarimetric subspace detectors. Most importantly, DLD solves for previous limitations due to the complex clutter background and achieves a performance comparable to that of the Wishart (Gaussian) distribution, particularly in the low target clutter ratio (TCR) case

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

A New Form of the Polarimetric Notch Filter

Ship detection using polarimetric synthetic radar (PolSAR) imagery attracts a lot of attention in recent years. Most notably, the detector polarimetric notch filter (PNF) has been demonstrated to be effective for ship detection in PolSAR imagery, which gives excellent performances. In this work, a mathematical form of one new PNF (NPNF) based on physical mechanisms of targets and clutter is further developed for partial targets. The different mechanisms have been revealed based on the projection matrix. The experimental results including simulated and measured data demonstrate that the NPNF exhibits a better performance than the original PNF

훈련 자료 자동 추출 알고리즘과 기계 학습을 통한 SAR 영상 기반의 선박 탐지

학위논문 (석사) -- 서울대학교 대학원 : 자연과학대학 지구환경과학부, 2021. 2. 김덕진.Detection and surveillance of vessels are regarded as a crucial application of SAR for their contribution to the preservation of marine resources and the assurance on maritime safety. Introduction of machine learning to vessel detection significantly enhanced the performance and efficiency of the detection, but a substantial majority of studies focused on modifying the object detector algorithm. As the fundamental enhancement of the detection performance would be nearly impossible without accurate training data of vessels, this study implemented AIS information containing real-time information of vessel’s movement in order to propose a robust algorithm which acquires the training data of vessels in an automated manner. As AIS information was irregularly and discretely obtained, the exact target interpolation time for each vessel was precisely determined, followed by the implementation of Kalman filter, which mitigates the measurement error of AIS sensor. In addition, as the velocity of each vessel renders an imprint inside the SAR image named as Doppler frequency shift, it was calibrated by restoring the elliptic satellite orbit from the satellite state vector and estimating the distance between the satellite and the target vessel. From the calibrated position of the AIS sensor inside the corresponding SAR image, training data was directly obtained via internal allocation of the AIS sensor in each vessel. For fishing boats, separate information system named as VPASS was applied for the identical procedure of training data retrieval. Training data of vessels obtained via the automated training data procurement algorithm was evaluated by a conventional object detector, for three detection evaluating parameters: precision, recall and F1 score. All three evaluation parameters from the proposed training data acquisition significantly exceeded that from the manual acquisition. The major difference between two training datasets was demonstrated in the inshore regions and in the vicinity of strong scattering vessels in which land artifacts, ships and the ghost signals derived from them were indiscernible by visual inspection. This study additionally introduced a possibility of resolving the unclassified usage of each vessel by comparing AIS information with the accurate vessel detection results.전천후 지구 관측 위성인 SAR를 통한 선박 탐지는 해양 자원의 확보와 해상 안전 보장에 매우 중요한 역할을 한다. 기계 학습 기법의 도입으로 인해 선박을 비롯한 사물 탐지의 정확도 및 효율성이 향상되었으나, 이와 관련된 다수의 연구는 탐지 알고리즘의 개량에 집중되었다. 그러나, 탐지 정확도의 근본적인 향상은 정밀하게 취득된 대량의 훈련자료 없이는 불가능하기에, 본 연구에서는 선박의 실시간 위치, 속도 정보인 AIS 자료를 이용하여 인공 지능 기반의 선박 탐지 알고리즘에 사용될 훈련자료를 자동적으로 취득하는 알고리즘을 제안하였다. 이를 위해 이산적인 AIS 자료를 SAR 영상의 취득시각에 맞추어 정확하게 보간하고, AIS 센서 자체가 가지는 오차를 최소화하였다. 또한, 이동하는 산란체의 시선 속도로 인해 발생하는 도플러 편이 효과를 보정하기 위해 SAR 위성의 상태 벡터를 이용하여 위성과 산란체 사이의 거리를 정밀하게 계산하였다. 이렇게 계산된 AIS 센서의 영상 내의 위치로부터 선박 내 AIS 센서의 배치를 고려하여 선박 탐지 알고리즘의 훈련자료 형식에 맞추어 훈련자료를 취득하고, 어선에 대한 위치, 속도 정보인 VPASS 자료 역시 유사한 방법으로 가공하여 훈련자료를 취득하였다. AIS 자료로부터 취득한 훈련자료는 기존 방법대로 수동 취득한 훈련자료와 함께 인공 지능 기반 사물 탐지 알고리즘을 통해 정확도를 평가하였다. 그 결과, 제시된 알고리즘으로 취득한 훈련 자료는 수동 취득한 훈련 자료 대비 더 높은 탐지 정확도를 보였으며, 이는 기존의 사물 탐지 알고리즘의 평가 지표인 정밀도, 재현율과 F1 score를 통해 진행되었다. 본 연구에서 제안한 훈련자료 자동 취득 기법으로 얻은 선박에 대한 훈련자료는 특히 기존의 선박 탐지 기법으로는 분별이 어려웠던 항만에 인접한 선박과 산란체 주변의 신호에 대한 정확한 분별 결과를 보였다. 본 연구에서는 이와 함께, 선박 탐지 결과와 해당 지역에 대한 AIS 및 VPASS 자료를 이용하여 선박의 미식별성을 판정할 수 있는 가능성 또한 제시하였다.Chapter 1. Introduction - 1 - 1.1 Research Background - 1 - 1.2 Research Objective - 8 - Chapter 2. Data Acquisition - 10 - 2.1 Acquisition of SAR Image Data - 10 - 2.2 Acquisition of AIS and VPASS Information - 20 - Chapter 3. Methodology on Training Data Procurement - 26 - 3.1 Interpolation of Discrete AIS Data - 29 - 3.1.1 Estimation of Target Interpolation Time for Vessels - 29 - 3.1.2 Application of Kalman Filter to AIS Data - 34 - 3.2 Doppler Frequency Shift Correction - 40 - 3.2.1 Theoretical Basis of Doppler Frequency Shift - 40 - 3.2.2 Mitigation of Doppler Frequency Shift - 48 - 3.3 Retrieval of Training Data of Vessels - 53 - 3.4 Algorithm on Vessel Training Data Acquisition from VPASS Information - 61 - Chapter 4. Methodology on Object Detection Architecture - 66 - Chapter 5. Results - 74 - 5.1 Assessment on Training Data - 74 - 5.2 Assessment on AIS-based Ship Detection - 79 - 5.3 Assessment on VPASS-based Fishing Boat Detection - 91 - Chapter 6. Discussions - 110 - 6.1 Discussion on AIS-Based Ship Detection - 110 - 6.2 Application on Determining Unclassified Vessels - 116 - Chapter 7. Conclusion - 125 - 국문 요약문 - 128 - Bibliography - 130 -Maste

Introduction to radar scattering application in remote sensing and diagnostics: Review

The manuscript reviews the current literature on scattering applications of RADAR (Radio Detecting And Ranging) in remote sensing and diagnostics. This paper gives prime features for a variety of RADAR applications ranging from forest and climate monitoring to weather forecast, sea status, planetary information, and mapping of natural disasters such as the ones caused by earthquakes. Both the fundamental parameters involved in scattering mechanisms of RADAR applications and the factors affecting RADAR performances are also discusse

Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources

Central to the looming paradigm shift toward data-intensive science, machine-learning techniques are becoming increasingly important. In particular, deep learning has proven to be both a major breakthrough and an extremely powerful tool in many fields. Shall we embrace deep learning as the key to everything? Or should we resist a black-box solution? These are controversial issues within the remote-sensing community. In this article, we analyze the challenges of using deep learning for remote-sensing data analysis, review recent advances, and provide resources we hope will make deep learning in remote sensing seem ridiculously simple. More importantly, we encourage remote-sensing scientists to bring their expertise into deep learning and use it as an implicit general model to tackle unprecedented, large-scale, influential challenges, such as climate change and urbanization