Multiple feature-enhanced synthetic aperture radar imaging

Non-quadratic regularization based image formation is a recently proposed framework for feature-enhanced radar imaging. Specific image formation techniques in this framework have so far focused on enhancing one type of feature, such as strong point scatterers, or smooth regions. However, many scenes contain a number of such features. We develop an image formation technique that simultaneously enhances multiple types of features by posing the problem as one of sparse signal representation based on overcomplete dictionaries. Due to the complex-valued nature of the reflectivities in SAR, our new approach is designed to sparsely represent the magnitude of the complex-valued scattered field in terms of multiple features, which turns the image reconstruction problem into a joint optimization problem over the representation of the magnitude and the phase of the underlying field reflectivities. We formulate the mathematical framework needed for this method and propose an iterative solution for the corresponding joint optimization problem. We demonstrate the effectiveness of this approach on various SAR images

훈련 자료 자동 추출 알고리즘과 기계 학습을 통한 SAR 영상 기반의 선박 탐지

학위논문 (석사) -- 서울대학교 대학원 : 자연과학대학 지구환경과학부, 2021. 2. 김덕진.Detection and surveillance of vessels are regarded as a crucial application of SAR for their contribution to the preservation of marine resources and the assurance on maritime safety. Introduction of machine learning to vessel detection significantly enhanced the performance and efficiency of the detection, but a substantial majority of studies focused on modifying the object detector algorithm. As the fundamental enhancement of the detection performance would be nearly impossible without accurate training data of vessels, this study implemented AIS information containing real-time information of vessel’s movement in order to propose a robust algorithm which acquires the training data of vessels in an automated manner. As AIS information was irregularly and discretely obtained, the exact target interpolation time for each vessel was precisely determined, followed by the implementation of Kalman filter, which mitigates the measurement error of AIS sensor. In addition, as the velocity of each vessel renders an imprint inside the SAR image named as Doppler frequency shift, it was calibrated by restoring the elliptic satellite orbit from the satellite state vector and estimating the distance between the satellite and the target vessel. From the calibrated position of the AIS sensor inside the corresponding SAR image, training data was directly obtained via internal allocation of the AIS sensor in each vessel. For fishing boats, separate information system named as VPASS was applied for the identical procedure of training data retrieval. Training data of vessels obtained via the automated training data procurement algorithm was evaluated by a conventional object detector, for three detection evaluating parameters: precision, recall and F1 score. All three evaluation parameters from the proposed training data acquisition significantly exceeded that from the manual acquisition. The major difference between two training datasets was demonstrated in the inshore regions and in the vicinity of strong scattering vessels in which land artifacts, ships and the ghost signals derived from them were indiscernible by visual inspection. This study additionally introduced a possibility of resolving the unclassified usage of each vessel by comparing AIS information with the accurate vessel detection results.전천후 지구 관측 위성인 SAR를 통한 선박 탐지는 해양 자원의 확보와 해상 안전 보장에 매우 중요한 역할을 한다. 기계 학습 기법의 도입으로 인해 선박을 비롯한 사물 탐지의 정확도 및 효율성이 향상되었으나, 이와 관련된 다수의 연구는 탐지 알고리즘의 개량에 집중되었다. 그러나, 탐지 정확도의 근본적인 향상은 정밀하게 취득된 대량의 훈련자료 없이는 불가능하기에, 본 연구에서는 선박의 실시간 위치, 속도 정보인 AIS 자료를 이용하여 인공 지능 기반의 선박 탐지 알고리즘에 사용될 훈련자료를 자동적으로 취득하는 알고리즘을 제안하였다. 이를 위해 이산적인 AIS 자료를 SAR 영상의 취득시각에 맞추어 정확하게 보간하고, AIS 센서 자체가 가지는 오차를 최소화하였다. 또한, 이동하는 산란체의 시선 속도로 인해 발생하는 도플러 편이 효과를 보정하기 위해 SAR 위성의 상태 벡터를 이용하여 위성과 산란체 사이의 거리를 정밀하게 계산하였다. 이렇게 계산된 AIS 센서의 영상 내의 위치로부터 선박 내 AIS 센서의 배치를 고려하여 선박 탐지 알고리즘의 훈련자료 형식에 맞추어 훈련자료를 취득하고, 어선에 대한 위치, 속도 정보인 VPASS 자료 역시 유사한 방법으로 가공하여 훈련자료를 취득하였다. AIS 자료로부터 취득한 훈련자료는 기존 방법대로 수동 취득한 훈련자료와 함께 인공 지능 기반 사물 탐지 알고리즘을 통해 정확도를 평가하였다. 그 결과, 제시된 알고리즘으로 취득한 훈련 자료는 수동 취득한 훈련 자료 대비 더 높은 탐지 정확도를 보였으며, 이는 기존의 사물 탐지 알고리즘의 평가 지표인 정밀도, 재현율과 F1 score를 통해 진행되었다. 본 연구에서 제안한 훈련자료 자동 취득 기법으로 얻은 선박에 대한 훈련자료는 특히 기존의 선박 탐지 기법으로는 분별이 어려웠던 항만에 인접한 선박과 산란체 주변의 신호에 대한 정확한 분별 결과를 보였다. 본 연구에서는 이와 함께, 선박 탐지 결과와 해당 지역에 대한 AIS 및 VPASS 자료를 이용하여 선박의 미식별성을 판정할 수 있는 가능성 또한 제시하였다.Chapter 1. Introduction - 1 - 1.1 Research Background - 1 - 1.2 Research Objective - 8 - Chapter 2. Data Acquisition - 10 - 2.1 Acquisition of SAR Image Data - 10 - 2.2 Acquisition of AIS and VPASS Information - 20 - Chapter 3. Methodology on Training Data Procurement - 26 - 3.1 Interpolation of Discrete AIS Data - 29 - 3.1.1 Estimation of Target Interpolation Time for Vessels - 29 - 3.1.2 Application of Kalman Filter to AIS Data - 34 - 3.2 Doppler Frequency Shift Correction - 40 - 3.2.1 Theoretical Basis of Doppler Frequency Shift - 40 - 3.2.2 Mitigation of Doppler Frequency Shift - 48 - 3.3 Retrieval of Training Data of Vessels - 53 - 3.4 Algorithm on Vessel Training Data Acquisition from VPASS Information - 61 - Chapter 4. Methodology on Object Detection Architecture - 66 - Chapter 5. Results - 74 - 5.1 Assessment on Training Data - 74 - 5.2 Assessment on AIS-based Ship Detection - 79 - 5.3 Assessment on VPASS-based Fishing Boat Detection - 91 - Chapter 6. Discussions - 110 - 6.1 Discussion on AIS-Based Ship Detection - 110 - 6.2 Application on Determining Unclassified Vessels - 116 - Chapter 7. Conclusion - 125 - 국문 요약문 - 128 - Bibliography - 130 -Maste

SAR imaging of moving targets by subaperture based low-rank and sparse decomposition

Synthetic aperture radar (SAR) has gained significance as an indispensable instrument of remote sensing and airborne surveillance. Its applications extend to 3D terrain mapping, oil spill detection, crop yield estimation and disaster evaluation. SAR utilizes platform motion to synthesize a large antenna thus rendering a very fine spatial resolution. Nevertheless, imaging of moving targets with SAR is a challenging problem. In this thesis, we propose a moving target imaging approach for SAR which exploits the low-rank and sparse decomposition (LRSD) of the subaperture data. As a first step, multiple subapertures are constructed from the raw data using frequency domain filtering. In contrast to the stationary points, moving targets in the SAR scene shift their position in the various subapertures. This enables a successful low-rank and sparse decomposition of the subaperture data where the sparse component captures the moving targets’ phase histories and reflectivity profiles. On the other hand, the low-rank component consists of the static background due to fewer spatial variations in multiple subapertures. This framework allows the reconstruction of full-resolution sparse and low-rank images by combining the spectral information of the decomposed subapertures. Furthermore, it enhances the applicability of sparsity-driven moving target imaging frameworks to very low signal to clutter ratio (SCR) scenarios by offering a considerable SCR performance improvement. We manifest the effectiveness of our approach through experiments with synthetic as well as real SAR data. Our real SAR experiments were based on MiniSAR and EMISAR data

Enhanced Polarimetric Radar Imaging Using Cross-Channel Coupling Constraints

Data for a scene of interest may be collected over multiple polarization channels. In the case of polarimetric synthetic aperture radar images, regularization techniques are typically applied independently to each polarimetric channel. However, independent processing does not account for cross-channel coupling and may corrupt the polarimetric information in the signals. Recent consideration of joint enhancement techniques has shown promising results for multi- channel datasets with similar regions of signal magnitude and/or phase. However, in the case of polarimetric SAR data, scattering may be present in some channels and not in others. This thesis mathematically formulates multi-channel sparse imaging for polarimetric radar data using a joint enhancement algorithm to enforce sparsity and polarimetric coupling constraints. Two candidate functional relationships are derived to describe polarimetric coupling among received signal channels: one convex function and one non-convex function. These functions are reformed as optimization constraints. Then, an optimization problem is constructed to maintain signal fidelity, enforce sparsity, and preserve interchannel coupling. An iterative dual gradient descent algorithm is used to alternatively calculate updated scene estimates for each channel and the maximizing Lagrange multipliers for each coupling constraint. Results are found for several polarimetric SAR datasets. Jointly enhanced images are compared with corresponding images found through independent enhancement, taking into consideration signal fidelity, sparsity, polarimetric preservation, and scattering classification. Overall, the jointly enhanced image channels display significantly better polarimetric preservation compared to the corresponding independently restored image channels. More research is needed to understand how improved polarimetric preservation can be used to improve target classification

3D space intersection features extraction from Synthetic Aperture Radar images

The main purpose of this Thesis is to develop new theoretical models in order to extend the capabilities of SAR images space intersection techniques to generate three dimensional information. Furthermore, the study aims at acquiring new knowledge on SAR image interpretation through the three dimensional comprehension of the scene. The proposed methodologies allow to extend the known radargrammetric applications to vector data generation, exploiting SAR images acquired with every possible geometries. The considered geometries are points, circles, cylinders and lines. The study assesses the estimation accuracy of the features in terms of absolute and relative position and dimensions, analyzing the nowadays operational SAR sensors with a special focus on the national COSMO-SkyMed system. The proposed approach is original as it does not require the direct matching between homologous points of different images, which is a necessary step for the classical radargrammetric techniques; points belonging to the same feature, circular or linear, recognized in different images, are matched through specific models in order to estimate the dimensions and the location of the feature itself. This approach is robust with respect to the variation of the viewing angle of the input images and allows to better exploit archive data, acquired with diverse viewing geometries. The obtained results confirm the validity of the proposed theoretical approach and enable important applicative developments, especially in the Defence domain: (i) introducing original three dimensional measurement tools to support visual image interpretation; (ii) performing an advanced modelling of building counting only on SAR images; (iii) exploiting SAR images as a source for geospatial information and data; (iv) producing geospatial reference information, such as Ground Control Point, without any need for survey on the ground

ACE-OT: Polarimetric SAR data based amplitude contrast enhancement algorithm for offset tracking applications

The use of polarimetric synthetic aperture radar (SAR) data can improve the performance of persistent scatterer interferometry (PSI). However, its huge potential remains locked for the amplitude information-based offset tracking (OT) technology. For example, to the best knowledge of the authors, there is no single example of a polarization-based image optimization method that has been developed for OT processing. In this article, an amplitude contrast enhancement (ACE) algorithm is introduced, which demonstrates the potential of the polarimetric SAR data on the improvement of OT performance. Its core idea is finding the optimal combination of the different scattering mechanisms for each pixel to improve the contrast. First, the orientation of the reflected polarization ellipse is removed, to avoid the influence of the geometric relationship between the antenna and the target, and the properties of the target. Then three similarity parameters are defined to represent the three basic reflection types of the single bounce, the double bounce, and the random reflection. After that, the optimizing equation is constructed with two optimizing vectors. Finally, the optimizing vectors are calculated to obtain the enhanced amplitude image. Three examples of the enhancement are presented with different PolSAR images sets of both full- (Radarsat-2) and dual-polarization (TerraSAR-X and Sentinel-1). The performance of ACE-OT has been compared with another method, the adaptive histogram enhancement (AHE). The impact of the number of polarization channels available on ACE-OT performance has also been studied.This work was supported in part by the China Scholarship Council under Grant 201806420035, in part by the Spanish Ministry of Science and Innovation (MCIN), in part by the State Research Agency (AEI) Project under Grant PID2020-117303GB-C21 and Grant MCIN/AEI/10.13039/501100011033, in part by the National Natural Science Foundation of China under Grant 42004011, in part by the China Postdoctoral Science Foundation under Grant 2020M671646, and in part by the Construction Program of Space-Air-Ground-Well Cooperative Awareness Spatial Information Project under Grant B20046.Peer ReviewedPostprint (author's final draft

Sparse and Redundant Representations for Inverse Problems and Recognition

Sparse and redundant representation of data enables the description of signals as linear combinations of a few atoms from a dictionary. In this dissertation, we study applications of sparse and redundant representations in inverse problems and object recognition. Furthermore, we propose two novel imaging modalities based on the recently introduced theory of Compressed Sensing (CS). This dissertation consists of four major parts. In the first part of the dissertation, we study a new type of deconvolution algorithm that is based on estimating the image from a shearlet decomposition. Shearlets provide a multi-directional and multi-scale decomposition that has been mathematically shown to represent distributed discontinuities such as edges better than traditional wavelets. We develop a deconvolution algorithm that allows for the approximation inversion operator to be controlled on a multi-scale and multi-directional basis. Furthermore, we develop a method for the automatic determination of the threshold values for the noise shrinkage for each scale and direction without explicit knowledge of the noise variance using a generalized cross validation method. In the second part of the dissertation, we study a reconstruction method that recovers highly undersampled images assumed to have a sparse representation in a gradient domain by using partial measurement samples that are collected in the Fourier domain. Our method makes use of a robust generalized Poisson solver that greatly aids in achieving a significantly improved performance over similar proposed methods. We will demonstrate by experiments that this new technique is more flexible to work with either random or restricted sampling scenarios better than its competitors. In the third part of the dissertation, we introduce a novel Synthetic Aperture Radar (SAR) imaging modality which can provide a high resolution map of the spatial distribution of targets and terrain using a significantly reduced number of needed transmitted and/or received electromagnetic waveforms. We demonstrate that this new imaging scheme, requires no new hardware components and allows the aperture to be compressed. Also, it presents many new applications and advantages which include strong resistance to countermesasures and interception, imaging much wider swaths and reduced on-board storage requirements. The last part of the dissertation deals with object recognition based on learning dictionaries for simultaneous sparse signal approximations and feature extraction. A dictionary is learned for each object class based on given training examples which minimize the representation error with a sparseness constraint. A novel test image is then projected onto the span of the atoms in each learned dictionary. The residual vectors along with the coefficients are then used for recognition. Applications to illumination robust face recognition and automatic target recognition are presented