Image fusion techniqes for remote sensing applications

Image fusion refers to the acquisition, processing and synergistic combination of information provided by various sensors or by the same sensor in many measuring contexts. The aim of this survey paper is to describe three typical applications of data fusion in remote sensing. The first study case considers the problem of the Synthetic Aperture Radar (SAR) Interferometry, where a pair of antennas are used to obtain an elevation map of the observed scene; the second one refers to the fusion of multisensor and multitemporal (Landsat Thematic Mapper and SAR) images of the same site acquired at different times, by using neural networks; the third one presents a processor to fuse multifrequency, multipolarization and mutiresolution SAR images, based on wavelet transform and multiscale Kalman filter. Each study case presents also results achieved by the proposed techniques applied to real data

Elevation and Deformation Extraction from TomoSAR

3D SAR tomography (TomoSAR) and 4D SAR differential tomography (Diff-TomoSAR) exploit multi-baseline SAR data stacks to provide an essential innovation of SAR Interferometry for many applications, sensing complex scenes with multiple scatterers mapped into the same SAR pixel cell. However, these are still influenced by DEM uncertainty, temporal decorrelation, orbital, tropospheric and ionospheric phase distortion and height blurring. In this thesis, these techniques are explored. As part of this exploration, the systematic procedures for DEM generation, DEM quality assessment, DEM quality improvement and DEM applications are first studied. Besides, this thesis focuses on the whole cycle of systematic methods for 3D & 4D TomoSAR imaging for height and deformation retrieval, from the problem formation phase, through the development of methods to testing on real SAR data. After DEM generation introduction from spaceborne bistatic InSAR (TanDEM-X) and airborne photogrammetry (Bluesky), a new DEM co-registration method with line feature validation (river network line, ridgeline, valley line, crater boundary feature and so on) is developed and demonstrated to assist the study of a wide area DEM data quality. This DEM co-registration method aligns two DEMs irrespective of the linear distortion model, which improves the quality of DEM vertical comparison accuracy significantly and is suitable and helpful for DEM quality assessment. A systematic TomoSAR algorithm and method have been established, tested, analysed and demonstrated for various applications (urban buildings, bridges, dams) to achieve better 3D & 4D tomographic SAR imaging results. These include applying Cosmo-Skymed X band single-polarisation data over the Zipingpu dam, Dujiangyan, Sichuan, China, to map topography; and using ALOS L band data in the San Francisco Bay region to map urban building and bridge. A new ionospheric correction method based on the tile method employing IGS TEC data, a split-spectrum and an ionospheric model via least squares are developed to correct ionospheric distortion to improve the accuracy of 3D & 4D tomographic SAR imaging. Meanwhile, a pixel by pixel orbit baseline estimation method is developed to address the research gaps of baseline estimation for 3D & 4D spaceborne SAR tomography imaging. Moreover, a SAR tomography imaging algorithm and a differential tomography four-dimensional SAR imaging algorithm based on compressive sensing, SAR interferometry phase (InSAR) calibration reference to DEM with DEM error correction, a new phase error calibration and compensation algorithm, based on PS, SVD, PGA, weighted least squares and minimum entropy, are developed to obtain accurate 3D & 4D tomographic SAR imaging results. The new baseline estimation method and consequent TomoSAR processing results showed that an accurate baseline estimation is essential to build up the TomoSAR model. After baseline estimation, phase calibration experiments (via FFT and Capon method) indicate that a phase calibration step is indispensable for TomoSAR imaging, which eventually influences the inversion results. A super-resolution reconstruction CS based study demonstrates X band data with the CS method does not fit for forest reconstruction but works for reconstruction of large civil engineering structures such as dams and urban buildings. Meanwhile, the L band data with FFT, Capon and the CS method are shown to work for the reconstruction of large manmade structures (such as bridges) and urban buildings

Ground-based synthetic aperture radar (GBSAR) interferometry for deformation monitoring

Ph. D ThesisGround-based synthetic aperture radar (GBSAR), together with interferometry, represents a powerful tool for deformation monitoring. GBSAR has inherent flexibility, allowing data to be collected with adjustable temporal resolutions through either continuous or discontinuous mode. The goal of this research is to develop a framework to effectively utilise GBSAR for deformation monitoring in both modes, with the emphasis on accuracy, robustness, and real-time capability. To achieve this goal, advanced Interferometric SAR (InSAR) processing algorithms have been proposed to address existing issues in conventional interferometry for GBSAR deformation monitoring. The proposed interferometric algorithms include a new non-local method for the accurate estimation of coherence and interferometric phase, a new approach to selecting coherent pixels with the aim of maximising the density of selected pixels and optimizing the reliability of time series analysis, and a rigorous model for the correction of atmospheric and repositioning errors. On the basis of these algorithms, two complete interferometric processing chains have been developed: one for continuous and the other for discontinuous GBSAR deformation monitoring. The continuous chain is able to process infinite incoming images in real time and extract the evolution of surface movements through temporally coherent pixels. The discontinuous chain integrates additional automatic coregistration of images and correction of repositioning errors between different campaigns. Successful deformation monitoring applications have been completed, including three continuous (a dune, a bridge, and a coastal cliff) and one discontinuous (a hillside), which have demonstrated the feasibility and effectiveness of the presented algorithms and chains for high-accuracy GBSAR interferometric measurement. Significant deformation signals were detected from the three continuous applications and no deformation from the discontinuous. The achieved results are justified quantitatively via a defined precision indicator for the time series estimation and validated qualitatively via a priori knowledge of these observing sites.China Scholarship Council (CSC), Newcastle Universit

Ionospheric correction of interferometric SAR data with application to the cryospheric sciences

Thesis (Ph.D.) University of Alaska Fairbanks, 2018The ionosphere has been identified as an important error source for spaceborne Synthetic Aperture Radar (SAR) data and SAR Interferometry (InSAR), especially for low frequency SAR missions, operating, e.g., at L-band or P-band. Developing effective algorithms for the correction of ionospheric effects is still a developing and active topic of remote sensing research. The focus of this thesis is to develop robust and accurate techniques for ionospheric correction of SAR and InSAR data and evaluate the benefit of these techniques for cryospheric research fields such as glacier ice velocity tracking and permafrost deformation monitoring. As both topics are mostly concerned with high latitude areas where the ionosphere is often active and characterized by turbulence, ionospheric correction is particularly relevant for these applications. After an introduction to the research topic in Chapter 1, Chapter 2 will discuss open issues in ionospheric correction including processing issues related to baseline-induced spectrum shifts. The effect of large baseline on split spectrum InSAR technique has been thoroughly evaluated and effective solutions for compensating this effect are proposed. In addition, a multiple sub-band approach is proposed for increasing the algorithm robustness and accuracy. Selected case studies are shown with the purpose of demonstrating the performance of the developed algorithm. In Chapter 3, the developed ionospheric correction technology is applied to optimize InSAR-based ice velocity measurements over the big ice sheets in Greenland and the Antarctic. Selected case studies are presented to demonstrate and validate the effectiveness of the proposed correction algorithms for ice velocity applications. It is shown that the ionosphere signal can be larger than the actual glacier motion signal in the interior of Greenland and Antarctic, emphasizing the necessity for operational ionospheric correction. The case studies also show that the accuracy of ice velocity estimates was significantly improved once the developed ionospheric correction techniques were integrated into the data processing flow. We demonstrate that the proposed ionosphere correction outperforms the traditionally-used approaches such as the averaging of multi-temporal data and the removal of obviously affected data sets. For instance, it is shown that about one hundred multi-temporal ice velocity estimates would need to be averaged to achieve the estimation accuracy of a single ionosphere-corrected measurement. In Chapter 4, we evaluate the necessity and benefit of ionospheric-correction for L-band InSAR-based permafrost research. In permafrost zones, InSAR-based surface deformation measurements are used together with geophysical models to estimate permafrost parameters such as active layer thickness, soil ice content, and permafrost degradation. Accurate error correction is needed to avoid biases in the estimated parameters and their co-variance properties. Through statistical analyses of a large number of L-band InSAR data sets over Alaska, we show that ionospheric signal distortions, at different levels of magnitude, are present in almost every InSAR dataset acquired in permafrost-affected regions. We analyze the ionospheric correction performance that can be achieved in permafrost zones by statistically analyzing correction results for large number of InSAR data. We also investigate the impact of ionospheric correction on the performance of the two main InSAR approaches that are used in permafrost zones: (1) we show the importance of ionospheric correction for permafrost deformation estimation from discrete InSAR observations; (2) we demonstrate that ionospheric correction leads to significant improvements in the accuracy of time-series InSAR-based permafrost products. Chapter 5 summarizes the work conducted in this dissertation and proposes next steps in this field of research

Seafloor depth estimation by means of interferometric synthetic aperture sonar

The topic of this thesis is relative depth estimation using interferometric sidelooking sonar. We give a thorough description of the geometry of interferometric sonar and of time delay estimation techniques. We present a novel solution for the depth estimate using sidelooking sonar, and review the cross-correlation function, the cross-uncertainty function and the phase-differencing technique. We find an elegant solution to co-registration and unwrapping by interpolating the sonar data in ground-range. Two depth estimation techniques are developed: Cross-correlation based sidescan bathymetry and synthetic aperture sonar (SAS) interferometry. We define flank length as a measure of the horizontal resolution in bathymetric maps and find that both sidescan bathymetry and SAS interferometry achieve theoretical resolutions. The vertical precision of our two methods are close to the performance predicted from the measured coherence. We study absolute phase-difference estimation using bandwidth and find a very simple split-bandwidth approach which outperforms a standard 2D phase unwrapper on complicated objects. We also examine advanced filtering of depth maps. Finally, we present pipeline surveying as an example application of interferometric SAS

SIGNAL: A Ka-band Digital Beam-Forming SAR System Concept to Monitor Topography Variations of Ice Caps and Glaciers

This paper discusses the implementation of an endto- end simulator for the BIOMASS mission. An overview of the system architecture is provided along with a functional description of the modules that comprise the simulator

Synthetic aperture radar imaging of embedded objects in dielectric slabs

This Ph.D. dissertation is composed of three parts. In Part I, simple, fast and practical algorithms for solving one-dimensional nonlinear inverse problems are proposed. The thickness and permittivity of a dielectric slab can be determined from frequency-domain data. Prior knowledge of the exact distance between the antenna and the slab surface is not required for the inversion, making the method applicable under practical conditions. Furthermore, the method is extended to low-loss situations in which the dielectric permittivity is a complex number. Noise effect has been studied, indicating the robustness of the algorithms with respect to noise. Both computer simulations and laboratory experiments show that the proposed algorithms turn out accurate and reliable results. In part II, synthetic aperture radar (SAR) imaging of embedded objects inside dielectric slabs is studied. First, basic issues regarding SAR imaging especially for out setting are addressed. Then, three different approaches for reconstructing images are analyzed, and their advantages and disadvantages discussed and compared. Although the Doppler shift frequency does not exist in the setting of our study, the concept of antenna\u27s physical looking angles is introduced instead and their relationship to spatial spectra provided. Based on this new outlook, the technique of short-time Fourier transform (STFT) is employed to provide a three-dimensional data set linking together the looking angle, time, and antenna location. Consequently, an effective and powerful method for estimating the relative permittivity of the host dielectric material is developed. This greatly facilitates SAR imaging of embedded objects in reality. Case studies based on experimental data are provided using algorithms developed in both Part I and Part II. It is shown that through one scan of experiment we are not only able to image the objects embedded inside the sample, but also able to retrieve the effective permittivity, eliminating the requirement of either the prior knowledge of the material permittivity or the exercise of a pre-experiment to determine it. In Part III, preliminary studies have been conducted on interferometric SAR (InSAR) for forming three-dimensional imagery. Good indications have been obtained from lab experiments

Advanced satellite radar interferometry for small-scale surface deformation detection

Synthetic aperture radar interferometry (InSAR) is a technique that enables generation of Digital Elevation Models (DEMs) and detection of surface motion at the centimetre level using radar signals transmitted from a satellite or an aeroplane. Deformation observations can be performed due to the fact that surface motion, caused by natural and human activities, generates a local phase shift in the resultant interferogram. The magnitude of surface deformation can be estimated directly as a fraction of the wavelength of the transmitted signal. Moreover, differential InSAR (DInSAR) eliminates the phase signal caused by relief to yield a differential interferogram in which the signature of surface deformation can be seen. Although InSAR applications are well established, the improvement of the interferometry technique and the quality of its products is highly desirable to further enhance its capabilities. The application of InSAR encounters problems due to noise in the interferometric phase measurement, caused by a number of decorrelation factors. In addition, the interferogram contains biases owing to satellite orbit errors and atmospheric heterogeneity These factors dramatically reduce the stlectiveness of radar interferometry in many applications, and, in particular, compromise detection and analysis of small-scale spatial deformations. The research presented in this thesis aim to apply radar interferometry processing to detect small-scale surface deformations, improve the quality of the interferometry products, determine the minimum and maximum detectable deformation gradient and enhance the analysis of the interferometric phase image. The quality of DEM and displacement maps can be improved by various methods at different processing levels. One of the methods is filtering of the interferometric phase.However, while filtering reduces noise in the interferogram, it does not necessarily enhance or recover the signal. Furthermore, the impact of the filter can significantly change the structure of the interferogram. A new adaptive radar interferogram filter has been developed and is presented herein. The filter is based on a modification to the Goldstein radar interferogram filter making the filter parameter dependent on coherence so that incoherent areas are filtered more than coherent areas. This modification minimises the loss of signal while still reducing the level of noise. A methodology leading to the creation of a functional model for determining minimum and maximum detectable deformation gradient, in terms of the coherence value, has been developed. The sets of representative deformation models have been simulated and the associated phase from these models has been introduced to real SAR data acquired by ERS-1/2 satellites. A number of cases of surface motion with varying magnitudes and spatial extent have been simulated. In each case, the resultant surface deformation has been compared with the 'true' surface deformation as defined by the deformation model. Based on those observations, the functional model has been developed. Finally, the extended analysis of the interferometric phase image using a wavelet approach is presented. The ability of a continuous wavelet transform to reveal the content of the wrapped phase interferogram, such as (i) discontinuities, (ii) extent of the deformation signal, and (iii) the magnitude of the deformation signal is examined. The results presented represent a preliminary study revealing the wavelet method as a promising technique for interferometric phase image analysis

Innovative Techniques for the Retrieval of Earth’s Surface and Atmosphere Geophysical Parameters: Spaceborne Infrared/Microwave Combined Analyses

With the advent of the first satellites for Earth Observation: Landsat-1 in July 1972 and ERS-1 in May 1991, the discipline of environmental remote sensing has become, over time, increasingly fundamental for the study of phenomena characterizing the planet Earth. The goal of environmental remote sensing is to perform detailed analyses and to monitor the temporal evolution of different physical phenomena, exploiting the mechanisms of interaction between the objects that are present in an observed scene and the electromagnetic radiation detected by sensors, placed at a distance from the scene, operating at different frequencies. The analyzed physical phenomena are those related to climate change, weather forecasts, global ocean circulation, greenhouse gas profiling, earthquakes, volcanic eruptions, soil subsidence, and the effects of rapid urbanization processes. Generally, remote sensing sensors are of two primary types: active and passive. Active sensors use their own source of electromagnetic radiation to illuminate and analyze an area of interest. An active sensor emits radiation in the direction of the area to be investigated and then detects and measures the radiation that is backscattered from the objects contained in that area. Passive sensors, on the other hand, detect natural electromagnetic radiation (e.g., from the Sun in the visible band and the Earth in the infrared and microwave bands) emitted or reflected by the object contained in the observed scene. The scientific community has dedicated many resources to developing techniques to estimate, study and analyze Earth’s geophysical parameters. These techniques differ for active and passive sensors because they depend strictly on the type of the measured physical quantity. In my P.h.D. work, inversion techniques for estimating Earth’s surface and atmosphere geophysical parameters will be addressed, emphasizing methods based on machine learning (ML). In particular, the study of cloud microphysics and the characterization of Earth’s surface changes phenomenon are the critical points of this work