Image fusion techniqes for remote sensing applications

Image fusion refers to the acquisition, processing and synergistic combination of information provided by various sensors or by the same sensor in many measuring contexts. The aim of this survey paper is to describe three typical applications of data fusion in remote sensing. The first study case considers the problem of the Synthetic Aperture Radar (SAR) Interferometry, where a pair of antennas are used to obtain an elevation map of the observed scene; the second one refers to the fusion of multisensor and multitemporal (Landsat Thematic Mapper and SAR) images of the same site acquired at different times, by using neural networks; the third one presents a processor to fuse multifrequency, multipolarization and mutiresolution SAR images, based on wavelet transform and multiscale Kalman filter. Each study case presents also results achieved by the proposed techniques applied to real data

Unsupervised multi-scale change detection from SAR imagery for monitoring natural and anthropogenic disasters

Thesis (Ph.D.) University of Alaska Fairbanks, 2017Radar remote sensing can play a critical role in operational monitoring of natural and anthropogenic disasters. Despite its all-weather capabilities, and its high performance in mapping, and monitoring of change, the application of radar remote sensing in operational monitoring activities has been limited. This has largely been due to: (1) the historically high costs associated with obtaining radar data; (2) slow data processing, and delivery procedures; and (3) the limited temporal sampling that was provided by spaceborne radar-based satellites. Recent advances in the capabilities of spaceborne Synthetic Aperture Radar (SAR) sensors have developed an environment that now allows for SAR to make significant contributions to disaster monitoring. New SAR processing strategies that can take full advantage of these new sensor capabilities are currently being developed. Hence, with this PhD dissertation, I aim to: (i) investigate unsupervised change detection techniques that can reliably extract signatures from time series of SAR images, and provide the necessary flexibility for application to a variety of natural, and anthropogenic hazard situations; (ii) investigate effective methods to reduce the effects of speckle and other noise on change detection performance; (iii) automate change detection algorithms using probabilistic Bayesian inferencing; and (iv) ensure that the developed technology is applicable to current, and future SAR sensors to maximize temporal sampling of a hazardous event. This is achieved by developing new algorithms that rely on image amplitude information only, the sole image parameter that is available for every single SAR acquisition. The motivation and implementation of the change detection concept are described in detail in Chapter 3. In the same chapter, I demonstrated the technique's performance using synthetic data as well as a real-data application to map wildfire progression. I applied Radiometric Terrain Correction (RTC) to the data to increase the sampling frequency, while the developed multiscaledriven approach reliably identified changes embedded in largely stationary background scenes. With this technique, I was able to identify the extent of burn scars with high accuracy. I further applied the application of the change detection technology to oil spill mapping. The analysis highlights that the approach described in Chapter 3 can be applied to this drastically different change detection problem with only little modification. While the core of the change detection technique remained unchanged, I made modifications to the pre-processing step to enable change detection from scenes of continuously varying background. I introduced the Lipschitz regularity (LR) transformation as a technique to normalize the typically dynamic ocean surface, facilitating high performance oil spill detection independent of environmental conditions during image acquisition. For instance, I showed that LR processing reduces the sensitivity of change detection performance to variations in surface winds, which is a known limitation in oil spill detection from SAR. Finally, I applied the change detection technique to aufeis flood mapping along the Sagavanirktok River. Due to the complex nature of aufeis flooded areas, I substituted the resolution-preserving speckle filter used in Chapter 3 with curvelet filters. In addition to validating the performance of the change detection results, I also provide evidence of the wealth of information that can be extracted about aufeis flooding events once a time series of change detection information was extracted from SAR imagery. A summary of the developed change detection techniques is conducted and suggested future work is presented in Chapter 6

Modeling of evolving textures using granulometries

This chapter describes a statistical approach to classification of dynamic texture images, called parallel evolution functions (PEFs). Traditional classification methods predict texture class membership using comparisons with a finite set of predefined texture classes and identify the closest class. However, where texture images arise from a dynamic texture evolving over time, estimation of a time state in a continuous evolutionary process is required instead. The PEF approach does this using regression modeling techniques to predict time state. It is a flexible approach which may be based on any suitable image features. Many textures are well suited to a morphological analysis and the PEF approach uses image texture features derived from a granulometric analysis of the image. The method is illustrated using both simulated images of Boolean processes and real images of corrosion. The PEF approach has particular advantages for training sets containing limited numbers of observations, which is the case in many real world industrial inspection scenarios and for which other methods can fail or perform badly. [41] G.W. Horgan, Mathematical morphology for analysing soil structure from images, European Journal of Soil Science, vol. 49, pp. 161–173, 1998. [42] G.W. Horgan, C.A. Reid and C.A. Glasbey, Biological image processing and enhancement, Image Processing and Analysis, A Practical Approach, R. Baldock and J. Graham, eds., Oxford University Press, Oxford, UK, pp. 37–67, 2000. [43] B.B. Hubbard, The World According to Wavelets: The Story of a Mathematical Technique in the Making, A.K. Peters Ltd., Wellesley, MA, 1995. [44] H. Iversen and T. Lonnestad. An evaluation of stochastic models for analysis and synthesis of gray-scale texture, Pattern Recognition Letters, vol. 15, pp. 575–585, 1994. [45] A.K. Jain and F. Farrokhnia, Unsupervised texture segmentation using Gabor filters, Pattern Recognition, vol. 24(12), pp. 1167–1186, 1991. [46] T. Jossang and F. Feder, The fractal characterization of rough surfaces, Physica Scripta, vol. T44, pp. 9–14, 1992. [47] A.K. Katsaggelos and T. Chun-Jen, Iterative image restoration, Handbook of Image and Video Processing, A. Bovik, ed., Academic Press, London, pp. 208–209, 2000. [48] M. K¨oppen, C.H. Nowack and G. R¨osel, Pareto-morphology for color image processing, Proceedings of SCIA99, 11th Scandinavian Conference on Image Analysis 1, Kangerlussuaq, Greenland, pp. 195–202, 1999. [49] S. Krishnamachari and R. Chellappa, Multiresolution Gauss-Markov random field models for texture segmentation, IEEE Transactions on Image Processing, vol. 6(2), pp. 251–267, 1997. [50] T. Kurita and N. Otsu, Texture classification by higher order local autocorrelation features, Proceedings of ACCV93, Asian Conference on Computer Vision, Osaka, pp. 175–178, 1993. [51] S.T. Kyvelidis, L. Lykouropoulos and N. Kouloumbi, Digital system for detecting, classifying, and fast retrieving corrosion generated defects, Journal of Coatings Technology, vol. 73(915), pp. 67–73, 2001. [52] Y. Liu, T. Zhao and J. Zhang, Learning multispectral texture features for cervical cancer detection, Proceedings of 2002 IEEE International Symposium on Biomedical Imaging: Macro to Nano, pp. 169–172, 2002. [53] G. McGunnigle and M.J. Chantler, Modeling deposition of surface texture, Electronics Letters, vol. 37(12), pp. 749–750, 2001. [54] J. McKenzie, S. Marshall, A.J. Gray and E.R. Dougherty, Morphological texture analysis using the texture evolution function, International Journal of Pattern Recognition and Artificial Intelligence, vol. 17(2), pp. 167–185, 2003. [55] J. McKenzie, Classification of dynamically evolving textures using evolution functions, Ph.D. Thesis, University of Strathclyde, UK, 2004. [56] S.G. Mallat, Multiresolution approximations and wavelet orthonormal bases of L2(R), Transactions of the American Mathematical Society, vol. 315, pp. 69–87, 1989. [57] S.G. Mallat, A theory for multiresolution signal decomposition: the wavelet representation, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 11, pp. 674–693, 1989. [58] B.S. Manjunath and W.Y. Ma, Texture features for browsing and retrieval of image data, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, pp. 837–842, 1996. [59] B.S. Manjunath, G.M. Haley and W.Y. Ma, Multiband techniques for texture classification and segmentation, Handbook of Image and Video Processing, A. Bovik, ed., Academic Press, London, pp. 367–381, 2000. [60] G. Matheron, Random Sets and Integral Geometry, Wiley Series in Probability and Mathematical Statistics, John Wiley and Sons, New York, 1975

Advanced satellite radar interferometry for small-scale surface deformation detection

Synthetic aperture radar interferometry (InSAR) is a technique that enables generation of Digital Elevation Models (DEMs) and detection of surface motion at the centimetre level using radar signals transmitted from a satellite or an aeroplane. Deformation observations can be performed due to the fact that surface motion, caused by natural and human activities, generates a local phase shift in the resultant interferogram. The magnitude of surface deformation can be estimated directly as a fraction of the wavelength of the transmitted signal. Moreover, differential InSAR (DInSAR) eliminates the phase signal caused by relief to yield a differential interferogram in which the signature of surface deformation can be seen. Although InSAR applications are well established, the improvement of the interferometry technique and the quality of its products is highly desirable to further enhance its capabilities. The application of InSAR encounters problems due to noise in the interferometric phase measurement, caused by a number of decorrelation factors. In addition, the interferogram contains biases owing to satellite orbit errors and atmospheric heterogeneity These factors dramatically reduce the stlectiveness of radar interferometry in many applications, and, in particular, compromise detection and analysis of small-scale spatial deformations. The research presented in this thesis aim to apply radar interferometry processing to detect small-scale surface deformations, improve the quality of the interferometry products, determine the minimum and maximum detectable deformation gradient and enhance the analysis of the interferometric phase image. The quality of DEM and displacement maps can be improved by various methods at different processing levels. One of the methods is filtering of the interferometric phase.However, while filtering reduces noise in the interferogram, it does not necessarily enhance or recover the signal. Furthermore, the impact of the filter can significantly change the structure of the interferogram. A new adaptive radar interferogram filter has been developed and is presented herein. The filter is based on a modification to the Goldstein radar interferogram filter making the filter parameter dependent on coherence so that incoherent areas are filtered more than coherent areas. This modification minimises the loss of signal while still reducing the level of noise. A methodology leading to the creation of a functional model for determining minimum and maximum detectable deformation gradient, in terms of the coherence value, has been developed. The sets of representative deformation models have been simulated and the associated phase from these models has been introduced to real SAR data acquired by ERS-1/2 satellites. A number of cases of surface motion with varying magnitudes and spatial extent have been simulated. In each case, the resultant surface deformation has been compared with the 'true' surface deformation as defined by the deformation model. Based on those observations, the functional model has been developed. Finally, the extended analysis of the interferometric phase image using a wavelet approach is presented. The ability of a continuous wavelet transform to reveal the content of the wrapped phase interferogram, such as (i) discontinuities, (ii) extent of the deformation signal, and (iii) the magnitude of the deformation signal is examined. The results presented represent a preliminary study revealing the wavelet method as a promising technique for interferometric phase image analysis

Historical forest biomass dynamics modelled with Landsat spectral trajectories

Acknowledgements National Forest Inventory data are available online, provided by Ministerio de Agricultura, Alimentación y Medio Ambiente (España). Landsat images are available online, provided by the USGS.Peer reviewedPostprin

Compaction of C-band synthetic aperture radar based sea ice information for navigation in the Baltic Sea

In this work operational sea ice synthetic aperture radar (SAR) data products were improved and developed. A SAR instrument is transmitting electromagnetic radiation at certain wavelengths and measures the radiation which is scattered back towards the instrument from the target, in our case sea and sea ice. The measured backscattering is converted to an image describing the target area through complex signal processing. The images, however, differ from optical images, i.e. photographs, and their visual interpretation is not straightforward. The main idea in this work has been to deliver the essential SAR-based sea ice information to end-users (typically on ships) in a compact and user-friendly format. The operational systems at Finnish Institute of Marine Research (FIMR) are currently based on the data received from a Canadian SAR-satellite, Radarsat-1. The operational sea ice classification, developed by the author with colleagues, has been further developed. One problem with the SAR data is typically that the backscattering varies depending on the incidence angle. The incidence angle is the angle in which the transmitted electromagnetic wave meets the target surface and it varies within each SAR image and between different SAR images depending on the measuring geometry. To improve this situation, an incidence angle correction algorithm to normalize the backscattering over the SAR incidence angle range for Baltic Sea ice has been developed as part of this work. The algorithm is based on SAR backscattering statistics over the Baltic Sea. To locate different sea ice areas in SAR images, a SAR segmentation algorithm based on pulse-coupled neural networks has been developed and tested. The parameters have been tuned suitable for the operational data in use at FIMR. The sea ice classification is based on this segmentation and the classification is segment-wise rather than pixel-wise. To improve SAR-based distinguishing between sea ice and open water an open water detection algorithm based on segmentation and local autocorrelation has been developed. Also ice type classification based on higher-order statistics and independent component analysis have been studied to get an improved SAR-based ice type classification. A compression algorithm for compressing sea ice SAR data for visual use has been developed. This algorithm is based on the wavelet decomposition, zero-tree structure and arithmetic coding. Also some properties of the human visual system were utilized. This algorithm was developed to produce smaller compressed SAR images, with a reasonable visual quality. The transmission of the compressed images to ships with low-speed data connections in reasonable time is then possible. One of the navigationally most important sea ice parameters is the ice thickness. SAR-based ice thickness estimation has been developed and evaluated as part of this work. This ice thickness estimation method uses the ice thickness history derived from digitized ice charts, made daily at the Finnish Ice Service, as its input, and updates this chart based on the novel SAR data. The result is an ice thickness chart representing the ice situation at the SAR acquisition time in higher resolution than in the manually made ice thickness charts. For the evaluation of the results a helicopter-borne ice thickness measuring instrument, based on electromagnetic induction and laser altimeter, was used.reviewe

Morphological Development of the German Wadden Sea from 1996 to 2009 Determined with the Waterline Method and SAR and Landsat Satellite Images

The Dutch, German, and Danish Wadden Sea contains some of the largest undisturbed tidal flats in the world of about 10,000 km2. The research areas covered in this thesis are the North Frisian, Neuwerk, and Cuxhaven regions of the German Wadden Sea. The goal of the thesis is to use the waterline method with SAR and optical images to derive topographic maps in order to analyze the morphological development of this valuable ecological system on large spatial and engineering time scales (90 km and 14 years). Compared to earlier applications, the method is improved with respect to the geocoding step and the data coverage of the complete tidal range. The results also allow analyzing smaller scale s developmental details, such as sandbars and estuaries. Topographical maps from 1996 to 1999, and 2004 to 2009 were generated. The largest morphological differences occurred between 2009 and 1996, also observed in the -2 m isobaths map. The Bed Elevation Range of the tidal flats includes all the elevation information from 1996 to 2009 in order to identify the maximum changes during the investigation period. It shows high morphodynamic regions are outer parts of the tidal flat, sandbars, and estuaries. Vertical nodal linear regression gives the direction of the morphological development (erosion or sedimentation). Our result shows that the rate of change is mostly between -0.1 to 0.1 m/yr. Extreme erosion rate reaches over -0.3 m/yr, while extreme sedimentation rate is up to 0.36 m/yr. The absolute amount of elevation change called turnover height has a growth rate of 8.2 mm/yr, indicating the growing morphodynamic activity over the investigation period. The net balance height of the whole investigation region shows an increasing trend of 6.8 mm/yr, demonstrating an overall sedimentation. According to large-scale analyses, the most dynamic areas are the sandbars. Tertiussand, D-Steert, Gelbsand, and Medemgrund/Medemsand are given detailed discussion in this thesis. The west side of the sandbars except for Medemgrund/Medemsand face the high wave and tidal energy arriving from the open North sea, and cause large erosion towards east, while Medemgrund/Medemsand located in the Elbe estuary show migration in the opposite direction. The three cross sections of Tertiussand, Gelbsand and Medemgrund all show clearly increasing elevation if comparing the average elevation over the years 1996-1999 and 2004-2009. Since the areas of Tertiussand and Gelbsand decreased, their increased elevation might relate to internal sediment redistribution. Medemgrund increasead in area, so its increased elevation could be compensated by the adjacent tidal flat Medemsand which has significant erosion towards the north and the sediment brought from Elbe River

Transform texture classification

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Ocean Engineering, 1996.Includes bibliographical references (leaves 155-163).by Xiaoou Tang.Ph.D