Information Extraction and Modeling from Remote Sensing Images: Application to the Enhancement of Digital Elevation Models

To deal with high complexity data such as remote sensing images presenting metric resolution over large areas, an innovative, fast and robust image processing system is presented. The modeling of increasing level of information is used to extract, represent and link image features to semantic content. The potential of the proposed techniques is demonstrated with an application to enhance and regularize digital elevation models based on information collected from RS images

Unsupervised multi-scale change detection from SAR imagery for monitoring natural and anthropogenic disasters

Thesis (Ph.D.) University of Alaska Fairbanks, 2017Radar remote sensing can play a critical role in operational monitoring of natural and anthropogenic disasters. Despite its all-weather capabilities, and its high performance in mapping, and monitoring of change, the application of radar remote sensing in operational monitoring activities has been limited. This has largely been due to: (1) the historically high costs associated with obtaining radar data; (2) slow data processing, and delivery procedures; and (3) the limited temporal sampling that was provided by spaceborne radar-based satellites. Recent advances in the capabilities of spaceborne Synthetic Aperture Radar (SAR) sensors have developed an environment that now allows for SAR to make significant contributions to disaster monitoring. New SAR processing strategies that can take full advantage of these new sensor capabilities are currently being developed. Hence, with this PhD dissertation, I aim to: (i) investigate unsupervised change detection techniques that can reliably extract signatures from time series of SAR images, and provide the necessary flexibility for application to a variety of natural, and anthropogenic hazard situations; (ii) investigate effective methods to reduce the effects of speckle and other noise on change detection performance; (iii) automate change detection algorithms using probabilistic Bayesian inferencing; and (iv) ensure that the developed technology is applicable to current, and future SAR sensors to maximize temporal sampling of a hazardous event. This is achieved by developing new algorithms that rely on image amplitude information only, the sole image parameter that is available for every single SAR acquisition. The motivation and implementation of the change detection concept are described in detail in Chapter 3. In the same chapter, I demonstrated the technique's performance using synthetic data as well as a real-data application to map wildfire progression. I applied Radiometric Terrain Correction (RTC) to the data to increase the sampling frequency, while the developed multiscaledriven approach reliably identified changes embedded in largely stationary background scenes. With this technique, I was able to identify the extent of burn scars with high accuracy. I further applied the application of the change detection technology to oil spill mapping. The analysis highlights that the approach described in Chapter 3 can be applied to this drastically different change detection problem with only little modification. While the core of the change detection technique remained unchanged, I made modifications to the pre-processing step to enable change detection from scenes of continuously varying background. I introduced the Lipschitz regularity (LR) transformation as a technique to normalize the typically dynamic ocean surface, facilitating high performance oil spill detection independent of environmental conditions during image acquisition. For instance, I showed that LR processing reduces the sensitivity of change detection performance to variations in surface winds, which is a known limitation in oil spill detection from SAR. Finally, I applied the change detection technique to aufeis flood mapping along the Sagavanirktok River. Due to the complex nature of aufeis flooded areas, I substituted the resolution-preserving speckle filter used in Chapter 3 with curvelet filters. In addition to validating the performance of the change detection results, I also provide evidence of the wealth of information that can be extracted about aufeis flooding events once a time series of change detection information was extracted from SAR imagery. A summary of the developed change detection techniques is conducted and suggested future work is presented in Chapter 6

Detection and height estimation of buildings from SAR and optical images using conditional random fields

[no abstract

Sea ice segmentation in SAR images using Deep Learning

Sea ice covers over seven percent of the world's oceans. Due to the effect of global warming, Arctic's ice extent has decreased significantly in the past decades. This reduction in sea ice cover is opening new pathways for the international shipping community through the Arctic. Due to the lengthening of the open water season, the Canadian Arctic has also observed a three-fold increase in the shipping traffic in the past few years. Although the ice extent has reduced, the risks and hazards involved in shipping through these regions are still significant. To promote safe and efficient maritime activities in the Canadian Arctic, Canadian Ice Service (CIS) provides information about ice in Canada's navigable waters. CIS uses Synthetic Aperture Radar (SAR) images as one of the prominent sources to gain insights about the ice conditions in Canadian waters. Automated SAR image interpretation is a complex task and requires algorithms to learn complex and rich features. Convolutional neural networks (CNNs) have demonstrated their ability to learn such features and have been used in various image classification, segmentation and object detection tasks. In this thesis, we first propose a method to detect marginal ice zones (MIZs) in SAR images. This method uses transfer learning combined with a multi-scale patch technique to detect the MIZs. The multi-scale patch technique involves generating the segmentation masks over different patch sizes for the same image. These masks are later stacked together and thresholded to generate the final MIZ prediction mask for an image. Later we dive deep into the MIZs and focus on segmenting sea ice floes. We propose a segmentation model optimized for the task of ice floe segmentation in SAR images. The model is based on a fully convolutional architecture with residual connections. In addition to this, a conditional random field is also used as a post-processing step. The whole network is trained end-to-end using a dual loss function. Qualitative and quantitative analysis suggests that our model beats the conventional segmentation architectures for the task of ice floe detection

Novel Markovian Change Detection Models in Computer Vision

In this thesis novel probabilistic models are proposed for three different change detection tasks of computer vision, primarily focusing on applications from video surveillance and aerial exploitation. The surveys are performed in a coherent Markov Random Field (MRF) segmentation framework, but the introduced models face different practical challenges such as shadow effects, image registration errors or presence of noisy and incomplete concept descriptors. Contributions are presented in efficient feature extraction, probabilistic modeling of natural processes and feature integration via local innovations in the model structures. We show by several experiments that the proposed novelties embedded into a strict mathematical toolkit can significantly improve the results in real world test images and videos

Compaction of C-band synthetic aperture radar based sea ice information for navigation in the Baltic Sea

In this work operational sea ice synthetic aperture radar (SAR) data products were improved and developed. A SAR instrument is transmitting electromagnetic radiation at certain wavelengths and measures the radiation which is scattered back towards the instrument from the target, in our case sea and sea ice. The measured backscattering is converted to an image describing the target area through complex signal processing. The images, however, differ from optical images, i.e. photographs, and their visual interpretation is not straightforward. The main idea in this work has been to deliver the essential SAR-based sea ice information to end-users (typically on ships) in a compact and user-friendly format. The operational systems at Finnish Institute of Marine Research (FIMR) are currently based on the data received from a Canadian SAR-satellite, Radarsat-1. The operational sea ice classification, developed by the author with colleagues, has been further developed. One problem with the SAR data is typically that the backscattering varies depending on the incidence angle. The incidence angle is the angle in which the transmitted electromagnetic wave meets the target surface and it varies within each SAR image and between different SAR images depending on the measuring geometry. To improve this situation, an incidence angle correction algorithm to normalize the backscattering over the SAR incidence angle range for Baltic Sea ice has been developed as part of this work. The algorithm is based on SAR backscattering statistics over the Baltic Sea. To locate different sea ice areas in SAR images, a SAR segmentation algorithm based on pulse-coupled neural networks has been developed and tested. The parameters have been tuned suitable for the operational data in use at FIMR. The sea ice classification is based on this segmentation and the classification is segment-wise rather than pixel-wise. To improve SAR-based distinguishing between sea ice and open water an open water detection algorithm based on segmentation and local autocorrelation has been developed. Also ice type classification based on higher-order statistics and independent component analysis have been studied to get an improved SAR-based ice type classification. A compression algorithm for compressing sea ice SAR data for visual use has been developed. This algorithm is based on the wavelet decomposition, zero-tree structure and arithmetic coding. Also some properties of the human visual system were utilized. This algorithm was developed to produce smaller compressed SAR images, with a reasonable visual quality. The transmission of the compressed images to ships with low-speed data connections in reasonable time is then possible. One of the navigationally most important sea ice parameters is the ice thickness. SAR-based ice thickness estimation has been developed and evaluated as part of this work. This ice thickness estimation method uses the ice thickness history derived from digitized ice charts, made daily at the Finnish Ice Service, as its input, and updates this chart based on the novel SAR data. The result is an ice thickness chart representing the ice situation at the SAR acquisition time in higher resolution than in the manually made ice thickness charts. For the evaluation of the results a helicopter-borne ice thickness measuring instrument, based on electromagnetic induction and laser altimeter, was used.reviewe

Robust Modular Feature-Based Terrain-Aided Visual Navigation and Mapping

The visual feature-based Terrain-Aided Navigation (TAN) system presented in this thesis addresses the problem of constraining inertial drift introduced into the location estimate of Unmanned Aerial Vehicles (UAVs) in GPS-denied environment. The presented TAN system utilises salient visual features representing semantic or human-interpretable objects (roads, forest and water boundaries) from onboard aerial imagery and associates them to a database of reference features created a-priori, through application of the same feature detection algorithms to satellite imagery. Correlation of the detected features with the reference features via a series of the robust data association steps allows a localisation solution to be achieved with a finite absolute bound precision defined by the certainty of the reference dataset. The feature-based Visual Navigation System (VNS) presented in this thesis was originally developed for a navigation application using simulated multi-year satellite image datasets. The extension of the system application into the mapping domain, in turn, has been based on the real (not simulated) flight data and imagery. In the mapping study the full potential of the system, being a versatile tool for enhancing the accuracy of the information derived from the aerial imagery has been demonstrated. Not only have the visual features, such as road networks, shorelines and water bodies, been used to obtain a position ’fix’, they have also been used in reverse for accurate mapping of vehicles detected on the roads into an inertial space with improved precision. Combined correction of the geo-coding errors and improved aircraft localisation formed a robust solution to the defense mapping application. A system of the proposed design will provide a complete independent navigation solution to an autonomous UAV and additionally give it object tracking capability