Sea Ice Classification of SAR Imagery Based on Convolution Neural Networks

We explore new and existing convolutional neural network (CNN) architectures for sea ice classification using Sentinel-1 (S1) synthetic aperture radar (SAR) data by investigating two key challenges: binary sea ice versus open-water classification, and a multi-class sea ice type classification. The analysis of sea ice in SAR images is challenging because of the thermal noise effects and ambiguities in the radar backscatter for certain conditions that include the reflection of complex information from sea ice surfaces. We use manually annotated SAR images containing various sea ice types to construct a dataset for our Deep Learning (DL) analysis. To avoid contamination between classes we use a combination of near-simultaneous SAR images from S1 and fine resolution cloud-free optical data from Sentinel-2 (S2). For the classification, we use data augmentation to adjust for the imbalance of sea ice type classes in the training data. The SAR images are divided into small patches which are processed one at a time. We demonstrate that the combination of data augmentation and training of a proposed modified Visual Geometric Group 16-layer (VGG-16) network, trained from scratch, significantly improves the classification performance, compared to the original VGG-16 model and an ad hoc CNN model. The experimental results show both qualitatively and quantitatively that our models produce accurate classification results

Learning to Estimate Sea Ice Concentration from SAR Imagery

Through the growing interest in the Arctic for shipping, mining and climate research, large-scale high quality ice concentration is of great interest. Due to the unavailability of suitable ice concentration estimation algorithms, ice concentration maps are interpreted from synthetic aperture radar (SAR) images manually by ice experts for operational uses. An automatic ice concentration estimation algorithm is required for accurate large-scale ice mapping. In this thesis, a set of algorithms are developed aiming at operational ice concentration estimation from SAR images. The major difficulty in designing a robust algorithm for ice concentration estimation from SAR images is the constantly changing SAR image features of ice and water in time and location. This difficulty is addressed by learning features instead of designing features from SAR images. A set of convolutional neural network based ice concentration estima- tion algorithms are developed to learn multi-scale SAR image features and simultaneously regress ice concentration from the learned image features. We first demonstrated the capa- bility of CNNs in ice concentration estimation from SAR images when trained using image analysis charts as ground truth. Then the model is further improved by taking into account the errors in the image analysis charts. Ice concentration estimates with improved robust- ness to training samples errors, accuracy and scale of details are obtained. The robustness of the developed methods are further demonstrated in the melt season of the Beaufort Sea, where reasonable ice concentration estimates are acquired. In order to reduce the model training time, it is desired to reuse existing models. The model transferability is evaluated and suggestions on using existing models to accelerate the training process are given, which is shown to reduce the training time by over 10 times in our case

Scalable computing for earth observation - Application on Sea Ice analysis

In recent years, Deep learning (DL) networks have shown considerable improvements and have become a preferred methodology in many different applications. These networks have outperformed other classical techniques, particularly in large data settings. In earth observation from the satellite field, for example, DL algorithms have demonstrated the ability to learn complicated nonlinear relationships in input data accurately. Thus, it contributed to advancement in this field. However, the training process of these networks has heavy computational overheads. The reason is two-fold: The sizable complexity of these networks and the high number of training samples needed to learn all parameters comprising these architectures. Although the quantity of training data enhances the accuracy of the trained models in general, the computational cost may restrict the amount of analysis that can be done. This issue is particularly critical in satellite remote sensing, where a myriad of satellites generate an enormous amount of data daily, and acquiring in-situ ground truth for building a large training dataset is a fundamental prerequisite. This dissertation considers various aspects of deep learning based sea ice monitoring from SAR data. In this application, labeling data is very costly and time-consuming. Also, in some cases, it is not even achievable due to challenges in establishing the required domain knowledge, specifically when it comes to monitoring Arctic Sea ice with Synthetic Aperture Radar (SAR), which is the application domain of this thesis. Because the Arctic is remote, has long dark seasons, and has a very dynamic weather system, the collection of reliable in-situ data is very demanding. In addition to the challenges of interpreting SAR data of sea ice, this issue makes SAR-based sea ice analysis with DL networks a complicated process. We propose novel DL methods to cope with the problems of scarce training data and address the computational cost of the training process. We analyze DL network capabilities based on self-designed architectures and learn strategies, such as transfer learning for sea ice classification. We also address the scarcity of training data by proposing a novel deep semi-supervised learning method based on SAR data for incorporating unlabeled data information into the training process. Finally, a new distributed DL method that can be used in a semi-supervised manner is proposed to address the computational complexity of deep neural network training

Innovative Techniques for the Retrieval of Earth’s Surface and Atmosphere Geophysical Parameters: Spaceborne Infrared/Microwave Combined Analyses

With the advent of the first satellites for Earth Observation: Landsat-1 in July 1972 and ERS-1 in May 1991, the discipline of environmental remote sensing has become, over time, increasingly fundamental for the study of phenomena characterizing the planet Earth. The goal of environmental remote sensing is to perform detailed analyses and to monitor the temporal evolution of different physical phenomena, exploiting the mechanisms of interaction between the objects that are present in an observed scene and the electromagnetic radiation detected by sensors, placed at a distance from the scene, operating at different frequencies. The analyzed physical phenomena are those related to climate change, weather forecasts, global ocean circulation, greenhouse gas profiling, earthquakes, volcanic eruptions, soil subsidence, and the effects of rapid urbanization processes. Generally, remote sensing sensors are of two primary types: active and passive. Active sensors use their own source of electromagnetic radiation to illuminate and analyze an area of interest. An active sensor emits radiation in the direction of the area to be investigated and then detects and measures the radiation that is backscattered from the objects contained in that area. Passive sensors, on the other hand, detect natural electromagnetic radiation (e.g., from the Sun in the visible band and the Earth in the infrared and microwave bands) emitted or reflected by the object contained in the observed scene. The scientific community has dedicated many resources to developing techniques to estimate, study and analyze Earth’s geophysical parameters. These techniques differ for active and passive sensors because they depend strictly on the type of the measured physical quantity. In my P.h.D. work, inversion techniques for estimating Earth’s surface and atmosphere geophysical parameters will be addressed, emphasizing methods based on machine learning (ML). In particular, the study of cloud microphysics and the characterization of Earth’s surface changes phenomenon are the critical points of this work

Automated Design of Neural Network Architecture for Classification

This Ph.D. thesis deals with finding a good architecture of a neural network classifier. The focus is on methods to improve the performance of existing architectures (i.e. architectures that are initialised by a good academic guess) and automatically building neural networks. An introduction to the Multi-Layer feed-forward neural network is given and the most essential properties for neural networks; there ability to learn from examples is discussion. Topics like traning and generalisation are treated in more explicit. On the basic of this dissuscion methods for finding a good architecture of the network described. This includes methods like; Early stopping, Cross validation, Regularisation, Pruning and various constructions algorithms (methods that successively builds a network). New ideas of combining units with different types of transfer functions like radial basis functions and sigmoid or threshold functions led to the development of a new construction algorithm for classification. The algorithm called "GLOCAL" is fully described. Results from these experiments real life data from a Synthetic Aperture Radar (SAR) are provided.The thesis was written so people from the industry and graduate students who are interested in neural networks hopeful would find it useful.Key words: Neural networks, Architectures, Training, Generalisation deductive and construction algorithms

Sustainable marine ecosystems: deep learning for water quality assessment and forecasting

An appropriate management of the available resources within oceans and coastal regions is vital to guarantee their sustainable development and preservation, where water quality is a key element. Leveraging on a combination of cross-disciplinary technologies including Remote Sensing (RS), Internet of Things (IoT), Big Data, cloud computing, and Artificial Intelligence (AI) is essential to attain this aim. In this paper, we review methodologies and technologies for water quality assessment that contribute to a sustainable management of marine environments. Specifically, we focus on Deep Leaning (DL) strategies for water quality estimation and forecasting. The analyzed literature is classified depending on the type of task, scenario and architecture. Moreover, several applications including coastal management and aquaculture are surveyed. Finally, we discuss open issues still to be addressed and potential research lines where transfer learning, knowledge fusion, reinforcement learning, edge computing and decision-making policies are expected to be the main involved agents.Postprint (published version

Detection and classification of sea ice from spaceborne multi-frequency synthetic aperture radar imagery and radar altimetry

The sea ice cover in the Arctic is undergoing drastic changes. Since the start of satellite observations by microwave remote sensing in the late 1970\u27s, the maximum summer sea ice extent has been decreasing and thereby causing a generally thinner and younger sea ice cover. Spaceborne radar remote sensing facilitates the determination of sea ice properties in a changing climate with the high spatio-temporal resolution necessary for a better understanding of the ongoing processes as well as safe navigation and operation in ice infested waters.The work presented in this thesis focuses on the one hand on synergies of multi-frequency spaceborne synthetic aperture radar (SAR) imagery for sea ice classification. On the other hand, the fusion of radar altimetry observations with near-coincidental SAR imagery is investigated for its potential to improve 3-dimensional sea ice information retrieval.Investigations of ice/water classification of C- and L-band SAR imagery with a feed-forward neural network demonstrated the capabilities of both frequencies to outline the sea ice edge with good accuracy. Classification results also indicate that a combination of both frequencies can improve the identification of thin ice areas within the ice pack compared to C-band alone. Incidence angle normalisation has proven to increase class separability of different ice types. Analysis of incidence angle dependence between 19-47\ub0 at co- and cross-polarisation from Sentinel-1 C-band images closed a gap in existing slope estimates at cross-polarisation for multiyear sea ice and confirms values obtained in other regions of the Arctic or with different sensors. Furthermore, it demonstrated that insufficient noise correction of the first subswath at cross-polarisation increased the slope estimates by 0.01 dB/1\ub0 for multiyear ice. The incidence angle dependence of the Sentinel-1 noise floor affected smoother first-year sea ice and made the first subswath unusable for reliable incidence angle estimates in those cases.Radar altimetry can complete the 2-dimensional sea ice picture with thickness information. By comparison of SAR imagery with altimeter waveforms from CryoSat-2, it is demonstrated that waveforms respond well to changes of the sea ice surface in the order of a few hundred metres to a few kilometres. Freeboard estimates do however not always correspond to these changes especially when mixtures of different ice types are found within the footprint. Homogeneous ice floes of about 10 km are necessary for robust averaged freeboard estimates. The results demonstrate that multi-frequency and multi-sensor approaches open up for future improvements of sea ice retrievals from radar remote sensing techniques, but access to in-situ data for training and validation will be critical

Guided Unsupervised Learning by Subaperture Decomposition for Ocean SAR Image Retrieval

Spaceborne synthetic aperture radar (SAR) can provide accurate images of the ocean surface roughness day-or-night in nearly all weather conditions, being an unique asset for many geophysical applications. Considering the huge amount of data daily acquired by satellites, automated techniques for physical features extraction are needed. Even if supervised deep learning methods attain state-of-the-art results, they require great amount of labeled data, which are difficult and excessively expensive to acquire for ocean SAR imagery. To this end, we use the subaperture decomposition (SD) algorithm to enhance the unsupervised learning retrieval on the ocean surface, empowering ocean researchers to search into large ocean databases. We empirically prove that SD improve the retrieval precision with over 20% for an unsupervised transformer auto-encoder network. Moreover, we show that SD brings important performance boost when Doppler centroid images are used as input data, leading the way to new unsupervised physics guided retrieval algorithms