Machine learning approaches to retrieve pan-Arctic melt ponds from visible satellite imagery

Melt ponds on sea ice play an important role in the seasonal evolution of the summer ice cover. In this study we present two machine learning algorithms, one (multi-layer neural network) for the retrieval of melt pond binary classification and another (multinomial logistic regression) for melt pond fraction using moderate resolution visible satellite imagery from the Moderate Resolution Imaging Spectroradiometer (MODIS). To minimize the impact of the anisotropic reflectance characteristics of sea ice and melt ponds, normalized MODIS band reflectance differences from top-of-the-atmosphere (TOA) measured reflectances were used. The training samples for the machine learning were based on MODIS reflectances extracted for sea ice, melt ponds and open water classifications based on high resolution (~2 m) WorldView (WV) data. The accuracy assessment for melt pond binary classification and fraction is further evaluated against WV imagery, showing mean overall accuracy (85.5%), average mean difference (0.09), and mean RMSE (0.18). In addition to cross-validation with WV, retrieved melt pond data are validated against melt pond fractions from satellite and ship-based observations, showing average mean differences (MD), root-mean-square-error (RMSE), and correlation coefficients (R) of 0.05, 0.12, and 0.41, respectively. We further investigate a case study of the spectral characteristics of melt ponds and ice during refreezing, and demonstrate an approach to mask out refrozen pixels by using yearly maps of melt onset and freeze-up data together with ice surface temperatures (IST). Finally, an example of monthly mean pan-Arctic melt pond binary classification and fraction are shown for July 2001, 2004, 2007, 2010, 2013, 2016, and 2019. Bulk processing of the entire 20 years of MODIS data will provide the science community with a much needed pan-Arctic melt pond data set

Advanced methods for earth observation data synergy for geophysical parameter retrieval

The first part of the thesis focuses on the analysis of relevant factors to estimate the response time between satellite-based and in-situ soil moisture (SM) using a Dynamic Time Warping (DTW). DTW was applied to the SMOS L4 SM, and was compared to in-situ root-zone SM in the REMEDHUS network in Western Spain. The method was customized to control the evolution of time lag during wetting and drying conditions. Climate factors in combination with crop growing seasons were studied to reveal SM-related processes. The heterogeneity of land use was analyzed using high-resolution images of NDVI from Sentinel-2 to provide information about the level of spatial representativity of SMOS data to each in-situ station. The comparison of long-term precipitation records and potential evapotranspiration allowed estimation of SM seasons describing different SM conditions depending on climate and soil properties. The second part of the thesis focuses on data-driven methods for sea ice segmentation and parameter retrieval. A Bayesian framework is employed to segment sets of multi-source satellite data. The Bayesian unsupervised learning algorithm allows to investigate the ‘hidden link’ between multiple data. The statistical properties are accounted for by a Gaussian Mixture Model, and the spatial interactions are reflected using Hidden Markov Random Fields. The algorithm segments spatial data into a number of classes, which are represented as a latent field in physical space and as clusters in feature space. In a first application, a two-step probabilistic approach based on Expectation-Maximization and the Bayesian segmentation algorithm was used to segment SAR images to discriminate surface water from sea ice types. Information on surface roughness is contained in the radar backscattering images which can be - in principle - used to detect melt ponds and to estimate high-resolution sea ice concentration (SIC). In a second study, the algorithm was applied to multi-incidence angle TB data from the SMOS L1C product to harness the its sensitivity to thin ice. The spatial patterns clearly discriminate well-determined areas of open water, old sea ice and a transition zone, which is sensitive to thin sea ice thickness (SIT) and SIC. In a third application, SMOS and the AMSR2 data are used to examine the joint effect of CIMR-like observations. The information contained in the low-frequency channels allows to reveal ranges of thin sea ice, and thicker ice can be determined from the relationship between the high-frequency channels and changing conditions as the sea ice ages. The proposed approach is suitable for merging large data sets and provides metrics for class analysis, and to make informed choices about integrating data from future missions into sea ice products. A regression neural network approach was investigated with the goal to infer SIT using TB data from the Flexible Microwave Payload 2 (FMPL-2) of the FSSCat mission. Two models - covering thin ice up to 0.6m and the full-range of SIT - were trained on Arctic data using ground truth data derived from the SMOS and Cryosat-2. This work demonstrates that moderate-cost CubeSat missions can provide valuable data for applications in Earth observation.La primera parte de la tesis se centra en el análisis de los factores relevantes para estimar el tiempo de respuesta entre la humedad del suelo (SM) basada en el satélite y la in-situ, utilizando una deformación temporal dinámica (DTW). El DTW se aplicó al SMOS L4 SM, y se comparó con la SM in-situ en la red REMEDHUS en el oeste de España. El método se adaptó para controlar la evolución del desfase temporal durante diferentes condiciones de humedad y secado. Se estudiaron los factores climáticos en combinación con los períodos de crecimiento de los cultivos para revelar los procesos relacionados con la SM. La heterogeneidad del uso del suelo se analizó utilizando imágenes de alta resolución de NDVI de Sentinel-2 para proporcionar información sobre el nivel de representatividad espacial de los datos de SMOS a cada estación in situ. La comparación de los patrones de precipitación a largo plazo y la evapotranspiración potencial permitió estimar las estaciones de SM que describen diferentes condiciones de SM en función del clima y las propiedades del suelo. La segunda parte de esta tesis se centra en métodos dirigidos por datos para la segmentación del hielo marino y la obtención de parámetros. Se emplea un método de inferencia bayesiano para segmentar conjuntos de datos satelitales de múltiples fuentes. El algoritmo de aprendizaje bayesiano no supervisado permite investigar el “vínculo oculto” entre múltiples datos. Las propiedades estadísticas se contabilizan mediante un modelo de mezcla gaussiana, y las interacciones espaciales se reflejan mediante campos aleatorios ocultos de Markov. El algoritmo segmenta los datos espaciales en una serie de clases, que se representan como un campo latente en el espacio físico y como clústeres en el espacio de las variables. En una primera aplicación, se utilizó un enfoque probabilístico de dos pasos basado en la maximización de expectativas y el algoritmo de segmentación bayesiano para segmentar imágenes SAR con el objetivo de discriminar el agua superficial de los tipos de hielo marino. La información sobre la rugosidad de la superficie está contenida en las imágenes de backscattering del radar, que puede utilizarse -en principio- para detectar estanques de deshielo y estimar la concentración de hielo marino (SIC) de alta resolución. En un segundo estudio, el algoritmo se aplicó a los datos TB de múltiples ángulos de incidencia del producto SMOS L1C para aprovechar su sensibilidad al hielo fino. Los patrones espaciales discriminan claramente áreas bien determinadas de aguas abiertas, hielo marino viejo y una zona de transición, que es sensible al espesor del hielo marino fino (SIT) y al SIC. En una tercera aplicación, se utilizan los datos de SMOS y de AMSR2 para examinar el efecto conjunto de las observaciones tipo CIMR. La información contenida en los canales de baja frecuencia permite revelar rangos de hielo marino delgado, y el hielo más grueso puede determinarse a partir de la relación entre los canales de alta frecuencia y las condiciones cambiantes a medida que el hielo marino envejece. El enfoque propuesto es adecuado para fusionar grandes conjuntos de datos y proporciona métricas para el análisis de clases, y para tomar decisiones informadas sobre la integración de datos de futuras misiones en los productos de hielo marino. Se investigó un enfoque de red neuronal de regresión con el objetivo de inferir el SIT utilizando datos de TB de la carga útil de microondas flexible 2 (FMPL-2) de la misión FSSCat. Se entrenaron dos modelos - que cubren el hielo fino hasta 0.6 m y el rango completo del SIT - con datos del Ártico utilizando datos de “ground truth” derivados del SMOS y del Cryosat-2. Este trabajo demuestra que las misiones CubeSat de coste moderado pueden proporcionar datos valiosos para aplicaciones de observación de la Tierra.Postprint (published version

Latest Altimetry-Based Sea Ice Freeboard and Volume Inter-Annual Variability in the Antarctic over 2003–2020

The relatively stable conditions of the sea ice cover in the Antarctic, observed for almost 40 years, seem to be changing recently. Therefore, it is essential to provide sea ice thickness (SIT) and volume (SIV) estimates in order to anticipate potential multi-scale changes in the Antarctic sea ice. For that purpose, the main objectives of this work are: (1) to assess a new sea ice freeboard, thickness and volume altimetry dataset over 2003–2020 and (2) to identify first order impacts of the sea ice recent conditions. To produce these series, we use a neuronal network to calibrate Envisat radar freeboards onto CryoSat-2 (CS2). This method addresses the impacts of surface roughness on Low Resolution Mode (LRM) measurements. During the 2011 common flight period, we found a mean deviation between Envisat and CryoSat-2 radar freeboards by about 0.5 cm. Using the Advanced Microwave Scanning Radiometer (AMSR) and the dual-frequency Altimetric Snow Depth (ASD) data, our solutions are compared with the Upward looking sonar (ULS) draft data, some in-situ measurement of the SIMBA campaign, the total freeboards of 6 Operation Ice Bridge (OIB) missions and ICESat-2 total freeboards. Over 2003–2020, the global mean radar freeboard decreased by about −14% per decade and the SIT and SIV by about −10% per decade (considering a snow depth climatology). This is marked by a slight increase through 2015, which is directly followed by a strong decrease in 2016. Thereafter, freeboards generally remained low and even continued to decrease in some regions such as the Weddell sea. Considering the 2013–2020 period, for which the ASD data are available, radar freeboards and SIT decreased by about −40% per decade. The SIV decreased by about −60% per decade. After 2016, the low SIT values contrast with the sea ice extent that has rather increased again, reaching near-average values in winter 2020. The regional analysis underlines that such thinning (from 2016) occurs in all regions except the Amundsen-Bellingshausen sea sector. Meanwhile, we observed a reversal of the main regional trends from 2016, which may be the signature of significant ongoing changes in the Antarctic sea ice

Evaluation of Machine Learning Algorithms for Lake Ice Classification from Optical Remote Sensing Data

The topic of lake ice cover mapping from satellite remote sensing data has gained interest in recent years since it allows the extent of lake ice and the dynamics of ice phenology over large areas to be monitored. Mapping lake ice extent can record the loss of the perennial ice cover for lakes located in the High Arctic. Moreover, ice phenology dates, retrieved from lake ice maps, are useful for assessing long-term trends and variability in climate, particularly due to their sensitivity to changes in near-surface air temperature. However, existing knowledge-driven (threshold-based) retrieval algorithms for lake ice-water classification that use top-of-the-atmosphere (TOA) reflectance products do not perform well under the condition of large solar zenith angles, resulting in low TOA reflectance. Machine learning (ML) techniques have received considerable attention in the remote sensing field for the past several decades, but they have not yet been applied in lake ice classification from optical remote sensing imagery. Therefore, this research has evaluated the capability of ML classifiers to enhance lake ice mapping using multispectral optical remote sensing data (MODIS L1B (TOA) product). Chapter 3, the main manuscript of this thesis, presents an investigation of four ML classifiers (i.e. multinomial logistic regression, MLR; support vector machine, SVM; random forest, RF; gradient boosting trees, GBT) in lake ice classification. Results are reported using 17 lakes located in the Northern Hemisphere, which represent different characteristics regarding area, altitude, freezing frequency, and ice cover duration. According to the overall accuracy assessment using a random k-fold cross-validation (k = 100), all ML classifiers were able to produce classification accuracies above 94%, and RF and GBT provided above 98% classification accuracies. Moreover, the RF and GBT algorithms provided a more visually accurate depiction of lake ice cover under challenging conditions (i.e., high solar zenith angles, black ice, and thin cloud cover). The two tree-based classifiers were found to provide the most robust spatial transferability over the 17 lakes and performed consistently well across three ice seasons, better than the other classifiers. Moreover, RF was insensitive to the choice of the hyperparameters compared to the other three classifiers. The results demonstrate that RF and GBT provide a great potential to map accurately lake ice cover globally over a long time-series. Additionally, a case study applying a convolution neural network (CNN) model for ice classification in Great Slave Lake, Canada is presented in Appendix A. Eighteen images acquired during the the ice season of 2009-2010 were used in this study. The proposed CNN produced a 98.03% accuracy with the testing dataset; however, the accuracy dropped to 90.13% using an independent (out-of-sample) validation dataset. Results show the powerful learning performance of the proposed CNN with the testing data accuracy obtained. At the same time, the accuracy reduction of the validation dataset indicates the overfitting behavior of the proposed model. A follow-up investigation would be needed to improve its performance. This thesis investigated the capability of ML algorithms (both pixel-based and spatial-based) in lake ice classification from the MODIS L1B product. Overall, ML techniques showed promising performances for lake ice cover mapping from the optical remote sensing data. The tree-based classifiers (pixel-based) exhibited the potential to produce accurate lake ice classification at a large-scale over long time-series. In addition, more work would be of benefit for improving the application of CNN in lake ice cover mapping from optical remote sensing imagery

Ocean remote sensing techniques and applications: a review (Part II)

As discussed in the first part of this review paper, Remote Sensing (RS) systems are great tools to study various oceanographic parameters. Part I of this study described different passive and active RS systems and six applications of RS in ocean studies, including Ocean Surface Wind (OSW), Ocean Surface Current (OSC), Ocean Wave Height (OWH), Sea Level (SL), Ocean Tide (OT), and Ship Detection (SD). In Part II, the remaining nine important applications of RS systems for ocean environments, including Iceberg, Sea Ice (SI), Sea Surface temperature (SST), Ocean Surface Salinity (OSS), Ocean Color (OC), Ocean Chlorophyll (OCh), Ocean Oil Spill (OOS), Underwater Ocean, and Fishery are comprehensively reviewed and discussed. For each application, the applicable RS systems, their advantages and disadvantages, various RS and Machine Learning (ML) techniques, and several case studies are discussed.Peer ReviewedPostprint (published version

Inverse electromagnetic scattering models for sea ice

Journal ArticleInverse scattering algorithms for reconstructing the physical properties of sea ice from scattered electromagnetic field data are presented. The development of these algorithms has advanced the theory of remote sensing, particularly in the microwave region, and has the potential to form the basis for a new generation of techniques for recovering sea ice properties, such as ice thickness, a parameter of geophysical and climatological importance. Moreover, the analysis underlying the algorithms has led to significant advances in the mathematical theory of inverse problems

Detection and classification of sea ice from spaceborne multi-frequency synthetic aperture radar imagery and radar altimetry

The sea ice cover in the Arctic is undergoing drastic changes. Since the start of satellite observations by microwave remote sensing in the late 1970\u27s, the maximum summer sea ice extent has been decreasing and thereby causing a generally thinner and younger sea ice cover. Spaceborne radar remote sensing facilitates the determination of sea ice properties in a changing climate with the high spatio-temporal resolution necessary for a better understanding of the ongoing processes as well as safe navigation and operation in ice infested waters.The work presented in this thesis focuses on the one hand on synergies of multi-frequency spaceborne synthetic aperture radar (SAR) imagery for sea ice classification. On the other hand, the fusion of radar altimetry observations with near-coincidental SAR imagery is investigated for its potential to improve 3-dimensional sea ice information retrieval.Investigations of ice/water classification of C- and L-band SAR imagery with a feed-forward neural network demonstrated the capabilities of both frequencies to outline the sea ice edge with good accuracy. Classification results also indicate that a combination of both frequencies can improve the identification of thin ice areas within the ice pack compared to C-band alone. Incidence angle normalisation has proven to increase class separability of different ice types. Analysis of incidence angle dependence between 19-47\ub0 at co- and cross-polarisation from Sentinel-1 C-band images closed a gap in existing slope estimates at cross-polarisation for multiyear sea ice and confirms values obtained in other regions of the Arctic or with different sensors. Furthermore, it demonstrated that insufficient noise correction of the first subswath at cross-polarisation increased the slope estimates by 0.01 dB/1\ub0 for multiyear ice. The incidence angle dependence of the Sentinel-1 noise floor affected smoother first-year sea ice and made the first subswath unusable for reliable incidence angle estimates in those cases.Radar altimetry can complete the 2-dimensional sea ice picture with thickness information. By comparison of SAR imagery with altimeter waveforms from CryoSat-2, it is demonstrated that waveforms respond well to changes of the sea ice surface in the order of a few hundred metres to a few kilometres. Freeboard estimates do however not always correspond to these changes especially when mixtures of different ice types are found within the footprint. Homogeneous ice floes of about 10 km are necessary for robust averaged freeboard estimates. The results demonstrate that multi-frequency and multi-sensor approaches open up for future improvements of sea ice retrievals from radar remote sensing techniques, but access to in-situ data for training and validation will be critical

Melt pond fractions on Arctic summer sea ice retrieved from Sentinel-3 satellite data with a constrained physical forward model

Abstract. The presence of melt ponds on Arctic summer sea ice significantly alters its albedo and thereby the surface energy budget and mass balance. Large-scale observations of melt pond coverage and sea ice albedo are crucial to investigate the role of sea ice for Arctic amplification and its representation in global climate models. We present the new Melt Pond Detection 2 (MPD2) algorithm, which retrieves melt pond, sea ice, and open-ocean fractions as well as surface albedo from Sentinel-3 visible and near-infrared reflectances. In contrast to most other algorithms, our method uses neither fixed values for the spectral albedo of the surface constituents nor an artificial neural network. Instead, it aims for a fully physical representation of the reflective properties of the surface constituents based on their optical characteristics. The state vector X, containing the optical properties of melt ponds and sea ice along with the area fractions of melt ponds and open ocean, is optimized in an iterative procedure to match the measured reflectances and describe the surface state. A major problem in unmixing a compound pixel is that a mixture of half open water and half bright ice cannot be distinguished from a homogeneous pixel of darker ice. In order to overcome this, we suggest constraining the retrieval with a priori information. Initial values and constraint of the surface fractions are derived with an empirical retrieval which uses the same spectral reflectances as implemented in the physical retrieval. The snow grain size and optical thickness change with time, and thus the ice surface albedo changes throughout the season. Therefore, field observations of spectral albedo are used to develop a parameterization of the sea ice optical properties as a function of the temperature history of the sea ice. With these a priori data, the iterative optimization is initialized and constrained, resulting in a retrieval uncertainty of below 8 % for melt pond and 9 % for open-ocean fractions compared to the reference dataset. As reference data for evaluation, a 10 m resolution product of melt pond and open-ocean fraction from Sentinel-2 optical imagery is used. </jats:p