Topography processing in Sen2Cor - Impact of horizontal resolution of Digital Surface Model

The Copernicus Sentinel-2 mission is fully operating since June 2017 with a constellation of two polar orbiting satellite units. Both Sentinel-2A and Sentinel-2B are equipped with an optical imaging sensor MSI (Multi-Spectral Instrument) which acquires high spatial resolution optical data products. Accurate atmospheric correction of satellite observations is a precondition for the development and delivery of high-quality applications. Therefore the atmospheric correction processor Sen2Cor was developed with the objective of delivering land surface reflectance products. Sen2Cor is designed to process single tile Level-1C products, providing Level-2A surface (Bottom-of-Atmosphere) reflectance product together with Aerosol Optical Thickness (AOT), Water Vapour (WV) estimation maps and a Scene Classification (SCL) map including cloud / cloud shadow classes for further processing. Sen2Cor processor can be downloaded from ESA website as a standalone tool for individual Level-2A processing by the users. It can be run either from command line or as a plugin of the Sentinel-2 Toolbox (SNAP-S2TBX). In parallel, ESA started in June 2017 to use Sen2Cor for systematic Level-2A processing of Sentinel-2 acquisitions over Europe. Since March 2018, Level-2A products are generated by the official Sentinel-2 ground segment (PDGS) and are available on the Copernicus Open Access Hub. Since the beginning of the Sentinel-2 mission, the digital surface model “PlanetDEM 90” from Planet Observer is used as source of Earth topography information, within the Sentinel-2 PDGS. It is at 90- meter resolution, based on SRTM data filled and corrected for 40% of Earth surface. However, until now most users had only access to original SRTM data to run with Sen2Cor or had to provide their own DEM following SRTM or DTED formats. The objective of this presentation is to provide users with an overview of how Sen2Cor makes use of the topography information to improve the quality of the cloud screening and scene classification as well as in the atmospheric correction and terrain correction. In addition, the presentation gives an outlook on Sen2Cor working with the upcoming Copernicus DEM, a new Digital Surface Model (DSM), which represents the surface of the Earth, including buildings, infrastructure and vegetation. This DEM is derived from an edited DSM named WorldDEM. The presentation shows the different L2A surface reflectance obtained with PlanetDEM 90, global Copernicus DEM at 30 m and at 90 m horizontal resolution, and some of these differences are discussed

Separability Analysis of Sentinel-2A Multi-Spectral Instrument (MSI) Data for Burned Area Discrimination

: Biomass burning is a global phenomenon and systematic burned area mapping is of increasing importance for science and applications. With high spatial resolution and novelty in band design, the recently launched Sentinel-2A satellite provides a new opportunity for moderate spatial resolution burned area mapping. This study examines the performance of the Sentinel-2A Multi Spectral Instrument (MSI) bands and derived spectral indices to differentiate between unburned and burned areas. For this purpose, five pairs of pre-fire and post-fire top of atmosphere (TOA reflectance) and atmospherically corrected (surface reflectance) images were studied. The pixel values of locations that were unburned in the first image and burned in the second image, as well as the values of locations that were unburned in both images which served as a control, were compared and the discrimination of individual bands and spectral indices were evaluated using parametric (transformed divergence) and non-parametric (decision tree) approaches. Based on the results, the most suitable MSI bands to detect burned areas are the 20 m near-infrared, short wave infrared and red-edge bands, while the performance of the spectral indices varied with location. The atmospheric correction only significantly influenced the separability of the visible wavelength bands. The results provide insights that are useful for developing Sentinel-2 burned area mapping algorithms

Exploitation of SAR and optical Sentinel data to detect rice crop and estimate seasonal dynamics of leaf area index

This paper presents and evaluates multitemporal LAI estimates derived from Sentinel-2A data on rice cultivated area identified using time series of Sentinel-1A images over the main European rice districts for the 2016 crop season. This study combines the information conveyed by Sentinel-1A and Sentinel-2A into a high-resolution LAI retrieval chain. Rice crop was detected using an operational multi-temporal rule-based algorithm, and LAI estimates were obtained by inverting the PROSAIL radiative transfer model with Gaussian process regression. Direct validation was performed with in situ LAI measurements acquired in coordinated field campaigns in three countries (Italy, Spain and Greece). Results showed high consistency between estimates and ground measurements, revealing high correlations (R^2>0.93) and good accuracies (RMSE<0.83, rRMSE_m<23.6% and rRMSE_r<16.6%) in all cases. Sentinel-2A estimates were compared with Landsat-8 showing high spatial consistency between estimates over the three areas. The possibility to exploit seasonally-updated crop mask exploiting Sentinel-1A data and the temporal consistency between Sentinel-2A and Landsat-7/8 LAI time series demonstrates the feasibility of deriving operationally high spatial-temporal decametric multi-sensor LAI time series useful for crop monitoring

Examination of Sentinel-2A Multi-spectral Instrument (MSI) Reflectance Anisotropy and the Suitability of a General Method to Normalize MSI Reflectance to Nadir BRDF Adjusted Reflectance

The Sentinel-2A multi-spectral instrument (MSI) acquires multi-spectral reflective wavelength observations with directional effects due to surface reflectance anisotropy and changes in the solar and viewing geometry. Directional effects were examined by considering two ten day periods of Sentinel-2A data acquired close to the solar principal and orthogonal planes over approximately 20° × 10° of southern Africa. More than 6.6 million (January 2016) and 10.6 million (April 2016) pairs of reflectance observations sensed 3 or 7 days apart in the forward and backscatter directions in overlapping Sentinel-2A orbit swaths were considered. The Sentinel-2A data were projected into the MODIS sinusoidal projection but first had to be registered due to a misregistration issue evident in the overlapping orbits. The top of atmosphere reflectance data were corrected to surface reflectance using the SEN2COR atmospheric correction software. Only pairs of forward and backward reflectance values that were cloud and snow-free, unsaturated, and had no significant change in their 3 or 7 day separation, were considered. The maximum observed Sentinel-2A view zenith angle was 11.93°. Greater BRDF effects were apparent in the January data (acquired close to the solar principal plane) than the April data (acquired close to the orthogonal plane) and at higher view zenith angle. For the January data the average difference between the surface reflectance in the forward and backward scatter directions at the Sentinel-2A scan edges increased with wavelength from 0.035 (blue), 0.047 (green), 0.057 (red), 0.078 (NIR), to about 0.1 (SWIR). These differences may constitute a significant source of noise for certain applications. The suitability of a recently published methodology developed to generate Landsat nadir BRDF-adjusted reflectance (NBAR) was examined for Sentinel-2A application. The methodology uses fixed MODIS BRDF spectral parameters and is attractive because it has little sensitivity to the land cover type, condition, or surface disturbance and can be derived in a computationally efficient manner globally. It was applied to the southern Africa Sentinel- 2A data and shown to reduce Sentinel-2A BRDF effects. The average difference between the reflectance in the forward and backward scatter directions at the Sentinel-2A scan edges was smaller in the NBAR data than in the corresponding surface reflectance data. Residual BRDF effects in the Sentinel-2A NBAR data occurred likely because of atmospheric correction and sensor calibration errors and inadequacies in the NBAR derivation approach. These issues are discussed with recommendations for future research including global and red-edge Sentinel-2A NBAR derivation that were not considered in this study

Global sensitivity analysis of leaf-canopy-atmosphere RTMs: Implications for biophysical variables retrieval from top-of-atmosphere radiance data

Knowledge of key variables driving the top of the atmosphere (TOA) radiance over a vegetated surface is an important step to derive biophysical variables from TOA radiance data, e.g., as observed by an optical satellite. Coupled leaf-canopy-atmosphere Radiative Transfer Models (RTMs) allow linking vegetation variables directly to the at-sensor TOA radiance measured. Global Sensitivity Analysis (GSA) of RTMs enables the computation of the total contribution of each input variable to the output variance. We determined the impacts of the leaf-canopy-atmosphere variables into TOA radiance using the GSA to gain insights into retrievable variables. The leaf and canopy RTM PROSAIL was coupled with the atmospheric RTM MODTRAN5. Because of MODTRAN's computational burden and GSA's demand for many simulations, we first developed a surrogate statistical learning model, i.e., an emulator, that allows approximating RTM outputs through a machine learning algorithm with low computation time. A Gaussian process regression (GPR) emulator was used to reproduce lookup tables of TOA radiance as a function of 12 input variables with relative errors of 2.4%. GSA total sensitivity results quantified the driving variables of emulated TOA radiance along the 400-2500 nm spectral range at 15 cm-1 (between 0.3-9 nm); overall, the vegetation variables play a more dominant role than atmospheric variables. This suggests the possibility to retrieve biophysical variables directly from at-sensor TOA radiance data. Particularly promising are leaf chlorophyll content, leaf water thickness and leaf area index, as these variables are the most important drivers in governing TOA radiance outside the water absorption regions. A software framework was developed to facilitate the development of retrieval models from at-sensor TOA radiance data. As a proof of concept, maps of these biophysical variables have been generated for both TOA (L1C) and bottom-of-atmosphere (L2A) Sentinel-2 data by means of a hybrid retrieval scheme, i.e., training GPR retrieval algorithms using the RTM simulations. Obtained maps from L1C vs L2A data are consistent, suggesting that vegetation properties can be directly retrieved from TOA radiance data given a cloud-free sky, thus without the need of an atmospheric correction

Multi-platform assessment of turbidity plumes during dredging operations in a major estuarine system

Abstract Dredging activities in estuaries frequently cause deleterious environmental effects on the water quality which can impact flora, fauna, and hydrodynamics, among others. A medium- and high-resolution satellite-based procedure is used in this study to monitor turbidity plumes generated during the dredging operations in the Guadalquivir estuary, a major estuarine system providing important ecosystem services in southwest Europe. A multi-sensor scheme is evaluated using a combination of five public and commercial medium- and high-resolution satellites, including Landsat-8, Sentinel-2A, WorldView-2, WorldView-3, and GeoEye-1, with pixel sizes ranging from 30 m to 0.3 m. Applying a multi-conditional algorithm after the atmospheric correction of the optical imagery with ACOLITE, Sen2Cor and QUAC processors, it is demonstrated the feasibility to monitoring suspended solids during dredging operations at a spatial resolution unachievable with traditional satellite-based ocean color sensors (>300 m). The frame work can be used to map on-going, post and pre-dredging activities and asses Total Suspended Solids (TSS) anomalies caused by natural and anthropogenic processes in coastal and inland waters. These promising results are suitable to effectively improve the assessment of features relevant to environmental policies for the challenging coastal management and might serve as a notable contribution to the Earth Observation Program

Scalable Crop Yield Prediction with Sentinel-2 Time Series and Temporal Convolutional Network

One of the precepts of food security is the proper functioning of the global food markets. This calls for open and timely intelligence on crop production on an agroclimatically meaningful territorial scale. We propose an operationally suitable method for large-scale in-season crop yield estimations from a satellite image time series (SITS) for statistical production. As an object-based method, it is spatially scalable from parcel to regional scale, making it useful for prediction tasks in which the reference data are available only at a coarser level, such as counties. We show that deep learning-based temporal convolutional network (TCN) outperforms the classical machine learning method random forests and produces more accurate results overall than published national crop forecasts. Our novel contribution is to show that mean-aggregated regional predictions with histogram-based features calculated from farm-level observations perform better than other tested approaches. In addition, TCN is robust to the presence of cloudy pixels, suggesting TCN can learn cloud masking from the data. The temporal compositing of information do not improve prediction performance. This indicates that with end-to-end learning less preprocessing in SITS tasks seems viable

Theia Snow collection: high-resolution operational snow cover maps from Sentinel-2 and Landsat-8 data

The Theia Snow collection routinely provides high-resolution maps of the snow-covered area from Sentinel-2 and Landsat-8 observations. The collection covers selected areas worldwide, including the main mountain regions in western Europe (e.g. Alps, Pyrenees) and the High Atlas in Morocco. Each product of the Theia Snow collection contains four classes: snow, no snow, cloud and no data. We present the algorithm to generate the snow products and provide an evaluation of the accuracy of Sentinel-2 snow products using in situ snow depth measurements, higher-resolution snow maps and visual control. The results suggest that the snow is accurately detected in the Theia snow collection and that the snow detection is more accurate than the Sen2Cor outputs (ESA level 2 product). An issue that should be addressed in a future release is the occurrence of false snow detection in some large clouds. The snow maps are currently produced and freely distributed on average 5&thinsp;d after the image acquisition as raster and vector files via the Theia portal (https://doi.org/10.24400/329360/F7Q52MNK).</p

An uncertainty prediction approach for active learning - application to earth observation

Mapping land cover and land usage dynamics are crucial in remote sensing since farmers are encouraged to either intensify or extend crop use due to the ongoing rise in the world’s population. A major issue in this area is interpreting and classifying a scene captured in high-resolution satellite imagery. Several methods have been put forth, including neural networks which generate data-dependent models (i.e. model is biased toward data) and static rule-based approaches with thresholds which are limited in terms of diversity(i.e. model lacks diversity in terms of rules). However, the problem of having a machine learning model that, given a large amount of training data, can classify multiple classes over different geographic Sentinel-2 imagery that out scales existing approaches remains open. On the other hand, supervised machine learning has evolved into an essential part of many areas due to the increasing number of labeled datasets. Examples include creating classifiers for applications that recognize images and voices, anticipate traffic, propose products, act as a virtual personal assistant and detect online fraud, among many more. Since these classifiers are highly dependent from the training datasets, without human interaction or accurate labels, the performance of these generated classifiers with unseen observations is uncertain. Thus, researchers attempted to evaluate a number of independent models using a statistical distance. However, the problem of, given a train-test split and classifiers modeled over the train set, identifying a prediction error using the relation between train and test sets remains open. Moreover, while some training data is essential for supervised machine learning, what happens if there is insufficient labeled data? After all, assigning labels to unlabeled datasets is a time-consuming process that may need significant expert human involvement. When there aren’t enough expert manual labels accessible for the vast amount of openly available data, active learning becomes crucial. However, given a large amount of training and unlabeled datasets, having an active learning model that can reduce the training cost of the classifier and at the same time assist in labeling new data points remains an open problem. From the experimental approaches and findings, the main research contributions, which concentrate on the issue of optical satellite image scene classification include: building labeled Sentinel-2 datasets with surface reflectance values; proposal of machine learning models for pixel-based image scene classification; proposal of a statistical distance based Evidence Function Model (EFM) to detect ML models misclassification; and proposal of a generalised sampling approach for active learning that, together with the EFM enables a way of determining the most informative examples. Firstly, using a manually annotated Sentinel-2 dataset, Machine Learning (ML) models for scene classification were developed and their performance was compared to Sen2Cor the reference package from the European Space Agency – a micro-F1 value of 84% was attained by the ML model, which is a significant improvement over the corresponding Sen2Cor performance of 59%. Secondly, to quantify the misclassification of the ML models, the Mahalanobis distance-based EFM was devised. This model achieved, for the labeled Sentinel-2 dataset, a micro-F1 of 67.89% for misclassification detection. Lastly, EFM was engineered as a sampling strategy for active learning leading to an approach that attains the same level of accuracy with only 0.02% of the total training samples when compared to a classifier trained with the full training set. With the help of the above-mentioned research contributions, we were able to provide an open-source Sentinel-2 image scene classification package which consists of ready-touse Python scripts and a ML model that classifies Sentinel-2 L1C images generating a 20m-resolution RGB image with the six studied classes (Cloud, Cirrus, Shadow, Snow, Water, and Other) giving academics a straightforward method for rapidly and effectively classifying Sentinel-2 scene images. Additionally, an active learning approach that uses, as sampling strategy, the observed prediction uncertainty given by EFM, will allow labeling only the most informative points to be used as input to build classifiers; Sumário: Uma Abordagem de Previsão de Incerteza para Aprendizagem Ativa – Aplicação à Observação da Terra O mapeamento da cobertura do solo e a dinâmica da utilização do solo são cruciais na deteção remota uma vez que os agricultores são incentivados a intensificar ou estender as culturas devido ao aumento contínuo da população mundial. Uma questão importante nesta área é interpretar e classificar cenas capturadas em imagens de satélite de alta resolução. Várias aproximações têm sido propostas incluindo a utilização de redes neuronais que produzem modelos dependentes dos dados (ou seja, o modelo é tendencioso em relação aos dados) e aproximações baseadas em regras que apresentam restrições de diversidade (ou seja, o modelo carece de diversidade em termos de regras). No entanto, a criação de um modelo de aprendizagem automática que, dada uma uma grande quantidade de dados de treino, é capaz de classificar, com desempenho superior, as imagens do Sentinel-2 em diferentes áreas geográficas permanece um problema em aberto. Por outro lado, têm sido utilizadas técnicas de aprendizagem supervisionada na resolução de problemas nas mais diversas áreas de devido à proliferação de conjuntos de dados etiquetados. Exemplos disto incluem classificadores para aplicações que reconhecem imagem e voz, antecipam tráfego, propõem produtos, atuam como assistentes pessoais virtuais e detetam fraudes online, entre muitos outros. Uma vez que estes classificadores são fortemente dependente do conjunto de dados de treino, sem interação humana ou etiquetas precisas, o seu desempenho sobre novos dados é incerta. Neste sentido existem propostas para avaliar modelos independentes usando uma distância estatística. No entanto, o problema de, dada uma divisão de treino-teste e um classificador, identificar o erro de previsão usando a relação entre aqueles conjuntos, permanece aberto. Mais ainda, embora alguns dados de treino sejam essenciais para a aprendizagem supervisionada, o que acontece quando a quantidade de dados etiquetados é insuficiente? Afinal, atribuir etiquetas é um processo demorado e que exige perícia, o que se traduz num envolvimento humano significativo. Quando a quantidade de dados etiquetados manualmente por peritos é insuficiente a aprendizagem ativa torna-se crucial. No entanto, dada uma grande quantidade dados de treino não etiquetados, ter um modelo de aprendizagem ativa que reduz o custo de treino do classificador e, ao mesmo tempo, auxilia a etiquetagem de novas observações permanece um problema em aberto. A partir das abordagens e estudos experimentais, as principais contribuições deste trabalho, que se concentra na classificação de cenas de imagens de satélite óptico incluem: criação de conjuntos de dados Sentinel-2 etiquetados, com valores de refletância de superfície; proposta de modelos de aprendizagem automática baseados em pixels para classificação de cenas de imagens de satétite; proposta de um Modelo de Função de Evidência (EFM) baseado numa distância estatística para detetar erros de classificação de modelos de aprendizagem; e proposta de uma abordagem de amostragem generalizada para aprendizagem ativa que, em conjunto com o EFM, possibilita uma forma de determinar os exemplos mais informativos. Em primeiro lugar, usando um conjunto de dados Sentinel-2 etiquetado manualmente, foram desenvolvidos modelos de Aprendizagem Automática (AA) para classificação de cenas e seu desempenho foi comparado com o do Sen2Cor – o produto de referência da Agência Espacial Europeia – tendo sido alcançado um valor de micro-F1 de 84% pelo classificador, o que representa uma melhoria significativa em relação ao desempenho Sen2Cor correspondente, de 59%. Em segundo lugar, para quantificar o erro de classificação dos modelos de AA, foi concebido o Modelo de Função de Evidência baseado na distância de Mahalanobis. Este modelo conseguiu, para o conjunto de dados etiquetado do Sentinel-2 um micro-F1 de 67,89% na deteção de classificação incorreta. Por fim, o EFM foi utilizado como uma estratégia de amostragem para a aprendizagem ativa, uma abordagem que permitiu atingir o mesmo nível de desempenho com apenas 0,02% do total de exemplos de treino quando comparado com um classificador treinado com o conjunto de treino completo. Com a ajuda das contribuições acima mencionadas, foi possível desenvolver um pacote de código aberto para classificação de cenas de imagens Sentinel-2 que, utilizando num conjunto de scripts Python, um modelo de classificação, e uma imagem Sentinel-2 L1C, gera a imagem RGB correspondente (com resolução de 20m) com as seis classes estudadas (Cloud, Cirrus, Shadow, Snow, Water e Other), disponibilizando à academia um método direto para a classificação de cenas de imagens do Sentinel-2 rápida e eficaz. Além disso, a abordagem de aprendizagem ativa que usa, como estratégia de amostragem, a deteção de classificacão incorreta dada pelo EFM, permite etiquetar apenas os pontos mais informativos a serem usados como entrada na construção de classificadores