Preface: the environmental mapping and analysis program (EnMAP) mission: preparing for its scientific exploitation

Open access; distributed under the terms and conditions of the Creative Commons Attribution (CC-BY) licenseThe imaging spectroscopy mission EnMAP aims to assess the state and evolution of terrestrialandaquaticecosystems,examinethemultifacetedimpactsofhumanactivities,andsupport a sustainable use of natural resources. Once in operation (scheduled to launch in 2019), EnMAP will provide high-quality observations in the visible to near-infrared and shortwave-infrared spectral range. The scientific preparation of the mission comprises an extensive science program. This special issue presents a collection of research articles, demonstrating the potential of EnMAP for various applications along with overview articles on the mission and software tools developed within its scientific preparation.Ye

The data concept behind the data: From metadata models and labelling schemes towards a generic spectral library

Spectral libraries play a major role in imaging spectroscopy. They are commonly used to store end-member and spectrally pure material spectra, which are primarily used for mapping or unmixing purposes. However, the development of spectral libraries is time consuming and usually sensor and site dependent. Spectral libraries are therefore often developed, used and tailored only for a specific case study and only for one sensor. Multi-sensor and multi-site use of spectral libraries is difficult and requires technical effort for adaptation, transformation, and data harmonization steps. Especially the huge amount of urban material specifications and its spectral variations hamper the setup of a complete spectral library consisting of all available urban material spectra. By a combined use of different urban spectral libraries, besides the improvement of spectral inter- and intra-class variability, missing material spectra could be considered with respect to a multi-sensor/ -site use. Publicly available spectral libraries mostly lack the metadata information that is essential for describing spectra acquisition and sampling background, and can serve to some extent as a measure of quality and reliability of the spectra and the entire library itself. In the GenLib project, a concept for a generic, multi-site and multi-sensor usable spectral library for image spectra on the urban focus was developed. This presentation will introduce a 1) unified, easy-to-understand hierarchical labeling scheme combined with 2) a comprehensive metadata concept that is 3) implemented in the SPECCHIO spectral information system to promote the setup and usability of a generic urban spectral library (GUSL). The labelling scheme was developed to ensure the translation of individual spectral libraries with their own labelling schemes and their usually varying level of details into the GUSL framework. It is based on a modified version of the EAGLE classification concept by combining land use, land cover, land characteristics and spectral characteristics. The metadata concept consists of 59 mandatory and optional attributes that are intended to specify the spatial context, spectral library information, references, accessibility, calibration, preprocessing steps, and spectra specific information describing library spectra implemented in the GUSL. It was developed on the basis of existing metadata concepts and was subject of an expert survey. The metadata concept and the labelling scheme are implemented in the spectral information system SPECCHIO, which is used for sharing and holding GUSL spectra. It allows easy implementation of spectra as well as their specification with the proposed metadata information to extend the GUSL. Therefore, the proposed data model represents a first fundamental step towards a generic usable and continuously expandable spectral library for urban areas. The metadata concept and the labelling scheme also build the basis for the necessary adaptation and transformation steps of the GUSL in order to use it entirely or in excerpts for further multi-site and multi-sensor applications

Assessment of Soil erosion parameters in Costa Rica using reflectance hyperspectral and simulated EnMAP imagery

Soil erosion can be linked to relative fractional cover of photosynthetic-active vegetation, non-photosynthetic-active vegetation and bare soil, and terrain characteristics such as the C and LS factors. This study investigates the capacity of EnMAP imagery to map areas prone to soil erosion in a region near San Jose, Costa Rica, characterized by spatially extensive coffee plantations and grazing in a mountainous terrain. Simulated EnMAP imagery is based on airborne hyperspectral HyMap data. Fractional cover estimates are derived using a Multiple End-member Spectral Mixture Analysis approach. The C and LS factors are derived from a digital elevation model. The analysis was done independently for EnMAP and HyMap, the latter treated as reference data as no ground truth is available. Results demonstrate that with EnMAP imagery it is possible to extract quality endmember classes with important spectral features related to PV, NPV and soil, and be able to estimate relative cover fractions. This spectral information is critical to separate soil and NPV which greatly can impact integrated modelling with terrain characteristics. From a regional perspective EnMAP can be used to highlight specific areas that may be prone to erosion where this information can be extract directly from the imagery using automated processes

Combining Field and Imaging Spectroscopy to Map Soil Organic Carbon in a Semiarid Environment

Semiarid regions are especially vulnerable to climate change and human-induced land-use changes and are of major importance in the context of necessary carbon sequestration and ongoing land degradation. Topsoil properties, such as soil carbon content, provide valuable indicators to these processes, and can be mapped using imaging spectroscopy (IS). In semiarid regions, this poses difficulties because models are needed that can cope with varying land surface and soil conditions, consider a partial vegetation coverage, and deal with usually low soil organic carbon (SOC) contents. We present an approach that aims at addressing these difficulties by using a combination of field and IS to map SOC in an extensively used semiarid ecosystem. In hyperspectral imagery of the HyMap sensor, the influence of nonsoil materials, i.e., vegetation, on the spectral signature of soil dominated image pixels was reduced and a residual soil signature was calculated. The proposed approach allowed this procedure up to a vegetation coverage of 40% clearly extending the mapping capability. SOC quantities are predicted by applying a spectral feature-based SOC prediction model to image data of residual soil spectra. With this approach, we could significantly increase the spatial extent for which SOC could be predicted with a minimal influence of a vegetation signal compared to previous approaches where the considered area was limited to a maximum of, e.g., 10% vegetation coverage. As a regional example, the approach was applied to a 320 km2 area in the Albany Thicket Biome, South Africa, where land cover and landuse changes have occurred due to decades of unsustainable land management. In the generated maps, spatial SOC patterns were interpreted and linked to geomorphic features and land surface processes, i.e., areas of soil erosion. It was found that the chosen approach supported the extraction of soil-related spectral image information in the semiarid region with highly varying land cover. However, the quantitative prediction of SOC contents revealed a lack in absolute accuracy

Manifold learning based spectral unmixing of hyperspectral remote sensing data

Nonlinear mixing effects inherent in hyperspectral data are not properly represented in linear spectral unmixing models. Although direct nonlinear unmixing models provide capability to capture nonlinear phenomena, they are difficult to formulate and the results are not always generalizable. Manifold learning based spectral unmixing accommodates nonlinearity in the data in the feature extraction stage followed by linear mixing, thereby incorporating some characteristics of nonlinearity while retaining advantages of linear unmixing approaches. Since endmember selection is critical to successful spectral unmixing, it is important to select proper endmembers from the manifold space. However, excessive computational burden hinders development of manifolds for large-scale remote sensing datasets. This dissertation addresses issues related to high computational overhead requirements of manifold learning for developing representative manifolds for the spectral unmixing task. Manifold approximations using landmarks are popular for mitigating the computational complexity of manifold learning. A new computationally effective landmark selection method that exploits spatial redundancy in the imagery is proposed. A robust, less costly landmark set with low spectral and spatial redundancy is successfully incorporated with a hybrid manifold which shares properties of both global and local manifolds. While landmark methods reduce computational demand, the resulting manifolds may not represent subtle features of the manifold adequately. Active learning heuristics are introduced to increase the number of landmarks, with the goal of developing more representative manifolds for spectral unmixing. By communicating between the landmark set and the query criteria relative to spectral unmixing, more representative and stable manifolds with less spectrally and spatially redundant landmarks are developed. A new ranking method based on the pixels with locally high spectral variability within image subsets and convex-geometry finds a solution more quickly and precisely. Experiments were conducted to evaluate the proposed methods using the AVIRIS Cuprite hyperspectral reference dataset. A case study of manifold learning based spectral unmixing in agricultural areas is included in the dissertation.Remotely sensed data collected by airborne or spaceborne sensors are utilized to quantify crop residue cover over an extensive area. Although remote sensing indices are popular for characterizing residue amounts, they are not effective with noisy Hyperion data because the effect of residual striping artifacts is amplified in ratios involving band differences. In this case study, spectral unmixing techniques are investigated for estimating crop residue as an alternative approach to empirical models developed using band based indices. The spectral unmixing techniques, and especially the manifold learning approaches, provide more robust, lower RMSE estimates for crop residue cover than the hyperspectral index based method for Hyperion data

Analyses of the Impact of Soil Conditions and Soil Degradation on Vegetation Vitality and Crop Productivity Based on Airborne Hyperspectral VNIR–SWIR–TIR Data in a Semi-Arid Rainfed Agricultural Area (Camarena, Central Spain)

Soils are an essential factor contributing to the agricultural production of rainfed crops such as barley and triticale cereals. Changing environmental conditions and inadequate land management are endangering soil quality and productivity and, in turn, crop quality and productivity are affected. Advances in hyperspectral remote sensing are of great use for the spatial characterization and monitoring of the soil degradation status, as well as its impact on crop growth and agricultural productivity. In this study, hyperspectral airborne data covering the visible, near-infrared, short-wave infrared, and thermal infrared (VNIR–SWIR–TIR, 0.4–12 µm) were acquired in a Mediterranean agricultural area of central Spain and used to analyze the spatial differences in vegetation vitality and grain yield in relation to the soil degradation status. Specifically, leaf area index (LAI), crop water stress index (CWSI), and the biomass of the crop yield are derived from the remote sensing data and discussed regarding their spatial differences and relationship to a classification of erosion and accumulation stages (SEAS) based on previous remote sensing analyses during bare soil conditions. LAI and harvested crop biomass yield could be well estimated by PLS regression based on the hyperspectral and in situ reference data (R2 of 0.83, r of 0.91, and an RMSE of 0.2 m2 m−2 for LAI and an R2 of 0.85, r of 0.92, and an RMSE of 0.48 t ha−1 for grain yield). In addition, the soil erosion and accumulation stages (SEAS) were successfully predicted based on the canopy spectral signal of vegetated crop fields using a random forest machine learning approach. Overall accuracy was achieved above 71% by combining the VNIR–SWIR–TIR canopy reflectance and emissivity of the growing season with topographic information after reducing the redundancy in the spectral dataset. The results show that the estimated crop traits are spatially related to the soil’s degradation status, with shallow and highly eroded soils, as well as sandy accumulation zones being associated with areas of low LAI, crop yield, and high crop water stress. Overall, the results of this study illustrate the enormous potential of imaging spectroscopy for a combined analysis of the plant-soil system in the frame of land and soil degradation monitoring

NASA's surface biology and geology designated observable: A perspective on surface imaging algorithms

The 2017–2027 National Academies' Decadal Survey, Thriving on Our Changing Planet, recommended Surface Biology and Geology (SBG) as a “Designated Targeted Observable” (DO). The SBG DO is based on the need for capabilities to acquire global, high spatial resolution, visible to shortwave infrared (VSWIR; 380–2500 nm; ~30 m pixel resolution) hyperspectral (imaging spectroscopy) and multispectral midwave and thermal infrared (MWIR: 3–5 μm; TIR: 8–12 μm; ~60 m pixel resolution) measurements with sub-monthly temporal revisits over terrestrial, freshwater, and coastal marine habitats. To address the various mission design needs, an SBG Algorithms Working Group of multidisciplinary researchers has been formed to review and evaluate the algorithms applicable to the SBG DO across a wide range of Earth science disciplines, including terrestrial and aquatic ecology, atmospheric science, geology, and hydrology. Here, we summarize current state-of-the-practice VSWIR and TIR algorithms that use airborne or orbital spectral imaging observations to address the SBG DO priorities identified by the Decadal Survey: (i) terrestrial vegetation physiology, functional traits, and health; (ii) inland and coastal aquatic ecosystems physiology, functional traits, and health; (iii) snow and ice accumulation, melting, and albedo; (iv) active surface composition (eruptions, landslides, evolving landscapes, hazard risks); (v) effects of changing land use on surface energy, water, momentum, and carbon fluxes; and (vi) managing agriculture, natural habitats, water use/quality, and urban development. We review existing algorithms in the following categories: snow/ice, aquatic environments, geology, and terrestrial vegetation, and summarize the community-state-of-practice in each category. This effort synthesizes the findings of more than 130 scientists

Applications of Satellite Earth Observations section - NEODAAS: Providing satellite data for efficient research

The NERC Earth Observation Data Acquisition and Analysis Service (NEODAAS) provides a central point of Earth Observation (EO) satellite data access and expertise for UK researchers. The service is tailored to individual users’ requirements to ensure that researchers can focus effort on their science, rather than struggling with correct use of unfamiliar satellite data

Satellite monitoring of harmful algal blooms (HABs) to protect the aquaculture industry

Harmful algal blooms (HABs) can cause sudden and considerable losses to fish farms, for example 500,000 salmon during one bloom in Shetland, and also present a threat to human health. Early warning allows the industry to take protective measures. PML's satellite monitoring of HABs is now funded by the Scottish aquaculture industry. The service involves processing EO ocean colour data from NASA and ESA in near-real time, and applying novel techniques for discriminating certain harmful blooms from harmless algae. Within the AQUA-USERS project we are extending this capability to further HAB species within several European countries

Quantitative Mapping of Soil Property Based on Laboratory and Airborne Hyperspectral Data Using Machine Learning

Soil visible and near-infrared spectroscopy provides a non-destructive, rapid and low-cost approach to quantify various soil physical and chemical properties based on their reflectance in the spectral range of 400–2500 nm. With an increasing number of large-scale soil spectral libraries established across the world and new space-borne hyperspectral sensors, there is a need to explore methods to extract informative features from reflectance spectra and produce accurate soil spectroscopic models using machine learning. Features generated from regional or large-scale soil spectral data play a key role in the quantitative spectroscopic model for soil properties. The Land Use/Land Cover Area Frame Survey (LUCAS) soil library was used to explore PLS-derived components and fractal features generated from soil spectra in this study. The gradient-boosting method performed well when coupled with extracted features on the estimation of several soil properties. Transfer learning based on convolutional neural networks (CNNs) was proposed to make the model developed from laboratory data transferable for airborne hyperspectral data. The soil clay map was successfully derived using HyMap imagery and the fine-tuned CNN model developed from LUCAS mineral soils, as deep learning has the potential to learn transferable features that generalise from the source domain to target domain. The external environmental factors like the presence of vegetation restrain the application of imaging spectroscopy. The reflectance data can be transformed into a vegetation suppressed domain with a force invariance approach, the performance of which was evaluated in an agricultural area using CASI airborne hyperspectral data. However, the relationship between vegetation and acquired spectra is complicated, and more efforts should put on removing the effects of external factors to make the model transferable from one sensor to another.:Abstract I Kurzfassung III Table of Contents V List of Figures IX List of Tables XIII List of Abbreviations XV 1 Introduction 1 1.1 Motivation 1 1.2 Soil spectra from different platforms 2 1.3 Soil property quantification using spectral data 4 1.4 Feature representation of soil spectra 5 1.5 Objectives 6 1.6 Thesis structure 7 2 Combining Partial Least Squares and the Gradient-Boosting Method for Soil Property Retrieval Using Visible Near-Infrared Shortwave Infrared Spectra 9 2.1 Abstract 10 2.2 Introduction 10 2.3 Materials and methods 13 2.3.1 The LUCAS soil spectral library 13 2.3.2 Partial least squares algorithm 15 2.3.3 Gradient-Boosted Decision Trees 15 2.3.4 Calculation of relative variable importance 16 2.3.5 Assessment 17 2.4 Results 17 2.4.1 Overview of the spectral measurement 17 2.4.2 Results of PLS regression for the estimation of soil properties 19 2.4.3 Results of PLS-GBDT for the estimation of soil properties 21 2.4.4 Relative important variables derived from PLS regression and the gradient-boosting method 24 2.5 Discussion 28 2.5.1 Dimension reduction for high-dimensional soil spectra 28 2.5.2 GBDT for quantitative soil spectroscopic modelling 29 2.6 Conclusions 30 3 Quantitative Retrieval of Organic Soil Properties from Visible Near-Infrared Shortwave Infrared Spectroscopy Using Fractal-Based Feature Extraction 31 3.1 Abstract 32 3.2 Introduction 32 3.3 Materials and Methods 35 3.3.1 The LUCAS topsoil dataset 35 3.3.2 Fractal feature extraction method 37 3.3.3 Gradient-boosting regression model 37 3.3.4 Evaluation 41 3.4 Results 42 3.4.1 Fractal features for soil spectroscopy 42 3.4.2 Effects of different step and window size on extracted fractal features 45 3.4.3 Modelling soil properties with fractal features 47 3.4.3 Comparison with PLS regression 49 3.5 Discussion 51 3.5.1 The importance of fractal dimension for soil spectra 51 3.5.2 Modelling soil properties with fractal features 52 3.6 Conclusions 53 4 Transfer Learning for Soil Spectroscopy Based on Convolutional Neural Networks and Its Application in Soil Clay Content Mapping Using Hyperspectral Imagery 55 4.1 Abstract 55 4.2 Introduction 56 4.3 Materials and Methods 59 4.3.1 Datasets 59 4.3.2 Methods 62 4.3.3 Assessment 67 4.4 Results and Discussion 67 4.4.1 Interpretation of mineral and organic soils from LUCAS dataset 67 4.4.2 1D-CNN and spectral index for LUCAS soil clay content estimation 69 4.4.3 Application of transfer learning for soil clay content mapping using the pre-trained 1D-CNN model 72 4.4.4 Comparison between spectral index and transfer learning 74 4.4.5 Large-scale soil spectral library for digital soil mapping at the local scale using hyperspectral imagery 75 4.5 Conclusions 75 5 A Case Study of Forced Invariance Approach for Soil Salinity Estimation in Vegetation-Covered Terrain Using Airborne Hyperspectral Imagery 77 5.1 Abstract 78 5.2 Introduction 78 5.3 Materials and Methods 81 5.3.1 Study area of Zhangye Oasis 81 5.3.2 Data description 82 5.3.3 Methods 83 5.3.3 Model performance assessment 85 5.4 Results and Discussion 86 5.4.1 The correlation between NDVI and soil salinity 86 5.4.2 Vegetation suppression performance using the Forced Invariance Approach 86 5.4.3 Estimation of soil properties using airborne hyperspectral data 88 5.5 Conclusions 90 6 Conclusions and Outlook 93 Bibliography 97 Acknowledgements 11