Prediction of topsoil organic carbon using airborne and satellite hyperspectral imagery

The Airborne Hyperspectral Scanner (AHS) and the Hyperion satellite hyperspectral sensors were evaluated for their ability to predict topsoil organic carbon (C) in burned mountain areas of northwestern Spain slightly covered by heather vegetation. Predictive models that estimated total organic C (TOC) and oxidizable organic C (OC) content were calibrated using two datasets: a ground observation dataset with 39 topsoil samples collected in the field (for models built using AHS data), and a dataset with 200 TOC/OC observations predicted by AHS (for models built using Hyperion data). For both datasets, the prediction was performed by stepwise multiple linear regression (SMLR) using reflectances and spectral indices (SI) obtained from the images, and by the widely-used partial least squares regression (PLSR) method. SMLR provided a performance comparable to or even better than PLSR, while using a lower number of channels. SMLR models for the AHS were based on a maximum of eight indices, and showed a coefficient of determination in the leave-one-out cross-validation R2 = 0.60–0.62, while models for the Hyperion sensor showed R2 = 0.49–0.61, using a maximum of 20 indices. Although slightly worse models were obtained for the Hyperion sensor, which was attributed to its lower signal-to-noise ratio (SNR), the prediction of TOC/OC was consistent across both sensors. The relevant wavelengths for TOC/OC predictions were the red region of the spectrum (600–700 nm), and the short wave infrared region between ~2000–2250 nm. The use of SMLR and spectral indices based on reference channels at ~1000 nm was suitable to quantify topsoil C, and provided an alternative to the more complex PLSR method

Satellite Imagery to Map Topsoil Organic Carbon Content over Cultivated Areas: An Overview

There is a need to update soil maps and monitor soil organic carbon (SOC) in the upper horizons or plough layer for enabling decision support and land management, while complying with several policies, especially those favoring soil carbon storage. This review paper is dedicated to the satellite-based spectral approaches for SOC assessment that have been achieved from several satellite sensors, study scales and geographical contexts in the past decade. Most approaches relying on pure spectral models have been carried out since 2019 and have dealt with temperate croplands in Europe, China and North America at the scale of small regions, of some hundreds of km(2): dry combustion and wet oxidation were the analytical determination methods used for 50% and 35% of the satellite-derived SOC studies, for which measured topsoil SOC contents mainly referred to mineral soils, typically cambisols and luvisols and to a lesser extent, regosols, leptosols, stagnosols and chernozems, with annual cropping systems with a SOC value of similar to 15 g.kg(-1) and a range of 30 g.kg(-1) in median. Most satellite-derived SOC spectral prediction models used limited preprocessing and were based on bare soil pixel retrieval after Normalized Difference Vegetation Index (NDVI) thresholding. About one third of these models used partial least squares regression (PLSR), while another third used random forest (RF), and the remaining included machine learning methods such as support vector machine (SVM). We did not find any studies either on deep learning methods or on all-performance evaluations and uncertainty analysis of spatial model predictions. Nevertheless, the literature examined here identifies satellite-based spectral information, especially derived under bare soil conditions, as an interesting approach that deserves further investigations. Future research includes considering the simultaneous analysis of imagery acquired at several dates i.e., temporal mosaicking, testing the influence of possible disturbing factors and mitigating their effects fusing mixed models incorporating non-spectral ancillary information

Identify the opportunities provided by developments in earth observation and remote sensing for national scale monitoring of soil quality

Defra wish to establish to what extent national-scale soil monitoring (both state and change) of a series of soil indicators might be undertaken by the application of remote sensing methods. Current soil monitoring activities rely on the field-based collection and laboratory analysis of soil samples from across the landscape according to different sampling designs. The use of remote sensing offers the potential to encompass a larger proportion of the landscape, but the signal detected by the remote sensor has to be converted into a meaningful soil measurement which may have considerable uncertainty associated with it. The eleven soil indicators which were considered in this report are pH, organic carbon, bulk density, phosphorus (Olsen P), nitrogen (total N), magnesium (extractable), potassium (extractable), copper (aqua regia extractable), cadmium (aqua regia extractable), zinc (aqua regia extractable) and nickel (aqua regia extractable). However, we also comment on the potential use of remote sensing for monitoring of soil depth and (in particular) peat depth, plus soil erosion and compaction. In assessing the potential of remote sensing methods for soil monitoring of state and change, we addressed the following questions: 1. When will these be ready for use and what level of further development is required? 2. Could remote sensing of any of these indicators replace and/or complement traditional field based national scale soil monitoring? 3. Can meaningful measures of change be derived? 4. How could remote soil monitoring of individual indicators be incorporated into national scale soil monitoring schemes? To address these questions, we undertook a comprehensive literature and internet search and also wrote to a range of international experts in remote sensing. It is important to note that the monitoring of the status of soil indicators, and the monitoring of their change, are two quite different challenges; they are different variables and their variability is likely to differ. There are particular challenges to the application of remote sensing of soil in northern temperate regions (such as England and Wales), including the presence of year-round vegetation cover which means that soil spectral reflectance cannot be captured by airborne or satellite observations, and long-periods of cloud cover which limits the application of satellite-based spectroscopy. We summarise the potential for each of the indicators, grouped where appropriate. Unless otherwise stated, the remote sensing methods would need to be combined with ground-based sampling and analysis to make a contribution to detection of state or change in soil indicators. Soil metals (copper (Cu), cadmium (Cd), zinc (Zn), nickel (Ni)): there is no technical basis for applying current remote sensing approaches to monitor either state or change of these indicators and there are no published studies which have shown how this might be achieved. Soil nutrients: the most promising remote sensing technique to improve estimates of the status of extractable potassium (K) is the collection and application of airborne radiometric survey (detection of gamma radiation by low-flying aircraft) but this should be investigated further. This is unlikely to assist in monitoring change. Based on published literature, it may be possible to enhance mapping the state of extractable magnesium (Mg), but not to monitor change, using hyperspectral (satellite or airborne) remote sensing in cultivated areas. This needs to be investigated further. There are no current remote sensing methods for detecting state or change of Olsen (extractable) phosphorus (P). Organic carbon and total nitrogen: Based on published literature, it may be possible to enhance mapping the state of organic carbon and total nitrogen (but not to monitor change), using hyperspectral (satellite or airborne) remote sensing in cultivated areas only. In applying this approach the satellite data are applied using a statistical model which is trained using ground-based sampling and analysis of soil

Quantitative Mapping of Soil Property Based on Laboratory and Airborne Hyperspectral Data Using Machine Learning

Soil visible and near-infrared spectroscopy provides a non-destructive, rapid and low-cost approach to quantify various soil physical and chemical properties based on their reflectance in the spectral range of 400–2500 nm. With an increasing number of large-scale soil spectral libraries established across the world and new space-borne hyperspectral sensors, there is a need to explore methods to extract informative features from reflectance spectra and produce accurate soil spectroscopic models using machine learning. Features generated from regional or large-scale soil spectral data play a key role in the quantitative spectroscopic model for soil properties. The Land Use/Land Cover Area Frame Survey (LUCAS) soil library was used to explore PLS-derived components and fractal features generated from soil spectra in this study. The gradient-boosting method performed well when coupled with extracted features on the estimation of several soil properties. Transfer learning based on convolutional neural networks (CNNs) was proposed to make the model developed from laboratory data transferable for airborne hyperspectral data. The soil clay map was successfully derived using HyMap imagery and the fine-tuned CNN model developed from LUCAS mineral soils, as deep learning has the potential to learn transferable features that generalise from the source domain to target domain. The external environmental factors like the presence of vegetation restrain the application of imaging spectroscopy. The reflectance data can be transformed into a vegetation suppressed domain with a force invariance approach, the performance of which was evaluated in an agricultural area using CASI airborne hyperspectral data. However, the relationship between vegetation and acquired spectra is complicated, and more efforts should put on removing the effects of external factors to make the model transferable from one sensor to another.:Abstract I Kurzfassung III Table of Contents V List of Figures IX List of Tables XIII List of Abbreviations XV 1 Introduction 1 1.1 Motivation 1 1.2 Soil spectra from different platforms 2 1.3 Soil property quantification using spectral data 4 1.4 Feature representation of soil spectra 5 1.5 Objectives 6 1.6 Thesis structure 7 2 Combining Partial Least Squares and the Gradient-Boosting Method for Soil Property Retrieval Using Visible Near-Infrared Shortwave Infrared Spectra 9 2.1 Abstract 10 2.2 Introduction 10 2.3 Materials and methods 13 2.3.1 The LUCAS soil spectral library 13 2.3.2 Partial least squares algorithm 15 2.3.3 Gradient-Boosted Decision Trees 15 2.3.4 Calculation of relative variable importance 16 2.3.5 Assessment 17 2.4 Results 17 2.4.1 Overview of the spectral measurement 17 2.4.2 Results of PLS regression for the estimation of soil properties 19 2.4.3 Results of PLS-GBDT for the estimation of soil properties 21 2.4.4 Relative important variables derived from PLS regression and the gradient-boosting method 24 2.5 Discussion 28 2.5.1 Dimension reduction for high-dimensional soil spectra 28 2.5.2 GBDT for quantitative soil spectroscopic modelling 29 2.6 Conclusions 30 3 Quantitative Retrieval of Organic Soil Properties from Visible Near-Infrared Shortwave Infrared Spectroscopy Using Fractal-Based Feature Extraction 31 3.1 Abstract 32 3.2 Introduction 32 3.3 Materials and Methods 35 3.3.1 The LUCAS topsoil dataset 35 3.3.2 Fractal feature extraction method 37 3.3.3 Gradient-boosting regression model 37 3.3.4 Evaluation 41 3.4 Results 42 3.4.1 Fractal features for soil spectroscopy 42 3.4.2 Effects of different step and window size on extracted fractal features 45 3.4.3 Modelling soil properties with fractal features 47 3.4.3 Comparison with PLS regression 49 3.5 Discussion 51 3.5.1 The importance of fractal dimension for soil spectra 51 3.5.2 Modelling soil properties with fractal features 52 3.6 Conclusions 53 4 Transfer Learning for Soil Spectroscopy Based on Convolutional Neural Networks and Its Application in Soil Clay Content Mapping Using Hyperspectral Imagery 55 4.1 Abstract 55 4.2 Introduction 56 4.3 Materials and Methods 59 4.3.1 Datasets 59 4.3.2 Methods 62 4.3.3 Assessment 67 4.4 Results and Discussion 67 4.4.1 Interpretation of mineral and organic soils from LUCAS dataset 67 4.4.2 1D-CNN and spectral index for LUCAS soil clay content estimation 69 4.4.3 Application of transfer learning for soil clay content mapping using the pre-trained 1D-CNN model 72 4.4.4 Comparison between spectral index and transfer learning 74 4.4.5 Large-scale soil spectral library for digital soil mapping at the local scale using hyperspectral imagery 75 4.5 Conclusions 75 5 A Case Study of Forced Invariance Approach for Soil Salinity Estimation in Vegetation-Covered Terrain Using Airborne Hyperspectral Imagery 77 5.1 Abstract 78 5.2 Introduction 78 5.3 Materials and Methods 81 5.3.1 Study area of Zhangye Oasis 81 5.3.2 Data description 82 5.3.3 Methods 83 5.3.3 Model performance assessment 85 5.4 Results and Discussion 86 5.4.1 The correlation between NDVI and soil salinity 86 5.4.2 Vegetation suppression performance using the Forced Invariance Approach 86 5.4.3 Estimation of soil properties using airborne hyperspectral data 88 5.5 Conclusions 90 6 Conclusions and Outlook 93 Bibliography 97 Acknowledgements 11

Evaluation of Airborne HySpex and Spaceborne PRISMA Hyperspectral Remote Sensing Data for Soil Organic Matter and Carbonates Estimation

Remote sensing and soil spectroscopy applications are valuable techniques for soil property estimation. Soil organic matter (SOM) and calcium carbonate are important factors in soil quality, and although organic matter is well studied, calcium carbonates require more investigation. In this study, we validated the performance of laboratory soil spectroscopy for estimating the aforementioned properties with referenced in situ data. We also examined the performance of imaging spectroscopy sensors, such as the airborne HySpex and the spaceborne PRISMA. For this purpose, we applied four commonly used machine learning algorithms and six preprocessing methods for the evaluation of the best fitting algorithm.. The study took place over crop areas of Amyntaio in Northern Greece, where extensive soil sampling was conducted. This is an area with a very variable mineralogical environment (from lignite mine to mountainous area). The SOM results were very good at the laboratory scale and for both remote sensing sensors with R2 = 0.79 for HySpex and R2 = 0.76 for PRISMA. Regarding the calcium carbonate estimations, the remote sensing accuracy was R2 = 0.82 for HySpex and R2 = 0.36 for PRISMA. PRISMA was still in the commissioning phase at the time of the study, and therefore, the acquired image did not cover the whole study area. Accuracies for calcium carbonates may be lower due to the smaller sample size used for the modeling procedure. The results show the potential for using quantitative predictions of SOM and the carbonate content based on soil and imaging spectroscopy at the air and spaceborne scales and for future applications using larger datasets

Combining Field and Imaging Spectroscopy to Map Soil Organic Carbon in a Semiarid Environment

Semiarid regions are especially vulnerable to climate change and human-induced land-use changes and are of major importance in the context of necessary carbon sequestration and ongoing land degradation. Topsoil properties, such as soil carbon content, provide valuable indicators to these processes, and can be mapped using imaging spectroscopy (IS). In semiarid regions, this poses difficulties because models are needed that can cope with varying land surface and soil conditions, consider a partial vegetation coverage, and deal with usually low soil organic carbon (SOC) contents. We present an approach that aims at addressing these difficulties by using a combination of field and IS to map SOC in an extensively used semiarid ecosystem. In hyperspectral imagery of the HyMap sensor, the influence of nonsoil materials, i.e., vegetation, on the spectral signature of soil dominated image pixels was reduced and a residual soil signature was calculated. The proposed approach allowed this procedure up to a vegetation coverage of 40% clearly extending the mapping capability. SOC quantities are predicted by applying a spectral feature-based SOC prediction model to image data of residual soil spectra. With this approach, we could significantly increase the spatial extent for which SOC could be predicted with a minimal influence of a vegetation signal compared to previous approaches where the considered area was limited to a maximum of, e.g., 10% vegetation coverage. As a regional example, the approach was applied to a 320 km2 area in the Albany Thicket Biome, South Africa, where land cover and landuse changes have occurred due to decades of unsustainable land management. In the generated maps, spatial SOC patterns were interpreted and linked to geomorphic features and land surface processes, i.e., areas of soil erosion. It was found that the chosen approach supported the extraction of soil-related spectral image information in the semiarid region with highly varying land cover. However, the quantitative prediction of SOC contents revealed a lack in absolute accuracy

Combining Field and Imaging Spectroscopy to Map Soil Organic Carbon in a Semiarid Environment

Semiarid regions are especially vulnerable to climate change and human-induced land-use changes and are of major importance in the context of necessary carbon sequestration and ongoing land degradation. Topsoil properties, such as soil carbon content, provide valuable indicators to these processes, and can be mapped using imaging spectroscopy (IS). In semiarid regions, this poses difficulties because models are needed that can cope with varying land surface and soil conditions, consider a partial vegetation coverage, and deal with usually low soil organic carbon (SOC) contents. We present an approach that aims at addressing these difficulties by using a combination of field and IS to map SOC in an extensively used semiarid ecosystem. In hyperspectral imagery of the HyMap sensor, the influence of nonsoil materials, i.e., vegetation, on the spectral signature of soil dominated image pixels was reduced and a residual soil signature was calculated. The proposed approach allowed this procedure up to a vegetation coverage of 40% clearly extending the mapping capability. SOC quantities are predicted by applying a spectral feature-based SOC prediction model to image data of residual soil spectra. With this approach, we could significantly increase the spatial extent for which SOC could be predicted with a minimal influence of a vegetation signal compared to previous approaches where the considered area was limited to a maximum of, e.g., 10% vegetation coverage. As a regional example, the approach was applied to a 320 km2 area in the Albany Thicket Biome, South Africa, where land cover and landuse changes have occurred due to decades of unsustainable land management. In the generated maps, spatial SOC patterns were interpreted and linked to geomorphic features and land surface processes, i.e., areas of soil erosion. It was found that the chosen approach supported the extraction of soil-related spectral image information in the semiarid region with highly varying land cover. However, the quantitative prediction of SOC contents revealed a lack in absolute accuracy

Remote Sensing for Soil Organic Carbon Mapping and Monitoring

[no abstract available