Quantitative Mapping of Soil Property Based on Laboratory and Airborne Hyperspectral Data Using Machine Learning

Soil visible and near-infrared spectroscopy provides a non-destructive, rapid and low-cost approach to quantify various soil physical and chemical properties based on their reflectance in the spectral range of 400–2500 nm. With an increasing number of large-scale soil spectral libraries established across the world and new space-borne hyperspectral sensors, there is a need to explore methods to extract informative features from reflectance spectra and produce accurate soil spectroscopic models using machine learning. Features generated from regional or large-scale soil spectral data play a key role in the quantitative spectroscopic model for soil properties. The Land Use/Land Cover Area Frame Survey (LUCAS) soil library was used to explore PLS-derived components and fractal features generated from soil spectra in this study. The gradient-boosting method performed well when coupled with extracted features on the estimation of several soil properties. Transfer learning based on convolutional neural networks (CNNs) was proposed to make the model developed from laboratory data transferable for airborne hyperspectral data. The soil clay map was successfully derived using HyMap imagery and the fine-tuned CNN model developed from LUCAS mineral soils, as deep learning has the potential to learn transferable features that generalise from the source domain to target domain. The external environmental factors like the presence of vegetation restrain the application of imaging spectroscopy. The reflectance data can be transformed into a vegetation suppressed domain with a force invariance approach, the performance of which was evaluated in an agricultural area using CASI airborne hyperspectral data. However, the relationship between vegetation and acquired spectra is complicated, and more efforts should put on removing the effects of external factors to make the model transferable from one sensor to another.:Abstract I Kurzfassung III Table of Contents V List of Figures IX List of Tables XIII List of Abbreviations XV 1 Introduction 1 1.1 Motivation 1 1.2 Soil spectra from different platforms 2 1.3 Soil property quantification using spectral data 4 1.4 Feature representation of soil spectra 5 1.5 Objectives 6 1.6 Thesis structure 7 2 Combining Partial Least Squares and the Gradient-Boosting Method for Soil Property Retrieval Using Visible Near-Infrared Shortwave Infrared Spectra 9 2.1 Abstract 10 2.2 Introduction 10 2.3 Materials and methods 13 2.3.1 The LUCAS soil spectral library 13 2.3.2 Partial least squares algorithm 15 2.3.3 Gradient-Boosted Decision Trees 15 2.3.4 Calculation of relative variable importance 16 2.3.5 Assessment 17 2.4 Results 17 2.4.1 Overview of the spectral measurement 17 2.4.2 Results of PLS regression for the estimation of soil properties 19 2.4.3 Results of PLS-GBDT for the estimation of soil properties 21 2.4.4 Relative important variables derived from PLS regression and the gradient-boosting method 24 2.5 Discussion 28 2.5.1 Dimension reduction for high-dimensional soil spectra 28 2.5.2 GBDT for quantitative soil spectroscopic modelling 29 2.6 Conclusions 30 3 Quantitative Retrieval of Organic Soil Properties from Visible Near-Infrared Shortwave Infrared Spectroscopy Using Fractal-Based Feature Extraction 31 3.1 Abstract 32 3.2 Introduction 32 3.3 Materials and Methods 35 3.3.1 The LUCAS topsoil dataset 35 3.3.2 Fractal feature extraction method 37 3.3.3 Gradient-boosting regression model 37 3.3.4 Evaluation 41 3.4 Results 42 3.4.1 Fractal features for soil spectroscopy 42 3.4.2 Effects of different step and window size on extracted fractal features 45 3.4.3 Modelling soil properties with fractal features 47 3.4.3 Comparison with PLS regression 49 3.5 Discussion 51 3.5.1 The importance of fractal dimension for soil spectra 51 3.5.2 Modelling soil properties with fractal features 52 3.6 Conclusions 53 4 Transfer Learning for Soil Spectroscopy Based on Convolutional Neural Networks and Its Application in Soil Clay Content Mapping Using Hyperspectral Imagery 55 4.1 Abstract 55 4.2 Introduction 56 4.3 Materials and Methods 59 4.3.1 Datasets 59 4.3.2 Methods 62 4.3.3 Assessment 67 4.4 Results and Discussion 67 4.4.1 Interpretation of mineral and organic soils from LUCAS dataset 67 4.4.2 1D-CNN and spectral index for LUCAS soil clay content estimation 69 4.4.3 Application of transfer learning for soil clay content mapping using the pre-trained 1D-CNN model 72 4.4.4 Comparison between spectral index and transfer learning 74 4.4.5 Large-scale soil spectral library for digital soil mapping at the local scale using hyperspectral imagery 75 4.5 Conclusions 75 5 A Case Study of Forced Invariance Approach for Soil Salinity Estimation in Vegetation-Covered Terrain Using Airborne Hyperspectral Imagery 77 5.1 Abstract 78 5.2 Introduction 78 5.3 Materials and Methods 81 5.3.1 Study area of Zhangye Oasis 81 5.3.2 Data description 82 5.3.3 Methods 83 5.3.3 Model performance assessment 85 5.4 Results and Discussion 86 5.4.1 The correlation between NDVI and soil salinity 86 5.4.2 Vegetation suppression performance using the Forced Invariance Approach 86 5.4.3 Estimation of soil properties using airborne hyperspectral data 88 5.5 Conclusions 90 6 Conclusions and Outlook 93 Bibliography 97 Acknowledgements 11

quantitative mapping of clay minerals using airborne imaging spectroscopy new data on mugello italy from sim ga prototypal sensor

AbstractThe possibility of using high spectral and spatial resolution remote sensing technologies is becoming increasingly important in the monitoring of soil degradation processes. A high spatial resolution hyperspectral dataset was acquired with the airborne Hyper SIM-GA sensor from Selex Galileo, simultaneously with ground soil spectral signatures and samples collection. A complete mapping procedure was developed using the 2000–2450 nm spectral region, demonstrating that the 2200 absorption band allows the obtainment of reliable maps of the clay content. The correlation achieved between the observed and the predicted values is encouraging for the extensive application of this technique in soil conservation planning and protection actions

Object identification and characterization with hyperspectral imagery to identify structure and function of Natura 2000 habitats

Habitat monitoring of designated areas under the EU Habitats Directive requires every 6 years information on area, range, structure and function for the protected (Annex I) habitat types. First results from studies on heathland areas in Belgium and the Netherlands show that hyperspectral imagery can be an important source of information to assist the evaluation of the habitat conservation status. Hyperspectral imagery can provide continuous maps of habitat quality indicators (e.g., life forms or structure types, management activities, grass, shrub and tree encroachment) at the pixel level. At the same time, terrain managers, nature conservation agencies and national authorities responsible for the reporting to the EU are not directly interested in pixels, but rather in information at the level of vegetation patches, groups of patches or the protected site as a whole. Such local level information is needed for management purposes, e.g., exact location of patches of habitat types and the sizes and quality of these patches within a protected site. Site complexity determines not only the classification success of remote sensing imagery, but influences also the results of aggregation of information from the pixel to the site level. For all these reasons, it is important to identify and characterize the vegetation patches. This paper focuses on the use of segmentation techniques to identify relevant vegetation patches in combination with spectral mixture analysis of hyperspectral imagery from the Airborne Hyperspectral Scanner (AHS). Comparison with traditional vegetation maps shows that the habitat or vegetation patches can be identified by segmentation of hyperspectral imagery. This paper shows that spectral mixture analysis in combination with segmentation techniques on hyperspectral imagery can provide useful information on processes such as grass encroachment that determine the conservation status of Natura 2000 heathland areas to a large extent. A limitation is that both advanced remote sensing approaches and traditional field based vegetation surveys seem to cause over and underestimations of grass encroachment for specific categories, but the first provides a better basis for monitoring if specific species are not directly considered

Prospectivity Mapping for Epithermal Deposits of Western Milos Using a Fuzzy Multi Criteria Evaluation Approach Parameterized by Airborne Hyperspectral Remote Sensing Data

A Mineral prospectivity mapping (MPM) approach using a GIS-based weighted linear combination implementation of a Multi-Criteria Evaluation approach utilising a fuzzy Analytical Hierarchy Process to elucidate expert knowledge has been implemented to analyse the spatial distribution of epithermal deposits on the Island of Milos, Greece and model their association with exploration evidence data with the aim of providing insights into the controls on ore deposition. An integrated field and Digital Airborne Imaging Spectrometer (DAIS) hyperspectral and thermal multispectral airborne remote sensing dataset supported by field mapping and laboratory analyses, has been utilised to resolve hydrothermal alteration and parameterise the MPM. This study has highlighted the intimate spatial relationship between topographic highs and locations with high grade silicified alteration at a number of locations. The ability of high spatial resolution multispectral Thermal InfraRed (TIR) remote sensing imagery, integrated with topographic data, to resolve these silicified topographic highs provides an additional tool in the exploration of epithermal deposits. The spatial relationships between silicified lithocaps, high-grade altered rocks, faulting and topographic highs were utilised in the development of the MPM model. A close association between the modelled results and the hydrothermal alteration mapped in the field supports the accuracy of this MPM approach.Funded by Natural Environment Research Council (NERC) GA/09f/139-RMS E355

A review of geothermal mapping techniques using remotely sensed data

Exploiting geothermal (GT) resources requires first and foremost locating suitable areas for its development. Remote sensing offers a synoptic capability of covering large areas in real time and can cost effectively explore prospective geothermal sites not easily detectable using conventional survey methods, thus can aid in the prefeasibility stages of geothermal exploration. In this paper, we evaluate the techniques and approaches used in literature for the detection of prospective geothermal sites. Observations have indicated that, while thermal temperature anomalies detection have been applicable in areas of magmatic episodes and volcanic activity, poor resolution especially from space borne data is still a challenge. Consequently, thermal anomalies have been detected with some degree of success using airborne data, however, this is mostly in locations of known surface manifestations such as hot springs and fumaroles. The indirect identification of indicator minerals related to geothermal systems have been applied using multispectral and hyperspectral data in many studies. However, the effectiveness of the techniques relies on the sophistication and innovative digital image processing methods employed to sieve out relevant spectral information. The use of algorithms to estimate land surface temperature and heat fluxes are also applied to aid thermal anomaly detection, nevertheless, remote sensing techniques are still complementary to geologic, geophysical and geochemical survey methods. While not the first of its kind, this review is aimed at identifying new developments, with a focus on the trends and limitations intrinsic to the techniques and a look at current gaps and prospects for the future.Keywords: Geothermal, remote sensing, thermal anomalies, indicator minerals, multispectral, hyperspectra

The impact of vegetation on lithological mapping using airborne multispectral data: a case study for the North Troodos Region, Cyprus

Vegetation cover can affect the lithological mapping capability of space- and airborne instruments because it obscures the spectral signatures of the underlying geological substrate. Despite being widely accepted as a hindrance, few studies have explicitly demonstrated the impact vegetation can have on remote lithological mapping. Accordingly, this study comprehensively elucidates the impact of vegetation on the lithological mapping capability of airborne multispectral data in the Troodos region, Cyprus. Synthetic spectral mixtures were first used to quantify the potential impact vegetation cover might have on spectral recognition and remote mapping of different rock types. The modeled effects of green grass were apparent in the spectra of low albedo lithologies for 30%–40% fractional cover, compared to just 20% for dry grass cover. Lichen was found to obscure the spectra for 30%–50% cover, depending on the spectral contrast between bare rock and lichen cover. The subsequent impact of vegetation on the remote mapping capability is elucidated by considering the outcomes of three airborne multispectral lithological classifications alongside the spectral mixing analysis and field observations. Vegetation abundance was found to be the primary control on the inability to classify large proportions of pixels in the imagery. Matched Filtering outperformed direct spectral matching algorithms owing to its ability to partially unmix pixel spectra with vegetation abundance above the modeled limits. This study highlights that despite the limited spectral sampling and resolution of the sensor and dense, ubiquitous vegetation cover, useful lithological information can be extracted using an appropriate algorithm. Furthermore, the findings of this case study provide a useful insight to the potential capabilities and challenges faced when utilizing comparable sensors (e.g., Landsat 8, Sentinel-2, WorldView-3) to map similar types of terrain

Caracterização e estudo comparativo de exsudações de hidrocarbonetos e plays petrolíferos em bacias terrestres das regiões central do Irã e sudeste do Brasil usando sensoriamento remoto espectral

Orientador: Carlos Roberto de Souza FilhoTese (doutorado) - Universidade Estadual de Campinas, Instituto de GeociênciasResumo: O objetivo desta pesquisa foi explorar as assinaturas de exsudações de hidrocarbonetos na superfície usando a tecnologia de detecção remota espectral. Isso foi alcançado primeiro, realizando uma revisão abrangente das capacidades e potenciais técnicas de detecção direta e indireta. Em seguida, a técnica foi aplicada para investigar dois locais de teste localizados no Irã e no Brasil, conhecidos por hospedar sistemas ativos de micro-exsudações e afloramentos betuminosos, respectivamente. A primeira área de estudo está localizada perto da cidade de Qom (Irã), e está inserida no campo petrolífero Alborz, enterrado sob sedimentos datados do Oligoceno da Formação Upper Red. O segundo local está localizado perto da cidade de Anhembi (SP), na margem oriental da bacia do Paraná, no Brasil, e inclui acumulações de betume em arenitos triássicos da Formação Pirambóia. O trabalho na área de Qom integrou evidências de (i) estudos petrográficos e geoquímicos em laboratório, (ii) investigações de afloramentos em campo, e (iii) mapeamento de anomalia em larga escala através de conjuntos de dados multi-espectrais ASTER e Sentinel-2. O resultado deste estudo se trata de novos indicadores mineralógicos e geoquímicos para a exploração de micro-exsudações e um modelo de micro-exsudações atualizado. Durante este trabalho, conseguimos desenvolver novas metodologias para análise de dados espectroscópicos. Através da utilização de dados simulados, indicamos que o instrumento de satélite WorldView-3 tem potencial para detecção direta de hidrocarbonetos. Na sequência do estudo, dados reais sobre afloramentos de arenitos e óleo na área de Anhembi foram investigados. A área foi fotografada novamente no chão e usando o sistema de imagem hiperespectral AisaFENIX. Seguiu-se estudos e amostragem no campo,incluindo espectroscopia de alcance fechado das amostras no laboratório usando instrumentos de imagem (ou seja, sisuCHEMA) e não-imagem (ou seja, FieldSpec-4). O estudo demonstrou que uma abordagem espectroscópica multi-escala poderia fornecer uma imagem completa das variações no conteúdo e composição do betume e minerais de alteração que acompanham. A assinatura de hidrocarbonetos, especialmente a centrada em 2300 nm, mostrou-se consistente e comparável entre as escalas e capaz de estimar o teor de betume de areias de petróleo em todas as escalas de imagemAbstract: The objective of this research was to explore for the signatures of seeping hydrocarbons on the surface using spectral remote sensing technology. It was achieved firstly by conducting a comprehensive review of the capacities and potentials of the technique for direct and indirect seepage detection. Next, the technique was applied to investigate two distinctive test sites located in Iran and Brazil known to retain active microseepage systems and bituminous outcrops, respectively. The first study area is located near the city of Qom in Iran, and consists of Alborz oilfield buried under Oligocene sediments of the Upper-Red Formation. The second site is located near the town of Anhembi on the eastern edge of the Paraná Basin in Brazil and includes bitumen accumulations in the Triassic sandstones of the Pirambóia Formation. Our work in Qom area integrated evidence from (i) petrographic, spectroscopic, and geochemical studies in the laboratory, (ii) outcrop investigations in the field, and (iii) broad-scale anomaly mapping via orbital remote sensing data. The outcomes of this study was novel mineralogical and geochemical indicators for microseepage characterization and a classification scheme for the microseepage-induced alterations. Our study indicated that active microseepage systems occur in large parts of the lithofacies in Qom area, implying that the extent of the petroleum reservoir is much larger than previously thought. During this work, we also developed new methodologies for spectroscopic data analysis and processing. On the other side, by using simulated data, we indicated that WorldView-3 satellite instrument has the potential for direct hydrocarbon detection. Following this demonstration, real datasets were acquired over oil-sand outcrops of the Anhembi area. The area was further imaged on the ground and from the air by using an AisaFENIX hyperspectral imaging system. This was followed by outcrop studies and sampling in the field and close-range spectroscopy in the laboratory using both imaging (i.e. sisuCHEMA) and nonimaging instruments. The study demonstrated that a multi-scale spectroscopic approach could provide a complete picture of the variations in the content and composition of bitumen and associated alteration mineralogy. The oil signature, especially the one centered at 2300 nm, was shown to be consistent and comparable among scales, and capable of estimating the bitumen content of oil-sands at all imaging scalesDoutoradoGeologia e Recursos NaturaisDoutor em Geociências2015/06663-7FAPES

Digital mapping of soil properties using multivariate statistical analysis and ASTER data in an Arid Region

Modeling and mapping of soil properties has been identified as key for effective land degradation management and mitigation. The ability to model and map soil properties at sufficient accuracy for a large agriculture area is demonstrated using Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) imagery. Soil samples were collected in the El-Tina Plain, Sinai, Egypt, concurrently with the acquisition of ASTER imagery, and measured for soil electrical conductivity (EC_e), clay content and soil organic matter (OM). An ASTER image covering the study area was preprocessed, and two predictive models, multivariate adaptive regression splines (MARS) and the partial least squares regression (PLSR), were constructed based on the ASTER spectra. For all three soil properties, the results of MARS models were better than those of the respective PLSR models, with cross-validation estimated R^2 of 0.85 and 0.80 for EC_e, 0.94 and 0.90 for clay content and 0.79 and 0.73 for OM. Independent validation of EC_e, clay content and OM maps with 32 soil samples showed the better performance of the MARS models, with R^2 = 0.81, 0.89 and 0.73, respectively, compared to R^2 = 0.78, 0.87 and 0.71 for the PLSR models. The results indicated that MARS is a more suitable and superior modeling technique than PLSR for the estimation and mapping of soil salinity (EC_e), clay content and OM. The method developed in this paper was found to be reliable and accurate for digital soil mapping in arid and semi-arid environments