Assessment of maize nitrogen uptake from PRISMA hyperspectral data through hybrid modelling

The spaceborne imaging spectroscopy mission PRecursore IperSpettrale della Missione Applicativa (PRISMA), launched on 22 March 2019 by the Italian Space Agency, opens new opportunities in many scientific domains, including precision farming and sustainable agriculture. This new Earth Observation (EO) data stream requires new-generation approaches for the estimation of important biophysical crop variables (BVs). In this framework, this study evaluated a hybrid approach, combining the radiative transfer model PROSAIL-PRO and several machine learning (ML) regression algorithms, for the retrieval of canopy chlorophyll content (CCC) and canopy nitrogen content (CNC) from synthetic PRISMA data. PRISMA-like data were simulated from two images acquired by the airborne sensor HyPlant, during a campaign performed in Grosseto (Italy) in 2018. CCC and CNC estimations, assessed from the best performing ML algorithms, were used to define two relations with plant nitrogen uptake (PNU). CNC proved to be slightly more correlated to PNU than CCC (R-2 = 0.82 and R-2 = 0.80, respectively). The CNC-PNU model was then applied to actual PRISMA images acquired in 2020. The results showed that the estimated PNU values are within the expected ranges, and the temporal trends are compatible with plant phenology stages

Quantitative Mapping of Soil Property Based on Laboratory and Airborne Hyperspectral Data Using Machine Learning

Soil visible and near-infrared spectroscopy provides a non-destructive, rapid and low-cost approach to quantify various soil physical and chemical properties based on their reflectance in the spectral range of 400–2500 nm. With an increasing number of large-scale soil spectral libraries established across the world and new space-borne hyperspectral sensors, there is a need to explore methods to extract informative features from reflectance spectra and produce accurate soil spectroscopic models using machine learning. Features generated from regional or large-scale soil spectral data play a key role in the quantitative spectroscopic model for soil properties. The Land Use/Land Cover Area Frame Survey (LUCAS) soil library was used to explore PLS-derived components and fractal features generated from soil spectra in this study. The gradient-boosting method performed well when coupled with extracted features on the estimation of several soil properties. Transfer learning based on convolutional neural networks (CNNs) was proposed to make the model developed from laboratory data transferable for airborne hyperspectral data. The soil clay map was successfully derived using HyMap imagery and the fine-tuned CNN model developed from LUCAS mineral soils, as deep learning has the potential to learn transferable features that generalise from the source domain to target domain. The external environmental factors like the presence of vegetation restrain the application of imaging spectroscopy. The reflectance data can be transformed into a vegetation suppressed domain with a force invariance approach, the performance of which was evaluated in an agricultural area using CASI airborne hyperspectral data. However, the relationship between vegetation and acquired spectra is complicated, and more efforts should put on removing the effects of external factors to make the model transferable from one sensor to another.:Abstract I Kurzfassung III Table of Contents V List of Figures IX List of Tables XIII List of Abbreviations XV 1 Introduction 1 1.1 Motivation 1 1.2 Soil spectra from different platforms 2 1.3 Soil property quantification using spectral data 4 1.4 Feature representation of soil spectra 5 1.5 Objectives 6 1.6 Thesis structure 7 2 Combining Partial Least Squares and the Gradient-Boosting Method for Soil Property Retrieval Using Visible Near-Infrared Shortwave Infrared Spectra 9 2.1 Abstract 10 2.2 Introduction 10 2.3 Materials and methods 13 2.3.1 The LUCAS soil spectral library 13 2.3.2 Partial least squares algorithm 15 2.3.3 Gradient-Boosted Decision Trees 15 2.3.4 Calculation of relative variable importance 16 2.3.5 Assessment 17 2.4 Results 17 2.4.1 Overview of the spectral measurement 17 2.4.2 Results of PLS regression for the estimation of soil properties 19 2.4.3 Results of PLS-GBDT for the estimation of soil properties 21 2.4.4 Relative important variables derived from PLS regression and the gradient-boosting method 24 2.5 Discussion 28 2.5.1 Dimension reduction for high-dimensional soil spectra 28 2.5.2 GBDT for quantitative soil spectroscopic modelling 29 2.6 Conclusions 30 3 Quantitative Retrieval of Organic Soil Properties from Visible Near-Infrared Shortwave Infrared Spectroscopy Using Fractal-Based Feature Extraction 31 3.1 Abstract 32 3.2 Introduction 32 3.3 Materials and Methods 35 3.3.1 The LUCAS topsoil dataset 35 3.3.2 Fractal feature extraction method 37 3.3.3 Gradient-boosting regression model 37 3.3.4 Evaluation 41 3.4 Results 42 3.4.1 Fractal features for soil spectroscopy 42 3.4.2 Effects of different step and window size on extracted fractal features 45 3.4.3 Modelling soil properties with fractal features 47 3.4.3 Comparison with PLS regression 49 3.5 Discussion 51 3.5.1 The importance of fractal dimension for soil spectra 51 3.5.2 Modelling soil properties with fractal features 52 3.6 Conclusions 53 4 Transfer Learning for Soil Spectroscopy Based on Convolutional Neural Networks and Its Application in Soil Clay Content Mapping Using Hyperspectral Imagery 55 4.1 Abstract 55 4.2 Introduction 56 4.3 Materials and Methods 59 4.3.1 Datasets 59 4.3.2 Methods 62 4.3.3 Assessment 67 4.4 Results and Discussion 67 4.4.1 Interpretation of mineral and organic soils from LUCAS dataset 67 4.4.2 1D-CNN and spectral index for LUCAS soil clay content estimation 69 4.4.3 Application of transfer learning for soil clay content mapping using the pre-trained 1D-CNN model 72 4.4.4 Comparison between spectral index and transfer learning 74 4.4.5 Large-scale soil spectral library for digital soil mapping at the local scale using hyperspectral imagery 75 4.5 Conclusions 75 5 A Case Study of Forced Invariance Approach for Soil Salinity Estimation in Vegetation-Covered Terrain Using Airborne Hyperspectral Imagery 77 5.1 Abstract 78 5.2 Introduction 78 5.3 Materials and Methods 81 5.3.1 Study area of Zhangye Oasis 81 5.3.2 Data description 82 5.3.3 Methods 83 5.3.3 Model performance assessment 85 5.4 Results and Discussion 86 5.4.1 The correlation between NDVI and soil salinity 86 5.4.2 Vegetation suppression performance using the Forced Invariance Approach 86 5.4.3 Estimation of soil properties using airborne hyperspectral data 88 5.5 Conclusions 90 6 Conclusions and Outlook 93 Bibliography 97 Acknowledgements 11

Satellite based methane emission estimation for flaring activities in oil and gas industry: A data-driven approach(SMEEF-OGI)

Klimaendringer, delvis utløst av klimagassutslipp, utgjør en kritisk global utfordring. Metan, en svært potent drivhusgass med et globalt oppvarmings potensial på 80 ganger karbondioksid, er en betydelig bidragsyter til denne krisen. Kilder til metanutslipp inkluderer olje- og gassindustrien, landbruket og avfallshåndteringen, med fakling i olje- og gassindustrien som en betydelig utslippskilde. Fakling, en standard prosess i olje- og gassindustrien, antas ofte å være 98 % effektiv ved omdannelse av metan til mindre skadelig karbondioksid. Nyere forskning fra University of Michigan, Stanford, Environmental Defense Fund og Scientific Aviation indikerer imidlertid at den allment aksepterte effektiviteten på 98 % av fakling ved konvertering av metan til karbondioksid, en mindre skadelig klimagass, kan være unøyaktig. Denne undersøkelsen revurderer fakkelprosessens effektivitet og dens rolle i metankonvertering. Dette arbeidet fokuserer på å lage en metode for uavhengig å beregne metanutslipp fra olje- og gassvirksomhet for å løse dette problemet. Satellittdata, som er et nyttig verktøy for å beregne klimagassutslipp fra ulike kilder, er inkludert i den foreslåtte metodikken. I tillegg til standard overvåkingsteknikker, tilbyr satellittdata en uavhengig, ikke-påtrengende, rimelig og kontinuerlig overvåkingstilnærming. På bakgrunn av dette er problemstillingen for dette arbeidet følgende "Hvordan kan en datadrevet tilnærming utvikles for å forbedre nøyaktigheten og kvaliteten på estimering av metanutslipp fra faklingsaktiviteter i olje- og gassindustrien, ved å bruke satellittdata fra utvalgte plattformer for å oppdage og kvantifisere fremtidige utslipp basert på maskinlæring mer effektivt?" For å oppnå dette ble følgende mål og aktiviteter utført. * Teoretisk rammeverk og sentrale begreper * Teknisk gjennomgang av dagens toppmoderne satellittplattformer og eksisterende litteratur. * Utvikling av et Proof of Concept * Foreslå en evaluering av metoden * Anbefalinger og videre arbeid Dette arbeidet har tatt i bruk en systematisk tilnærming, som starter med et omfattende teoretisk rammeverk for å forstå bruken av fakling, de miljømessige implikasjonene av metan, den nåværende «state-of-the-art» av forskning, og «state-of-the-art» i felt for fjernmåling via satellitter. Basert på rammeverket utviklet i de innledende fasene av dette arbeidet, ble det formulert en datadrevet metodikk, som benytter VIIRS-datasettet for å få geografiske områder av interesse. Hyperspektrale data og metandata ble samlet fra Sentinel-2 og Sentinel-5P satellittdatasettet. Denne informasjonen ble behandlet via en foreslått rørledning, med innledende justering og forbedring. I dette arbeidet ble bildene forbedret ved å beregne den normaliserte brennindeksen. Resultatet var et datasett som inneholdt plasseringen av kjente fakkelsteder, med data fra både Sentinel-2 og Sentinel-5P-satellitten. Resultatene understreker forskjellene i dekningen mellom Sentinel-2- og Sentinel-5P-data, en faktor som potensielt kan påvirke nøyaktigheten av metanutslippsestimater. De anvendte forbehandlingsteknikkene forbedret dataklarheten og brukervennligheten markant, men deres effektivitet kan avhenge av fakkelstedenes spesifikke egenskaper og rådatakvaliteten. Dessuten, til tross for visse begrensninger, ga kombinasjonen av Sentinel-2 og Sentinel-5P-data effektivt et omfattende datasett egnet for videre analyse. Avslutningsvis introduserer dette prosjektet en oppmuntrende metodikk for å estimere metanutslipp fra fakling i olje- og gassindustrien. Den legger et grunnleggende springbrett for fremtidig forskning, og forbedrer kontinuerlig presisjonen og kvaliteten på data for å bekjempe klimaendringer. Denne metodikken kan sees i flytskjemaet nedenfor. Basert på arbeidet som er gjort i dette prosjektet, kan fremtidig arbeid fokusere på å innlemme alternative kilder til metan data, utvide interesseområdene gjennom industrisamarbeid og forsøke å trekke ut ytterligere detaljer gjennom bildesegmenteringsmetoder. Dette prosjektet legger et grunnlag, og baner vei for påfølgende utforskninger å bygge videre på.Climate change, precipitated in part by greenhouse gas emissions, presents a critical global challenge. Methane, a highly potent greenhouse gas with a global warming potential of 80 times that of carbon dioxide, is a significant contributor to this crisis. Sources of methane emissions include the oil and gas industry, agriculture, and waste management, with flaring in the oil and gas industry constituting a significant emission source. Flaring, a standard process in the Oil and gas industry is often assumed to be 98% efficient when converting methane to less harmful carbon dioxide. However, recent research from the University of Michigan, Stanford, the Environmental Defense Fund, and Scientific Aviation indicates that the widely accepted 98% efficiency of flaring in converting methane to carbon dioxide, a less harmful greenhouse gas, may be inaccurate. This investigation reevaluates the flaring process's efficiency and its role in methane conversion. This work focuses on creating a method to independently calculate methane emissions from oil and gas activities to solve this issue. Satellite data, which is a helpful tool for calculating greenhouse gas emissions from various sources, is included in the suggested methodology. In addition to standard monitoring techniques, satellite data offers an independent, non-intrusive, affordable, and continuous monitoring approach. Based on this, the problem statement for this work is the following “How can a data-driven approach be developed to enhance the accuracy and quality of methane emission estimation from flaring activities in the Oil and Gas industry, using satellite data from selected platforms to detect and quantify future emissions based on Machine learning more effectively?" To achieve this, the following objectives and activities were performed. * Theoretical Framework and key concepts * Technical review of the current state-of-the-art satellite platforms and existing literature. * Development of a Proof of Concept * Proposing an evaluation of the method * Recommendations and further work This work has adopted a systematic approach, starting with a comprehensive theoretical framework to understand the utilization of flaring, the environmental implications of methane, the current state-of-the-art of research, and the state-of-the-art in the field of remote sensing via satellites. Based upon the framework developed during the initial phases of this work, a data-driven methodology was formulated, utilizing the VIIRS dataset to get geographical areas of interest. Hyperspectral and methane data were aggregated from the Sentinel-2 and Sentinel-5P satellite dataset. This information was processed via a proposed pipeline, with initial alignment and enhancement. In this work, the images were enhanced by calculating the Normalized Burn Index. The result was a dataset containing the location of known flare sites, with data from both the Sentinel-2, and the Sentinel-5P satellite. The results underscore the disparities in coverage between Sentinel-2 and Sentinel-5P data, a factor that could potentially influence the precision of methane emission estimates. The applied preprocessing techniques markedly enhanced data clarity and usability, but their efficacy may hinge on the flaring sites' specific characteristics and the raw data quality. Moreover, despite certain limitations, the combination of Sentinel-2 and Sentinel-5P data effectively yielded a comprehensive dataset suitable for further analysis. In conclusion, this project introduces an encouraging methodology for estimating methane emissions from flaring activities within the oil and gas industry. It lays a foundational steppingstone for future research, continually enhancing the precision and quality of data in combating climate change. This methodology can be seen in the flow chart below. Based on the work done in this project, future work could focus on incorporating alternative sources of methane data, broadening the areas of interest through industry collaboration, and attempting to extract further features through image segmentation methods. This project signifies a start, paving the way for subsequent explorations to build upon. Climate change, precipitated in part by greenhouse gas emissions, presents a critical global challenge. Methane, a highly potent greenhouse gas with a global warming potential of 80 times that of carbon dioxide, is a significant contributor to this crisis. Sources of methane emissions include the oil and gas industry, agriculture, and waste management, with flaring in the oil and gas industry constituting a significant emission source. Flaring, a standard process in the Oil and gas industry is often assumed to be 98% efficient when converting methane to less harmful carbon dioxide. However, recent research from the University of Michigan, Stanford, the Environmental Defense Fund, and Scientific Aviation indicates that the widely accepted 98% efficiency of flaring in converting methane to carbon dioxide, a less harmful greenhouse gas, may be inaccurate. This investigation reevaluates the flaring process's efficiency and its role in methane conversion. This work focuses on creating a method to independently calculate methane emissions from oil and gas activities to solve this issue. Satellite data, which is a helpful tool for calculating greenhouse gas emissions from various sources, is included in the suggested methodology. In addition to standard monitoring techniques, satellite data offers an independent, non-intrusive, affordable, and continuous monitoring approach. Based on this, the problem statement for this work is the following “How can a data-driven approach be developed to enhance the accuracy and quality of methane emission estimation from flaring activities in the Oil and Gas industry, using satellite data from selected platforms to detect and quantify future emissions based on Machine learning more effectively?" To achieve this, the following objectives and activities were performed. * Theoretical Framework and key concepts * Technical review of the current state-of-the-art satellite platforms and existing literature. * Development of a Proof of Concept * Proposing an evaluation of the method * Recommendations and further work This work has adopted a systematic approach, starting with a comprehensive theoretical framework to understand the utilization of flaring, the environmental implications of methane, the current state-of-the-art of research, and the state-of-the-art in the field of remote sensing via satellites. Based upon the framework developed during the initial phases of this work, a data-driven methodology was formulated, utilizing the VIIRS dataset to get geographical areas of interest. Hyperspectral and methane data were aggregated from the Sentinel-2 and Sentinel-5P satellite dataset. This information was processed via a proposed pipeline, with initial alignment and enhancement. In this work, the images were enhanced by calculating the Normalized Burn Index. The result was a dataset containing the location of known flare sites, with data from both the Sentinel-2, and the Sentinel-5P satellite. The results underscore the disparities in coverage between Sentinel-2 and Sentinel-5P data, a factor that could potentially influence the precision of methane emission estimates. The applied preprocessing techniques markedly enhanced data clarity and usability, but their efficacy may hinge on the flaring sites' specific characteristics and the raw data quality. Moreover, despite certain limitations, the combination of Sentinel-2 and Sentinel-5P data effectively yielded a comprehensive dataset suitable for further analysis. In conclusion, this project introduces an encouraging methodology for estimating methane emissions from flaring activities within the oil and gas industry. It lays a foundational steppingstone for future research, continually enhancing the precision and quality of data in combating climate change. This methodology can be seen in the flow chart below. Based on the work done in this project, future work could focus on incorporating alternative sources of methane data, broadening the areas of interest through industry collaboration, and attempting to extract further features through image segmentation methods. This project signifies a start, paving the way for subsequent explorations to build upon

Characterizing Dryland Ecosystems Using Remote Sensing and Dynamic Global Vegetation Modeling

Drylands include all terrestrial regions where the production of crops, forage, wood and other ecosystem services are limited by water. These ecosystems cover approximately 40% of the earth terrestrial surface and accommodate more than 2 billion people (Millennium Ecosystem Assessment, 2005). Moreover, the interannual variability of the global carbon budget is strongly regulated by vegetation dynamics in drylands. Understanding the dynamics of such ecosystems is significant for assessing the potential for and impacts of natural or anthropogenic disturbances and mitigation planning, and a necessary step toward enhancing the economic and social well-being of dryland communities in a sustainable manner (Global Drylands: A UN system-wide response, 2011). In this research, a combination of remote sensing, field data collection, and ecosystem modeling were used to establish an integrated framework for semi-arid ecosystems dynamics monitoring. Foliar nitrogen (N) plays an important role in vegetation processes such as photosynthesis and there is wide interest in retrieving this variable from hyperspectral remote sensing data. In this study, I used the theory of canopy spectral invariants (AKA p-theory) to understand the role of canopy structure and soil in the retrieval of foliar N from hyperspectral data and machine learning techniques. The results of this study showed the inconsistencies among different machine learning techniques used for estimating N. Using p-theory, I demonstrated that soil can contribute up to 95% to the total radiation budget of the canopy. I suggested an alternative approach to study photosynthesis is the use of dynamic global vegetation models (DGVMs). Gross primary production (GPP) is the apparent ecosystem scale photosynthesis that can be estimated using DGVMs. In this study, I performed a thorough sensitivity analysis and calibrated the Ecosystem Demography (EDv2.2) model along an elevation gradient in a dryland study area. I investigated the GPP capacity and activity by comparing the EDv2.2 GPP with flux towers and remote sensing products. The overall results showed that EDv2.2 performed well in capturing GPP capacity and its long term trend at lower elevation sites within the study area; whereas the model performed worse at higher elevations likely due to the change in vegetation community. I discussed that adding more heterogeneity and modifying ecosystem processes such as phenology and plant hydraulics in ED.v2.2 will improve its application to higher elevation ecosystems where there is more vegetation production. And finally, I developed an integrated hyperspectral-lidar framework for regional mapping of xeric and mesic vegetation in the study area. I showed that by considering spectral shape and magnitude, canopy structure and landscape features (riparian zone), we can develop a straightforward algorithm for vegetation mapping in drylands. This framework is simple, easy to interpret and consistent with our ecological understanding of vegetation distribution in drylands over large areas. Collectively, the results I present in this dissertation demonstrate the potential for advanced remote sensing and modeling to help us better understand ecosystem processes in drylands