Trooppisen korkeusgradientin maaperän hiilen arviointi kuvantavalla spektroskopialla näkyvän valon ja lähi-infrapunan alueella

Maaperä on suurin aktiivisesti kiertävä maanpäällinen hiilivarasto, joka on heikentynyt suuresti viimeisen 100-200 vuoden aikana ihmistoiminnan seurauksena. Tilanteen parantamiseksi vaaditaan laajamittaista maaperän hiilen seurantaa ja kehittyneempiä metodeja tätä varten. Tässä tutkimuksessa demonstroidaan näkyvän valon ja infrapunan aallonpituuksilla toimivan hyperspektrikameran toimivuutta maaperän orgaanisen hiilen ennustamisessa. Tähän käytetään kahta monimuuttujamenetelmää, PLS-regressiota, sekä lasso regressiota, jota ei ole aikaisemmin tähän tarkoitukseen käytetty. 191 maaperänäytettä kerättiin Taitavuorilta Keniasta trooppiselta seudulta nousevan rinteen ympäriltä, viiden eri maankäytön alueelta, jotka ovat: peltometsäviljely, pelto, metsä, pensasmaa sekä sisal plantaasi. Näytteet kuvattiin hyperspektrikamera Specim IQ:lla sekä laboratoriossa, että kentällä. Kuvista tuotettiin kolme datasettiä, yksi kuvien keskiarvoisella spektrillä, toinen segmentoitujen kuvien osien keskiarvoisilla spektreillä ja kolmas segmentoitujen kuvien osien keskiarvoisilla spektreillä siten, että ääriarvot suodatettiin pois. Sekä PLS-regressio- sekä lasso regressiomallit antoivat hyviä tuloksia kaikilla dataseteillä (PLSR: R2min = 0.85, RMSEmin = 0.78, lasso: R2min=0.85, RMSEmin=0.80) viitaten sekä laitteen tuottaman datan, että lasso regression soveltuvan maaperän orgaanisen hiilen mallintamiseen. Segmentoitujen osa-kuvien käyttö mallien opettamisessa paransi tuloksia PLSR malleissa, mutta ei vaikuttanut merkittävästi lasso regressiomallien tuloksiin. Vaikka laboratoriossa kuvannettu data antoikin hyviä tuloksia, kenttäolosuhteissa kuvaaminen oli haasteellista ja tulokset tällä datalla olivat heikkoja. Tulevien tutkimusten tulisikin keskittyä kenttämenetelmien kehittämiseen ja löytämään ratkaisuja maaperän hiilen luotettavaan mittaamiseen suoraan maasta, tai lähellä tutkittavaa kohdetta siirreltävien laboratorio järjestelyiden avulla. Tämä parantaisi hiilimittausten saavutettavuutta ja mahdollistaisi niiden paremman hyödyntämisen esimerkiksi täsmäviljelyssä.Soil is the largest actively cycling terrestrial carbon pool, which has been severely distrubed in the last 100-200 years by human actions. To improve the situation, extensive monitoring of soil carbon and new methods for monitoring are required. This study demonstrates the capability of a portable hyperspectral device operating in the visible-near infrared (VIS-NIR) spectrum for soil organic carbon (SOC) prediction. Two multivariate methods, partial least squares regression (PLSR) and for this purpose previously untested lasso regression were used for prediction. 191 soil samples were collected from Taita Hills, Kenya. The samples represent a tropical altitudinal gradient with five land uses: agroforestry, field, forest, shrubland and sisal plantation. The samples were imaged with hyperspectral camera, Specim IQ in laboratory and in field conditions, and the carbon content of the samples was determined with a dry-oxidization analyzer. Three datasets were derived from the images, one containing the mean spectra of the complete imaged samples, one with segmented sub-image spectra and one with segmented sub-image spectra where outlier spectra were removed. Both multivariate methods were tested with all three datasets with good prediction accuracies (PLSR: R2min = 0.85, RMSEmin = 0.78, lasso: R2min=0.85, RMSEmin=0.80), demonstrating the feasibility of both the device and lasso regression as SOC prediction tools. Using the segmented sub-image datasets improved the results with PLSR but had no significant effect on lasso regression prediction results. While good results were gained with laboratory imagery, the field imaging conditions were difficult, and the data performed poorly. Future research should focus on finding solutions to reliably estimate SOC content in situ or with portable laboratory setups to make SOC measurements more widely accessible and agile for e.g. precision agriculture purposes

Visible and near infrared spectroscopy in soil science

This chapter provides a review on the state of soil visible–near infrared (vis–NIR) spectroscopy. Our intention is for the review to serve as a source of up-to date information on the past and current role of vis–NIR spectroscopy in soil science. It should also provide critical discussion on issues surrounding the use of vis–NIR for soil analysis and on future directions. To this end, we describe the fundamentals of visible and infrared diffuse reflectance spectroscopy and spectroscopic multivariate calibrations. A review of the past and current role of vis–NIR spectroscopy in soil analysis is provided, focusing on important soil attributes such as soil organic matter (SOM), minerals, texture, nutrients, water, pH, and heavy metals. We then discuss the performance and generalization capacity of vis–NIR calibrations, with particular attention on sample pre-tratments, co-variations in data sets, and mathematical data preprocessing. Field analyses and strategies for the practical use of vis–NIR are considered. We conclude that the technique is useful to measure soil water and mineral composition and to derive robust calibrations for SOM and clay content. Many studies show that we also can predict properties such as pH and nutrients, although their robustness may be questioned. For future work we recommend that research should focus on: (i) moving forward with more theoretical calibrations, (ii) better understanding of the complexity of soil and the physical basis for soil reflection, and (iii) applications and the use of spectra for soil mapping and monitoring, and for making inferences about soils quality, fertility and function. To do this, research in soil spectroscopy needs to be more collaborative and strategic. The development of the Global Soil Spectral Library might be a step in the right direction

Machine learning based on-line prediction of soil organic carbon after removal of soil moisture effect

It is well-documented in the visible and near-infrared reflectance spectroscopy (VNIRS) studies that soil moisture content (SMC) negatively affects the prediction accuracy of soil attributes. This work was undertaken to remove the negative effect of SMC on the on-line prediction of soil organic carbon (SOC). A mobile VNIR spectrophotometer with a spectral range of 305-1700 nm and spectral resolution of 1 nm (CompactSpec, Tec5 Technology, Germany) was used for the spectral measurements at four farms in Flanders, Belgium. A total of 381 fresh soil samples were collected and divided into a calibration set (264) and a validation set (117). The validation samples were processed (air-dried and grind) and scanned with the same spectrophotometer in the laboratory. Three SMC correction methods, namely, external parameter orthogonalization (EPO), piecewise direct standardization (PDS), and orthogonal signal correction (OSC) were used to correct the on-line fresh spectra based-on its corresponding laboratory spectra. Then, the Cubist machine learning method was used to develop calibration models of SOC using the on-line spectra (after correction) of the calibration set. Results indicated that the EPO-Cubist outperformed the PDS-Cubist and the OSC-Cubist, with considerable improvements in the prediction results of SOC (coefficient of determination (R-2) = 0.76, ratio of performance to deviation (RPD) = 2.08, and root mean square error of prediction (RMSEP) = 0.12%), compared with the corresponding uncorrected on-line spectra (R-2 = 0.55, RPD = 1.24, and RMSEP = 0.20%). It can be concluded that SOC can be accurately predicted on-line using the Cubist machine learning method, after removing the negative effect of SMC with the EPO method

Rapid identification of oil contaminated soils using visible near infrared diffuse reflectance spectroscopy

Initially, 46 petroleum contaminated and non-contaminated soil samples were collected and scanned using visible near-infrared diffuse reflectance spectroscopy (VisNIR DRS) at three combinations of moisture content and pretreatment. The VisNIR spectra of soil samples were used to predict total petroleum hydrocarbon (TPH) content using partial least squares (PLS) regression and boosted regression tree (BRT) models. The field-moist intact scan proved best for predicting TPH content with a validation r2 of 0.64 and relative percent difference (RPD) of 1.70. Those 46 samples were used to calibrate a penalized spline (PS) model. Subsequently, the PS model was used to predict soil TPH content for 128 soil samples collected over an 80 ha study site. An exponential semivariogram using PS predictions revealed strong spatial dependence among soil TPH [r2 = 0.76, range = 52 m, nugget = 0.001 (log10 mg kg-1)2, and sill 1.044 (log10 mg kg-1)2]. An ordinary block kriging map produced from the data showed that TPH distribution matched the expected TPH variability of the study site. Another study used DRS to measure reflectance patterns of 68 artificially constructed samples with different clay content, organic carbon levels, petroleum types, and different levels of contamination per type. Both first derivative of reflectance and discrete wavelet transformations were used to preprocess the spectra. Principal component analysis (PCA) was applied for qualitative VisNIR discrimination of variable soil types, organic carbon levels, petroleum types, and concentration levels. Soil types were separated with 100% accuracy, and organic carbon levels were separated with 96% accuracy by linear discriminant analysis. The support vector machine produced 82% classification accuracy for organic carbon levels by repeated random splitting of the whole dataset. However, spectral absorptions for each petroleum hydrocarbon overlapped with each other and could not be separated with any classification scheme when contaminations were mixed. Wavelet-based multiple linear regression performed best for predicting petroleum amount with the highest residual prediction deviation (RPD) of 3.97. While using the first derivative of reflectance spectra, PS regression performed better (RPD = 3.3) than the PLS (RPD= 2.5) model. Specific calibrations considering additional soil physicochemical variability are recommended to produce improved predictions

Potential of on-the-go gamma-ray spectrometry for estimation and management of soil potassium site specifically

High resolution data on plant available potassium (Ka) is crucial to optimize variable rate potassium fertilizer recommendations, and subsequently improve crop growth and yield. A gamma-ray passive spectrometry sensor was evaluated for on-the-go mapping and management of the spatial distribution of Ka over a 8.4 ha field at Huldenberg, Belgium. During the on-the-go measurement, a 5 s sampling interval was used while driving at 3 km/h speed along 10 m parallel transects. Two calibration models to predict Ka across the field were developed and compared: (1) a simple third order polynomial function (3DPF) was established between the sensor reading of the naturally occurring radioactive isotope of potassium (K-40) and laboratory measured Ka and (2) a partial least squares regression (PLSR) model linking gamma-ray spectra and laboratory measured Ka. Although a relatively small number of samples (45 samples) were used for the development of the PLSR calibration model, the cross-validation analysis resulted in a very good performance with a coefficient of determination (R2) of 0.85, a residual prediction deviation (RPD) of 2.67, a root mean square error of cross-validation (RMSECV) of 2.29 (mg/100 g) and a ratio of performance to interquartile distance (RPIQ) of 2.61. This was a much better result that that obtained with the 3DPF model (R2 = 0.69). The spatial distribution of Ka developed based on 3DPF and PLSR methods showed great similarity with the corresponding map developed using the data from the laboratory analysis. The calculated variable rate fertilizer recommendation based on gamma-ray data showed marginal differences in the amount of K2O fertilizer applied, compared to the uniform rate fertilization based on the conventional laboratory chemical soil analyses. The on-the-go measurement of Ka using gamma-ray spectrometry shows high potential, although the technology needs to be evaluated in a larger number of fields

Combined use of Vis-NIR and XRF sensors for tropical soil fertility analysis : assessing different data fusion approaches

Visible and near infrared (vis-NIR) diffuse reflectance and X-ray fluorescence (XRF) sensors are promising proximal soil sensing (PSS) tools for predicting soil key fertility attributes. This work aimed at assessing the performance of the individual and combined use of vis-NIR and XRF sensors to predict clay, organic matter (OM), cation exchange capacity (CEC), pH, base saturation (V), and extractable (ex-) nutrients (ex-P, ex-K, ex-Ca, and ex-Mg) in Brazilian tropical soils. Individual models using the data of each sensor alone were calibrated using multiple linear regressions (MLR) for the XRF data, and partial least squares (PLS) regressions for the vis-NIR data. Six data fusion approaches were evaluated and compared against individual models using relative improvement (RI). The data fusion approaches included (i) two spectra fusion approaches, which simply combined the data of both sensors in a merged dataset, followed by support vector machine (SF-SVM) and PLS (SF-PLS) regression analysis; (ii) two model averaging approaches using the Granger and Ramanathan (GR) method; and (iii) two data fusion methods based on least squares (LS) modeling. For the GR and LS approaches, two different combinations of inputs were used for MLR. The GR2 and LS2 used the prediction of individual sensors, whereas the GR3 and LS3 used the individual sensors prediction plus the SF-PLS prediction. The individual vis-NIR models showed the best results for clay and OM prediction (RPD >= 2.61), while the individual XRF models exhibited the best predictive models for CEC, V, ex-K, ex-Ca, and ex-Mg (RPD >= 2.57). For eight out of nine soil attributes studied (clay, CEC, pH, V, ex-P, ex-K, ex-Ca, and ex-Mg), the combined use of vis-NIR and XRF sensors using at least one of the six data fusion approaches improved the accuracy of the predictions (with RI ranging from 1 to 21%). In general, the LS3 model averaging approach stood out as the data fusion method with the greatest number of attributes with positive RI (six attributes; namely, clay, CEC, pH, ex-P, ex-K, and ex-Mg). Meanwhile, no single approach was capable of exploiting the synergism between sensors for all attributes of interest, suggesting that the selection of the best data fusion approach should be attribute-specific. The results presented in this work evidenced the complementarity of XRF and vis-NIR sensors to predict fertility attributes in tropical soils, and encourage further research to find a generalized method of data fusion of both sensors data. Keywords Author Keywords

Data fusion of XRF and Vis-NIR using outer product analysis, Granger–Ramanathan, and least squares for prediction of key soil attributes

Visible-near-infrared (vis-NIR) and X-ray fluorescence (XRF) are key technologies becoming pervasive in proximal soil sensing (PSS), whose fusion holds promising potential to improve the estimation accuracy of soil attributes. In this paper, we examine different data fusion methods for the prediction of key soil fertility attributes including pH, organic carbon (OC), magnesium (Mg), and calcium (Ca). To this end, the vis-NIR and XRF spectra of 267 soil samples were collected from nine fields in Belgium, from which the soil samples of six fields were used for calibration of the single-sensor and data fusion models while the validation was performed on the remaining three fields. The first fusion method was the outer product analysis (OPA), for which the outer product (OP) of the two spectra is computed, flattened, and then subjected to partial least squares (PLS) regression model. Two versions of OPA were evaluated: (i) OPA-FS in which the full spectra were used as input; and (ii) OPA-SS in which selected spectral ranges were used as input. In addition, we examined the potential of least squares (LS) and Granger-Ramanathan (GR) analyses for the fusion of the predictions provided by the single-sensor PLS models. Results demonstrate that the prediction performance of the single-sensor PLS models is improved by GR in addition to the LS fusion method for all soil attributes since it accounts for residuals. Resorting to LS, the largest improvements compared to the single-sensor models were obtained, respectively, for Mg (residual prediction deviation (RPD) = 4.08, coefficient of determination (R-2) = 0.94, ratio of performance of inter-quantile (RPIQ) = 1.64, root mean square error (RMSE) = 4.57 mg/100 g), OC (RPD = 1.79, R-2 = 0.69, RPIQ = 2.82, RMSE = 0.16%), pH (RPD = 1.61, R-2 = 0.61, RPIQ = 3.06, RMSE = 0.29), and Ca (RPD = 3.33, R-2 = 0.91, RPIQ = 1, RMSE = 207.48 mg/100 g). OPA-FS and OPA-SS outperformed the individual, GR, and LS models for pH only, while OPA-FS was effective in improving the individual sensor models for Mg as well. The results of this study suggest LS as a robust fusion method in improving the prediction accuracy for all the studied soil attributes.Visible-near-infrared (vis-NIR) and X-ray fluorescence (XRF) are key technologies becoming pervasive in proximal soil sensing (PSS), whose fusion holds promising potential to improve the estimation accuracy of soil attributes. In this paper, we examine different data fusion methods for the prediction of key soil fertility attributes including pH, organic carbon (OC), magnesium (Mg), and calcium (Ca). To this end, the vis-NIR and XRF spectra of 267 soil samples were collected from nine fields in Belgium, from which the soil samples of six fields were used for calibration of the single-sensor and data fusion models while the validation was performed on the remaining three fields. The first fusion method was the outer product analysis (OPA), for which the outer product (OP) of the two spectra is computed, flattened, and then subjected to partial least squares (PLS) regression model. Two versions of OPA were evaluated: (i) OPA-FS in which the full spectra were used as input; and (ii) OPA-SS in which selected spectral ranges were used as input. In addition, we examined the potential of least squares (LS) and Granger-Ramanathan (GR) analyses for the fusion of the predictions provided by the single-sensor PLS models. Results demonstrate that the prediction performance of the single-sensor PLS models is improved by GR in addition to the LS fusion method for all soil attributes since it accounts for residuals. Resorting to LS, the largest improvements compared to the single-sensor models were obtained, respectively, for Mg (residual prediction deviation (RPD) = 4.08, coefficient of determination (R-2) = 0.94, ratio of performance of inter-quantile (RPIQ) = 1.64, root mean square error (RMSE) = 4.57 mg/100 g), OC (RPD = 1.79, R-2 = 0.69, RPIQ = 2.82, RMSE = 0.16%), pH (RPD = 1.61, R-2 = 0.61, RPIQ = 3.06, RMSE = 0.29), and Ca (RPD = 3.33, R-2 = 0.91, RPIQ = 1, RMSE = 207.48 mg/100 g). OPA-FS and OPA-SS outperformed the individual, GR, and LS models for pH only, while OPA-FS was effective in improving the individual sensor models for Mg as well. The results of this study suggest LS as a robust fusion method in improving the prediction accuracy for all the studied soil attributes.A

A Portable in-situ Near-infrared LEDs-based Soil Nitrogen Sensor

Monitoring soil Nitrogen content for palm oil cultivation is paramount to produce high-quality palm oil. This study aims to investigate the feasibility of a designed portable near-infrared (NIR) light emitting diodes (LEDs)-based soil Nitrogen in predicting the soil Nitrogen content using NIR light. First, soil samples that collected from a local oil palm plantation were scanned using the developed sensor and followed by a conventional method, i.e. Kjeldahl analysis. A chemometric analysis was applied in this study to develop a predictive model by choosing the best result from an artificial neural network (ANN). The performance of ANN was validated using leave one out cross-validation. Results indicate that ANN with one hundred number of hidden neurons outperformed with a root mean square error of cross-validation of 0.031. This finding suggests that the proposed sensor coupled with ANN is promising to satisfactorily predict soil Nitrogen content