A Global Systematic Review of Improving Crop Model Estimations by Assimilating Remote Sensing Data: Implications for Small-Scale Agricultural Systems

There is a growing effort to use access to remote sensing data (RS) in conjunction with crop model simulation capability to improve the accuracy of crop growth and yield estimates. This is critical for sustainable agricultural management and food security, especially in farming communities with limited resources and data. Therefore, the objective of this study was to provide a systematic review of research on data assimilation and summarize how its application varies by country, crop, and farming systems. In addition, we highlight the implications of using process-based crop models (PBCMs) and data assimilation in small-scale farming systems. Using a strict search term, we searched the Scopus and Web of Science databases and found 497 potential publications. After screening for relevance using predefined inclusion and exclusion criteria, 123 publications were included in the final review. Our results show increasing global interest in RS data assimilation approaches; however, 81% of the studies were from countries with relatively high levels of agricultural production, technology, and innovation. There is increasing development of crop models, availability of RS data sources, and characterization of crop parameters assimilated into PBCMs. Most studies used recalibration or updating methods to mainly incorporate remotely sensed leaf area index from MODIS or Landsat into the WOrld FOod STudies (WOFOST) model to improve yield estimates for staple crops in large-scale and irrigated farming systems. However, these methods cannot compensate for the uncertainties in RS data and crop models. We concluded that further research on data assimilation using newly available high-resolution RS datasets, such as Sentinel-2, should be conducted to significantly improve simulations of rare crops and small-scale rainfed farming systems. This is critical for informing local crop management decisions to improve policy and food security assessments

A Mixed Data-Based Deep Neural Network to Estimate Leaf Area Index in Wheat Breeding Trials

Remote and non-destructive estimation of leaf area index (LAI) has been a challenge in the last few decades as the direct and indirect methods available are laborious and time-consuming. The recent emergence of high-throughput plant phenotyping platforms has increased the need to develop new phenotyping tools for better decision-making by breeders. In this paper, a novel model based on artificial intelligence algorithms and nadir-view red green blue (RGB) images taken from a terrestrial high throughput phenotyping platform is presented. The model mixes numerical data collected in a wheat breeding field and visual features extracted from the images to make rapid and accurate LAI estimations. Model-based LAI estimations were validated against LAI measurements determined non-destructively using an allometric relationship obtained in this study. The model performance was also compared with LAI estimates obtained by other classical indirect methods based on bottom-up hemispherical images and gaps fraction theory. Model-based LAI estimations were highly correlated with ground-truth LAI. The model performance was slightly better than that of the hemispherical image-based method, which tended to underestimate LAI. These results show the great potential of the developed model for near real-time LAI estimation, which can be further improved in the future by increasing the dataset used to train the model

The influence of temporal resolution on crop yield estimation with Earth Observation data assimilation

Crop growth simulation models are often used to estimate crop yield.For most models, this requires crop, water, and soil management information, though this information is often lacking in many regions of the world. Assimilation of Earth observation (EO) data in crop growth models can generate field-level yield estimates over large areas. The use of EO for assimilation often requires a trade-off between spatial and temporal resolution. Spatiotemporal data fusion can provide higher spatial (≤30m) and temporal resolution data to avoid this trade-off. In this study, we evaluated the timing and frequency of EO data assimilation in the Simple Algorithm for Yield Estimation (SAFY) in a persistently cloudy and fragmented agroecosystem of Ethiopia for 2019 and 2020 growing seasons. We used Landsat and MODIS data fusion to obtain frequent and spatially detailed LAI estimates and assimilated at each main maize growth stage to evaluate the effect of timing and frequency of LAI assimilation. The jointing to grain filling stage observations were more important (RMSE = 117 g/m2, rRMSE = 16%) than other growth stages to improve yield estimation. Using LAI estimates at key crop growth stages was more influential than the frequency of LAI estimates. Reasonably accurate yield estimation (rRMSE = 20%) was obtained using the pre-peak growth stage LAI observations, suggesting that the method is suitable for in-season yield forecasting. LAI retrieval errors from EO data, particularly at the early and late growth stages, were the source of yield estimation uncertainty. Therefore, assimilation of other EO-derived biophysical variables and improving LAI retrieval accuracy from EO data could further improve crop growth model performance in smallholder agricultural systems

Crop growth and yield monitoring in smallholder agricultural systems:a multi-sensor data fusion approach

Smallholder agricultural systems are highly vulnerable to production risks posed by the intensification of extreme weather events such as drought and flooding, soil degradation, pests, lack of access to agricultural inputs, and political instability. Monitoring the spatial and temporal variability of crop growth and yield is crucial for farm management, national-level food security assessments, and famine early warning. However, agricultural monitoring is difficult in fragmented agricultural landscapes because of scarcity and uncertainty of data to capture small crop fields. Traditional pre- and post-harvest crop monitoring and yield estimation based on fieldwork is costly, slow, and can be unrepresentative of heterogeneous agricultural landscapes as found in smallholder systems in sub-Saharan Africa. Devising accurate and timely crop phenology detection and yield estimation methods can improve our understanding of the status of crop production and food security in these regions.Satellite-based Earth observation (EO) data plays a key role in monitoring the spatial and temporal variability of crop growth and yield over large areas. The small field sizes and variability in management practices in fragmented landscapes requires high spatial and high temporal resolution EO data. This thesis develops and demonstrates methods to investigate the spatiotemporal variability of crop phenology detection and yield estimation using Landsat and MODIS data fusion in smallholder agricultural systems in the Lake Tana sub-basin of Ethiopia. The overall aim is to further broaden the application of multi-sensor EO data for crop growth monitoring in smallholder agricultural systems.The thesis addressed two important aspects of crop monitoring applications of EO data: phenology detection and yield estimation. First, the ESTARFM data fusion workflow was modified based on local knowledge of crop calendars and land cover to improve crop phenology monitoring in fragmented agricultural landscapes. The approach minimized data fusion uncertainties in predicting temporal reflectance change of crops during the growing season and the reflectance value of fused data was comparable to the original Landsat image reserved for validation. The main sources of uncertainty in data fusion are the small field size and abrupt crop growth changes between the base andviiprediction dates due to flooding, weeding, fertiliser application, and harvesting. The improved data fusion approach allowed us to determine crop phenology and estimate LAI more accurately than both the standard ESTARFM data fusion method and when using MODIS data without fusion. We also calibrated and validated a dynamic threshold phenology detection method using maize and rice crop sowing and harvest date information. Crop-specific phenology determined from data fusion minimized the mismatch between EO-derived phenometrics and the actual crop calendar. The study concluded that accurate phenology detection and LAI estimation from Landsat–MODIS data fusion demonstrates the feasibility of crop growth monitoring using multi-sensor data fusion in fragmented and persistently cloudy agricultural landscapes.Subsequently, the validated data fusion and phenology detection methods were implemented to understand crop phenology trends from 2000 to 2020. These trends are often less understood in smallholder agricultural systems due to the lack of high spatial resolution data to distinguish crops from the surrounding natural vegetation. Trends based on Landsat–MODIS fusion were compared with those detected using MODIS alone to assess the contribution of data fusion to discern crop phenometric change. Landsat and MODIS fusion discerned crop and environment-specific trends in the magnitude and direction of crop phenology change. The results underlined the importance of high spatial and temporal resolution EO data to capture environment-specific crop phenology change, which has implications in designing adaptation and crop management practices in these regions.The second important aspect of the crop monitoring problem addressed in this thesis is improving crop yield estimation in smallholder agricultural systems. The large input requirements of crop models and lack of spatial information about the heterogeneous crop-growing environment and agronomic management practices are major challenges to the accurate estimation of crop yield. We assimilated leaf area index (LAI) and phenology information from Landsat–MODIS fusion in a crop model (simple algorithm for yield estimation: SAFY) to obtain reasonably reliable crop yield estimates. The SAFY model is sensitive to the spatial and temporal resolution of the calibration input LAI, phenology information, and the effective light use efficiency (ELUE) parameter, which needs accurate field level inputs during modelviiioptimization. Assimilating fused EO-based phenology information minimized model uncertainty and captured the large management and environmental variation in smallholder agricultural systems.In the final research chapter of the thesis, we analysed the contribution of assimilating LAI at different phenological stages. The frequency and timing of LAI observations influences the retrieval accuracy of the assimilating LAI in crop growth simulation models. The use of (optical) EO data to estimate LAI is constrained by limited repeat frequency and cloud cover, which can reduce yield estimation accuracy. We evaluated the relative contribution of EO observations at different crop growth stages for accurate calibration of crop model parameters. We found that LAI between jointing and grain filling has the highest contribution to SAFY yield estimation and that the distribution of LAI during the key development stages was more useful than the frequency of LAI to improve yield estimation. This information on the optimal timing of EO data assimilation is important to develop better in-season crop yield forecasting in smallholder systems

Integration of Multiscale Sensing Data for Phenomics Applications

Sensing technologies can be a powerful tool for phenotyping in breeding programs. Plant phenotypes can be assessed non-invasively and repeatedly across the whole population and throughout the plant development period utilizing advanced sensors and remote sensing platforms. In this study, multiscale sensing platforms—satellite, unmanned aerial vehicle (UAV), proximal sensing system, and Internet of Things (IoT) based sensing systems—equipped with sensors such as visible/RGB, multispectral, and hyperspectral systems were utilized for field-based phenomics applications. The applicability of a suitable sensing technology depends on the area of study, specific phenomics application, sensor specification, and data acquisition conditions. Three main phenomics applications were explored: (i) pasture crop health status evaluation, (ii) above-ground biomass quantity and quality evaluation in the field pea, and (iii) evaluating wheat yield potential in winter and spring wheat. The first study demonstrates the reliability of using a high-resolution satellite (ground sampling distance, GSD = 3 m) and UAV imagery for pasture management. The data from multiscale sensing data showed that the grazing density significantly affected pasture biomass (p < 0.05) only in 2019, and the vegetation index (VI) data from the two imagery types were highly correlated (r ≥ 0.78, p < 0.001, 2019). In the second study, the above-ground biomass (AGBM) and biomass quality (12 quality traits) were evaluated using UAV-based RGB and multispectral imaging, and hyperspectral sensing, respectively, in the winter pea breeding program (2019 and 2020 seasons). Three image processing approaches were evaluated for AGBM estimation, where the best results were acquired using the 3D point cloud model at 1.5 alpha shape technique showing high correlation with harvested fresh (r = 0.78–0.81, p < 0.001) and dry (r = 0.70–0.81, p < 0.001) AGBM. Similarly, the selected features from the normalized difference spectral indices and the ratio spectral indices extracted from hyperspectral data with the random forest model provided high predictive accuracy for all 12 biomass quality traits (0.81 < R2 < 0. 93; 0.05 < RMSE (%) < 1.80; 0.03 < MAE (%) < 1.32).In the wheat study, the vegetation indies were highly correlated between satellite (GSD = 0.31 m) and UAV data (0.42 ≤ r ≤ 0.99, p < 0.01) from winter and spring wheat breeding trials (2020 and 2021). The yield prediction using such VIs with the high-resolution satellite imagery (6.26 ≤ RMSE% ≤ 25.49; 5.11 ≤ MAE% ≤ 20.95; 0.17 ≤ r ≤0.78) and UAV imagery (5.53 ≤ RMSE% ≤ 17.20; 4.28 ≤ MAE% ≤ 14.20; 0.43 ≤ r ≤ 0.92) was also high. In addition to these two platforms, an intelligent and compact IoT-based sensor system was developed for independent and automated phenomics applications to measure and monitor plant responses in real-time. The sensor development, improvisation, and implementation encompassed three field seasons (2020, 2021, and 2022 seasons). The developed IoT-based sensor system could be successfully implemented to monitor multiple trials for timely crop management and increased resource efficiency. The system shows a high potential for supporting plant breeding programs for in-field phenotyping applications. All studies demonstrated promising results in monitoring and estimating crop performance and phenotypic traits using multiscale sensing systems

Remote Sensing for Precision Nitrogen Management

This book focuses on the fundamental and applied research of the non-destructive estimation and diagnosis of crop leaf and plant nitrogen status and in-season nitrogen management strategies based on leaf sensors, proximal canopy sensors, unmanned aerial vehicle remote sensing, manned aerial remote sensing and satellite remote sensing technologies. Statistical and machine learning methods are used to predict plant-nitrogen-related parameters with sensor data or sensor data together with soil, landscape, weather and/or management information. Different sensing technologies or different modelling approaches are compared and evaluated. Strategies are developed to use crop sensing data for in-season nitrogen recommendations to improve nitrogen use efficiency and protect the environment

Seasonal mapping of irrigated winter wheat traits in Argentina with a hybrid retrieval workflow using sentinel-2 imagery

Earth observation offers an unprecedented opportunity to monitor intensively cultivated areas providing key support to assess fertilizer needs and crop water uptake. Routinely, vegetation traits mapping can help farmers to monitor plant development along the crop’s phenological cycle, which is particularly relevant for irrigated agricultural areas. The high spatial and temporal resolution of the Sentinel-2 (S2) multispectral instrument leverages the possibility to estimate leaf area index (LAI), canopy chlorophyll content (CCC), and vegetation water content (VWC) from space. Therefore, our study presents a hybrid retrieval workflow combining a physically-based strategy with a machine learning regression algorithm, i.e., Gaussian processes regression, and an active learning technique to estimate LAI, CCC and VWC of irrigated winter wheat. The established hybrid models of the three traits were validated against in-situ data of a wheat campaign in the Bonaerense valley, South of the Buenos Aires Province, Argentina, in the year 2020. We obtained good to highly accurate validation results with LAI: R2 = 0.92, RMSE = 0.43 m2 m−2, CCC: R2 = 0.80, RMSE = 0.27 g m−2 and VWC: R2 = 0.75, RMSE = 416 g m−2. The retrieval models were also applied to a series of S2 images, producing time series along the seasonal cycle, which reflected the effects of fertilizer and irrigation on crop growth. The associated uncertainties along with the obtained maps underlined the robustness of the hybrid retrieval workflow. We conclude that processing S2 imagery with optimised hybrid models allows accurate space-based crop traits mapping over large irrigated areas and thus can support agricultural management decisions.Fil: Caballero, Gabriel. Technological University of Uruguay (UTEC). Agri-Environmental Engineering; Uruguay. University of Valencia. Image Processing Laboratory (IPL); EspañaFil: Pezzola, Alejandro. Instituto Nacional de Tecnología Agropecuaria (INTA). Estación Experimental Agropecuaria Hilario Ascasubi; ArgentinaFil: Winschel, Cristina Ines. Instituto Nacional de Tecnología Agropecuaria (INTA). Estación Experimental Agropecuaria Hilario Ascasubi; ArgentinaFil: Casella, Alejandra. Instituto Nacional de Tecnología Agropecuaria (INTA). Instituto de Clima y Agua; ArgentinaFil: Sanchez Angonova, Paolo Andres. Instituto Nacional de Tecnología Agropecuaria (INTA). Estación Experimental Agropecuaria Hilario Ascasubi; ArgentinaFil: Rivera Caicedo, Juan Pablo. CONACYT-UAN. Secretary of Research and Graduate Studies; MéxicoFil: Berger, Katja. University of Valencia. Image Processing Laboratory (IPL); España. Mantle Labs GmbH; AustriaFil: Verrelst, Jochem. University of Valencia. Image Processing Laboratory (IPL); EspañaFil: Delegido, Jesús. Universidad de Valencia. Image Processing Laboratory (IPL); Españ

Digital phenotyping and genotype-to-phenotype (G2P) models to predict complex traits in cereal crops

The revolution in digital phenotyping combined with the new layers of omics and envirotyping tools offers great promise to improve selection and accelerate genetic gains for crop improvement. This chapter examines the latest methods involving digital phenotyping tools to predict complex traits in cereals crops. The chapter has two parts. In the first part, entitled “Digital phenotyping as a tool to support breeding programs”, the secondary phenotypes measured by high-throughput plant phenotyping that are potentially useful for breeding are reviewed. In the second part, “Implementing complex G2P models in breeding programs”, the integration of data from digital phenotyping into genotype to phenotype (G2P) models to improve the prediction of complex traits using genomic information is discussed. The current status of statistical models to incorporate secondary traits in univariate and multivariate models, as well as how to better handle longitudinal (for example light interception, biomass accumulation, canopy height) traits, is reviewe