Mapping of multitemporal rice (Oryza sativa L.) growth stages using remote sensing with multi-sensor and machine learning : a thesis dissertation presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Earth Science at Massey University, Manawatū, New Zealand

Figure 2.1 is adapted and re-used under a Creative Commons Attribution 4.0 International (CC BY 4.0) license.Rice (Oryza Sativa) plays a pivotal role in food security for Asian countries, especially in Indonesia. Due to the increasing pressure of environmental changes, such as land use and climate, rice cultivation areas need to be monitored regularly and spatially to ensure sustainable rice production. Moreover, timely information of rice growth stages (RGS) can lead to more efficient of inputs distribution from water, seed, fertilizer, and pesticide. One of the efficient solutions for regularly mapping the rice crop is using Earth observation satellites. Moreover, the increasing availability of open access satellite images such as Landsat-8, Sentinel-1, and Sentinel-2 provides ample opportunities to map continuous and high-resolution rice growth stages with greater accuracy. The majority of the literature has focused on mapping rice area, cropping patterns and relied mainly on the phenology of vegetation. However, the mapping process of RGS was difficult to assess the accuracy, time-consuming, and depended on only one sensor. In this work, we discuss the use of machine learning algorithms (MLA) for mapping paddy RGS with multiple remote sensing data in near-real-time. The study area was Java Island, which is the primary rice producer in Indonesia. This study has investigated: (1) the mapping of RGS using Landsat-8 imagery and different MLAs, and their rigorous performance was evaluated by conducting a multitemporal analysis; (2) the temporal consistency of predicting RGS using Sentinel-2, MOD13Q1, and Sentinel-1 data; (3) evaluating the correlation of local statistics data and paddy RGS using Sentinel-2, PROBA-V, and Sentinel-1 with MLAs. The ground truth datasets were collected from multi-year web camera data (2014-2016) and three months of the field campaign in different regions of Java (2018). The study considered the RGS in the analysis to be vegetative, reproductive, ripening, bare land, and flooding, and MLAs such as support vector machines (SVMs), random forest (RF), and artificial neural network (ANN) were used. The temporal consistency matrix was used to compare the classification maps within three sensor datasets (Landsat-8 OLI, Sentinel-2, and Sentinel-2, MOD13Q1, Sentinel-1) and in four periods (5, 10, 15, 16 days). Moreover, the result of the RGS map was also compared with monthly data from local statistics within each sub-district using cross-correlation analysis. The result from the analysis shows that SVM with a radial base function outperformed the RF and ANN and proved to be a robust method for small-size datasets (< 1,000 points). Compared to Sentinel-2, Landsat-8 OLI gives less accuracy due to the lack of a red-edge band and larger pixel size (30 x 30 m). Integration of Sentinel-2, MOD13Q1, and Sentinel-1 improved the classification performance and increased the temporal availability of cloud-free maps. The integration of PROBA-V and Sentinel-1 improved the classification accuracy from the Landsat-8 result, consistent with the monthly rice planting area statistics at the sub-district level. The western area of Java has the highest accuracy and consistency since the cropping pattern only relied on rice cultivation. In contrast, less accuracy was noticed in the eastern area because of upland rice cultivation due to limited irrigation facilities and mixed cropping. In addition, the cultivation of shallots to the north of Nganjuk Regency interferes with the model predictions because the cultivation of shallots resembles the vegetative phase due to the water banks. One future research idea is the auto-detection of the cropping index in the complex landscape to be able to use it for mapping RGS on a global scale. Detection of the rice area and RGS using Google Earth Engine (GEE) can be an action plan to disseminate the information quickly on a planetary scale. Our results show that the multitemporal Sentinel-1 combined with RF can detect rice areas with high accuracy (>91%). Similarly, accurate RGS maps can be detected by integrating multiple remote sensing (Sentinel-2, Landsat-8 OLI, and MOD13Q1) data with acceptable accuracy (76.4%), with high temporal frequency and lower cloud interference (every 16 days). Overall, this study shows that remote sensing combined with the machine learning methodology can deliver information on RGS in a timely fashion, which is easy to scale up and consistent both in time and space and matches the local statistics. This thesis is also in line with the existing rice monitoring projects such as Crop Monitor, Crop Watch, AMIS, and Sen4Agri to support disseminating information over a large area. To sum up, the proposed workflow and detailed map provide a more accurate method and information in near real-time for stakeholders, such as governmental agencies against the existing mapping method. This method can be introduced to provide accurate information to rice farmers promptly with sufficient inputs such as irrigation, seeds, and fertilisers for ensuring national food security from the shifting planting time due to climate change

CubeSat constellations provide enhanced crop phenology and digital agricultural insights using daily leaf area index retrievals

Satellite remote sensing has great potential to deliver on the promise of a data-driven agricultural revolution, with emerging space-based platforms providing spatiotemporal insights into precisionlevel attributes such as crop water use, vegetation health and condition and crop response to management practices. Using a harmonized collection of high-resolution Planet CubeSat, Sentinel-2, Landsat-8 and additional coarser resolution imagery from MODIS and VIIRS, we exploit a multisatellite data fusion and machine learning approach to deliver a radiometrically calibrated and gap-filled time-series of daily leaf area index (LAI) at an unprecedented spatial resolution of 3 m. The insights available from such high-resolution CubeSat-based LAI data are demonstrated through tracking the growth cycle of a maize crop and identifying observable within-field spatial and temporal variations across key phenological stages. Daily LAI retrievals peaked at the tasseling stage, demonstrating their value for fertilizer and irrigation scheduling. An evaluation of satellite-based retrievals against field-measured LAI data collected from both rain-fed and irrigated fields shows high correlation and captures the spatiotemporal development of intra- and inter-field variations. Novel agricultural insights related to individual vegetative and reproductive growth stages were obtained, showcasing the capacity for new high-resolution CubeSat platforms to deliver actionable intelligence for precision agricultural and related applications

Field-scale mapping of evaporative stress indicators of crop yield: An application over Mead, NE, USA

The Evaporative Stress Index (ESI) quantifies temporal anomalies in a normalized evapotranspiration (ET) metric describing the ratio of actual-to-reference ET (fRET) as derived from satellite remote sensing. At regional scales (3–10 km pixel resolution), the ESI has demonstrated the capacity to capture developing crop stress and impacts on regional yield variability in water-limited agricultural regions. However, its performance in some regions where the vegetation cycle is intensively managed appears to be degraded due to spatial and temporal limitations in the standard ESI products. In this study, we investigated potential improvements to ESI by generating maps of ET, fRET, and fRET anomalies at high spatiotemporal resolution (30-m pixels, daily time steps) using a multi-sensor data fusion method, enabling separation of landcover types with different phenologies and resilience to drought. The study was conducted for the period 2010–2014 covering a region around Mead, Nebraska that includes both rainfed and irrigated crops. Correlations between ESI and measurements of maize yield were investigated at both the field and county level to assess the potential of ESI as a yield forecasting tool. To examine the role of crop phenology in yield-ESI correlations, annual input fRET time series were aligned by both calendar day and by biophysically relevant dates (e.g. days since planting or emergence). At the resolution of the operational U.S. ESI product (4 km), adjusting fRET alignment to a regionally reported emergence date prior to anomaly computation improves r2 correlations with county-level yield estimates from 0.28 to 0.80. At 30-m resolution, where pure maize pixels can be isolated from other crops and landcover types, county-level yield correlations improved from 0.47 to 0.93 when aligning fRET by emergence date rather than calendar date. Peak correlations occurred 68 days after emergence, corresponding to the silking stage for maize when grain development is particularly sensitive to soil moisture deficiencies. The results of this study demonstrate the utility of remotely sensed ET in conveying spatially and temporally explicit water stress information to yield prediction and crop simulation models

Multi-Season Phenology Mapping of Nile Delta Croplands Using Time Series of Sentinel-2 and Landsat 8 Green LAI

Space-based cropland phenology monitoring substantially assists agricultural managing practices and plays an important role in crop yield predictions. Multitemporal satellite observations allow analyzing vegetation seasonal dynamics over large areas by using vegetation indices or by deriving biophysical variables. The Nile Delta represents about half of all agricultural lands of Egypt. In this region, intensifying farming systems are predominant and multi-cropping rotations schemes are increasing, requiring a high temporal and spatial resolution monitoring for capturing successive crop growth cycles. This study presents a workflow for cropland phenology characterization and mapping based on time series of green Leaf Area Index (LAI) generated from NASA’s Harmonized Landsat 8 (L8) and Sentinel-2 (S2) surface reflectance dataset from 2016 to 2019. LAI time series were processed for each satellite dataset, which were used separately and combined to identify seasonal dynamics for a selection of crop types (wheat, clover, maize and rice). For the combination of L8 with S2 LAI products, we proposed two time series smoothing and fitting methods: (1) the Savitzky–Golay (SG) filter and (2) the Gaussian Processes Regression (GPR) fitting function. Single-sensor and L8-S2 combined LAI time series were used for the calculation of key crop Land Surface Phenology (LSP) metrics (start of season, end of season, length of season), whereby the detection of cropland growing seasons was based on two established threshold methods, i.e., a seasonal or a relative amplitude value. Overall, the developed phenology extraction scheme enabled identifying up to two successive crop cycles within a year, with a superior performance observed for the seasonal than for the relative threshold method, in terms of consistency and cropland season detection capability. Differences between the time series collections were analyzed by comparing the phenology metrics per crop type and year. Results suggest that L8-S2 combined LAI data streams with GPR led to a more precise detection of the start and end of growing seasons for most crop types, reaching an overall detection of 74% over the total planted crops versus 69% with S2 and 63% with L8 alone. Finally, the phenology mapping allowed us to evaluate the spatial and temporal evolution of the croplands over the agroecosystem in the Nile Delta.E.A. was supported by the predoctoral scholarship, grant number ACIF/2019/187, funded by the Generalitat Valenciana and co-funded by the European Social Fund. J.V. and S.B. were supported by the European Research Council (ERC) under the ERC-2017-STG SENTIFLEX project, grant number 755617. J.V. was additionally supported by a Ramón y Cajal Contract (Spanish Ministry of Science, Innovation and Universities). S.B. was additionally supported by the Generalitat Valenciana SEJIGENT program (SEJIGENT/2021/001) and European Union—NextGenerationEU (ZAMBRANO 21-04)

Site-specific seeding using multi-sensor and data fusion techniques : a review

Site-specific seeding (SSS) is a precision agricultural (PA) practice aiming at optimizing seeding rate and depth, depending on the within field variability in soil fertility and yield potential. Unlike other site-specific applications, SSS was not adopted sufficiently by farmers due to some technological and practical challenges that need to be overcome. Success of site-specific application strongly depends on the accuracy of measurement of key parameters in the system, modeling and delineation of management zone maps, accurate recommendations and finally the right choice of variable rate (VR) technologies and their integrations. The current study reviews available principles and technologies for both map-based and senor-based SSS. It covers the background of crop and soil quality indicators (SQI), various soil and crop sensor technologies and recommendation approaches of map-based and sensor-based SSS applications. It also discusses the potential of socio-economic benefits of SSS against uniform seeding. The current review proposes prospective future technology synthesis for implementation of SSS in practice. A multi-sensor data fusion system, integrating proper sensor combinations, is suggested as an essential approach for putting SSS into practice

Mapping Crop Cycles in China Using MODIS-EVI Time Series

As the Earth’s population continues to grow and demand for food increases, the need for improved and timely information related to the properties and dynamics of global agricultural systems is becoming increasingly important. Global land cover maps derived from satellite data provide indispensable information regarding the geographic distribution and areal extent of global croplands. However, land use information, such as cropping intensity (defined here as the number of cropping cycles per year), is not routinely available over large areas because mapping this information from remote sensing is challenging. In this study, we present a simple but efficient algorithm for automated mapping of cropping intensity based on data from NASA’s (NASA: The National Aeronautics and Space Administration) MODerate Resolution Imaging Spectroradiometer (MODIS). The proposed algorithm first applies an adaptive Savitzky-Golay filter to smooth Enhanced Vegetation Index (EVI) time series derived from MODIS surface reflectance data. It then uses an iterative moving-window methodology to identify cropping cycles from the smoothed EVI time series. Comparison of results from our algorithm with national survey data at both the provincial and prefectural level in China show that the algorithm provides estimates of gross sown area that agree well with inventory data. Accuracy assessment comparing visually interpreted time series with algorithm results for a random sample of agricultural areas in China indicates an overall accuracy of 91.0% for three classes defined based on the number of cycles observed in EVI time series. The algorithm therefore appears to provide a straightforward and efficient method for mapping cropping intensity from MODIS time series data

Phenological corrections to a field-scale, ET-based crop stress indicator: An application to yield forecasting across the U.S. Corn Belt

Soil moisture deficiency is a major factor in determining crop yields in water-limited agricultural production regions. Evapotranspiration (ET), which consists of crop water use through transpiration and water loss through direct soil evaporation, is a good indicator of soil moisture availability and vegetation health. ET therefore has been an integral part of many yield estimation efforts. The Evaporative Stress Index (ESI) is an ET-based crop stress indicator that describes temporal anomalies in a normalized evapotranspiration metric as derived from satellite remote sensing. ESI has demonstrated the capacity to explain regional yield variability in water-limited regions. However, its performance in some regions where the vegetation cycle is intensively managed appears to be degraded due to interannual phenological variability. This investigation selected three study sites across the U.S. Corn Belt – Mead, NE, Ames, IA and Champaign, IL – to investigate the potential operational value of 30-m resolution, phenologically corrected ESI datasets for yield prediction. The analysis was conducted over an 8-year period from 2010 to 2017, which included both drought and pluvial conditions as well as a broad range in yield values. Detrended yield anomalies for corn and soybean were correlated with ESI computed using annual ET curves temporally aligned based on (1) calendar date, (2) crop emergence date, and (3) a growing degree day (GDD) scaled time axis. Results showed that ESI has good correlations with yield anomalies at the county scale and that phenological corrections to the annual temporal alignment of the ET timeseries improve the correlation, especially when the time axis is defined by GDD rather than the calendar date. Peak correlations occur in the silking stage for corn and the reproductive stage for soybean – phases when these crops are particularly sensitive to soil moisture deficiencies. Regression equations derived at the time of peak correlation were used to estimate yields at county scale using a leave-one-out cross-validation strategy. The ESI-based yield estimates agree well with the USDA National Agricultural Statistics Service (NASS) county-level crop yield data, with correlation coefficients ranging from 0.79 to 0.93 and percent root-mean-square errors of 5–8%. These results demonstrate that remotely sensed ET at high spatiotemporal resolution can convey valuable water stress information for forecasting crop yields across the Corn Belt if interannual phenological variability is considered

Crop Disease Detection Using Remote Sensing Image Analysis

Pest and crop disease threats are often estimated by complex changes in crops and the applied agricultural practices that result mainly from the increasing food demand and climate change at global level. In an attempt to explore high-end and sustainable solutions for both pest and crop disease management, remote sensing technologies have been employed, taking advantages of possible changes deriving from relative alterations in the metabolic activity of infected crops which in turn are highly associated to crop spectral reflectance properties. Recent developments applied to high resolution data acquired with remote sensing tools, offer an additional tool which is the opportunity of mapping the infected field areas in the form of patchy land areas or those areas that are susceptible to diseases. This makes easier the discrimination between healthy and diseased crops, providing an additional tool to crop monitoring. The current book brings together recent research work comprising of innovative applications that involve novel remote sensing approaches and their applications oriented to crop disease detection. The book provides an in-depth view of the developments in remote sensing and explores its potential to assess health status in crops

Image processing techniques for plant phenotyping using RGB and thermal imagery = Técnicas de procesamiento de imágenes RGB y térmicas como herramienta para fenotipado de cultivos

[eng] World cereal stocks need to increase in order to meet growing demands. Currently, maize, rice, wheat, are the main crops worldwide, while other cereals such as barley, sorghum, oat or different millets are also well placed in the top list. Crop productivity is affected directly by climate change factors such as heat, drought, floods or storms. Researchers agree that global climate change is having a major impact on crop productivity. In that way, several studies have been focused on climate change scenarios and more specifically abiotic stresses in cereals. For instance, in the case of heat stress, high temperatures between anthesis to grain filling can decrease grain yield. In order to deal with the climate change and future environmental scenarios, plant breeding is one of the main alternatives breeding is even considered to contribute to the larger component of yield growth compared to management. Plant breeding programs are focused on identifying genotypes with high yields and quality to act as a parentals and further the best individuals among the segregating population thus develop new varieties of plants. Breeders use the phenotypic data, plant and crop performance, and genetic information to improve the yield by selection (GxE, with G and E indicating genetic and environmental factors). More factors must be taken into account to increase the yield, such as, for instance, the education of farmers, economic incentives and the use of new technologies (GxExM, with M indicating management). Plant phenotyping is related with the observable (or measurable) characteristics of the plant while the crop growing as well as the association between the plant genetic background and its response to the environment (GxE). In traditional phenotyping the measurements are collated manually, which is tedious, time consuming and prone to subjective errors. Nowadays the technology is involved in many applications. From the point of view of plan phenotyping, technology has been incorporated as a tool. The use of image processing techniques integrating sensors and algorithm processes, is therefore, an alternative to asses automatically (or semi-automatically) these traits. Images have become a useful tool for plant phenotyping because most frequently data from the sensors are processed and analyzed as an image in two (2D) or three (3D) dimensions. An image is the arrangement of pixels in a regular Cartesian coordinates as a matrix, each pixel has a numerical value into the matrix which represents the number of photons captured by the sensor within the exposition time. Therefore, an image is the optical representation of the object illuminated by a radiating source. The main characteristics of images can be defined by the sensor spectral and spatial properties, with the spatial properties of the resulting image also heavily dependent on the sensor platform (which determines the distance from the target object).[spa] Las existencias mundiales de cereales deben aumentar para satisfacer la creciente demanda. Actualmente, el maíz, el arroz y el trigo son los principales cultivos a nivel mundial, otros cereales como la cebada, el sorgo y la avena están también bien ubicados en la lista. La productividad de los cultivos se ve afectada directamente por factores del cambio climático como el calor, la sequía, las inundaciones o las tormentas. Los investigadores coinciden en que el cambio climático global está teniendo un gran impacto en la productividad de los cultivos. Es por esto que muchos estudios se han centrado en escenarios de cambio climático y más específicamente en estrés abiótico. Por ejemplo, en el caso de estrés por calor, las altas temperaturas entre antesis y llenado de grano pueden disminuir el rendimiento del grano. Para hacer frente al cambio climático y escenarios ambientales futuros, el mejoramiento de plantas es una de las principales alternativas; incluso se considera que las técnicas de mejoramiento contribuyen en mayor medida al aumento del rendimiento que el manejo del cultivo. Los programas de mejora se centran en identificar genotipos con altos rendimientos y calidad para actuar como progenitores y promover los mejores individuos para desarrollar nuevas variedades de plantas. Los mejoradores utilizan los datos fenotípicos, el desempeño de las plantas y los cultivos, y la información genética para mejorar el rendimiento mediante selección (GxE, donde G y E indican factores genéticos y ambientales). El fenotipado plantas está relacionado con las características observables (o medibles) de la planta mientras crece el cultivo, así como con la asociación entre el fondo genético de la planta y su respuesta al medio ambiente (GxE). En el fenotipado tradicional, las mediciones se clasifican manualmente, lo cual es tedioso, consume mucho tiempo y es propenso a errores subjetivos. Sin embargo, hoy en día la tecnología está involucrada en muchas aplicaciones. Desde el punto de vista del fenotipado de plantas, la tecnología se ha incorporado como una herramienta. El uso de técnicas de procesamiento de imágenes que integran sensores y algoritmos son por lo tanto una alternativa para evaluar automáticamente (o semiautomáticamente) estas características