Reconstruction of Daily 30 m Data from HJ CCD, GF-1 WFV, Landsat, and MODIS Data for Crop Monitoring

With the recent launch of new satellites and the developments of spatiotemporal data fusion methods, we are entering an era of high spatiotemporal resolution remote-sensing analysis. This study proposed a method to reconstruct daily 30 m remote-sensing data for monitoring crop types and phenology in two study areas located in Xinjiang Province, China. First, the Spatial and Temporal Data Fusion Approach (STDFA) was used to reconstruct the time series high spatiotemporal resolution data from the Huanjing satellite charge coupled device (HJ CCD), Gaofen satellite no. 1 wide field-of-view camera (GF-1 WFV), Landsat, and Moderate Resolution Imaging Spectroradiometer (MODIS) data. Then, the reconstructed time series were applied to extract crop phenology using a Hybrid Piecewise Logistic Model (HPLM). In addition, the onset date of greenness increase (OGI) and greenness decrease (OGD) were also calculated using the simulated phenology. Finally, crop types were mapped using the phenology information. The results show that the reconstructed high spatiotemporal data had a high quality with a proportion of good observations (PGQ) higher than 0.95 and the HPLM approach can simulate time series Normalized Different Vegetation Index (NDVI) very well with R2 ranging from 0.635 to 0.952 in Luntai and 0.719 to 0.991 in Bole, respectively. The reconstructed high spatiotemporal data were able to extract crop phenology in single crop fields, which provided a very detailed pattern relative to that from time series MODIS data. Moreover, the crop types can be classified using the reconstructed time series high spatiotemporal data with overall accuracy equal to 0.91 in Luntai and 0.95 in Bole, which is 0.028 and 0.046 higher than those obtained by using multi-temporal Landsat NDVI data

Remote Sensing in Agriculture: State-of-the-Art

The Special Issue on “Remote Sensing in Agriculture: State-of-the-Art” gives an exhaustive overview of the ongoing remote sensing technology transfer into the agricultural sector. It consists of 10 high-quality papers focusing on a wide range of remote sensing models and techniques to forecast crop production and yield, to map agricultural landscape and to evaluate plant and soil biophysical features. Satellite, RPAS, and SAR data were involved. This preface describes shortly each contribution published in such Special Issue

A systematic review of the use of Deep Learning in Satellite Imagery for Agriculture

Agricultural research is essential for increasing food production to meet the requirements of an increasing population in the coming decades. Recently, satellite technology has been improving rapidly and deep learning has seen much success in generic computer vision tasks and many application areas which presents an important opportunity to improve analysis of agricultural land. Here we present a systematic review of 150 studies to find the current uses of deep learning on satellite imagery for agricultural research. Although we identify 5 categories of agricultural monitoring tasks, the majority of the research interest is in crop segmentation and yield prediction. We found that, when used, modern deep learning methods consistently outperformed traditional machine learning across most tasks; the only exception was that Long Short-Term Memory (LSTM) Recurrent Neural Networks did not consistently outperform Random Forests (RF) for yield prediction. The reviewed studies have largely adopted methodologies from generic computer vision, except for one major omission: benchmark datasets are not utilised to evaluate models across studies, making it difficult to compare results. Additionally, some studies have specifically utilised the extra spectral resolution available in satellite imagery, but other divergent properties of satellite images - such as the hugely different scales of spatial patterns - are not being taken advantage of in the reviewed studies.Comment: 25 pages, 2 figures and lots of large tables. Supplementary materials section included here in main pd

Crop monitoring and yield estimation using polarimetric SAR and optical satellite data in southwestern Ontario

Optical satellite data have been proven as an efficient source to extract crop information and monitor crop growth conditions over large areas. In local- to subfield-scale crop monitoring studies, both high spatial resolution and high temporal resolution of the image data are important. However, the acquisition of optical data is limited by the constant contamination of clouds in cloudy areas. This thesis explores the potential of polarimetric Synthetic Aperture Radar (SAR) satellite data and the spatio-temporal data fusion approach in crop monitoring and yield estimation applications in southwestern Ontario. Firstly, the sensitivity of 16 parameters derived from C-band Radarsat-2 polarimetric SAR data to crop height and fractional vegetation cover (FVC) was investigated. The results show that the SAR backscatters are affected by many factors unrelated to the crop canopy such as the incidence angle and the soil background and the degree of sensitivity varies with the crop types, growing stages, and the polarimetric SAR parameters. Secondly, the Minimum Noise Fraction (MNF) transformation, for the first time, was applied to multitemporal Radarsat-2 polarimetric SAR data in cropland area mapping based on the random forest classifier. An overall classification accuracy of 95.89% was achieved using the MNF transformation of the multi-temporal coherency matrix acquired from July to November. Then, a spatio-temporal data fusion method was developed to generate Normalized Difference Vegetation Index (NDVI) time series with both high spatial and high temporal resolution in heterogeneous regions using Landsat and MODIS imagery. The proposed method outperforms two other widely used methods. Finally, an improved crop phenology detection method was proposed, and the phenology information was then forced into the Simple Algorithm for Yield Estimation (SAFY) model to estimate crop biomass and yield. Compared with the SAFY model without forcing the remotely sensed phenology and a simple light use efficiency (LUE) model, the SAFY incorporating the remotely sensed phenology can improve the accuracy of biomass estimation by about 4% in relative Root Mean Square Error (RRMSE). The studies in this thesis improve the ability to monitor crop growth status and production at subfield scale

Big Earth Data and Machine Learning for Sustainable and Resilient Agriculture

Big streams of Earth images from satellites or other platforms (e.g., drones and mobile phones) are becoming increasingly available at low or no cost and with enhanced spatial and temporal resolution. This thesis recognizes the unprecedented opportunities offered by the high quality and open access Earth observation data of our times and introduces novel machine learning and big data methods to properly exploit them towards developing applications for sustainable and resilient agriculture. The thesis addresses three distinct thematic areas, i.e., the monitoring of the Common Agricultural Policy (CAP), the monitoring of food security and applications for smart and resilient agriculture. The methodological innovations of the developments related to the three thematic areas address the following issues: i) the processing of big Earth Observation (EO) data, ii) the scarcity of annotated data for machine learning model training and iii) the gap between machine learning outputs and actionable advice. This thesis demonstrated how big data technologies such as data cubes, distributed learning, linked open data and semantic enrichment can be used to exploit the data deluge and extract knowledge to address real user needs. Furthermore, this thesis argues for the importance of semi-supervised and unsupervised machine learning models that circumvent the ever-present challenge of scarce annotations and thus allow for model generalization in space and time. Specifically, it is shown how merely few ground truth data are needed to generate high quality crop type maps and crop phenology estimations. Finally, this thesis argues there is considerable distance in value between model inferences and decision making in real-world scenarios and thereby showcases the power of causal and interpretable machine learning in bridging this gap.Comment: Phd thesi

Spatiotemporal analysis of gapfilled high spatial resolution time series for crop monitoring.

[ES] La obtención de mapas fiables de clasificación de cultivos es importante para muchas aplicaciones agrícolas, como el monitoreo de los campos y la seguridad alimentaria. Hoy en día existen distintas bases de datos de cobertura terrestre con diferentes escalas espaciales y temporales cubriendo diferentes regiones terrestres (por ejemplo, Corine Land cover (CORINE) en Europa o Cropland Data Layer (CDL) en Estados Unidos (EE.UU.)). Sin embargo, estas bases de datos son mapas históricos y por lo tanto no reflejan los estados fenológicos actuales de los cultivos. Normalmente estos mapas requieren un tiempo específico (anual) para generarse basándose en las diferentes fenologías de cada cultivo. Los objetivos de este trabajo son dos: 1- analizar la distribución espacial de los cultivos a diferentes regiones espaciales para identificar las áreas más representativas. 2- analizar el rango temporal utilizado para acelerar la generación de mapas de clasificación. El análisis se realiza sobre el contiguo de Estados Unidos (CONUS, de sus siglas en inglés) en 2019. Para abordar estos objetivos, se utilizan diferentes fuentes de datos. La capa CDL, una base de datos robusta y completa de mapas de cultivo en el CONUS, que proporciona datos anuales de cobertura terrestre rasterizados y georeferenciados. Así como, datos multiespectrales a 30 metros de resolución espacial, preprocesados para rellenar los posibles huecos debido a la presencia de nubes y aerosoles en los datos. Este conjunto de datos ha sido generado por la fusión de sensores Landsat y Moderate Resolution Imaging Spectroradiometer (MODIS). Para procesar tal elevada cantidad de datos se utilizará Google Earth Engine (GEE), que es una aplicación que procesa la información en la nube y está especializada en el procesamiento geoespacial. GEE se puede utilizar para obtener mapas de cultivos a nivel mundial, pero requiere algoritmos eficientes. En este estudio se analizarán diferentes algoritmos de aprendizaje de máquina (machine learning) para analizar la posible aceleración de la obtención de los mapas de clasificación de cultivo. En GEE hay diferentes tipos de algoritmos de clasificación disponibles, desde simples árboles de decisión (decision trees) hasta algoritmos más complejos como máquinas de vectores soporte (SVM) o redes neuronales (neural networks). Este estudio presentará los primeros resultados para la generación de mapas de clasificación de cultivos utilizando la menor cantidad posible de información, a nivel temporal, con una resolución espacial de 30 metros.[EN] Reliable crop classification maps are important for many agricultural applications, such as field monitoring and food security. Nowadays there are already several crop cover databases at different scales and temporal resolutions for different parts of the world (e. g. Corine Land cover in Europe (CORINE) or Cropland Data Layer (CDL) in the United States (US)). However, these databases are historical crop cover maps and hence do not reflect the actual crops on the ground. Usually, these maps require a specific time (annually) to be generated based on the diversity of the different crop phenologies. The aims of this work are two: 1- analyzing the multi-scale spatial crop distribution to identify the most representative areas. 2- analyzing the temporal range used to generate crop cover maps to build maps promptly. The analysis is done over the contiguous US (CONUS) in 2019. To address these objectives, different types of data are used. The CDL, a robust and complete cropland mapping in the CONUS, which provides annual land cover data raster geo-referenced. And, multispectral high-resolution gap-filled data at 30 meter spatial resolution used to avoid the presence of clouds and aerosols in the data. This dataset has been generated by the fusion of Landsat and Moderate Resolution Imaging Spectroradiometer (MODIS). To process this large amount of data will be used Google Earth Engine (GEE) which is a cloud-based application specialized in geospatial processing. GEE can be used to map crops globally, but it requires efficient algorithms. In this study, different machine learning algorithms will be analyzed to generate the promptest classification crop maps. Several options are available in GEE from simple decision trees to more complex algorithms like support vector machines or neural networks. This study will present the first results and the potential to generate crop classification maps using as less possible temporal range information at 30 meters spatial resolution.Rajadel Lambistos, C. (2020). Análisis espaciotemporal de series temporales sin huecos de alta resolución espacial. Universitat Politècnica de València. http://hdl.handle.net/10251/155879TFG

Characterizing Spatiotemporal Patterns of White Mold in Soybean across South Dakota Using Remote Sensing

Soybean is among the most important crops, cultivated primarily for beans, which are used for food, feed, and biofuel. According to FAO, the United States was the biggest soybeans producer in 2016. The main soybean producing regions in the United States are the Corn Belt and the lower Mississippi Valley. Despite its importance, soybean production is reduced by several diseases, among which Sclerotinia stem rot, also known as white mold, a fungal disease that is caused by the fungus Sclerotinia sclerotiorum is among the top 10 soybean diseases. The disease may attack several plants and considerably reduce yield. According to previous reports, environmental conditions corresponding to high yield potential are most conducive for white mold development. These conditions include cool temperature (12-24 °C), continued wet and moist conditions (70-120 h) generally resulting from rain, but the disease development requires the presence of a susceptible soybean variety. To better understand white mold development in the field, there is a need to investigate its spatiotemoral characteristics and provide accurate estimates of the damages that white mold may cause. Current and accurate data about white mold are scarce, especially at county or larger scale. Studies that explored the characteristics of white mold were generally field oriented and local in scale, and when the spectral characteristics were investigated, the authors used spectroradiometers that are not accessible to farmers and to the general public and are mostly used for experimental modeling. This study employed free remote sensing Landsat 8 images to quantify white mold in South Dakota. Images acquired in May and July were used to map the land cover and extract the soybean mask, while an image acquired in August was used to map and quantify white mold using the random forest algorithm. The land cover map was produced with an overall accuracy of 95% while white mold was mapped with an overall accuracy of 99%. White mold area estimates were respectively 132 km2, 88 km2, and 190 km2, representing 31%, 22% and 29% of the total soybean area for Marshall, Codington and Day counties. This study also explored the spatial characteristics of white mold in soybean fields and its impact on yield. The yield distribution exhibited a significant positive spatial autocorrelation (Moran’s I = 0.38, p-value \u3c 0.001 for Moody field, Moran’s I = 0.45, p-value \u3c 0.001, for Marshall field) as an evidence of clustering. Significant clusters could be observed in white mold areas (low-low clusters) or in healthy soybeans (high-high clusters). The yield loss caused by the worst white mold was estimated at 36% and 56% respectively for the Moody and the Marshall fields, with the most accurate loss estimation occurring between late August and early September. Finally, this study modeled the temporal evolution of white mold using a logistic regression analysis in which the white mold was modeled as a function of the NDVI. The model was successful, but further improved by the inclusion of the Day of the Year (DOY). The respective areas under the curves (AUC) were 0.95 for NDVI and 0.99 for NDVI+DOY models. A comparison of the NDVI temporal change between different sites showed that white mold temporal development was affected by the site location, which could be influenced by many local parameters such as the soil properties, the local elevation, management practices, or weather parameters. This study showed the importance of freely available remotely sensed satellite images in the estimation of crop disease areas and in the characterization of the spatial and temporal patterns of crop disease; this could help in timely disease damage assessment

Joint retrieval of growing season corn canopy LAI and leaf chlorophyll content by fusing Sentinel-2 and MODIS images

Continuous and accurate estimates of crop canopy leaf area index (LAI) and chlorophyll content are of great importance for crop growth monitoring. These estimates can be useful for precision agricultural management and agricultural planning. Our objectives were to investigate the joint retrieval of corn canopy LAI and chlorophyll content using filtered reflectances from Sentinel-2 and MODIS data acquired during the corn growing season, which, being generally hot and rainy, results in few cloud-free Sentinel-2 images. In addition, the retrieved time series of LAI and chlorophyll content results were used to monitor the corn growth behavior in the study area. Our results showed that: (1) the joint retrieval of LAI and chlorophyll content using the proposed joint probability distribution method improved the estimation accuracy of both corn canopy LAI and chlorophyll content. Corn canopy LAI and chlorophyll content were retrieved jointly and accurately using the PROSAIL model with fused Kalman filtered (KF) reflectance images. The relation between retrieved and field measured LAI and chlorophyll content of four corn-growing stages had a coefficient of determination (R2) of about 0.6, and root mean square errors (RMSEs) ranges of mainly 0.1-0.2 and 0.0-0.3, respectively. (2) Kalman filtering is a good way to produce continuous high-resolution reflectance images by synthesizing Sentinel-2 and MODIS reflectances. The correlation between fused KF and Sentinel-2 reflectances had an R2 value of 0.98 and RMSE of 0.0133, and the correlation between KF and field-measured reflectances had an R2 value of 0.8598 and RMSE of 0.0404. (3) The derived continuous KF reflectances captured the crop behavior well. Our analysis showed that the LAI increased from day of year (DOY) 181 (trefoil stage) to DOY 236 (filling stage), and then increased continuously until harvest, while the chlorophyll content first also increased from DOY 181 to DOY 236, and then remained stable until harvest. These results revealed that the jointly retrieved continuous LAI and chlorophyll content could be used to monitor corn growth conditions

Land Surface Monitoring Based on Satellite Imagery

This book focuses attention on significant novel approaches developed to monitor land surface by exploiting satellite data in the infrared and visible ranges. Unlike in situ measurements, satellite data provide global coverage and higher temporal resolution, with very accurate retrievals of land parameters. This is fundamental in the study of climate change and global warming. The authors offer an overview of different methodologies to retrieve land surface parameters— evapotranspiration, emissivity contrast and water deficit indices, land subsidence, leaf area index, vegetation height, and crop coefficient—all of which play a significant role in the study of land cover, land use, monitoring of vegetation and soil water stress, as well as early warning and detection of forest fires and drought