Crop growth and yield monitoring in smallholder agricultural systems:a multi-sensor data fusion approach

Smallholder agricultural systems are highly vulnerable to production risks posed by the intensification of extreme weather events such as drought and flooding, soil degradation, pests, lack of access to agricultural inputs, and political instability. Monitoring the spatial and temporal variability of crop growth and yield is crucial for farm management, national-level food security assessments, and famine early warning. However, agricultural monitoring is difficult in fragmented agricultural landscapes because of scarcity and uncertainty of data to capture small crop fields. Traditional pre- and post-harvest crop monitoring and yield estimation based on fieldwork is costly, slow, and can be unrepresentative of heterogeneous agricultural landscapes as found in smallholder systems in sub-Saharan Africa. Devising accurate and timely crop phenology detection and yield estimation methods can improve our understanding of the status of crop production and food security in these regions.Satellite-based Earth observation (EO) data plays a key role in monitoring the spatial and temporal variability of crop growth and yield over large areas. The small field sizes and variability in management practices in fragmented landscapes requires high spatial and high temporal resolution EO data. This thesis develops and demonstrates methods to investigate the spatiotemporal variability of crop phenology detection and yield estimation using Landsat and MODIS data fusion in smallholder agricultural systems in the Lake Tana sub-basin of Ethiopia. The overall aim is to further broaden the application of multi-sensor EO data for crop growth monitoring in smallholder agricultural systems.The thesis addressed two important aspects of crop monitoring applications of EO data: phenology detection and yield estimation. First, the ESTARFM data fusion workflow was modified based on local knowledge of crop calendars and land cover to improve crop phenology monitoring in fragmented agricultural landscapes. The approach minimized data fusion uncertainties in predicting temporal reflectance change of crops during the growing season and the reflectance value of fused data was comparable to the original Landsat image reserved for validation. The main sources of uncertainty in data fusion are the small field size and abrupt crop growth changes between the base andviiprediction dates due to flooding, weeding, fertiliser application, and harvesting. The improved data fusion approach allowed us to determine crop phenology and estimate LAI more accurately than both the standard ESTARFM data fusion method and when using MODIS data without fusion. We also calibrated and validated a dynamic threshold phenology detection method using maize and rice crop sowing and harvest date information. Crop-specific phenology determined from data fusion minimized the mismatch between EO-derived phenometrics and the actual crop calendar. The study concluded that accurate phenology detection and LAI estimation from Landsat–MODIS data fusion demonstrates the feasibility of crop growth monitoring using multi-sensor data fusion in fragmented and persistently cloudy agricultural landscapes.Subsequently, the validated data fusion and phenology detection methods were implemented to understand crop phenology trends from 2000 to 2020. These trends are often less understood in smallholder agricultural systems due to the lack of high spatial resolution data to distinguish crops from the surrounding natural vegetation. Trends based on Landsat–MODIS fusion were compared with those detected using MODIS alone to assess the contribution of data fusion to discern crop phenometric change. Landsat and MODIS fusion discerned crop and environment-specific trends in the magnitude and direction of crop phenology change. The results underlined the importance of high spatial and temporal resolution EO data to capture environment-specific crop phenology change, which has implications in designing adaptation and crop management practices in these regions.The second important aspect of the crop monitoring problem addressed in this thesis is improving crop yield estimation in smallholder agricultural systems. The large input requirements of crop models and lack of spatial information about the heterogeneous crop-growing environment and agronomic management practices are major challenges to the accurate estimation of crop yield. We assimilated leaf area index (LAI) and phenology information from Landsat–MODIS fusion in a crop model (simple algorithm for yield estimation: SAFY) to obtain reasonably reliable crop yield estimates. The SAFY model is sensitive to the spatial and temporal resolution of the calibration input LAI, phenology information, and the effective light use efficiency (ELUE) parameter, which needs accurate field level inputs during modelviiioptimization. Assimilating fused EO-based phenology information minimized model uncertainty and captured the large management and environmental variation in smallholder agricultural systems.In the final research chapter of the thesis, we analysed the contribution of assimilating LAI at different phenological stages. The frequency and timing of LAI observations influences the retrieval accuracy of the assimilating LAI in crop growth simulation models. The use of (optical) EO data to estimate LAI is constrained by limited repeat frequency and cloud cover, which can reduce yield estimation accuracy. We evaluated the relative contribution of EO observations at different crop growth stages for accurate calibration of crop model parameters. We found that LAI between jointing and grain filling has the highest contribution to SAFY yield estimation and that the distribution of LAI during the key development stages was more useful than the frequency of LAI to improve yield estimation. This information on the optimal timing of EO data assimilation is important to develop better in-season crop yield forecasting in smallholder systems

Remote Sensing in Agriculture: State-of-the-Art

The Special Issue on “Remote Sensing in Agriculture: State-of-the-Art” gives an exhaustive overview of the ongoing remote sensing technology transfer into the agricultural sector. It consists of 10 high-quality papers focusing on a wide range of remote sensing models and techniques to forecast crop production and yield, to map agricultural landscape and to evaluate plant and soil biophysical features. Satellite, RPAS, and SAR data were involved. This preface describes shortly each contribution published in such Special Issue

Classification of Rice Growth Phases with an Object-Based Approach using Sentinel-2 Imagery

Monitoring of rice crops in Indonesia is supported by the local government at the sub-district level. This practice requires a lot of funds and is considered less efficient. Another option is to utilize remote sensing data using Sentinel-2 free satellite imagery to monitor rice growth spatio-temporally and over a wider area. Sentinel-2 is designed to support agricultural monitoring. To monitor the growth phase of rice can be done with a pixel-based classification, but this approach has limitations due to the appearance of salt and pepper that affect the classification results and accuracy. The object-based image analysis approach can overcome this phenomenon and better mimic human perception of objects. This study aims to identify the growth phases of rice in Sentinel-2 imagery using an object-based classification approach, and to monitor the spatio-temporal distribution of rice growth phases. Sentinel-2 imagery with 10 acquisitions in May – August 2021 was analyzed using an object-based approach and the growth phases of rice were classified using the SVM approach. The results show that the growth phase of rice can be identified and classified properly without the salt and pepper phenomenon with an object-based approach from Sentinel-2 multi-temporal imagery. The accuracy of the SVM classification model is good with an average accuracy of 81.60. The object-based SVM classification can map the distribution of rice growth phases consistently and continuously from Sentinel-2 multi-temporal images.Pemantauan tanaman padi di Indonesia didukung oleh pemerintah daerah di tingkat kecamatan. Praktik tersebut membutuhkan dana yang besar dan dinilai kurang efisien. Opsi lain adalah pemanfaatan data Penginderaan Jauh menggunakan citra satelit gratis Sentinel-2 untuk memantau pertumbuhan padi secara spasio temporal dan pada wilayah yang lebih luas. Citra Sentinel-2 didesain untuk mendukung pemantauan pertanian. Untuk memantau fase tumbuh padi dapat dilakukan dengan klasifikasi berbasis piksel, tetapi pendekatan ini memiliki keterbatasan munculnya salt and pepper yang mengganggu hasil dan akurasi klasifikasi. Pendekatan klasifikasi Object-Based Image Analysis dapat mengatasi fenomena ini dan lebih baik dalam meniru persepsi manusia terhadap objek. Penelitian ini bertujuan untuk mengidentifikasi fase tumbuh padi pada citra Sentinel-2 dengan pendekatan klasifikasi berbasis objek, dan memantau sebaran spasio temporal fase tumbuh padi. Citra Sentinel-2 dengan 10 akuisisi bulan Mei – Agustus 2021 dianalisis dengan pendekatan berbasis objek dan fase tumbuh padi diklasifikasi dengan pendekatan SVM. Hasil analisis menunjukkan bahwa fase tumbuh padi dapat diidentfikasi dan diklasifikasi dengan baik tanpa fenomena salt and pepper dengan pendekatan berbasis objek dari citra multi-temporal Sentinel-2. Ketelitian model klasifikasi SVM cukup baik dengan rata-rata akurasi 81,60. Klasifikasi SVM berbasis objek dapat memetakan sebaran fase tumbuh padi konsisten dan berlanjut dari citra multi-temporal Sentinel-2

Sustainable Agriculture and Advances of Remote Sensing (Volume 1)

Agriculture, as the main source of alimentation and the most important economic activity globally, is being affected by the impacts of climate change. To maintain and increase our global food system production, to reduce biodiversity loss and preserve our natural ecosystem, new practices and technologies are required. This book focuses on the latest advances in remote sensing technology and agricultural engineering leading to the sustainable agriculture practices. Earth observation data, in situ and proxy-remote sensing data are the main source of information for monitoring and analyzing agriculture activities. Particular attention is given to earth observation satellites and the Internet of Things for data collection, to multispectral and hyperspectral data analysis using machine learning and deep learning, to WebGIS and the Internet of Things for sharing and publishing the results, among others

Just-in-time Pastureland Trait Estimation for Silage Optimization, under Limited Data Constraints

To ensure that pasture-based farming meets production and environmental targets for a growing population under increasing resource constraints, producers need to know pastureland traits. Current proximal pastureland trait prediction methods largely rely on vegetation indices to determine biomass and moisture content. The development of new techniques relies on the challenging task of collecting labelled pastureland data, leading to small datasets. Classical computer vision has already been applied to weed identification and recognition of fruit blemishes using morphological features, but machine learning algorithms can parameterise models without the provision of explicit features, and deep learning can extract even more abstract knowledge although typically this is assumed to be based around very large datasets. This work hypothesises that through the advantages of state-of-the-art deep learning systems, pastureland crop traits can be accurately assessed in a just-in-time fashion, based on data retrieved from an inexpensive sensor platform, under the constraint of limited amounts of labelled data. However the challenges to achieve this overall goal are great, and for applications such as just-in-time yield and moisture estimation for farm-machinery, this work must bring together systems development, knowledge of good pastureland practice, and also techniques for handling low-volume datasets in a machine learning context. Given these challenges, this thesis makes a number of contributions. The first of these is a comprehensive literature review, relating pastureland traits to ruminant nutrient requirements and exploring trait estimation methods, from contact to remote sensing methods, including details of vegetation indices and the sensors and techniques required to use them. The second major contribution is a high-level specification of a platform for collecting and labelling pastureland data. This includes the collection of four-channel Blue, Green, Red and NIR (VISNIR) images, narrowband data, height and temperature differential, using inexpensive proximal sensors and provides a basis for holistic data analysis. Physical data platforms built around this specification were created to collect and label pastureland data, involving computer scientists, agricultural, mechanical and electronic engineers, and biologists from academia and industry, working with farmers. Using the developed platform and a set of protocols for data collection, a further contribution of this work was the collection of a multi-sensor multimodal dataset for pastureland properties. This was made up of four-channel image data, height data, thermal data, Global Positioning System (GPS) and hyperspectral data, and is available and labelled with biomass (Kg/Ha) and percentage dry matter, ready for use in deep learning. However, the most notable contribution of this work was a systematic investigation of various machine learning methods applied to the collected data in order to maximise model performance under the constraints indicated above. The initial set of models focused on collected hyperspectral datasets. However, due to their relative complexity in real-time deployment, the focus was instead on models that could best leverage image data. The main body of these models centred on image processing methods and, in particular, the use of the so-called Inception Resnet and MobileNet models to predict fresh biomass and percentage dry matter, enhancing performance using data fusion, transfer learning and multi-task learning. Images were subdivided to augment the dataset, using two different patch sizes, resulting in around 10,000 small patches of size 156 x 156 pixels and around 5,000 large patches of size 240 x 240 pixels. Five-fold cross validation was used in all analysis. Prediction accuracy was compared to older mechanisms, albeit using hyperspectral data collected, with no provision made for lighting, humidity or temperature. Hyperspectral labelled data did not produce accurate results when used to calculate Normalized Difference Vegetation Index (NDVI), or to train a neural network (NN), a 1D Convolutional Neural Network (CNN) or Long Short Term Memory (LSTM) models. Potential reasons for this are discussed, including issues around the use of highly sensitive devices in uncontrolled environments. The most accurate prediction came from a multi-modal hybrid model that concatenated output from an Inception ResNet based model, run on RGB data with ImageNet pre-trained RGB weights, output from a residual network trained on NIR data, and LiDAR height data, before fully connected layers, using the small patch dataset with a minimum validation MAPE of 28.23% for fresh biomass and 11.43% for dryness. However, a very similar prediction accuracy resulted from a model that omitted NIR data, thus requiring fewer sensors and training resources, making it more sustainable. Although NIR and temperature differential data were collected and used for analysis, neither improved prediction accuracy, with the Inception ResNet model’s minimum validation MAPE rising to 39.42% when NIR data was added. When both NIR data and temperature differential were added to a multi-task learning Inception ResNet model, it yielded a minimum validation MAPE of 33.32%. As more labelled data are collected, the models can be further trained, enabling sensors on mowers to collect data and give timely trait information to farmers. This technology is also transferable to other crops. Overall, this work should provide a valuable contribution to the smart agriculture research space

Remote Sensing as a Precision Farming Tool in the Nile Valley, Egypt

Detecting stress in plants resulting from different stressors including nitrogen deficiency, salinity, moisture, contamination and diseases, is crucial in crop production. In the Nile Valley, crop production is hindered perhaps more fundamentally by issues of water supply and salinity. Predicting stress in crops by conventional methods is tedious, laborious and costly and is perhaps unreliable in providing a spatial context of stress patterns. Accurate and quick monitoring techniques for crop status to detect stress in crops at early growth stages are needed to maximize crop productivity. In this context, remotely sensed data may provide a useful tool in precision farming. This research aims to evaluate the role of in situ hyperspectral and high spatial resolution satellite remote sensing data to detect stress in wheat and maize crops and assess whether moisture induced stress can be distinguished from salinity induced stress spectrally. A series of five greenhouse based experiments on wheat and maize were undertaken subjecting both crops to a range of salinity and moisture stress levels. Spectroradiometry measurements were collected at different growth stages of each crop to assess the relationship between crop biophysical and biochemical properties and reflectance measurements from plant canopies. Additionally, high spatial resolution satellite images including two QuickBird, one ASTER and two SPOT HRV were acquired in south-west Alexandria, Egypt to assess the potential of high spectral and spatial resolution satellite imagery to detect stress in wheat and maize at local and regional scales. Two field work visits were conducted in Egypt to collect ground reference data and coupled with Hyperion imagery acquisition, during winter and summer seasons of 2007 in March (8-30: wheat) and July (12-17: maize). Despite efforts, Hyperion imagery was not acquired due to factors out with the control of this research. Strong significant correlations between crop properties and different vegetation indices derived from both ground based and satellite platforms were observed. RDVI showed a sensitive index to different wheat properties (r > 0.90 with different biophysical properties). In maize, GNDVIbr and Cgreen had strong significant correlations with maize biophysical properties (r > 0.80). PCA showed the possibility to distinguish between moisture and salinity induced stress at the grain filling stages. The results further showed that a combined approach of high (2-5 m) and moderate (15-20) spatial resolution satellite imagery can provide a better mechanistic interpretation of the distribution and sources of stress, despite the typical small size of fields (20-50 m scale). QuickBird imagery successfully detects stress within field and local scales, whereas SPOT HRV imagery is useful in detecting stress at a regional scale, and therefore, can be a robust tool in identifying issues of crop management at a regional scale. Due to the limited spectral capabilities of high spatial resolution images, distinguishing different sources of stress is not directly possible, and therefore, hyperspectral satellite imagery (e.g. Hyperion or HyspIRI) is required to distinguish between moisture and salinity induced stress. It is evident from the results that remotely sensed data acquired by both in situ hyperspectral and high spatial resolution satellite remote sensing can be used as a useful tool in precision farming in the Nile Valley, Egypt. A combined approach of using reliable high spatial and spectral satellite remote sensing data could provide better insight about stress at local and regional scales. Using this technique as a precision farming and management tool will lead to improved crop productivity by limiting stress and consequently provide a valuable tool in combating issues of food supply at a time of rapid population growth

Optimizing Plant Water Use Efficiency for a Sustainable Environment

The rising shortage of water resources in crop-producing regions worldwide and the need for irrigation optimisation call for sustainable water savings. The allocation of irrigation water will be an ever-increasing source of pressure because of vast agricultural demands under changing climatic conditions. Consequently, irrigation has to be closely linked with water-use efficiency with the aim of boosting productivity and improving food quality, singularly in those regions where problems of water shortages or collection and delivery are widespread. The present Special Issue (SI) showcases 19 original contributions, addressing water-use efficiency in the context of sustainable irrigation management to meet water scarcity conditions. These papers cover a wide range of subjects including (i) interaction mineral nutrition and irrigation in horticultural crops, (ii) sustainable irrigation in woody fruit crops, (iii) medicinal plants, (iv) industrial crops, and (v) other topics devoted to remote sensing techniques and crop water requirements, genotypes for drought tolerance, and agricultural management. The studies were carried out in both field and laboratory surveys, with modelling studies also being conducted, and a wide range of geographic regions are also covered. The collection of these manuscripts presented in this SI updates on and provides a relevant contribution for efficient saving water resources

Proceedings of the European Conference on Agricultural Engineering AgEng2021

This proceedings book results from the AgEng2021 Agricultural Engineering Conference under auspices of the European Society of Agricultural Engineers, held in an online format based on the University of Évora, Portugal, from 4 to 8 July 2021. This book contains the full papers of a selection of abstracts that were the base for the oral presentations and posters presented at the conference. Presentations were distributed in eleven thematic areas: Artificial Intelligence, data processing and management; Automation, robotics and sensor technology; Circular Economy; Education and Rural development; Energy and bioenergy; Integrated and sustainable Farming systems; New application technologies and mechanisation; Post-harvest technologies; Smart farming / Precision agriculture; Soil, land and water engineering; Sustainable production in Farm buildings