Crop growth and yield monitoring in smallholder agricultural systems:a multi-sensor data fusion approach

Smallholder agricultural systems are highly vulnerable to production risks posed by the intensification of extreme weather events such as drought and flooding, soil degradation, pests, lack of access to agricultural inputs, and political instability. Monitoring the spatial and temporal variability of crop growth and yield is crucial for farm management, national-level food security assessments, and famine early warning. However, agricultural monitoring is difficult in fragmented agricultural landscapes because of scarcity and uncertainty of data to capture small crop fields. Traditional pre- and post-harvest crop monitoring and yield estimation based on fieldwork is costly, slow, and can be unrepresentative of heterogeneous agricultural landscapes as found in smallholder systems in sub-Saharan Africa. Devising accurate and timely crop phenology detection and yield estimation methods can improve our understanding of the status of crop production and food security in these regions.Satellite-based Earth observation (EO) data plays a key role in monitoring the spatial and temporal variability of crop growth and yield over large areas. The small field sizes and variability in management practices in fragmented landscapes requires high spatial and high temporal resolution EO data. This thesis develops and demonstrates methods to investigate the spatiotemporal variability of crop phenology detection and yield estimation using Landsat and MODIS data fusion in smallholder agricultural systems in the Lake Tana sub-basin of Ethiopia. The overall aim is to further broaden the application of multi-sensor EO data for crop growth monitoring in smallholder agricultural systems.The thesis addressed two important aspects of crop monitoring applications of EO data: phenology detection and yield estimation. First, the ESTARFM data fusion workflow was modified based on local knowledge of crop calendars and land cover to improve crop phenology monitoring in fragmented agricultural landscapes. The approach minimized data fusion uncertainties in predicting temporal reflectance change of crops during the growing season and the reflectance value of fused data was comparable to the original Landsat image reserved for validation. The main sources of uncertainty in data fusion are the small field size and abrupt crop growth changes between the base andviiprediction dates due to flooding, weeding, fertiliser application, and harvesting. The improved data fusion approach allowed us to determine crop phenology and estimate LAI more accurately than both the standard ESTARFM data fusion method and when using MODIS data without fusion. We also calibrated and validated a dynamic threshold phenology detection method using maize and rice crop sowing and harvest date information. Crop-specific phenology determined from data fusion minimized the mismatch between EO-derived phenometrics and the actual crop calendar. The study concluded that accurate phenology detection and LAI estimation from Landsat–MODIS data fusion demonstrates the feasibility of crop growth monitoring using multi-sensor data fusion in fragmented and persistently cloudy agricultural landscapes.Subsequently, the validated data fusion and phenology detection methods were implemented to understand crop phenology trends from 2000 to 2020. These trends are often less understood in smallholder agricultural systems due to the lack of high spatial resolution data to distinguish crops from the surrounding natural vegetation. Trends based on Landsat–MODIS fusion were compared with those detected using MODIS alone to assess the contribution of data fusion to discern crop phenometric change. Landsat and MODIS fusion discerned crop and environment-specific trends in the magnitude and direction of crop phenology change. The results underlined the importance of high spatial and temporal resolution EO data to capture environment-specific crop phenology change, which has implications in designing adaptation and crop management practices in these regions.The second important aspect of the crop monitoring problem addressed in this thesis is improving crop yield estimation in smallholder agricultural systems. The large input requirements of crop models and lack of spatial information about the heterogeneous crop-growing environment and agronomic management practices are major challenges to the accurate estimation of crop yield. We assimilated leaf area index (LAI) and phenology information from Landsat–MODIS fusion in a crop model (simple algorithm for yield estimation: SAFY) to obtain reasonably reliable crop yield estimates. The SAFY model is sensitive to the spatial and temporal resolution of the calibration input LAI, phenology information, and the effective light use efficiency (ELUE) parameter, which needs accurate field level inputs during modelviiioptimization. Assimilating fused EO-based phenology information minimized model uncertainty and captured the large management and environmental variation in smallholder agricultural systems.In the final research chapter of the thesis, we analysed the contribution of assimilating LAI at different phenological stages. The frequency and timing of LAI observations influences the retrieval accuracy of the assimilating LAI in crop growth simulation models. The use of (optical) EO data to estimate LAI is constrained by limited repeat frequency and cloud cover, which can reduce yield estimation accuracy. We evaluated the relative contribution of EO observations at different crop growth stages for accurate calibration of crop model parameters. We found that LAI between jointing and grain filling has the highest contribution to SAFY yield estimation and that the distribution of LAI during the key development stages was more useful than the frequency of LAI to improve yield estimation. This information on the optimal timing of EO data assimilation is important to develop better in-season crop yield forecasting in smallholder systems

Neural Radiance Fields: Past, Present, and Future

The various aspects like modeling and interpreting 3D environments and surroundings have enticed humans to progress their research in 3D Computer Vision, Computer Graphics, and Machine Learning. An attempt made by Mildenhall et al in their paper about NeRFs (Neural Radiance Fields) led to a boom in Computer Graphics, Robotics, Computer Vision, and the possible scope of High-Resolution Low Storage Augmented Reality and Virtual Reality-based 3D models have gained traction from res with more than 1000 preprints related to NeRFs published. This paper serves as a bridge for people starting to study these fields by building on the basics of Mathematics, Geometry, Computer Vision, and Computer Graphics to the difficulties encountered in Implicit Representations at the intersection of all these disciplines. This survey provides the history of rendering, Implicit Learning, and NeRFs, the progression of research on NeRFs, and the potential applications and implications of NeRFs in today's world. In doing so, this survey categorizes all the NeRF-related research in terms of the datasets used, objective functions, applications solved, and evaluation criteria for these applications.Comment: 413 pages, 9 figures, 277 citation

Holographic Fourier domain diffuse correlation spectroscopy

Diffuse correlation spectroscopy (DCS) is a non-invasive optical modality which can be used to measure cerebral blood flow (CBF) in real-time. It has important potential applications in clinical monitoring, as well as in neuroscience and the development of a non-invasive brain-computer interface. However, a trade-off exists between the signal-to-noise ratio (SNR) and imaging depth, and thus CBF sensitivity, of this technique. Additionally, as DCS is a diffuse optical technique, it is limited by a lack of inherent depth discrimination within the illuminated region of each source-detector pair, and the CBF signal is therefore also prone to contamination by the extracerebral tissues which the light traverses. Placing a particular emphasis on scalability, affordability, and robustness to ambient light, in this work I demonstrate a novel approach which fuses the fields of digital holography and DCS: holographic Fourier domain DCS (FD-DCS). The mathematical formalism of FD-DCS is derived and validated, followed by the construction and validation (for both in vitro and in vivo experiments) of a holographic FD-DCS instrument. By undertaking a systematic SNR performance assessment and developing a novel multispeckle denoising algorithm, I demonstrate the highest SNR gain reported in the DCS literature to date, achieved using scalable and low-cost camera-based detection. With a view to generating a forward model for holographic FD-DCS, in this thesis I propose a novel framework to simulate statistically accurate time-integrated dynamic speckle patterns in biomedical optics. The solution that I propose to this previously unsolved problem is based on the Karhunen-Loève expansion of the electric field, and I validate this technique against novel expressions for speckle contrast for different forms of homogeneous field. I also show that this method can readily be extended to cases with spatially varying sample properties, and that it can also be used to model optical and acoustic parameters

Sustainable Agriculture and Advances of Remote Sensing (Volume 1)

Agriculture, as the main source of alimentation and the most important economic activity globally, is being affected by the impacts of climate change. To maintain and increase our global food system production, to reduce biodiversity loss and preserve our natural ecosystem, new practices and technologies are required. This book focuses on the latest advances in remote sensing technology and agricultural engineering leading to the sustainable agriculture practices. Earth observation data, in situ and proxy-remote sensing data are the main source of information for monitoring and analyzing agriculture activities. Particular attention is given to earth observation satellites and the Internet of Things for data collection, to multispectral and hyperspectral data analysis using machine learning and deep learning, to WebGIS and the Internet of Things for sharing and publishing the results, among others

Object Association Across Multiple Moving Cameras In Planar Scenes

In this dissertation, we address the problem of object detection and object association across multiple cameras over large areas that are well modeled by planes. We present a unifying probabilistic framework that captures the underlying geometry of planar scenes, and present algorithms to estimate geometric relationships between different cameras, which are subsequently used for co-operative association of objects. We first present a local1 object detection scheme that has three fundamental innovations over existing approaches. First, the model of the intensities of image pixels as independent random variables is challenged and it is asserted that useful correlation exists in intensities of spatially proximal pixels. This correlation is exploited to sustain high levels of detection accuracy in the presence of dynamic scene behavior, nominal misalignments and motion due to parallax. By using a non-parametric density estimation method over a joint domain-range representation of image pixels, complex dependencies between the domain (location) and range (color) are directly modeled. We present a model of the background as a single probability density. Second, temporal persistence is introduced as a detection criterion. Unlike previous approaches to object detection that detect objects by building adaptive models of the background, the foreground is modeled to augment the detection of objects (without explicit tracking), since objects detected in the preceding frame contain substantial evidence for detection in the current frame. Finally, the background and foreground models are used competitively in a MAP-MRF decision framework, stressing spatial context as a condition of detecting interesting objects and the posterior function is maximized efficiently by finding the minimum cut of a capacitated graph. Experimental validation of the method is performed and presented on a diverse set of data. We then address the problem of associating objects across multiple cameras in planar scenes. Since cameras may be moving, there is a possibility of both spatial and temporal non-overlap in the fields of view of the camera. We first address the case where spatial and temporal overlap can be assumed. Since the cameras are moving and often widely separated, direct appearance-based or proximity-based constraints cannot be used. Instead, we exploit geometric constraints on the relationship between the motion of each object across cameras, to test multiple correspondence hypotheses, without assuming any prior calibration information. Here, there are three contributions. First, we present a statistically and geometrically meaningful means of evaluating a hypothesized correspondence between multiple objects in multiple cameras. Second, since multiple cameras exist, ensuring coherency in association, i.e. transitive closure is maintained between more than two cameras, is an essential requirement. To ensure such coherency we pose the problem of object associating across cameras as a k-dimensional matching and use an approximation to find the association. We show that, under appropriate conditions, re-entering objects can also be re-associated to their original labels. Third, we show that as a result of associating objects across the cameras, a concurrent visualization of multiple aerial video streams is possible. Results are shown on a number of real and controlled scenarios with multiple objects observed by multiple cameras, validating our qualitative models. Finally, we present a unifying framework for object association across multiple cameras and for estimating inter-camera homographies between (spatially and temporally) overlapping and non-overlapping cameras, whether they are moving or non-moving. By making use of explicit polynomial models for the kinematics of objects, we present algorithms to estimate inter-frame homographies. Under an appropriate measurement noise model, an EM algorithm is applied for the maximum likelihood estimation of the inter-camera homographies and kinematic parameters. Rather than fit curves locally (in each camera) and match them across views, we present an approach that simultaneously refines the estimates of inter-camera homographies and curve coefficients globally. We demonstrate the efficacy of the approach on a number of real sequences taken from aerial cameras, and report quantitative performance during simulations

Remote Sensing Monitoring of Land Surface Temperature (LST)

This book is a collection of recent developments, methodologies, calibration and validation techniques, and applications of thermal remote sensing data and derived products from UAV-based, aerial, and satellite remote sensing. A set of 15 papers written by a total of 70 authors was selected for this book. The published papers cover a wide range of topics, which can be classified in five groups: algorithms, calibration and validation techniques, improvements in long-term consistency in satellite LST, downscaling of LST, and LST applications and land surface emissivity research

Synergistic optical and microwave remote sensing approaches for soil moisture mapping at high resolution

Aplicat embargament des de la data de defensa fins al dia 1 d'octubre de 2022Soil moisture is an essential climate variable that plays a crucial role linking the Earth’s water, energy, and carbon cycles. It is responsible for the water exchange between the Earth’s surface and the atmosphere, and provides key information about soil evaporation, plant transpiration, and the allocation of precipitation into runoff, surface flow and infiltration. Therefore, an accurate estimation of soil moisture is needed to enhance our current climate and meteorological forecasting skills, and to improve our current understanding of the hydrological cycle and its extremes (e.g., droughts and floods). L-band Microwave passive and active sensors have been used during the last decades to estimate soil moisture, since there is a strong relationship between this variable and the soil dielectric properties. Currently, there are two operational L-band missions specifically devoted to globally measure soil moisture: the ESA’s Soil Moisture and the Ocean Salinity (SMOS), launched in November 2009; and the NASA’s Soil Moisture Active Passive (SMAP), launched in January 2015. The spatial resolution of the SMOS and SMAP radiometers, in the order of tens of kilometers (~40 km), is adequate for global applications. However, to fulfill the needs of a growing number of applications at local or regional scale, higher spatial detail (< 1 km) is required. To bridge this gap and improve the spatial resolution of the soil moisture maps, a variety of spatial enhancement or spatial (sub-pixel) disaggregation approaches have been proposed. This Ph.D. Thesis focuses on the study of the Earth’s surface soil moisture from remotely sensed observations. This work includes the implementation of several soil moisture retrieval techniques and the development, implementation, validation and comparison of different spatial enhancement or downscaling techniques, applied at local, regional, and continental scale. To meet these objectives, synergies between several active/passive microwave sensors (SMOS, SMAP and Sentinel-1) and optical/thermal sensors (MODIS) have been explored. The results are presented as follows: - Spatially consistent downscaling approach for SMOS using an adaptive moving window A passive microwave/optical downscaling algorithm for SMOS is proposed to obtain fine-scale soil moisture maps (1 km) from the native resolution (~40 km) of the instrument. This algorithm introduces the concept of a shape-adaptive window as a central improvement of the disaggregation technique presented by Piles et al. (2014), allowing its application at continental scales. - Assessment of multi-scale SMOS and SMAP soil moisture products across the Iberian Peninsula The temporal and spatial characteristics of SMOS and SMAP soil moisture products at coarse- and fine-scales are assessed in order to learn about their distinct features and the rationale behind them, tracing back to the physical assumptions they are based upon. - Impact of incidence angle diversity on soil moisture retrievals at coarse and fine scales An incidence angle (32.5°, 42.5° and 52.5°)-adaptive calibration of radiative transfer effective parameters single scattering albedo and soil roughness has been carried out, highlighting the importance of such parameterization to accurately estimate soil moisture at coarse-resolution. Then, these parameterizations are used to examine the potential application of a physically-based active-passive downscaling approach to upcoming microwave missions, namely CIMR, ROSE-L and Sentinel-1 Next Generation. Soil moisture maps obtained for the Iberian Peninsula at the three different angles, and at coarse and fine scales are inter-compared using in situ measurements and model data as benchmarks.La humedad del suelo es una variable climática esencial que juega un papel crucial en la relación de los ciclos del agua, la energía y el carbono de la Tierra. Es responsable del intercambio de agua entre la superficie de la Tierra y la atmósfera, y proporciona información crucial sobre la evaporación del suelo, la transpiración de las plantas y la distribución de la precipitación en escorrentía, flujo superficial e infiltración. Por lo tanto, es necesaria una estimación precisa de la humedad del suelo para mejorar las predicciones climáticas y meteorológicas, y comprender mejor el ciclo hidrológico y sus extremos (v.g., sequías e inundaciones). Los sensores pasivos y activos en banda L se han usado durante las últimas décadas para estimar la humedad del suelo debido a la relación directa que existe entre esta variable y las propiedades dieléctricas del suelo. Actualmente, hay dos misiones operativas en banda L específicamente dedicadas a medir la humedad del suelo a escala global: la misión Soil Moisture and Ocean Salinity (SMOS) de la ESA, lanzada en noviembre de 2009; y la misión Soil Moisture Active Passive (SMAP) de la NASA, lanzada en enero de 2015. La resolución espacial de los radiómetros SMOS y SMAP, del orden de unas decenas de kilómetros (~40 km), es adecuada para aplicaciones a escala global. Sin embargo, para satisfacer las necesidades de un número creciente de aplicaciones a escala local o regional, se requiere más detalle espacial (<1 km). Para solventar esta limitación y mejorar la resolución espacial de los mapas de humedad, se han propuesto diferentes técnicas de mejora o desagregación espacial. Esta Tesis se centra en el estudio de la humedad de la superficie terrestre a partir de datos obtenidos a través de teledetección. Este trabajo incluye la implementación de distintos algoritmos de recuperación de la humedad del suelo y el desarrollo, implementación, validación y comparación de distintas técnicas de desagregación, aplicadas a escala local, regional y continental. Para cumplir estos objetivos, se han explorado sinergias entre diferentes sensores de microondas activos/pasivos (SMOS, SMAP y Sentinel-1) y sensores ópticos/térmicos. Los resultados se presentan de la siguiente manera: - Técnica de desagregación espacialmente consistente, basada en una ventana móvil adaptativa, aplicada a los datos SMOS Se propone un algoritmo de desagregación del píxel basado en datos obtenidos de medidas radiométricas de microondas en banda L y datos ópticos, para mejorar la resolución espacial de los mapas de humedad del suelo desde la resolución nativa del instrumento (~40 km) hasta resoluciones de 1 km. El algoritmo introduce el concepto de una ventana de contorno adaptativo, como mejora principal sobre la técnica de desagregación presentada en Piles et al. (2014), permitiendo su implementación a escala continental. - Análisis multiescalar de productos de humedad del suelo SMAP y SMOS sobre la Península Ibérica Se han evaluado las características temporales y espaciales de distintos productos de humedad del suelo SMOS y SMAP, a baja y a alta resolución, para conocer sus características distintivas y comprender las razones de sus diferencias. Para ello, ha sido necesario rastrear los supuestos físicos en los que se basan. - Impacto del ángulo de incidencia en la recuperación de la humedad del suelo a baja y a alta resolución Se ha llevado a cabo una calibración adaptada al ángulo de incidencia (32.5°, 42.5° y 52.5°) de los parámetros efectivos, albedo de dispersión simple y rugosidad del suelo, descritos en el modelo de transferencia radiativa � − �, incidiendo en la importancia de esta parametrización para estimar la humedad del suelo de forma precisa a baja resolución. El resultado de las mismas se ha utilizado para estudiar la potencial aplicación de un algoritmo activo/pasivo de desagregación basado en la física para las próximas misiones de microondas, llamadas CIMR, ROSE-L y Sentinel-1 Next Generation. Los mapas de humedad recuperados a los tres ángulos de incidencia, tanto a baja como a alta resolución, se han obtenido para la Península Ibérica y se han comparado entre ellos usando como referencia mediciones de humedad in situ.Postprint (published version