Towards Smart Big Weather Data Management

Smart management of weather data is pivotal to achieving sustainable agriculture since weather monitoring is linked to crop water requirement estimation and consequently to efficient irrigation systems. Advances in technologies such as remote sensing and the Internet of Things (IoT) have led to the generation of this data with a high temporal resolution which requires adequate infrastructure and processing tools to gain insights from it. To this end, this paper presents a smart weather data management system composed of three layers: the data acquisition layer, the data storage layer, and the application layer. The data can be sourced from station sensors, real-time IoT sensors, third-party services (APIs), or manually imported from files. It is then checked for errors and missing values before being stored using the distributed database MongoDB. The platform provides various services related to weather data: (i) forecast univariate weather time series, (ii) perform advanced analysis and visualization, (iii) use machine learning to estimate and model important climatic parameters such as the reference evapotranspiration (ET0) estimation using the XGBoost model (R2 = 0.96 and RMSE = 0.39). As part of a test phase, the system uses data from a meteorological station installed in the study area in Morocco

Irrigation Amounts and Timing Retrieval through Data Assimilation of Surface Soil Moisture into the FAO-56 Approach in the South Mediterranean Region

International audienceAgricultural water use represents more than 70% of the world’s freshwater through irrigation water inputs that are poorly known at the field scale. Irrigation monitoring is thus an important issue for optimizing water use in particular with regards to the water scarcity that the semi-arid regions are already facing. In this context, the aim of this study is to develop and evaluate a new approach to predict seasonal to daily irrigation timing and amounts at the field scale. The method is based on surface soil moisture (SSM) data assimilated into a simple land surface (FAO-56) model through a particle filter technique based on an ensemble of irrigation scenarios. The approach is implemented in three steps. First, synthetic experiments are designed to assess the impact of the frequency of observation, the errors on SSM and the a priori constraints on the irrigation scenarios for different irrigation techniques (flooding and drip). In a second step, the method is evaluated using in situ SSM measurements with different revisit times (3, 6 and 12 days) to mimic the available SSM product derived from remote sensing observation. Finally, SSM estimates from Sentinel-1 are used. Data are collected on different wheat fields grown in Morocco, for both flood and drip irrigation techniques in addition to rainfed fields used for an indirect evaluation of the method performance. Using in situ data, accurate results are obtained. With an observation every 6 days to mimic the Sentinel-1 revisit time, the seasonal amounts are retrieved with R > 0.98, RMSE < 32 mm and bias < 2.5 mm. Likewise, a good agreement is observed at the daily scale for flood irrigation as more than 70% of the detected irrigation events have a time difference from actual irrigation events shorter than 4 days. Over the drip irrigated fields, the statistical metrics are R = 0.74, RMSE = 24.8 mm and bias = 2.3 mm for irrigation amounts cumulated over 15 days. When using SSM products derived from Sentinel-1 data, the statistical metrics on 15-day cumulated amounts slightly dropped to R = 0.64, RMSE = 28.7 mm and bias = 1.9 mm. The metrics on the seasonal amount retrievals are close to assimilating in situ observations with R = 0.99, RMSE = 33.5 mm and bias = −18.8 mm. Finally, among four rainfed seasons, only one false event was detected. This study opens perspectives for the regional retrieval of irrigation amounts and timing at the field scale and for mapping irrigated/non irrigated area

Hydro Statistical Assessment of TRMM and GPM Precipitation Products against Ground Precipitation over a Mediterranean Mountainous Watershed (in the Moroccan High Atlas)

[EN] The tropical Rainfall Measuring Mission TRMM 3B42 V7 product and its successor, the Global Precipitation Measurement Integrated Multi-satellitE Retrievals for GPM IMERG high-resolution product GPM IMERG V5, have been validated against rain gauges precipitation in an arid mountainous basin where ground-based observations of precipitation are sparse, or spatially undistributed. This paper aims to evaluate hydro-statically the performances of the TRMM 3B42 V7 and GPM IMERG V05 satellite precipitations products SPPs, at multiple temporal scales, from 2014 to 2017. SPPs are compared with the gauge station and show good results for both statistical and contingency metrics with notable values R > 0.94. Moreover, the rainfall-runoff events implemented on the hydrological model were performed at 3-hourly time steps and showed satisfactory results based on the obtained Nash–Sutcliffe criteria ranging from 94.50% to 57.50%, and from 89.3% to 51.2%, respectively. The TRMM product tends to underestimate and not capture extreme precipitation events. In contrast, the GPM product can identify the variability of precipitation at small time steps, although a slight underestimation in the detection of extreme events can be corrected during the validation steps. The proposed method is an interesting approach for solving the problem of insufficient observed data in the Mediterranean regions.This research was supported by the projects: ERANETMED3-062 CHAAMS Global Change: Assessment and Adaptation to Mediterranean Region Water Scarcity and PRIMA-S2-ALTOS-2018 Managing water resources within Mediterranean agrosystems by accounting for spatial structures and connectivities.Peer reviewe

Hydro Statistical Assessment of TRMM and GPM Precipitation Products against Ground Precipitation over a Mediterranean Mountainous Watershed (in the Moroccan High Atlas)

The tropical Rainfall Measuring Mission TRMM 3B42 V7 product and its successor, the Global Precipitation Measurement Integrated Multi-satellitE Retrievals for GPM IMERG high-resolution product GPM IMERG V5, have been validated against rain gauges precipitation in an arid mountainous basin where ground-based observations of precipitation are sparse, or spatially undistributed. This paper aims to evaluate hydro-statically the performances of the TRMM 3B42 V7 and GPM IMERG V05 satellite precipitations products SPPs, at multiple temporal scales, from 2014 to 2017. SPPs are compared with the gauge station and show good results for both statistical and contingency metrics with notable values R &gt; 0.94. Moreover, the rainfall-runoff events implemented on the hydrological model were performed at 3-hourly time steps and showed satisfactory results based on the obtained Nash&ndash;Sutcliffe criteria ranging from 94.50% to 57.50%, and from 89.3% to 51.2%, respectively. The TRMM product tends to underestimate and not capture extreme precipitation events. In contrast, the GPM product can identify the variability of precipitation at small time steps, although a slight underestimation in the detection of extreme events can be corrected during the validation steps. The proposed method is an interesting approach for solving the problem of insufficient observed data in the Mediterranean regions

Smart Weather Data Management Based on Artificial Intelligence and Big Data Analytics for Precision Agriculture

Smart management of weather data is an essential step toward implementing sustainability and precision in agriculture. It represents an important input for numerous tasks, such as crop growth, development, yield, and irrigation scheduling, to name a few. Advances in technology allow collecting this weather data from heterogeneous sources with high temporal resolution and at low cost. Generating and using these data in their raw form makes no sense, and therefore implementing adequate infrastructure and tools is necessary. For that purpose, this paper presents a smart weather data management system evaluated using data from a meteorological station installed in our study area covering the period from 2013 to 2020 at a half-hourly scale. The proposed system makes use of state-of-the-art statistical methods, machine learning, and deep learning models to derive actionable insights from these raw data. The general architecture is made up of four layers: data acquisition, data storage, data processing, and application layers. The data sources include real-time sensors, IoT devices, reanalysis data, and raw files. The data are then checked for errors and missing values using a proposed method based on ERA5-Land reanalysis data and deep learning. The resulting coefficient of determination (R2) and Root Mean Squared Error (RMSE) for this method were 0.96 and 0.04, respectively, for the scaled air temperature estimate. The MongoDB NoSQL database is used for storage thanks to its ability to deal with real-world big data. The system offers various services such as (i) weather time series forecasts, (ii) visualization and analysis of meteorological data, and (iii) the use of machine learning to estimate the reference evapotranspiration (ET0) needed for efficient irrigation. To this, the platform uses the XGBoost model to achieve the precision of the Penman–Monteith method while using a limited number of meteorological variables (air temperature and global solar radiation). Results for this approach give R2 = 0.97 and RMSE = 0.07. This system represents the first incremental step toward implementing smart and sustainable agriculture in Morocco

Evaluation and analysis of deep percolation losses of drip irrigated citrus crops under non-saline and saline conditions in a semi-arid area

International audienceIn arid and semi-arid regions, irrigation management is important to avoid water loss by soil evaporation and deep percolation (DP). In this context, estimating the irrigation water demand has been investigated by many studies in the Haouz plain. However, DP losses beneath irrigated areas in the plain have not been quantified. To fill the gap, this study evaluated DP over two drip-irrigated citrus orchards (Agafay and Saada) using both water balance and direct fluxmeter measurement methods, and explored the simple FAO-56 approach to optimise irrigation in order to both avoid crop water stress and reduce DP losses in case of non-saline and saline soils. The experimental measurements determined different terms of the water balance by using an Eddy-Covariance system, fluxmeter, soil moisture sensors and a meteorological station. Using the water balance equation and fluxmeter measurements, results showed that about 37% and 45% of supplied water was lost by DP in Saada and Agafay sites, respectively. The main cause of DP losses was the mismatch between irrigation and the real crop water requirement. For Agafay site, it was found that increased over-irrigation had the effect of reducing soil salinity by leaching salts.The applied FAO-56 model suggested an optimal irrigation scheduling by taking into account both rainfall and soil salinity. The recommended irrigations could save about 39% of supplied water in non-saline soil at Saada and from 30% to 47% in saline soil at Agafay

Projection of irrigation water demand based on the simulation of synthetic crop coefficients and climate change

International audienceAbstract. In the context of major changes (climate, demography, economy, etc.), the southern Mediterranean area faces serious challenges with intrinsically low, irregular, and continuously decreasing water resources. In some regions, the proper growth both in terms of cropping density and surface area of irrigated areas is so significant that it needs to be included in future scenarios. A method for estimating the future evolution of irrigation water requirements is proposed and tested in the Tensift watershed, Morocco. Monthly synthetic crop coefficients (Kc) of the different irrigated areas were obtained from a time series of remote sensing observations. An empirical model using the synthetic Kc and rainfall was developed and fitted to the actual data for each of the different irrigated areas within the study area. The model consists of a system of equations that takes into account the monthly trend of Kc, the impact of yearly rainfall, and the saturation of Kc due to the presence of tree crops. The impact of precipitation change is included in the Kc estimate and the water budget. The anthropogenic impact is included in the equations for Kc. The impact of temperature change is only included in the reference evapotranspiration, with no impact on the Kc cycle. The model appears to be reliable with an average r2 of 0.69 for the observation period (2000–2016). However, different subsampling tests of the number of calibration years showed that the performance is degraded when the size of the training dataset is reduced. When subsampling the training dataset to one-third of the 16 available years, r2 was reduced to 0.45. This score has been interpreted as the level of reliability that could be expected for two time periods after the full training years (thus near to 2050). The model has been used to reinterpret a local water management plan and to incorporate two downscaled climate change scenarios (RCP4.5 and RCP8.5). The examination of irrigation water requirements until 2050 revealed that the difference between the two climate scenarios was very small (< 2 %), while the two agricultural scenarios were strongly contrasted both spatially and in terms of their impact on water resources. The approach is generic and can be refined by incorporating irrigation efficiencies

Optimizing the Sowing Date to Improve Water Management and Wheat Yield in a Large Irrigation Scheme, through a Remote Sensing and an Evolution Strategy-Based Approach

This study aims to investigate the effects of an optimized sowing calendar for wheat over a surface irrigation scheme in the semi-arid region of Haouz (Morocco) on irrigation water requirements, crop growth and development and on yield. For that, a scenario-based simulation approach based on the covariance matrix adaptation–evolution strategy (CMA-ES) was proposed to optimize both the spatiotemporal distribution of sowing dates and the irrigation schedules, and then evaluate wheat crop using the 2011–2012 growing season dataset. Six sowing scenarios were simulated and compared to identify the most optimal spatiotemporal sowing calendar. The obtained results showed that with reference to the existing sowing patterns, early sowing of wheat leads to higher yields compared to late sowing (from 7.40 to 5.32 t/ha). Compared with actual conditions in the study area, the spatial heterogeneity is highly reduced, which increased equity between farmers. The results also showed that the proportion of plots irrigated in time can be increased (from 40% to 82%) compared to both the actual irrigation schedules and to previous results of irrigation optimization, which did not take into consideration sowing dates optimization. Furthermore, considerable reduction of more than 40% of applied irrigation water can be achieved by optimizing sowing dates. Thus, the proposed approach in this study is relevant for irrigation managers and farmers since it provides an insight on the consequences of their agricultural practices regarding the wheat sowing calendar and irrigation scheduling and can be implemented to recommend the best practices to adopt

Assessing Irrigation Water Use with Remote Sensing-Based Soil Water Balance at an Irrigation Scheme Level in a Semi-Arid Region of Morocco

International audienceThis study aims to evaluate a remote sensing-based approach to allow estimation of the temporal and spatial distribution of crop evapotranspiration (ET) and irrigation water requirements over irrigated areas in semi-arid regions. The method is based on the daily step FAO-56 Soil Water Balance model combined with a time series of basal crop coefficients and the fractional vegetation cover derived from high-resolution satellite Normalized Difference Vegetation Index (NDVI) imagery. The model was first calibrated and validated at plot scale using ET measured by eddy-covariance systems over wheat fields and olive orchards representing the main crops grown in the study area of the Haouz plain (central Morocco). The results showed that the model provided good estimates of ET for wheat and olive trees with a root mean square error (RMSE) of about 0.56 and 0.54 mm/day respectively. The model was then used to compare remotely sensed estimates of irrigation requirements (RS-IWR) and irrigation water supplied (WS) at plot scale over an irrigation district in the Haouz plain through three growing seasons. The comparison indicated a large spatio-temporal variability in irrigation water demands and supplies; the median values of WS and RS-IWR were 130 (175), 117 (175) and 118 (112) mm respectively in the 2002–2003, 2005–2006 and 2008–2009 seasons. This could be attributed to inadequate irrigation supply and/or to farmers’ socio-economic considerations and management practices. The findings demonstrate the potential for irrigation managers to use remote sensing-based models to monitor irrigation water usage for efficient and sustainable use of water resources