Improving hydrologic modeling of runoff processes using data-driven models

2021 Spring.Includes bibliographical references.Accurate rainfall–runoff simulation is essential for responding to natural disasters, such as floods and droughts, and for proper water resources management in a wide variety of fields, including hydrology, agriculture, and environmental studies. A hydrologic model aims to analyze the nonlinear and complex relationship between rainfall and runoff based on empirical equations and multiple parameters. To obtain reliable results of runoff simulations, it is necessary to consider three tasks, namely, reasonably diagnosing the modeling performance, managing the uncertainties in the modeling outcome, and simulating runoff considering various conditions. Recently, with the advancement of computing systems, technology, resources, and information, data-driven models are widely used in various fields such as language translation, image classification, and time-series analysis. In addition, as spatial and temporal resolutions of observations are improved, the applicability of data-driven models, which require massive amounts of datasets, is rapidly increasing. In hydrology, rainfall–runoff simulation requires various datasets including meteorological, topographical, and soil properties with multiple time steps from sub-hourly to monthly. This research investigates whether data-driven approaches can be effectively applied for runoff analysis. In particular, this research aims to explore if data-driven models can 1) reasonably evaluate hydrologic models, 2) improve the modeling performance, and 3) predict hourly runoff using distributed forcing datasets. The details of these three research aspects are as follows: First, this research developed a hydrologic assessment tool using a hybrid framework, which combines two data-driven models, to evaluate the performance of a hydrologic model for runoff simulation. The National Water Model, which is a fully distributed hydrologic model, was used as the physical-based model. The developed assessment tool aims to provide easy-to-understand performance ratings for the simulated hydrograph components, namely, the rising and recession limbs, as well as for the entire hydrograph, against observed runoff data. In this research, four performance ratings were used. This is the first research that tries to apply data-driven models for evaluating the performance of the National Water Model and the results are expected to reasonably diagnose the model's ability for runoff simulations based on a short-term time step. Second, correction of errors inherent in the predicted runoff is essential for efficient water management. Hydrologic models include various parameters that cannot be measured directly, but they can be adjusted to improve the predictive performance. However, even a calibrated model still has obvious errors in predicting runoff. In this research, a data-driven model was applied to correct errors in the predicted runoff from the National Water Model and improve its predictive performance. The proposed method uses historic errors in runoff to predict new errors as a post-processor. This research shows that data-driven models, which can build algorithms based on the relationships between datasets, have strong potential for correcting errors and improving the predictive performance of hydrologic models. Finally, to simulate rainfall-runoff accurately, it is essential to consider various factors such as precipitation, soil property, and runoff coming from upstream regions. With improvements in observation systems and resources, various types of forcing datasets, including remote-sensing based data and data-assimilation system products, are available for hydrologic analysis. In this research, various data-driven models with distributed forcing datasets were applied to perform hourly runoff predictions. The forcing datasets included different hydrologic factors such as soil moisture, precipitation, land surface temperature, and base flow, which were obtained from a data assimilation system. The predicted results were evaluated in terms of seasonal and event-based performances and compared with those of the National Water Model. The results demonstrated that data-driven models for hourly runoff forecasting are effective and useful for short-term runoff prediction and developing flood warning system during wet season

Ensemble evaluation of hydrological model hypotheses

It is demonstrated for the first time how model parameter, structural and data uncertainties can be accounted for explicitly and simultaneously within the Generalized Likelihood Uncertainty Estimation (GLUE) methodology. As an example application, 72 variants of a single soil moisture accounting store are tested as simplified hypotheses of runoff generation at six experimental grassland field-scale lysimeters through model rejection and a novel diagnostic scheme. The fields, designed as replicates, exhibit different hydrological behaviors which yield different model performances. For fields with low initial discharge levels at the beginning of events, the conceptual stores considered reach their limit of applicability. Conversely, one of the fields yielding more discharge than the others, but having larger data gaps, allows for greater flexibility in the choice of model structures. As a model learning exercise, the study points to a “leaking” of the fields not evident from previous field experiments. It is discussed how understanding observational uncertainties and incorporating these into model diagnostics can help appreciate the scale of model structural error

A New Soil Conservation Methodology and Application to Cropping Systems in Tropical Steeplands: A comparative synthesis of results obtained in ACIAR Project PN 9201

Land Economics/Use,

Flood Forecasting Using Machine Learning Methods

This book is a printed edition of the Special Issue Flood Forecasting Using Machine Learning Methods that was published in Wate

Including spatial distribution in a data-driven rainfall-runoff model to improve reservoir inflow forecasting in Taiwan

Multi-step ahead inflow forecasting has a critical role to play in reservoir operation and management in Taiwan during typhoons as statutory legislation requires a minimum of 3-hours warning to be issued before any reservoir releases are made. However, the complex spatial and temporal heterogeneity of typhoon rainfall, coupled with a remote and mountainous physiographic context makes the development of real-time rainfall-runoff models that can accurately predict reservoir inflow several hours ahead of time challenging. Consequently, there is an urgent, operational requirement for models that can enhance reservoir inflow prediction at forecast horizons of more than 3-hours. In this paper we develop a novel semi-distributed, data-driven, rainfall-runoff model for the Shihmen catchment, north Taiwan. A suite of Adaptive Network-based Fuzzy Inference System solutions is created using various combinations of auto-regressive, spatially-lumped radar and point-based rain gauge predictors. Different levels of spatially-aggregated radar-derived rainfall data are used to generate 4, 8 and 12 sub-catchment input drivers. In general, the semi-distributed radar rainfall models outperform their less complex counterparts in predictions of reservoir inflow at lead-times greater than 3-hours. Performance is found to be optimal when spatial aggregation is restricted to 4 sub-catchments, with up to 30% improvements in the performance over lumped and point-based models being evident at 5-hour lead times. The potential benefits of applying semi-distributed, data-driven models in reservoir inflow modelling specifically, and hydrological modelling more generally, is thus demonstrated

Comparison of Three Intelligent Techniques for Runoff Simulation

In this study, performance of a feedback neural network, Elman, is evaluated for runoff simulation. The model ability is compared with two other intelligent models namely, standalone feedforward Multi-layer Perceptron (MLP) neural network model and hybrid Adaptive Neuro-Fuzzy Inference System (ANFIS) model. In this case, daily runoff data during monsoon period in a catchment located at south India were collected. Three statistical criteria, correlation coefficient, coefficient of efficiency and the difference of slope of a best-fit line from observed-estimated scatter plots to 1:1 line, were applied for comparing the performances of the models. The results showed that ANFIS technique provided significant improvement as compared to Elman and MLP models. ANFIS could be an efficient alternative to artificial neural networks, a computationally intensive method, for runoff predictions providing at least comparable accuracy. Comparing two neural networks indicated that, unexpectedly, Elman technique has high ability than MLP, which is a powerful model in simulation of hydrological processes, in runoff modeling

Applications of remote sensing to hydrologic planning

The transfer of LANDSAT remote sensing technology from the research sector to user operational applications requires demonstration of the utility and accuracy of LANDSAT data in solving real problems. This report describes such a demonstration project in the area of water resources, specifically the estimation of non-point source pollutant loads. Non-point source pollutants were estimated from land cover data from LANDSAT images. Classification accuracies for three small watersheds were above 95%. Land cover was converted to pollutant loads for a fourth watershed through the use of coefficients relating significant pollutants to land use and storm runoff volume. These data were input into a simulator model which simulated runoff from average rainfall. The result was the estimation of monthly expected pollutant loads for the 17 subbasins comprising the Magothy watershed

Advanced Remote Sensing Precipitation Input for Improved Runoff Simulation : Local to regional scale modelling

Accurate precipitation data are crucial for hydrological modelling and rainwater runoff management. Precipitation variability exists through a wide range of spatial and temporal scales and cannot be captured well using sparse rain gauge networks. This limitation is further emphasised for urban and mountainous catchments, especially under global warming, causing an increased frequency of extreme events. Recent advances in remote sensing (RS) techniques make monitoring precipitation possible over larger areas at more regular resolutions than conventional rain gauge networks. The RS data can be biased mainly due to the indirect estimations prone to multiple error sources and temporally discrete observations. The wealth of spatiotemporal precipitation data by RS, however, calls for developing data-driven solutions for both the bias correction and hydrological modelling that, in turn, requires new procedures to assure generalization of the existing methods. The present dissertation comprises a comprehensive summary followed by five appended papers, attempting to evaluate quantitative precipitation estimations (QPE) by state-of-the-art instruments/products for local and regional hydrological applications. Accordingly, two recently installed dual polarimetric doppler X-band weather radars (X-WRs) in southern Sweden and multiple Global Precipitation Mission (GPM) products in Iran were studied at the relevant scales for urban hydrology (1–5-min and sub-km) and large water supply river–reservoir system operation (daily-monthly and 0.1°), respectively. The validation against rain gauge observations (Paper I and II) showed a significant dependency of the X-WR and GPM precipitation errors on the radial distance and regional precipitation pattern, respectively. Taking observations from local tipping bucket rain gauges at the 1–30-km ranges as a reference, the apparent problems with a single X-WR is related to the attenuation during heavy rains and overshooting (at higher elevation angle scans). An internationally bias-corrected GPM product called GPM-IMERG-Final shows a generally good correlation to synoptic observations of over 300 rain gauges in Iran except for extreme observations that are much better predicted by the GPM-IMERG Late product during spring, summer, and autumn seasons. To leverage the wealth of spatiotemporally complete and validated precipitation data for hydrological modelling, two novel data-driven procedures using artificial neural networks (ANNs) were developed. As in Paper III, the formulation of the new ANN input variables, namely, ECOVs and CCOVs, representing the event- and catchment-specific areal precipitation coverage ratios, improve monthly runoff estimations in all the studied sub-catchments of the Karkheh River basin (KRB) in the mountainous semi-arid climate of western Iran. Merging the doppler and dual-polarization data in the overlapping coverage of the two XWRs (Paper IV) via an ANN-based QPE improves rainfall detection and accuracy. ANN-assisted estimation of rainfall quantiles, compared to the merging with an empirically based regression model, also shows better results especially related to the extreme 5-min data. Finally, Paper V describes the impact of human activities such as agricultural developments that can equally affect the runoff variation. This fact is considered in Paper III by including MODIS Terra products as additional inputs

River flow forecasting using an integrated approach of wavelet multi-resolution analysis and computational intelligence techniques

In this research an attempt is made to develop highly accurate river flow forecasting models. Wavelet multi-resolution analysis is applied in conjunction with artificial neural networks and adaptive neuro-fuzzy inference system. Various types and structure of computational intelligence models are developed and applied on four different rivers in Australia. Research outcomes indicate that forecasting reliability is significantly improved by applying proposed hybrid models, especially for longer lead time and peak values

Leveraging Crowdsourced Navigation Data In Roadway Pluvial Flash Flood Prediction

This dissertation develops and tests a new data-driven framework for short-term roadway pluvial flash flood (PFF) risk estimation at the scale of road segments using crowdsourced navigation data and a simplified physics-based PFF model. Pluvial flash flooding (PFF) is defined as localized floods caused by an overwhelmed natural or engineered drainage system. This study develops a data curation and computational framework for data collection, preprocessing, and modeling to estimate the risk of PFF at road-segment scales. A hybrid approach is also developed that couples a statistical model and a simplified physics-based simulation model in a machine learning (ML) model to rapidly predict the risk of roadway PFF using Waze alerts in real-time