Bluecat: A Local Uncertainty Estimator for Deterministic Simulations and Predictions

We present a new method for simulating and predicting hydrologic variables with uncertainty assessment and provide example applications to river flows. The method is identified with the acronym “Bluecat” and is based on the use of a deterministic model which is subsequently converted to a stochastic formulation. The latter provides an adjustment on statistical basis of the deterministic prediction along with its confidence limits. The distinguishing features of the proposed approach are the ability to infer the probability distribution of the prediction without requiring strong hypotheses on the statistical characterization of the prediction error (e.g., normality, homoscedasticity), and its transparent and intuitive use of the observations. Bluecat makes use of a rigorous theory to estimate the probability distribution of the predictand conditioned by the deterministic model output, by inferring the conditional statistics of observations. Therefore Bluecat bridges the gaps between deterministic (possibly physically based, or deep learning-based) and stochastic models, as well as between rigorous theory and transparent use of data with an innovative and user oriented approach. We present two examples of application to the case studies of the Arno river at Subbiano and Sieve river at Fornacina. The results confirm the distinguishing features of the method along with its technical soundness. We provide an open software working in the R environment, along with help facilities and detailed instructions to reproduce the case studies presented here

Climate Extrapolations in Hydrology: The Expanded Bluecat Methodology

Bluecat is a recently proposed methodology to upgrade a deterministic model (D-model) into a stochastic one (S-model), based on the hypothesis that the information contained in a time series of observations and the concurrent predictions made by the D-model is sufficient to support this upgrade. The prominent characteristics of the methodology are its simplicity and transparency, which allow its easy use in practical applications, without sophisticated computational means. In this paper, we utilize the Bluecat methodology and expand it in order to be combined with climate model outputs, which often require extrapolation out of the range of values covered by observations. We apply the expanded methodology to the precipitation and temperature processes in a large area, namely the entire territory of Italy. The results showcase the appropriateness of the method for hydroclimatic studies, as regards the assessment of the performance of the climate projections, as well as their stochastic conversion with simultaneous bias correction and uncertainty quantification

KNN vs. Bluecat—Machine Learning vs. Classical Statistics

Uncertainty is inherent in the modelling of any physical processes. Regarding hydrological modelling, the uncertainty has multiple sources including the measurement errors of the stresses (the model inputs), the measurement errors of the hydrological process of interest (the observations against which the model is calibrated), the model limitations, etc. The typical techniques to assess this uncertainty (e.g., Monte Carlo simulation) are computationally expensive and require specific preparations for each individual application (e.g., selection of appropriate probability distribution). Recently, data-driven methods have been suggested that attempt to estimate the uncertainty of a model simulation based exclusively on the available data. In this study, two data-driven methods were employed, one based on machine learning techniques, and one based on statistical approaches. These methods were tested in two real-world case studies to obtain conclusions regarding their reliability. Furthermore, the flexibility of the machine learning method allowed assessing more complex sampling schemes for the data-driven estimation of the uncertainty. The anatomisation of the algorithmic background of the two methods revealed similarities between them, with the background of the statistical method being more theoretically robust. Nevertheless, the results from the case studies indicated that both methods perform equivalently well. For this reason, data-driven methods can become a valuable tool for practitioners

A large sample analysis of European rivers on seasonal river flow correlation and its physical drivers

The geophysical and hydrological processes governing river flow formation exhibit persistence at several timescales, which may manifest itself with the presence of positive seasonal correlation of streamflow at several different time lags. We investigate here how persistence propagates along subsequent seasons and affects low and high flows. We define the high-flow season (HFS) and the low-flow season (LFS) as the 3-month and the 1-month periods which usually exhibit the higher and lower river flows, respectively. A dataset of 224 rivers from six European countries spanning more than 50 years of daily flow data is exploited. We compute the lagged seasonal correlation between selected river flow signatures, in HFS and LFS, and the average river flow in the antecedent months. Signatures are peak and average river flow for HFS and LFS, respectively. We investigate the links between seasonal streamflow correlation and various physiographic catchment characteristics and hydro-climatic properties. We find persistence to be more intense for LFS signatures than HFS. To exploit the seasonal correlation in the frequency estimation of high and low flows, we fit a bi-variate meta-Gaussian probability distribution to the selected flow signatures and average flow in the antecedent months in order to condition the distribution of high and low flows in the HFS and LFS, respectively, upon river flow observations in the previous months. The benefit of the suggested methodology is demonstrated by updating the frequency distribution of high and low flows one season in advance in a real-world case. Our findings suggest that there is a traceable physical basis for river memory which, in turn, can be statistically assimilated into high- and low-flow frequency estimation to reduce uncertainty and improve predictions for technical purposes

HESS Opinions: "Climate, hydrology, energy, water: recognizing uncertainty and seeking sustainability"

Since 1990 extensive funds have been spent on research in climate change. Although Earth Sciences, including climatology and hydrology, have benefited significantly, progress has proved incommensurate with the effort and funds, perhaps because these disciplines were perceived as “tools” subservient to the needs of the climate change enterprise rather than autonomous sciences. At the same time, research was misleadingly focused more on the “symptom”, i.e. the emission of greenhouse gases, than on the “illness”, i.e. the unsustainability of fossil fuel-based energy production. Unless energy saving and use of renewable resources become the norm, there is a real risk of severe socioeconomic crisis in the not-too-distant future. A framework for drastic paradigm change is needed, in which water plays a central role, due to its unique link to all forms of renewable energy, from production (hydro and wave power) to storage (for time-varying wind and solar sources), to biofuel production (irrigation). The extended role of water should be considered in parallel to its other uses, domestic, agricultural and industrial. Hydrology, the science of water on Earth, must move towards this new paradigm by radically rethinking its fundamentals, which are unjustifiably trapped in the 19thcentury myths of deterministic theories and the zeal to eliminate uncertainty. Guidance is offered by modern statistical and quantum physics, which reveal the intrinsic character of uncertainty/entropy in nature, thus advancing towards a new understanding and modelling of physical processes, which is central to the effective use of renewable energy and water resources

Resolving conflicting objectives in the management of the Plastiras Lake: Can we quantify beauty?

The possible water management of the Plastiras Lake, an artificial reservoir in central Greece, is examined. The lake and surrounding landscape are aesthetically degraded when the water level drops, and the requirement of maintaining a high quality of the scenery constitutes one of the several conflicting water uses, the other ones being irrigation, water supply, and power production. This environmental water use, and, to a lesser extent, the requirement for adequate water quality, results in constraining the annual release. Thus, the allowed fluctuation of reservoir stage is not defined by the physical and technical characteristics of the reservoir, but by a multi-criteria decision, the three criteria being maximising water release, ensuring adequate water quality, and maintaining a high quality of the natural landscape. Each of these criteria is analyzed separately. The results are then put together in a multicriterion tableau, which helps understand the implications of the possible alternative decisions. Several conflict resolution methods are overviewed, namely willingness to pay, hedonic prices, and multi-criteria decision analysis. All these methods attempt to quantify non-quantifiable qualities, and it is concluded that they don't necessarily offer any advantage over merely making a choice based on understanding

Climate-informed stochastic hydrological modeling: Incorporating decadal-scale variability using paleo data

A hierarchical framework for incorporating modes of climate variability into stochastic simulations of hydrological data is developed, termed the climate-informed multi-time scale stochastic (CIMSS) framework. A case study on two catchments in eastern Australia illustrates this framework. To develop an identifiable model characterizing long-term variability for the first level of the hierarchy, paleoclimate proxies, and instrumental indices describing the Interdecadal Pacific Oscillation (IPO) and the Pacific Decadal Oscillation (PDO) are analyzed. A new paleo IPO-PDO time series dating back 440 yr is produced, combining seven IPO-PDO paleo sources using an objective smoothing procedure to fit low-pass filters to individual records. The paleo data analysis indicates that wet/dry IPO-PDO states have a broad range of run lengths, with 90% between 3 and 33 yr and a mean of 15 yr. The Markov chain model, previously used to simulate oscillating wet/dry climate states, is found to underestimate the probability of wet/dry periods >5 yr, and is rejected in favor of a gamma distribution for simulating the run lengths of the wet/dry IPO-PDO states. For the second level of the hierarchy, a seasonal rainfall model is conditioned on the simulated IPO-PDO state. The model is able to replicate observed statistics such as seasonal and multiyear accumulated rainfall distributions and interannual autocorrelations. Mean seasonal rainfall in the IPO-PDO dry states is found to be 15%-28% lower than the wet state at the case study sites. In comparison, an annual lag-one autoregressive model is unable to adequately capture the observed rainfall distribution within separate IPO-PDO states. Copyright © 2011 by the American Geophysical Union.Benjamin J. Henley, Mark A. Thyer, George Kuczera and Stewart W. Frank

Climate-informed stochastic hydrological modeling: Incorporating decadal-scale variability using paleo data

A hierarchical framework for incorporating modes of climate variability into stochastic simulations of hydrological data is developed, termed the climate-informed multi-time scale stochastic (CIMSS) framework. A case study on two catchments in eastern Australia illustrates this framework. To develop an identifiable model characterizing long-term variability for the first level of the hierarchy, paleoclimate proxies, and instrumental indices describing the Interdecadal Pacific Oscillation (IPO) and the Pacific Decadal Oscillation (PDO) are analyzed. A new paleo IPO-PDO time series dating back 440 yr is produced, combining seven IPO-PDO paleo sources using an objective smoothing procedure to fit low-pass filters to individual records. The paleo data analysis indicates that wet/dry IPO-PDO states have a broad range of run lengths, with 90% between 3 and 33 yr and a mean of 15 yr. The Markov chain model, previously used to simulate oscillating wet/dry climate states, is found to underestimate the probability of wet/dry periods >5 yr, and is rejected in favor of a gamma distribution for simulating the run lengths of the wet/dry IPO-PDO states. For the second level of the hierarchy, a seasonal rainfall model is conditioned on the simulated IPO-PDO state. The model is able to replicate observed statistics such as seasonal and multiyear accumulated rainfall distributions and interannual autocorrelations. Mean seasonal rainfall in the IPO-PDO dry states is found to be 15%-28% lower than the wet state at the case study sites. In comparison, an annual lag-one autoregressive model is unable to adequately capture the observed rainfall distribution within separate IPO-PDO states. Copyright © 2011 by the American Geophysical Union.Benjamin J. Henley, Mark A. Thyer, George Kuczera and Stewart W. Frank

Invigorating hydrological research through journal publications

Over the past five years, the editors of a number of journals in the discipline of hydrology have met informally to discuss challenges and concerns in relation to the rapidly changing publishing landscape. Two of the previous meetings, in Götenborg in July 2013 and in Prague in June 2015, were followed by joint editorials (Blöschl et al. 2014; Koutsoyiannis et al. 2016) published in all participating journals. A meeting was convened in Vienna in April 2017 [during the General Assembly of the European Geosciences Union (EGU)] that was attended by 21 editors representing 14 journals. Even though the journals are published in very different settings, the editors found common cause in a vision of the editor’s role beyond just that of gatekeeper ensuring high-quality publications, to also being critical facilitators of scientific advances. In that enabling spirit, we as editors acknowledge the need to anticipate and adapt to the changing publishing landscape. This editorial communicates our views on the implications for authors, readers, reviewers, institutional assessors, and the community of editors, as discussed during the meeting and subsequently

Random walk forecast of urban water in Iran under uncertainty

There are two significant reasons for the uncertainties of water demand. On one hand, an evolving technological world is plagued with accelerated change in lifestyles and consumption patterns; and on the other hand, intensifying climate change. Therefore, with an uncertain future, what enables policymakers to define the state of water resources, which are affected by withdrawals and demands? Through a case study based on thirteen years of observation data in the Zayandeh Rud River basin in Isfahan province located in Iran, this paper forecasts a wide range of urban water demand possibilities in order to create a portfolio of plans which could be utilized by different water managers. A comparison and contrast of two existing methods are discussed, demonstrating the Random Walk Methodology, which will be referred to as the â On uncertainty pathâ , because it takes the uncertainties into account and can be recommended to managers. This On Uncertainty Path is composed of both dynamic forecasting method and system simulation. The outcomes show the advantage of such methods particularly for places that climate change will aggravate their water scarcity, such as Iran