Statistical post-processing of hydrological forecasts using Bayesian model averaging

Accurate and reliable probabilistic forecasts of hydrological quantities like runoff or water level are beneficial to various areas of society. Probabilistic state-of-the-art hydrological ensemble prediction models are usually driven with meteorological ensemble forecasts. Hence, biases and dispersion errors of the meteorological forecasts cascade down to the hydrological predictions and add to the errors of the hydrological models. The systematic parts of these errors can be reduced by applying statistical post-processing. For a sound estimation of predictive uncertainty and an optimal correction of systematic errors, statistical post-processing methods should be tailored to the particular forecast variable at hand. Former studies have shown that it can make sense to treat hydrological quantities as bounded variables. In this paper, a doubly truncated Bayesian model averaging (BMA) method, which allows for flexible post-processing of (multi-model) ensemble forecasts of water level, is introduced. A case study based on water level for a gauge of river Rhine, reveals a good predictive skill of doubly truncated BMA compared both to the raw ensemble and the reference ensemble model output statistics approach.Comment: 19 pages, 6 figure

ForChaos: Real Time Application DDoS detection using Forecasting and Chaos Theory in Smart Home IoT Network

Recently, D/DoS attacks have been launched by zombie IoT devices in smart home networks. They pose a great threat to to network systems with Application Layer DDoS attacks being especially hard to detect due to their stealth and seemingly legitimacy. In this paper, we propose we propose ForChaos, a lightweight detection algorithm for IoT devices, that is based on forecasting and chaos theory to identify flooding and DDoS attacks. For every time-series behaviour collected, a forecasting-technique prediction is generated, based on a number of features, and the error between the two values is calcualted. In order to assess the error of the forecasting from the actual value, the lyapunov exponent is used to detect potential malicious behaviour. In NS-3 we evaluate our detection algorithm through a series of experiments in Flooding and Slow-Rate DDoS attacks. The results are presented and discussed in detail and compared with related studies, demonstrating its effectiveness and robustness

Enhancing Students' Understanding of Risk and Geologic Hazards Using a Dartboard Model

This article describes the use of a model to express the magnitude-frequency relationships of natural hazards. The model consists of a dartboard whose rings can be drawn to represent magnitude, exceedence probability, average recurrence interval, or other statistical information. Students are engaged by "playing" the dart game through conducting a thought experiment, actually throwing at a physical dartboard, or simulating events based on a computer program. This type of model is applicable to any sequence of events that can be described by random sampling. It helps emphasize the random nature of such events, and provides a means for presenting hazard recurrence information in an easily visible form. In addition, it helps mitigate students' misconceptions about risk and average recurrence intervals, and provides a way to teach probability concepts without the use of sophisticated mathematics. Educational levels: Graduate or professional

Blue Nile Runoff Sensitivity to Climate Change

This study describes implementation of hydrological climate change impact assessment tool utilising a combination of statistical spatiotemporal downscaling and an operational hydrological model known as the Nile Forecasting System. A spatial rainfall generator was used to produce high-resolution (daily, 20km) gridded rainfall data required by the distributed hydrological model from monthly GCM outputs. The combined system was used to assess the sensitivity of upper Blue Nile flows at Diem flow gauging station to changes in future rainfall during the June-September rainy season based on output from three GCMs. The assessment also incorporated future evapotranspiration changes over the basin. The climate change scenarios derived in this study were broadly in line with other studies, with the majority of scenarios indicating wetter conditions in the future. Translating the impacts into runoff in the basin showed increased future mean flows, although these would be offset to some degree by rising evapotranspiration. Impacts on extreme runoff indicated the possibility of more severe floods in future. These are likely to be exacerbated by land-use changes including overgrazing, deforestation, and improper farming practices. Blue Nile basin flood managers therefore need to continue to prepare for the possibility of more frequent floods by adopting a range of measures to minimise loss of life and guard against other flood damage

Uncertainty Quantification of Future Design Rainfall Depths in Korea

One of the most common ways to investigate changes in future rainfall extremes is to use future rainfall data simulated by climate models with climate change scenarios. However, the projected future design rainfall intensity varies greatly depending on which climate model is applied. In this study, future rainfall Intensity???Duration???Frequency (IDF) curves are projected using various combinations of climate models. Future Ensemble Average (FEA) is calculated using a total of 16 design rainfall intensity ensembles, and uncertainty of FEA is quantified using the coefficient of variation of ensembles. The FEA and its uncertainty vary widely depending on how the climate model combination is constructed, and the uncertainty of the FEA depends heavily on the inclusion of specific climate model combinations at each site. In other words, we found that unconditionally using many ensemble members did not help to reduce the uncertainty of future IDF curves. Finally, a method for constructing ensemble members that reduces the uncertainty of future IDF curves is proposed, which will contribute to minimizing confusion among policy makers in developing climate change adaptation policies

Towards the improvement of machine learning peak runoff forecasting by exploiting ground- and satellite-based precipitation data: A feature engineering approach

La predicción de picos de caudal en sistemas montañosos complejos presenta desafíos en hidrología debido a la falta de datos y las limitaciones de los modelos físicos. El aprendizaje automático (ML) ofrece una solución al permitir la integración de técnicas y productos satelitales de precipitación (SPPs). Sin embargo, se ha debatido sobre la efectividad del ML debido a su naturaleza de "caja negra" que dificulta la mejora del rendimiento y la reproducibilidad de los resultados. Para abordar estas preocupaciones, se han propuesto estrategias de ingeniería de características (FE) para incorporar conocimiento físico en los modelos de ML, mejorando la comprensión y precisión de las predicciones. Esta investigación doctoral tiene como objetivo mejorar la predicción de picos de caudal mediante la integración de conceptos hidrológicos a través de técnicas de FE y el uso de datos de precipitación in-situ y SPPs. Se exploran técnicas y estrategias de ML para mejorar la precisión en sistemas hidrológicos macro y mesoescala. Además, se propone una estrategia de FE para aprovechar la información de SPPs y superar la escasez de datos espaciales y temporales. La integración de técnicas avanzadas de ML y FE representa un avance en hidrología, especialmente para sistemas montañosos complejos con limitada o nula red de monitoreo. Los hallazgos de este estudio serán valiosos para tomadores de decisiones e hidrólogos, facilitando la mitigación de los impactos de los picos de caudal. Además, las metodologías desarrolladas se pueden adaptar a otros sistemas de macro y mesoescala, beneficiando a la comunidad científica en general.Peak runoff forecasting in complex mountain systems poses significant challenges in hydrology due to limitations in traditional physically-based models and data scarcity. However, the integration of machine learning (ML) techniques offers a promising solution by balancing computational efficiency and enabling the incorporation of satellite precipitation products (SPPs). However, debates have emerged regarding the effectiveness of ML in hydrology, as its black-box nature lacks explicit representation of hydrological processes, hindering performance improvement and result reproducibility. To address these concerns, recent studies emphasize the inclusion of FE strategies to incorporate physical knowledge into ML models, enabling a better understanding of the system and improved forecasting accuracy. This doctoral research aims to enhance the effectiveness of ML in peak runoff forecasting by integrating hydrological concepts through FE techniques, utilizing both ground-based and satellite-based precipitation data. For this, we explore ML techniques and strategies to enhance accuracy in complex macro- and mesoscale hydrological systems. Additionally, we propose a FE strategy for a proper utilization of SPP information which is crucial for overcoming spatial and temporal data scarcity. The integration of advanced ML techniques and FE represents a significant advancement in hydrology, particularly for complex mountain systems with limited or inexistent monitoring networks. The findings of this study will provide valuable insights for decision-makers and hydrologists, facilitating effective mitigation of the impacts of peak runoffs. Moreover, the developed methodologies can be adapted to other macro- and meso-scale systems, with necessary adjustments based on available data and system-specific characteristics, thus benefiting the broader scientific community.0000-0002-7683-37680000-0002-6206-075XDoctor (PhD) en Recursos HídricosCuenc

Ensemble evaluation of hydrological model hypotheses

It is demonstrated for the first time how model parameter, structural and data uncertainties can be accounted for explicitly and simultaneously within the Generalized Likelihood Uncertainty Estimation (GLUE) methodology. As an example application, 72 variants of a single soil moisture accounting store are tested as simplified hypotheses of runoff generation at six experimental grassland field-scale lysimeters through model rejection and a novel diagnostic scheme. The fields, designed as replicates, exhibit different hydrological behaviors which yield different model performances. For fields with low initial discharge levels at the beginning of events, the conceptual stores considered reach their limit of applicability. Conversely, one of the fields yielding more discharge than the others, but having larger data gaps, allows for greater flexibility in the choice of model structures. As a model learning exercise, the study points to a “leaking” of the fields not evident from previous field experiments. It is discussed how understanding observational uncertainties and incorporating these into model diagnostics can help appreciate the scale of model structural error