Distributed Evaluation of Local Sensitivity Analysis (DELSA), with application to hydrologic models

This is the published version. Copyright 2014 American Geophysical UnionThis paper presents a hybrid local-global sensitivity analysis method termed the Distributed Evaluation of Local Sensitivity Analysis (DELSA), which is used here to identify important and unimportant parameters and evaluate how model parameter importance changes as parameter values change. DELSA uses derivative-based “local” methods to obtain the distribution of parameter sensitivity across the parameter space, which promotes consideration of sensitivity analysis results in the context of simulated dynamics. This work presents DELSA, discusses how it relates to existing methods, and uses two hydrologic test cases to compare its performance with the popular global, variance-based Sobol' method. The first test case is a simple nonlinear reservoir model with two parameters. The second test case involves five alternative “bucket-style” hydrologic models with up to 14 parameters applied to a medium-sized catchment (200 km2) in the Belgian Ardennes. Results show that in both examples, Sobol' and DELSA identify similar important and unimportant parameters, with DELSA enabling more detailed insight at much lower computational cost. For example, in the real-world problem the time delay in runoff is the most important parameter in all models, but DELSA shows that for about 20% of parameter sets it is not important at all and alternative mechanisms and parameters dominate. Moreover, the time delay was identified as important in regions producing poor model fits, whereas other parameters were identified as more important in regions of the parameter space producing better model fits. The ability to understand how parameter importance varies through parameter space is critical to inform decisions about, for example, additional data collection and model development. The ability to perform such analyses with modest computational requirements provides exciting opportunities to evaluate complicated models as well as many alternative models

On the choice of calibration metrics for “high-flow” estimation using hydrologic models

Calibration is an essential step for improving the accuracy of simulations generated using hydrologic models. A key modeling decision is selecting the performance metric to be optimized It has been common to use squared error performance metrics, or normalized variants such as Nash-Sutcliffe efficiency (NSE), based on the idea that their squared-error nature will emphasize the estimates of high flows. However, we conclude that NSE-based model calibrations actually result in poor reproduction of high-flow events, such as the annual peak flows that are used for flood frequency estimation. Using three different types of performance metrics, we calibrate two hydrological models at a daily step, the Variable Infiltration Capacity (VIC) model and the mesoscale Hydrologic Model (mHM), and evaluate their ability to simulate high-flow events for 492 basins throughout the contiguous United States. The metrics investigated are (1) NSE, (2) Kling-Gupta efficiency (KGE) and its variants, and (3) annual peak flow bias (APFB), where the latter is an application-specific metric that focuses on annual peak flows. As expected, the APFB metric produces the best annual peak flow estimates; however, performance on other high-flow-related metrics is poor. In contrast, the use of NSE results in annual peak flow estimates that are more than 20 % worse, primarily due to the tendency of NSE to underestimate observed flow variability. On the other hand, the use of KGE results in annual peak flow estimates that are better than from NSE, owing to improved flow time series metrics (mean and variance), with only a slight degradation in performance with respect to other related metrics, particularly when a non-standard weighting of the components of KGE is used. Stochastically generated ensemble simulations based on model residuals show the ability to improve the high-flow metrics, regardless of the deterministic performances. However, we emphasize that improving the fidelity of streamflow dynamics from deterministically calibrated models is still important, as it may improve high-flow metrics (for the right reasons). Overall, this work highlights the need for a deeper understanding of performance metric behavior and design in relation to the desired goals of model calibration.Open access journalThis item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at [email protected]

Evaluation of the high resolution WRF-Chem (v3.4.1) air quality forecast and its comparison with statistical ozone predictions

An integrated modelling system based on the regional online coupled meteorology–atmospheric chemistry WRF-Chem model configured with two nested domains with horizontal resolutions of 11.1 and 3.7 km has been applied for numerical weather prediction and for air quality forecasts in Slovenia. In the study, an evaluation of the air quality forecasting system has been performed for summer 2013. In the case of ozone (O3) daily maxima, the first- and second-day model predictions have been also compared to the operational statistical O3 forecast and to the persistence. Results of discrete and categorical evaluations show that the WRF-Chem-based forecasting system is able to produce reliable forecasts which, depending on monitoring site and the evaluation measure applied, can outperform the statistical model. For example, the correlation coefficient shows the highest skill for WRF-Chem model O3 predictions, confirming the significance of the non-linear processes taken into account in an online coupled Eulerian model. For some stations and areas biases were relatively high due to highly complex terrain and unresolved local meteorological and emission dynamics, which contributed to somewhat lower WRF-Chem skill obtained in categorical model evaluations. Applying a bias correction could further improve WRF-Chem model forecasting skill in these cases

Evaluation of the high resolution WRF-Chem (v3.4.1) air quality forecast and its comparison with statistical ozone predictions

An integrated modelling system based on the regional online coupled meteorology–atmospheric chemistry WRF-Chem model configured with two nested domains with horizontal resolutions of 11.1 and 3.7 km has been applied for numerical weather prediction and for air quality forecasts in Slovenia. In the study, an evaluation of the air quality forecasting system has been performed for summer 2013. In the case of ozone (O3) daily maxima, the first- and second-day model predictions have been also compared to the operational statistical O3 forecast and to the persistence. Results of discrete and categorical evaluations show that the WRF-Chem-based forecasting system is able to produce reliable forecasts which, depending on monitoring site and the evaluation measure applied, can outperform the statistical model. For example, the correlation coefficient shows the highest skill for WRF-Chem model O3 predictions, confirming the significance of the non-linear processes taken into account in an online coupled Eulerian model. For some stations and areas biases were relatively high due to highly complex terrain and unresolved local meteorological and emission dynamics, which contributed to somewhat lower WRF-Chem skill obtained in categorical model evaluations. Applying a bias correction could further improve WRF-Chem model forecasting skill in these cases

Operational aspects of asynchronous filtering for flood forecasting

This study investigates the suitability of the asynchronous ensemble Kalman filter (AEnKF) and a partitioned updating scheme for hydrological forecasting. The AEnKF requires forward integration of the model for the analysis and enables assimilation of current and past observations simultaneously at a single analysis step. The results of discharge assimilation into a grid-based hydrological model (using a soil moisture error model) for the Upper Ourthe catchment in the Belgian Ardennes show that including past predictions and observations in the data assimilation method improves the model forecasts. Additionally, we show that elimination of the strongly non-linear relation between the soil moisture storage and assimilated discharge observations from the model update becomes beneficial for improved operational forecasting, which is evaluated using several validation measures

Climate change alters low flows in Europe under global warming of 1.5, 2, and 3°C

There is growing evidence that climate change will alter water availability in Europe. Here, we investigate how hydrological low flows are affected under different levels of future global warming (i.e. 1.5, 2, and 3K with respect to the pre-industrial period) in rivers with a contributing area of more than 1000km2. The analysis is based on a multi-model ensemble of 45 hydrological simulations based on three representative concentration pathways (RCP2.6, RCP6.0, RCP8.5), five Coupled Model Intercomparison Project Phase 5 (CMIP5) general circulation models (GCMs: GFDL-ESM2M, HadGEM2-ES, IPSL-CM5A-LR, MIROC-ESM-CHEM, NorESM1-M) and three state-of-the-art hydrological models (HMs: mHM, Noah-MP, and PCR-GLOBWB). High-resolution model results are available at a spatial resolution of 5km across the pan-European domain at a daily temporal resolution. Low river flow is described as the percentile of daily streamflow that is exceeded 90% of the time. It is determined separately for each GCM/HM combination and warming scenario. The results show that the low-flow change signal amplifies with increasing warming levels. Low flows decrease in the Mediterranean region, while they increase in the Alpine and Northern regions. In the Mediterranean, the level of warming amplifies the signal from -12% under 1.5K, compared to the baseline period 1971-2000, to -35% under global warming of 3K, largely due to the projected decreases in annual precipitation. In contrast, the signal is amplified from +22 (1.5K) to +45% (3K) in the Alpine region due to changes in snow accumulation. The changes in low flows are significant for regions with relatively large change signals and under higher levels of warming. However, it is not possible to distinguish climate-induced differences in low flows between 1.5 and 2K warming because of (1) the large inter-annual variability which prevents distinguishing statistical estimates of period-averaged changes for a given GCM/HM combination, and (2) the uncertainty in the multi-model ensemble expressed by the signal-to-noise ratio. The contribution by the GCMs to the uncertainty in the model results is generally higher than the one by the HMs. However, the uncertainty due to HMs cannot be neglected. In the Alpine, Northern, and Mediterranean regions, the uncertainty contribution by the HMs is partly higher than those by the GCMs due to different representations of processes such as snow, soil moisture and evapotranspiration. Based on the analysis results, it is recommended (1) to use multiple HMs in climate impact studies and (2) to embrace uncertainty information on the multi-model ensemble as well as its single members in the adaptation process

Generating spatial precipitation ensembles: impact of temporal correlation structure

Sound spatially distributed rainfall fields including a proper spatial and temporal error structure are of key interest for hydrologists to force hydrological models and to identify uncertainties in the simulated and forecasted catchment response. The current paper presents a temporally coherent error identification method based on time-dependent multivariate spatial conditional simulations, which are conditioned on preceding simulations. A sensitivity analysis and real-world experiment are carried out within the hilly region of the Belgian Ardennes. Precipitation fields are simulated for pixels of 10 km × 10 km resolution. Uncertainty analyses in the simulated fields focus on (1) the number of previous simulation hours on which the new simulation is conditioned, (2) the advection speed of the rainfall event, (3) the size of the catchment considered, and (4) the rain gauge density within the catchment. The results for a sensitivity analysis show for typical advection speeds >20 km h<sup>−1</sup>, no uncertainty is added in terms of across ensemble spread when conditioned on more than one or two previous hourly simulations. However, for the real-world experiment, additional uncertainty can still be added when conditioning on a larger number of previous simulations. This is because for actual precipitation fields, the dynamics exhibit a larger spatial and temporal variability. Moreover, by thinning the observation network with 50%, the added uncertainty increases only slightly and the cross-validation shows that the simulations at the unobserved locations are unbiased. Finally, the first-order autocorrelation coefficients show clear temporal coherence in the time series of the areal precipitation using the time-dependent multivariate conditional simulations, which was not the case using the time-independent univariate conditional simulations. The presented work can be easily implemented within a hydrological calibration and data assimilation framework and can be used as an improvement over currently used simplistic approaches to perturb the interpolated point or spatially distributed precipitation estimates