109 research outputs found
Fast calibrated additive quantile regression
We propose a novel framework for fitting additive quantile regression models,
which provides well calibrated inference about the conditional quantiles and
fast automatic estimation of the smoothing parameters, for model structures as
diverse as those usable with distributional GAMs, while maintaining equivalent
numerical efficiency and stability. The proposed methods are at once
statistically rigorous and computationally efficient, because they are based on
the general belief updating framework of Bissiri et al. (2016) to loss based
inference, but compute by adapting the stable fitting methods of Wood et al.
(2016). We show how the pinball loss is statistically suboptimal relative to a
novel smooth generalisation, which also gives access to fast estimation
methods. Further, we provide a novel calibration method for efficiently
selecting the 'learning rate' balancing the loss with the smoothing priors
during inference, thereby obtaining reliable quantile uncertainty estimates.
Our work was motivated by a probabilistic electricity load forecasting
application, used here to demonstrate the proposed approach. The methods
described here are implemented by the qgam R package, available on the
Comprehensive R Archive Network (CRAN)
Recommended from our members
A Flexible Copula Regression Model with Bernoulli and Tweedie Margins for Estimating the Effect of Spending on Mental Health
Previous evidence shows that better insurance coverage increases medical expenditure. However, formal studies on the effect of spending on health outcomes, and especially mental health, are lacking. To fill this gap, we reanalyze data from the Rand Health Insurance Experiment and estimate a joint non-linear model of spending and mental health. We address the endogeneity of spending in a flexible copula regression model with Bernoulli and Tweedie margins and discuss its implementation in the freely available GJRM R package. Results confirm the importance of accounting for endogeneity: in the joint model, a $1000 spending in mental care is estimated to reduce the probability of low mental health by 1.3 percentage points, but this effect is not statistically significant. Ignoring endogeneity leads to a spurious (upwardly biased) estimate
Developmental transitions in body color in chacma baboon infants: Implications to estimate age and developmental pace
International audienc
Additive covariance matrix models: modelling regional electricity net-demand in Great Britain
Forecasts of regional electricity net-demand, consumption minus embedded generation, are an essential input for reliable and economic power system operation, and energy trading. While such forecasts are typically performed region by region, operations such as managing power flows require spatially coherent joint forecasts, which account for cross-regional dependencies. Here, we forecast the joint distribution of net-demand across the 14 regions constituting Great Britain's electricity network. Joint modelling is complicated by the fact that the net-demand variability within each region, and the dependencies between regions, vary with temporal, socio-economical and weather-related factors. We accommodate for these characteristics by proposing a multivariate Gaussian model based on a modified Cholesky parametrisation, which allows us to model each unconstrained parameter via an additive model. Given that the number of model parameters and covariates is large, we adopt a semi-automated approach to model selection, based on gradient boosting. In addition to comparing the forecasting performance of several versions of the proposed model with that of two non-Gaussian copula-based models, we visually explore the model output to interpret how the covariates affect net-demand variability and dependencies. The code for reproducing the results in this paper is available at https://doi.org/10.5281/zenodo.7315105, while methods for building and fitting multivariate Gaussian additive models are provided by the SCM R package, available at https://github.com/VinGioia90/SCM
Recommended from our members
A Flexible Copula Regression Model with Bernoulli and Tweedie Margins for Estimating the Effect of Spending on Mental Health
We develop a flexible two-equation copula model to address endogeneity of medical expenditures in a distribution regression for health. The expenditure margin uses the compound gamma distribution, a special case of the Tweedie family of distributions, to account for a spike at zero and a highly skewed continuous part. An efficient estimation algorithm offers flexible choices of copulae and link functions, including logit, probit and cloglog for the health margin. Our empirical application revisits data from the Rand Health Insurance Experiment. In the joint model, using random insurance plan assignment as instrument for spending, a $1000 increase is estimated to reduce the probability of a low post-program mental health index by 1.9 percentage points. The effect is not statistically significant. Ignoring endogeneity leads to a spurious positive effect estimate
- …